You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

77 lines
2.7 KiB

Redo coordinator structure, connect API to node - API: - Modify the constructor so that hardcoded rollup constants don't need to be passed (introduce a `Config` and use `configAPI` internally) - Common: - Update rollup constants with proper *big.Int when required - Add BidCoordinator and Slot structs used by the HistoryDB and Synchronizer. - Add helper methods to AuctionConstants - AuctionVariables: Add column `DefaultSlotSetBidSlotNum` (in the SQL table: `default_slot_set_bid_slot_num`), which indicates at which slotNum does the `DefaultSlotSetBid` specified starts applying. - Config: - Move coordinator exclusive configuration from the node config to the coordinator config - Coordinator: - Reorganize the code towards having the goroutines started and stopped from the coordinator itself instead of the node. - Remove all stop and stopped channels, and use context.Context and sync.WaitGroup instead. - Remove BatchInfo setters and assing variables directly - In ServerProof and ServerProofPool use context instead stop channel. - Use message passing to notify the coordinator about sync updates and reorgs - Introduce the Pipeline, which can be started and stopped by the Coordinator - Introduce the TxManager, which manages ethereum transactions (the TxManager is also in charge of making the forge call to the rollup smart contract). The TxManager keeps ethereum transactions and: 1. Waits for the transaction to be accepted 2. Waits for the transaction to be confirmed for N blocks - In forge logic, first prepare a batch and then wait for an available server proof to have all work ready once the proof server is ready. - Remove the `isForgeSequence` method which was querying the smart contract, and instead use notifications sent by the Synchronizer to figure out if it's forging time. - Update test (which is a minimal test to manually see if the coordinator starts) - HistoryDB: - Add method to get the number of batches in a slot (used to detect when a slot has passed the bid winner forging deadline) - Add method to get the best bid and associated coordinator of a slot (used to detect the forgerAddress that can forge the slot) - General: - Rename some instances of `currentBlock` to `lastBlock` to be more clear. - Node: - Connect the API to the node and call the methods to update cached state when the sync advances blocks. - Call methods to update Coordinator state when the sync advances blocks and finds reorgs. - Synchronizer: - Add Auction field in the Stats, which contain the current slot with info about highest bidder and other related info required to know who can forge in the current block. - Better organization of cached state: - On Sync, update the internal cached state - On Init or Reorg, load the state from HistoryDB into the internal cached state.
4 years ago
Redo coordinator structure, connect API to node - API: - Modify the constructor so that hardcoded rollup constants don't need to be passed (introduce a `Config` and use `configAPI` internally) - Common: - Update rollup constants with proper *big.Int when required - Add BidCoordinator and Slot structs used by the HistoryDB and Synchronizer. - Add helper methods to AuctionConstants - AuctionVariables: Add column `DefaultSlotSetBidSlotNum` (in the SQL table: `default_slot_set_bid_slot_num`), which indicates at which slotNum does the `DefaultSlotSetBid` specified starts applying. - Config: - Move coordinator exclusive configuration from the node config to the coordinator config - Coordinator: - Reorganize the code towards having the goroutines started and stopped from the coordinator itself instead of the node. - Remove all stop and stopped channels, and use context.Context and sync.WaitGroup instead. - Remove BatchInfo setters and assing variables directly - In ServerProof and ServerProofPool use context instead stop channel. - Use message passing to notify the coordinator about sync updates and reorgs - Introduce the Pipeline, which can be started and stopped by the Coordinator - Introduce the TxManager, which manages ethereum transactions (the TxManager is also in charge of making the forge call to the rollup smart contract). The TxManager keeps ethereum transactions and: 1. Waits for the transaction to be accepted 2. Waits for the transaction to be confirmed for N blocks - In forge logic, first prepare a batch and then wait for an available server proof to have all work ready once the proof server is ready. - Remove the `isForgeSequence` method which was querying the smart contract, and instead use notifications sent by the Synchronizer to figure out if it's forging time. - Update test (which is a minimal test to manually see if the coordinator starts) - HistoryDB: - Add method to get the number of batches in a slot (used to detect when a slot has passed the bid winner forging deadline) - Add method to get the best bid and associated coordinator of a slot (used to detect the forgerAddress that can forge the slot) - General: - Rename some instances of `currentBlock` to `lastBlock` to be more clear. - Node: - Connect the API to the node and call the methods to update cached state when the sync advances blocks. - Call methods to update Coordinator state when the sync advances blocks and finds reorgs. - Synchronizer: - Add Auction field in the Stats, which contain the current slot with info about highest bidder and other related info required to know who can forge in the current block. - Better organization of cached state: - On Sync, update the internal cached state - On Init or Reorg, load the state from HistoryDB into the internal cached state.
4 years ago
  1. package common
  2. import (
  3. "encoding/binary"
  4. "fmt"
  5. "math/big"
  6. ethCommon "github.com/ethereum/go-ethereum/common"
  7. "github.com/hermeznetwork/tracerr"
  8. )
  9. const batchNumBytesLen = 8
  10. // Batch is a struct that represents Hermez network batch
  11. type Batch struct {
  12. BatchNum BatchNum `meddler:"batch_num"`
  13. EthBlockNum int64 `meddler:"eth_block_num"` // Ethereum block in which the batch is forged
  14. ForgerAddr ethCommon.Address `meddler:"forger_addr"`
  15. CollectedFees map[TokenID]*big.Int `meddler:"fees_collected,json"`
  16. FeeIdxsCoordinator []Idx `meddler:"fee_idxs_coordinator,json"`
  17. StateRoot *big.Int `meddler:"state_root,bigint"`
  18. NumAccounts int `meddler:"num_accounts"`
  19. LastIdx int64 `meddler:"last_idx"`
  20. ExitRoot *big.Int `meddler:"exit_root,bigint"`
  21. ForgeL1TxsNum *int64 `meddler:"forge_l1_txs_num"` // optional, Only when the batch forges L1 txs. Identifier that corresponds to the group of L1 txs forged in the current batch.
  22. SlotNum int64 `meddler:"slot_num"` // Slot in which the batch is forged
  23. TotalFeesUSD *float64 `meddler:"total_fees_usd"`
  24. }
  25. // BatchNum identifies a batch
  26. type BatchNum int64
  27. // Bytes returns a byte array of length 4 representing the BatchNum
  28. func (bn BatchNum) Bytes() []byte {
  29. var batchNumBytes [batchNumBytesLen]byte
  30. binary.BigEndian.PutUint64(batchNumBytes[:], uint64(bn))
  31. return batchNumBytes[:]
  32. }
  33. // BigInt returns a *big.Int representing the BatchNum
  34. func (bn BatchNum) BigInt() *big.Int {
  35. return big.NewInt(int64(bn))
  36. }
  37. // BatchNumFromBytes returns BatchNum from a []byte
  38. func BatchNumFromBytes(b []byte) (BatchNum, error) {
  39. if len(b) != batchNumBytesLen {
  40. return 0, tracerr.Wrap(fmt.Errorf("can not parse BatchNumFromBytes, bytes len %d, expected %d", len(b), batchNumBytesLen))
  41. }
  42. batchNum := binary.BigEndian.Uint64(b[:batchNumBytesLen])
  43. return BatchNum(batchNum), nil
  44. }
  45. // BatchData contains the information of a Batch
  46. type BatchData struct {
  47. L1Batch bool // TODO: Remove once Batch.ForgeL1TxsNum is a pointer
  48. // L1UserTxs that were forged in the batch
  49. L1UserTxs []L1Tx
  50. L1CoordinatorTxs []L1Tx
  51. L2Txs []L2Tx
  52. CreatedAccounts []Account
  53. ExitTree []ExitInfo
  54. Batch Batch
  55. }
  56. // NewBatchData creates an empty BatchData with the slices initialized.
  57. func NewBatchData() *BatchData {
  58. return &BatchData{
  59. L1Batch: false,
  60. // L1UserTxs: make([]common.L1Tx, 0),
  61. L1CoordinatorTxs: make([]L1Tx, 0),
  62. L2Txs: make([]L2Tx, 0),
  63. CreatedAccounts: make([]Account, 0),
  64. ExitTree: make([]ExitInfo, 0),
  65. Batch: Batch{},
  66. }
  67. }