You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

114 lines
3.9 KiB

Redo coordinator structure, connect API to node - API: - Modify the constructor so that hardcoded rollup constants don't need to be passed (introduce a `Config` and use `configAPI` internally) - Common: - Update rollup constants with proper *big.Int when required - Add BidCoordinator and Slot structs used by the HistoryDB and Synchronizer. - Add helper methods to AuctionConstants - AuctionVariables: Add column `DefaultSlotSetBidSlotNum` (in the SQL table: `default_slot_set_bid_slot_num`), which indicates at which slotNum does the `DefaultSlotSetBid` specified starts applying. - Config: - Move coordinator exclusive configuration from the node config to the coordinator config - Coordinator: - Reorganize the code towards having the goroutines started and stopped from the coordinator itself instead of the node. - Remove all stop and stopped channels, and use context.Context and sync.WaitGroup instead. - Remove BatchInfo setters and assing variables directly - In ServerProof and ServerProofPool use context instead stop channel. - Use message passing to notify the coordinator about sync updates and reorgs - Introduce the Pipeline, which can be started and stopped by the Coordinator - Introduce the TxManager, which manages ethereum transactions (the TxManager is also in charge of making the forge call to the rollup smart contract). The TxManager keeps ethereum transactions and: 1. Waits for the transaction to be accepted 2. Waits for the transaction to be confirmed for N blocks - In forge logic, first prepare a batch and then wait for an available server proof to have all work ready once the proof server is ready. - Remove the `isForgeSequence` method which was querying the smart contract, and instead use notifications sent by the Synchronizer to figure out if it's forging time. - Update test (which is a minimal test to manually see if the coordinator starts) - HistoryDB: - Add method to get the number of batches in a slot (used to detect when a slot has passed the bid winner forging deadline) - Add method to get the best bid and associated coordinator of a slot (used to detect the forgerAddress that can forge the slot) - General: - Rename some instances of `currentBlock` to `lastBlock` to be more clear. - Node: - Connect the API to the node and call the methods to update cached state when the sync advances blocks. - Call methods to update Coordinator state when the sync advances blocks and finds reorgs. - Synchronizer: - Add Auction field in the Stats, which contain the current slot with info about highest bidder and other related info required to know who can forge in the current block. - Better organization of cached state: - On Sync, update the internal cached state - On Init or Reorg, load the state from HistoryDB into the internal cached state.
4 years ago
Redo coordinator structure, connect API to node - API: - Modify the constructor so that hardcoded rollup constants don't need to be passed (introduce a `Config` and use `configAPI` internally) - Common: - Update rollup constants with proper *big.Int when required - Add BidCoordinator and Slot structs used by the HistoryDB and Synchronizer. - Add helper methods to AuctionConstants - AuctionVariables: Add column `DefaultSlotSetBidSlotNum` (in the SQL table: `default_slot_set_bid_slot_num`), which indicates at which slotNum does the `DefaultSlotSetBid` specified starts applying. - Config: - Move coordinator exclusive configuration from the node config to the coordinator config - Coordinator: - Reorganize the code towards having the goroutines started and stopped from the coordinator itself instead of the node. - Remove all stop and stopped channels, and use context.Context and sync.WaitGroup instead. - Remove BatchInfo setters and assing variables directly - In ServerProof and ServerProofPool use context instead stop channel. - Use message passing to notify the coordinator about sync updates and reorgs - Introduce the Pipeline, which can be started and stopped by the Coordinator - Introduce the TxManager, which manages ethereum transactions (the TxManager is also in charge of making the forge call to the rollup smart contract). The TxManager keeps ethereum transactions and: 1. Waits for the transaction to be accepted 2. Waits for the transaction to be confirmed for N blocks - In forge logic, first prepare a batch and then wait for an available server proof to have all work ready once the proof server is ready. - Remove the `isForgeSequence` method which was querying the smart contract, and instead use notifications sent by the Synchronizer to figure out if it's forging time. - Update test (which is a minimal test to manually see if the coordinator starts) - HistoryDB: - Add method to get the number of batches in a slot (used to detect when a slot has passed the bid winner forging deadline) - Add method to get the best bid and associated coordinator of a slot (used to detect the forgerAddress that can forge the slot) - General: - Rename some instances of `currentBlock` to `lastBlock` to be more clear. - Node: - Connect the API to the node and call the methods to update cached state when the sync advances blocks. - Call methods to update Coordinator state when the sync advances blocks and finds reorgs. - Synchronizer: - Add Auction field in the Stats, which contain the current slot with info about highest bidder and other related info required to know who can forge in the current block. - Better organization of cached state: - On Sync, update the internal cached state - On Init or Reorg, load the state from HistoryDB into the internal cached state.
4 years ago
  1. package common
  2. import (
  3. "encoding/binary"
  4. "fmt"
  5. "math/big"
  6. ethCommon "github.com/ethereum/go-ethereum/common"
  7. "github.com/hermeznetwork/tracerr"
  8. )
  9. const batchNumBytesLen = 8
  10. // Batch is a struct that represents Hermez network batch
  11. type Batch struct {
  12. BatchNum BatchNum `meddler:"batch_num"`
  13. EthBlockNum int64 `meddler:"eth_block_num"` // Ethereum block in which the batch is forged
  14. ForgerAddr ethCommon.Address `meddler:"forger_addr"`
  15. CollectedFees map[TokenID]*big.Int `meddler:"fees_collected,json"`
  16. FeeIdxsCoordinator []Idx `meddler:"fee_idxs_coordinator,json"`
  17. StateRoot *big.Int `meddler:"state_root,bigint"`
  18. NumAccounts int `meddler:"num_accounts"`
  19. LastIdx int64 `meddler:"last_idx"`
  20. ExitRoot *big.Int `meddler:"exit_root,bigint"`
  21. ForgeL1TxsNum *int64 `meddler:"forge_l1_txs_num"` // optional, Only when the batch forges L1 txs. Identifier that corresponds to the group of L1 txs forged in the current batch.
  22. SlotNum int64 `meddler:"slot_num"` // Slot in which the batch is forged
  23. TotalFeesUSD *float64 `meddler:"total_fees_usd"`
  24. }
  25. func NewEmptyBatch() *Batch {
  26. return &Batch{
  27. BatchNum: 0,
  28. EthBlockNum: 0,
  29. ForgerAddr: ethCommon.Address{},
  30. CollectedFees: make(map[TokenID]*big.Int),
  31. FeeIdxsCoordinator: make([]Idx, 0),
  32. StateRoot: big.NewInt(0),
  33. NumAccounts: 0,
  34. LastIdx: 0,
  35. ExitRoot: big.NewInt(0),
  36. ForgeL1TxsNum: nil,
  37. SlotNum: 0,
  38. TotalFeesUSD: nil,
  39. }
  40. }
  41. // BatchNum identifies a batch
  42. type BatchNum int64
  43. // Bytes returns a byte array of length 4 representing the BatchNum
  44. func (bn BatchNum) Bytes() []byte {
  45. var batchNumBytes [batchNumBytesLen]byte
  46. binary.BigEndian.PutUint64(batchNumBytes[:], uint64(bn))
  47. return batchNumBytes[:]
  48. }
  49. // BigInt returns a *big.Int representing the BatchNum
  50. func (bn BatchNum) BigInt() *big.Int {
  51. return big.NewInt(int64(bn))
  52. }
  53. // BatchNumFromBytes returns BatchNum from a []byte
  54. func BatchNumFromBytes(b []byte) (BatchNum, error) {
  55. if len(b) != batchNumBytesLen {
  56. return 0, tracerr.Wrap(fmt.Errorf("can not parse BatchNumFromBytes, bytes len %d, expected %d", len(b), batchNumBytesLen))
  57. }
  58. batchNum := binary.BigEndian.Uint64(b[:batchNumBytesLen])
  59. return BatchNum(batchNum), nil
  60. }
  61. // BatchData contains the information of a Batch
  62. type BatchData struct {
  63. L1Batch bool // TODO: Remove once Batch.ForgeL1TxsNum is a pointer
  64. // L1UserTxs that were forged in the batch
  65. L1UserTxs []L1Tx
  66. L1CoordinatorTxs []L1Tx
  67. L2Txs []L2Tx
  68. CreatedAccounts []Account
  69. ExitTree []ExitInfo
  70. Batch Batch
  71. }
  72. // NewBatchData creates an empty BatchData with the slices initialized.
  73. func NewBatchData() *BatchData {
  74. return &BatchData{
  75. L1Batch: false,
  76. // L1UserTxs: make([]common.L1Tx, 0),
  77. L1CoordinatorTxs: make([]L1Tx, 0),
  78. L2Txs: make([]L2Tx, 0),
  79. CreatedAccounts: make([]Account, 0),
  80. ExitTree: make([]ExitInfo, 0),
  81. Batch: Batch{},
  82. }
  83. }
  84. // BatchSync is a subset of Batch that contains fileds needed for the
  85. // synchronizer and coordinator
  86. // type BatchSync struct {
  87. // BatchNum BatchNum `meddler:"batch_num"`
  88. // EthBlockNum int64 `meddler:"eth_block_num"` // Ethereum block in which the batch is forged
  89. // ForgerAddr ethCommon.Address `meddler:"forger_addr"`
  90. // StateRoot *big.Int `meddler:"state_root,bigint"`
  91. // SlotNum int64 `meddler:"slot_num"` // Slot in which the batch is forged
  92. // }
  93. //
  94. // func NewBatchSync() *BatchSync {
  95. // return &BatchSync{
  96. // BatchNum: 0,
  97. // EthBlockNum: 0,
  98. // ForgerAddr: ethCommon.Address,
  99. // StateRoot: big.NewInt(0),
  100. // SlotNum: 0,
  101. // }
  102. // }