Redo coordinator structure, connect API to node
- API:
- Modify the constructor so that hardcoded rollup constants don't need
to be passed (introduce a `Config` and use `configAPI` internally)
- Common:
- Update rollup constants with proper *big.Int when required
- Add BidCoordinator and Slot structs used by the HistoryDB and
Synchronizer.
- Add helper methods to AuctionConstants
- AuctionVariables: Add column `DefaultSlotSetBidSlotNum` (in the SQL
table: `default_slot_set_bid_slot_num`), which indicates at which
slotNum does the `DefaultSlotSetBid` specified starts applying.
- Config:
- Move coordinator exclusive configuration from the node config to the
coordinator config
- Coordinator:
- Reorganize the code towards having the goroutines started and stopped
from the coordinator itself instead of the node.
- Remove all stop and stopped channels, and use context.Context and
sync.WaitGroup instead.
- Remove BatchInfo setters and assing variables directly
- In ServerProof and ServerProofPool use context instead stop channel.
- Use message passing to notify the coordinator about sync updates and
reorgs
- Introduce the Pipeline, which can be started and stopped by the
Coordinator
- Introduce the TxManager, which manages ethereum transactions (the
TxManager is also in charge of making the forge call to the rollup
smart contract). The TxManager keeps ethereum transactions and:
1. Waits for the transaction to be accepted
2. Waits for the transaction to be confirmed for N blocks
- In forge logic, first prepare a batch and then wait for an available
server proof to have all work ready once the proof server is ready.
- Remove the `isForgeSequence` method which was querying the smart
contract, and instead use notifications sent by the Synchronizer to
figure out if it's forging time.
- Update test (which is a minimal test to manually see if the
coordinator starts)
- HistoryDB:
- Add method to get the number of batches in a slot (used to detect when
a slot has passed the bid winner forging deadline)
- Add method to get the best bid and associated coordinator of a slot
(used to detect the forgerAddress that can forge the slot)
- General:
- Rename some instances of `currentBlock` to `lastBlock` to be more
clear.
- Node:
- Connect the API to the node and call the methods to update cached
state when the sync advances blocks.
- Call methods to update Coordinator state when the sync advances blocks
and finds reorgs.
- Synchronizer:
- Add Auction field in the Stats, which contain the current slot with
info about highest bidder and other related info required to know who
can forge in the current block.
- Better organization of cached state:
- On Sync, update the internal cached state
- On Init or Reorg, load the state from HistoryDB into the
internal cached state.
4 years ago Update coordinator, call all api update functions
- Common:
- Rename Block.EthBlockNum to Block.Num to avoid unneeded repetition
- API:
- Add UpdateNetworkInfoBlock to update just block information, to be
used when the node is not yet synchronized
- Node:
- Call API.UpdateMetrics and UpdateRecommendedFee in a loop, with
configurable time intervals
- Synchronizer:
- When mapping events by TxHash, use an array to support the possibility
of multiple calls of the same function happening in the same
transaction (for example, a smart contract in a single transaction
could call withdraw with delay twice, which would generate 2 withdraw
events, and 2 deposit events).
- In Stats, keep entire LastBlock instead of just the blockNum
- In Stats, add lastL1BatchBlock
- Test Stats and SCVars
- Coordinator:
- Enable writing the BatchInfo in every step of the pipeline to disk
(with JSON text files) for debugging purposes.
- Move the Pipeline functionality from the Coordinator to its own struct
(Pipeline)
- Implement shouldL1lL2Batch
- In TxManager, implement logic to perform several attempts when doing
ethereum node RPC calls before considering the error. (Both for calls
to forgeBatch and transaction receipt)
- In TxManager, reorganize the flow and note the specific points in
which actions are made when err != nil
- HistoryDB:
- Implement GetLastL1BatchBlockNum: returns the blockNum of the latest
forged l1Batch, to help the coordinator decide when to forge an
L1Batch.
- EthereumClient and test.Client:
- Update EthBlockByNumber to return the last block when the passed
number is -1.
4 years ago Redo coordinator structure, connect API to node
- API:
- Modify the constructor so that hardcoded rollup constants don't need
to be passed (introduce a `Config` and use `configAPI` internally)
- Common:
- Update rollup constants with proper *big.Int when required
- Add BidCoordinator and Slot structs used by the HistoryDB and
Synchronizer.
- Add helper methods to AuctionConstants
- AuctionVariables: Add column `DefaultSlotSetBidSlotNum` (in the SQL
table: `default_slot_set_bid_slot_num`), which indicates at which
slotNum does the `DefaultSlotSetBid` specified starts applying.
- Config:
- Move coordinator exclusive configuration from the node config to the
coordinator config
- Coordinator:
- Reorganize the code towards having the goroutines started and stopped
from the coordinator itself instead of the node.
- Remove all stop and stopped channels, and use context.Context and
sync.WaitGroup instead.
- Remove BatchInfo setters and assing variables directly
- In ServerProof and ServerProofPool use context instead stop channel.
- Use message passing to notify the coordinator about sync updates and
reorgs
- Introduce the Pipeline, which can be started and stopped by the
Coordinator
- Introduce the TxManager, which manages ethereum transactions (the
TxManager is also in charge of making the forge call to the rollup
smart contract). The TxManager keeps ethereum transactions and:
1. Waits for the transaction to be accepted
2. Waits for the transaction to be confirmed for N blocks
- In forge logic, first prepare a batch and then wait for an available
server proof to have all work ready once the proof server is ready.
- Remove the `isForgeSequence` method which was querying the smart
contract, and instead use notifications sent by the Synchronizer to
figure out if it's forging time.
- Update test (which is a minimal test to manually see if the
coordinator starts)
- HistoryDB:
- Add method to get the number of batches in a slot (used to detect when
a slot has passed the bid winner forging deadline)
- Add method to get the best bid and associated coordinator of a slot
(used to detect the forgerAddress that can forge the slot)
- General:
- Rename some instances of `currentBlock` to `lastBlock` to be more
clear.
- Node:
- Connect the API to the node and call the methods to update cached
state when the sync advances blocks.
- Call methods to update Coordinator state when the sync advances blocks
and finds reorgs.
- Synchronizer:
- Add Auction field in the Stats, which contain the current slot with
info about highest bidder and other related info required to know who
can forge in the current block.
- Better organization of cached state:
- On Sync, update the internal cached state
- On Init or Reorg, load the state from HistoryDB into the
internal cached state.
4 years ago Redo coordinator structure, connect API to node
- API:
- Modify the constructor so that hardcoded rollup constants don't need
to be passed (introduce a `Config` and use `configAPI` internally)
- Common:
- Update rollup constants with proper *big.Int when required
- Add BidCoordinator and Slot structs used by the HistoryDB and
Synchronizer.
- Add helper methods to AuctionConstants
- AuctionVariables: Add column `DefaultSlotSetBidSlotNum` (in the SQL
table: `default_slot_set_bid_slot_num`), which indicates at which
slotNum does the `DefaultSlotSetBid` specified starts applying.
- Config:
- Move coordinator exclusive configuration from the node config to the
coordinator config
- Coordinator:
- Reorganize the code towards having the goroutines started and stopped
from the coordinator itself instead of the node.
- Remove all stop and stopped channels, and use context.Context and
sync.WaitGroup instead.
- Remove BatchInfo setters and assing variables directly
- In ServerProof and ServerProofPool use context instead stop channel.
- Use message passing to notify the coordinator about sync updates and
reorgs
- Introduce the Pipeline, which can be started and stopped by the
Coordinator
- Introduce the TxManager, which manages ethereum transactions (the
TxManager is also in charge of making the forge call to the rollup
smart contract). The TxManager keeps ethereum transactions and:
1. Waits for the transaction to be accepted
2. Waits for the transaction to be confirmed for N blocks
- In forge logic, first prepare a batch and then wait for an available
server proof to have all work ready once the proof server is ready.
- Remove the `isForgeSequence` method which was querying the smart
contract, and instead use notifications sent by the Synchronizer to
figure out if it's forging time.
- Update test (which is a minimal test to manually see if the
coordinator starts)
- HistoryDB:
- Add method to get the number of batches in a slot (used to detect when
a slot has passed the bid winner forging deadline)
- Add method to get the best bid and associated coordinator of a slot
(used to detect the forgerAddress that can forge the slot)
- General:
- Rename some instances of `currentBlock` to `lastBlock` to be more
clear.
- Node:
- Connect the API to the node and call the methods to update cached
state when the sync advances blocks.
- Call methods to update Coordinator state when the sync advances blocks
and finds reorgs.
- Synchronizer:
- Add Auction field in the Stats, which contain the current slot with
info about highest bidder and other related info required to know who
can forge in the current block.
- Better organization of cached state:
- On Sync, update the internal cached state
- On Init or Reorg, load the state from HistoryDB into the
internal cached state.
4 years ago |
|
[API] Address = "localhost:8086" Explorer = true UpdateMetricsInterval = "10s" UpdateRecommendedFeeInterval = "10s"
[Debug] APIAddress = "localhost:12345"
[StateDB] Path = "/tmp/iden3-test/hermez/statedb"
[PostgreSQL] Port = 5432 Host = "localhost" User = "hermez" Password = "yourpasswordhere" Name = "hermez"
[Web3] URL = "http://localhost:8545"
[Synchronizer] SyncLoopInterval = "1s" StatsRefreshPeriod = "1s"
[Synchronizer.StartBlockNum] Rollup = 19 Auction = 17 WDelayer = 15
[SmartContracts] Rollup = "0x8EEaea23686c319133a7cC110b840d1591d9AeE0" Auction = "0x317113D2593e3efF1FfAE0ba2fF7A61861Df7ae5" WDelayer = "0x5E0816F0f8bC560cB2B9e9C87187BeCac8c2021F" TokenHEZ = "0x5D94e3e7aeC542aB0F9129B9a7BAdeb5B3Ca0f77" TokenHEZName = "Hermez Network Token"
[Synchronizer.InitialVariables.Auction] DonationAddress = "0x0000000000000000000000000000000000000001" BootCoordinator = "0xb4124cEB3451635DAcedd11767f004d8a28c6eE7" BootCoordinatorURL = "https://boot.coordinator.io" DefaultSlotSetBid = [ "10000000000000000000", "10000000000000000000", "10000000000000000000", "10000000000000000000", "10000000000000000000", "10000000000000000000", ] DefaultSlotSetBidSlotNum = 0 ClosedAuctionSlots = 2 OpenAuctionSlots = 4320 AllocationRatio = [4000, 4000, 2000] Outbidding = 1000 SlotDeadline = 20
[Synchronizer.InitialVariables.WDelayer] # HermezRollupAddress = HermezGovernanceAddress = "0x0000000000000000000000000000000000000001" EmergencyCouncilAddress = "0x0000000000000000000000000000000000000001" WithdrawalDelay = 60 EmergencyModeStartingTime = 0 EmergencyMode = false
[Synchronizer.InitialVariables.Rollup] FeeAddToken = "10" ForgeL1L2BatchTimeout = 10 WithdrawalDelay = 1209600 # 60 * 60 * 24 * 7 * 2 SafeMode = false [[Synchronizer.InitialVariables.Rollup.Buckets]] CeilUSD = 0 Withdrawals = 0 BlockWithdrawalRate = 0 MaxWithdrawals = 0 [[Synchronizer.InitialVariables.Rollup.Buckets]] CeilUSD = 0 Withdrawals = 0 BlockWithdrawalRate = 0 MaxWithdrawals = 0 [[Synchronizer.InitialVariables.Rollup.Buckets]] CeilUSD = 0 Withdrawals = 0 BlockWithdrawalRate = 0 MaxWithdrawals = 0 [[Synchronizer.InitialVariables.Rollup.Buckets]] CeilUSD = 0 Withdrawals = 0 BlockWithdrawalRate = 0 MaxWithdrawals = 0 [[Synchronizer.InitialVariables.Rollup.Buckets]] CeilUSD = 0 Withdrawals = 0 BlockWithdrawalRate = 0 MaxWithdrawals = 0
[Coordinator] ForgerAddress = "0x6BB84Cc84D4A34467aD12a2039A312f7029e2071" ConfirmBlocks = 10 L1BatchTimeoutPerc = 0.6 ProofServerPollInterval = "1s" SyncRetryInterval = "1s"
[Coordinator.L2DB] SafetyPeriod = 10 MaxTxs = 512 TTL = "24h" PurgeBatchDelay = 10 InvalidateBatchDelay = 20 PurgeBlockDelay = 10 InvalidateBlockDelay = 20
[Coordinator.TxSelector] Path = "/tmp/iden3-test/hermez/txselector"
[Coordinator.BatchBuilder] Path = "/tmp/iden3-test/hermez/batchbuilder"
[[Coordinator.ServerProofs]] URL = "http://localhost:3000"
[Coordinator.EthClient] CallGasLimit = 300000 DeployGasLimit = 1000000 GasPriceDiv = 100 ReceiptTimeout = "60s" ReceiptLoopInterval = "500ms"
CheckLoopInterval = "500ms" Attempts = 8 AttemptsDelay = "200ms"
[Coordinator.API] Coordinator = true
[Coordinator.Debug] BatchPath = "/tmp/iden3-test/hermez/batchesdebug"
|