Parent Log: http://ci.aztec-labs.com/fadb814e2da9969e Command: 22a91bf956a4cb93:ISOLATE=1:NAME=e2e_epochs/epochs_upload_failed_proof yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_upload_failed_proof.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/47bd93499e6606131b6ececa3536632cf5e84409 Env: REF_NAME=gh-readonly-queue/next/pr-15080-215be54ba7d05741f58f591612a9e5454104b24d CURRENT_VERSION=0.87.6 CI_FULL=1 Date: Wed Jun 18 09:31:52 UTC 2025 System: ARCH=amd64 CPUS=128 MEM=493Gi HOSTNAME=pr-15080_amd64_x2-full Resources: CPU_LIST=0-127 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_476a42720cde10eb_next 09:31:53 +++ id -u 09:31:53 +++ id -g 09:31:53 ++ docker run -d --name e2e_epochs_epochs_upload_failed_proof --net=none --cpuset-cpus=0-127 --cpus=2 --memory=8g --user 1000:1000 -v/home/aztec-dev:/home/aztec-dev --mount type=tmpfs,target=/tmp,tmpfs-size=1g --workdir /home/aztec-dev/aztec-packages -e HOME -e VERBOSE -e GIT_CONFIG_GLOBAL=/home/aztec-dev/aztec-packages/build-images/src/home/.gitconfig -e FORCE_COLOR=true -e CPUS -e MEM aztecprotocol/build:3.0 /bin/bash -c 'timeout -v 600s bash -c '\''yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_upload_failed_proof.test.ts'\''' 09:31:53 + cid=f6607b943357be9ef205ea2897fe977705ea72d77a4b927c260023e07417bada 09:31:53 + set +x 09:31:54 {"level":25,"time":1750239114748,"pid":11,"hostname":"f6607b943357","module":"logger","msg":"Logger initialized with level verbose"} 09:32:03 [09:32:03.338] INFO: e2e:epochs_upload_failed_proof Running test: e2e_epochs/epochs_upload_failed_proof uploads failed proving job state and re-runs it on a fresh instance 09:32:03 [09:32:03.517] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Logging metrics to log/e2e_epochs_epochs_upload_failed_proof.jsonl 09:32:03 [09:32:03.869] WARN: ethereum:cheat_codes Set L1 automine to true 09:32:03 [09:32:03.900] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Sent 0.1 ETH to deployer {"deployer":"0x05f32b3cc3888453ff71b01135b34ff8e41263f2","value":100000000000000000} 09:32:03 [09:32:03.923] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Sent 0.1 ETH to deployer {"deployer":"0x05f32b3cc3888453ff71b01135b34ff8e41263f2","value":100000000000000000} 09:32:03 [09:32:03.943] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Multicall3 09:32:03 [09:32:03.946] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Calling anvil_setBlockTimestampInterval with params: [8] 09:32:03 [09:32:03.949] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Set block interval to 8 09:32:03 [09:32:03.950] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contracts from 0xf39Fd6e51aad88F6F4ce6aB8827279cffFb92266 09:32:04 [09:32:04.005] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x8166bb789c828e492198babef9becf8ac44628f059d48e6f68114a9ae2ade6ec {"gasLimit":867658,"maxFeePerGas":"120.351651125","maxPriorityFeePerGas":"118.94979"} 09:32:04 [09:32:04.007] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xB8999345dA8041f1Da51ac5179B1F055A560f397 in tx 0x8166bb789c828e492198babef9becf8ac44628f059d48e6f68114a9ae2ade6ec. 09:32:04 [09:32:04.010] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Fee Asset at 0xb8999345da8041f1da51ac5179b1f055a560f397 09:32:04 [09:32:04.087] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x07d928293fb6819e2a8abf9d0b32b04560f633065cf07cefb5dcf9ca71af1db2 {"gasLimit":867644,"maxFeePerGas":"143.976575211","maxPriorityFeePerGas":"142.739748"} 09:32:04 [09:32:04.088] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xBb9e13665Cfb3d531F288a11E7312b6b91C59292 in tx 0x07d928293fb6819e2a8abf9d0b32b04560f633065cf07cefb5dcf9ca71af1db2. 09:32:04 [09:32:04.089] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Staking Asset at 0xbb9e13665cfb3d531f288a11e7312b6b91c59292 09:32:04 [09:32:04.163] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xaea8901378fc3dd27f030542afe63b646eb508d14ca9b264a18f1b2c0a6c9742 {"gasLimit":3126464,"maxFeePerGas":"172.377275728","maxPriorityFeePerGas":"171.2876976"} 09:32:04 [09:32:04.164] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xFa2858cA5fdf40129734409F7519b44582B8D091 in tx 0xaea8901378fc3dd27f030542afe63b646eb508d14ca9b264a18f1b2c0a6c9742. 09:32:04 [09:32:04.165] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed GSE at 0xfa2858ca5fdf40129734409f7519b44582b8d091 09:32:04 [09:32:04.203] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x16ac847cd12f2ca188dc7c57557698d2e30c717f9ff4b3bee30569e2a009b2df {"gasLimit":1030455,"maxFeePerGas":"206.505096634","maxPriorityFeePerGas":"205.54523712"} 09:32:04 [09:32:04.204] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xd79AF51B8839EC9bd9c18107eDA85523dFd96206 in tx 0x16ac847cd12f2ca188dc7c57557698d2e30c717f9ff4b3bee30569e2a009b2df. 09:32:04 [09:32:04.208] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Registry at 0xd79af51b8839ec9bd9c18107eda85523dfd96206 09:32:04 [09:32:04.240] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xb529fd31d8de51ee1ee5d0f30ab7b6820cf9a392f49a84e4c786ca17f3b69f22 {"gasLimit":1998686,"maxFeePerGas":"247.514707084","maxPriorityFeePerGas":"246.654284544"} 09:32:04 [09:32:04.241] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x9Fd955bA864E81acbF586F1ffcB4ba689bf6cf2a in tx 0xb529fd31d8de51ee1ee5d0f30ab7b6820cf9a392f49a84e4c786ca17f3b69f22. 09:32:04 [09:32:04.242] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed GovernanceProposer at 0x9fd955ba864e81acbf586f1ffcb4ba689bf6cf2a 09:32:04 [09:32:04.293] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x4310bda1d354201e760871a224530a0d6bd9993fe19f752b207a624e0c4e27c3 {"gasLimit":3092007,"maxFeePerGas":"296.744085407","maxPriorityFeePerGas":"295.985141452"} 09:32:04 [09:32:04.294] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x51E452ef904FFE5daE09fAA826966E9CC2125904 in tx 0x4310bda1d354201e760871a224530a0d6bd9993fe19f752b207a624e0c4e27c3. 09:32:04 [09:32:04.296] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Governance at 0x51e452ef904ffe5dae09faa826966e9cc2125904 09:32:04 [09:32:04.324] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x4820abfc3f6804d776b6830cda17e6d053481fd0836a9b72b056297329004de6 {"gasLimit":100000,"maxFeePerGas":"355.856633653","maxPriorityFeePerGas":"355.182169742"} 09:32:04 [09:32:04.325] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Set governance on GSE in 0x4820abfc3f6804d776b6830cda17e6d053481fd0836a9b72b056297329004de6 09:32:04 [09:32:04.354] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xac3e9a225d3bca6d877d7cfde6241a60a1b3f05ba11deadc75e185604ae836b5 {"gasLimit":397405,"maxFeePerGas":"426.823037513","maxPriorityFeePerGas":"426.21860369"} 09:32:04 [09:32:04.355] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xE5006923b8eE541E0c928Bc72d28b18D3f570f62 in tx 0xac3e9a225d3bca6d877d7cfde6241a60a1b3f05ba11deadc75e185604ae836b5. 09:32:04 [09:32:04.356] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed CoinIssuer at 0xe5006923b8ee541e0c928bc72d28b18d3f570f62 09:32:04 [09:32:04.357] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for deployments to complete 09:32:04 [09:32:04.357] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 7 transactions to be mined... 09:32:04 [09:32:04.396] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 09:32:04 [09:32:04.417] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xe2117c4b0e9a1732bc62a3fdeb7fe84f86eccaa9ad097a02985eeb8fc9269a2e {"gasLimit":100000,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 09:32:04 [09:32:04.418] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added coin issuer 0xe5006923b8ee541e0c928bc72d28b18d3f570f62 as minter on fee asset in 0xe2117c4b0e9a1732bc62a3fdeb7fe84f86eccaa9ad097a02985eeb8fc9269a2e 09:32:04 [09:32:04.438] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xc582e4484124769dc3f6e9feb6f06bc1f84b52379b781dbf887eea0f0775571c {"gasLimit":56661,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 09:32:04 [09:32:04.466] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x100b31bd1e3992df58985c26db7e5351f01cbb7b9c2e961c411c57733fb6cfa5 {"gasLimit":344517,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 09:32:04 [09:32:04.466] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xB4fF23c4B1E2Bc7C86090d4FBDa21A457ee6727F in tx 0x100b31bd1e3992df58985c26db7e5351f01cbb7b9c2e961c411c57733fb6cfa5. 09:32:04 [09:32:04.467] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed FeeAssetHandler at 0xb4ff23c4b1e2bc7c86090d4fbda21a457ee6727f 09:32:04 [09:32:04.483] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xc451aae80a23ef806a4bacf2e291d1c2ae150b6200ea2ea4e841b119a7e7c28b {"gasLimit":56804,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 09:32:04 [09:32:04.483] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added fee asset handler 0xb4ff23c4b1e2bc7c86090d4fbda21a457ee6727f as minter on fee asset in 0xc451aae80a23ef806a4bacf2e291d1c2ae150b6200ea2ea4e841b119a7e7c28b 09:32:04 [09:32:04.512] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xdf29fa760ac2eecd0fb4832a5af80412c5c25214c26e1778c8a86a3732f1d9f7 {"gasLimit":2514669,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 09:32:04 [09:32:04.512] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x47d6163A580DCeF179F23c3e48f56B1c0446F336 in tx 0xdf29fa760ac2eecd0fb4832a5af80412c5c25214c26e1778c8a86a3732f1d9f7. 09:32:04 [09:32:04.513] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed StakingAssetHandler at 0x47d6163a580dcef179f23c3e48f56b1c0446f336 09:32:04 [09:32:04.541] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xf2ac7def0ffbc3bed228a4a24ed9d9c3eb7c15b9d42e7db9b9edd3c15ab736df {"gasLimit":56804,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 09:32:04 [09:32:04.542] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added staking asset handler 0x47d6163a580dcef179f23c3e48f56b1c0446f336 as minter on staking asset in 0xf2ac7def0ffbc3bed228a4a24ed9d9c3eb7c15b9d42e7db9b9edd3c15ab736df 09:32:04 [09:32:04.542] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for deployments to complete 09:32:04 [09:32:04.542] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 9 transactions to be mined... 09:32:04 [09:32:04.585] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 09:32:04 [09:32:04.605] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed shared contracts 09:32:04 [09:32:04.640] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x91a04f69719a84aacd823f2906533fea50245c46fe7ee6d49a467d9048a888a3 {"gasLimit":84837,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 09:32:04 [09:32:04.641] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Funded reward distributor with 10000000000000000000000000 fee asset in 0x91a04f69719a84aacd823f2906533fea50245c46fe7ee6d49a467d9048a888a3 09:32:04 [09:32:04.666] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x6732a13052b668b6ed53c2db691f949dc5751b43ca937a6796aab9388f3cb12a {"gasLimit":154658,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 09:32:04 [09:32:04.666] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x277E22B0C9698d7f2A1cD7C6d857511617587309 in tx 0x6732a13052b668b6ed53c2db691f949dc5751b43ca937a6796aab9388f3cb12a. 09:32:04 [09:32:04.666] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup will use the mock verifier at 0x277e22b0c9698d7f2a1cd7c6d857511617587309 09:32:04 [09:32:04.667] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup config args {"aztecSlotDuration":16,"aztecEpochDuration":4,"targetCommitteeSize":0,"aztecProofSubmissionWindow":7,"slashingQuorum":6,"slashingRoundSize":10,"manaTarget":10000000000,"entryQueueFlushSizeMin":48,"entryQueueFlushSizeQuotient":2,"provingCostPerMana":100,"rewardConfig":{"sequencerBps":5000,"increment":200000,"maxScore":5000000,"a":5000,"k":1000000,"minimum":100000}} 09:32:04 [09:32:04.686] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xf801541a3de5b28861a17ced0571249b87149025568b873f1666920ab24b84df {"gasLimit":87007,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 09:32:04 [09:32:04.687] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xBD07A4C2977D9d0C2EfF342A2086A45eAf7eCa0C in tx 0xf801541a3de5b28861a17ced0571249b87149025568b873f1666920ab24b84df. 09:32:04 [09:32:04.758] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x2d56e602cb6796d48756268772cc6966ae275b8c62058c3cf3125b3914df82dd {"gasLimit":5102068,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 09:32:04 [09:32:04.759] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x505DeEE46B446F2aeDc452e9a1B8a08F9B1E1a49 in tx 0x2d56e602cb6796d48756268772cc6966ae275b8c62058c3cf3125b3914df82dd. 09:32:04 [09:32:04.799] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x441cd4a2356266fb3deeffc30ece162785acba603f36c6acaa67b307c220d058 {"gasLimit":2858979,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 09:32:04 [09:32:04.800] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xb3468888960A29F98AaE24Aeba2fde79BB9eB38b in tx 0x441cd4a2356266fb3deeffc30ece162785acba603f36c6acaa67b307c220d058. 09:32:04 [09:32:04.801] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Awaiting for linked libraries to be deployed 09:32:04 [09:32:04.895] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xa8da595ff6f852f239332650dfdd10b3f0fa1ccb549b99b1973cf1ee6b9694f1 {"gasLimit":11102217,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 09:32:04 [09:32:04.895] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xBA51Fc42929e2e08fFC4BA54Aeb996830CbdFFcf in tx 0xa8da595ff6f852f239332650dfdd10b3f0fa1ccb549b99b1973cf1ee6b9694f1. 09:32:04 [09:32:04.896] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Rollup at 0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf {"aztecSlotDuration":16,"aztecEpochDuration":4,"targetCommitteeSize":0,"aztecProofSubmissionWindow":7,"slashingQuorum":6,"slashingRoundSize":10,"manaTarget":10000000000,"entryQueueFlushSizeMin":48,"entryQueueFlushSizeQuotient":2,"provingCostPerMana":100,"rewardConfig":{"sequencerBps":5000,"increment":200000,"maxScore":5000000,"a":5000,"k":1000000,"minimum":100000}} 09:32:04 [09:32:04.896] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 11 transactions to be mined... 09:32:04 [09:32:04.930] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 09:32:04 [09:32:04.930] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof All core contracts have been deployed 09:32:04 [09:32:04.950] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x0afa0f0bd2e259adac6fd9ce44f3a25ebef53c25eb5b98089900165aca1470f4 {"gasLimit":1056496,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 09:32:04 [09:32:04.951] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xf6E203ac765cAa944c1e9D16590F53eaf4115b82 in tx 0x0afa0f0bd2e259adac6fd9ce44f3a25ebef53c25eb5b98089900165aca1470f4. 09:32:04 [09:32:04.951] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed SlashFactory at 0xf6e203ac765caa944c1e9d16590f53eaf4115b82 09:32:04 [09:32:04.985] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x56934dd2c87f0cf91440f44dea306e0ed85321d3f9431331ef9896487a8401da {"gasLimit":116979,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 09:32:04 [09:32:04.985] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Adding rollup 0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf to registry 0xd79af51b8839ec9bd9c18107eda85523dfd96206 in tx 0x56934dd2c87f0cf91440f44dea306e0ed85321d3f9431331ef9896487a8401da 09:32:05 [09:32:05.005] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x3690f7ec9ee5bdc4f100741b8bf70eba94507abe8d5caec643fc4f7c1f446a9f {"gasLimit":109478,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 09:32:05 [09:32:05.006] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Adding rollup 0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf to GSE 0xfa2858ca5fdf40129734409f7519b44582b8d091 in tx 0x3690f7ec9ee5bdc4f100741b8bf70eba94507abe8d5caec643fc4f7c1f446a9f 09:32:05 [09:32:05.011] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 12 transactions to be mined... 09:32:05 [09:32:05.052] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 09:32:05 [09:32:05.058] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup deployed 09:32:05 [09:32:05.061] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for rollup and slash factory to be deployed 09:32:05 [09:32:05.061] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 12 transactions to be mined... 09:32:05 [09:32:05.102] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 09:32:05 [09:32:05.103] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof All transactions for L1 deployment have been mined 09:32:05 [09:32:05.131] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Aztec L1 contracts initialized {"registryAddress":"0xd79af51b8839ec9bd9c18107eda85523dfd96206","governanceAddress":"0x51e452ef904ffe5dae09faa826966e9cc2125904","governanceProposerAddress":"0x9fd955ba864e81acbf586f1ffcb4ba689bf6cf2a","rollupAddress":"0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf","inboxAddress":"0x8a9b384a6fff1f6bb08e97cd7e5ae4802c595f00","outboxAddress":"0x083b459575a58978cc2368b523dfd7c46d6dc972","feeJuicePortalAddress":"0x0d13d578695a34882ed9770b7a757b68e7a9d8b1","feeJuiceAddress":"0xb8999345da8041f1da51ac5179b1f055a560f397","stakingAssetAddress":"0xbb9e13665cfb3d531f288a11e7312b6b91c59292","rewardDistributorAddress":"0x8c4a6a1d7797dd91749a53a9ce691b7e6cebe5c0","gseAddress":"0xfa2858ca5fdf40129734409f7519b44582b8d091","coinIssuerAddress":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266"} 09:32:05 [09:32:05.131] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Handing over to governance 09:32:05 [09:32:05.156] WARN: ethereum:cheat_codes Set L1 automine to false 09:32:05 [09:32:05.171] WARN: ethereum:cheat_codes Set L1 interval mining to 8 seconds 09:32:05 [09:32:05.186] WARN: foundation:test-date-provider Time set to 2025-06-18T09:35:07.000Z {"offset":181815,"timeMs":1750239307000} 09:32:05 [09:32:05.195] INFO: aztecjs:utils:watcher Watcher not started because not auto mining 09:32:05 [09:32:05.196] INFO: telemetry:client Using NoopTelemetryClient 09:32:05 [09:32:05.200] INFO: kv-store:lmdb-v2:blob-sink Creating blob-sink data store at directory /tmp/b48ca1e76b7355b2/blob-sink with map size 134217728 KB (LMDB v2) 09:32:05 [09:32:05.207] INFO: kv-store:lmdb-v2:blob-sink Starting data store with maxReaders 16 09:32:05 [09:32:05.219] INFO: blob-sink:server Server is running on http://localhost:45123 09:32:05 [09:32:05.220] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating and synching an aztec node... 09:32:05 [09:32:05.221] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Using native ACVM binary at ../../noir/noir-repo/target/release/acvm with working directory /tmp/b650f362/acvm 09:32:05 [09:32:05.222] INFO: node:blob-sink:client Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:45123"} 09:32:05 [09:32:05.249] VERBOSE: node:MAIN-aztec-node Snapshot sync is disabled. No snapshots URL provided. 09:32:05 [09:32:05.250] INFO: archiver:lmdb Creating archiver data store at directory /tmp/b48ca1e76b7355b2/archiver with map size 134217728 KB (LMDB v2) 09:32:05 [09:32:05.253] INFO: archiver:lmdb Starting data store with maxReaders 16 09:32:06 [09:32:06.277] INFO: node:blob-sink:client Testing configured blob sources {"blobSinkUrl":"http://localhost:45123"} 09:32:06 [09:32:06.296] INFO: node:blob-sink:client Blob sink is reachable {"blobSinkUrl":"http://localhost:45123"} 09:32:06 [09:32:06.296] WARN: node:blob-sink:client No L1 consensus host urls configured 09:32:06 [09:32:06.297] WARN: node:blob-sink:client No archive client configured 09:32:06 [09:32:06.300] INFO: archiver Starting archiver sync to rollup contract 0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf from L1 block 22 to current L1 block 25 with hash 0x919f4c43fd9f8a88263c65a557b6aacfbbe389b16388bff05cb90b0aa7969550 {"blocksSynchedTo":22,"messagesSynchedTo":{"l1BlockHash":"0xc563fd3cb90f2a1a26555d293aa77a614c5eb1d918a54678acf4c92a650ddfd2","l1BlockNumber":22}} 09:32:06 [09:32:06.329] INFO: archiver Initial archiver sync to L1 block 25 complete. {"l1BlockNumber":25,"syncPoint":{"blocksSynchedTo":25},"latest":{"number":0},"proven":{"number":0},"finalized":{"number":0}} 09:32:06 [09:32:06.343] INFO: world-state:database Creating world state data store at directory /tmp/b48ca1e76b7355b2/world_state with map sizes {"archiveTreeMapSizeKb":134217728,"nullifierTreeMapSizeKb":134217728,"noteHashTreeMapSizeKb":134217728,"messageTreeMapSizeKb":134217728,"publicDataTreeMapSizeKb":134217728} and 2 threads. 09:32:06 [09:32:06.384] INFO: world_state Created world state synchroniser with block history of 2 09:32:06 [09:32:06.385] WARN: node:MAIN-aztec-node Aztec node is accepting fake proofs 09:32:06 [09:32:06.398] INFO: p2p:lmdb-v2 Creating p2p data store at directory /tmp/b48ca1e76b7355b2/p2p with map size 134217728 KB (LMDB v2) 09:32:06 [09:32:06.408] INFO: p2p:lmdb-v2 Starting data store with maxReaders 16 09:32:06 [09:32:06.415] INFO: p2p-archive:lmdb-v2 Creating p2p-archive data store at directory /tmp/b48ca1e76b7355b2/p2p-archive with map size 134217728 KB (LMDB v2) 09:32:06 [09:32:06.419] INFO: p2p-archive:lmdb-v2 Starting data store with maxReaders 16 09:32:06 [09:32:06.427] INFO: p2p-peer:lmdb-v2 Creating p2p-peers data store at directory /tmp/b48ca1e76b7355b2/p2p-peers with map size 134217728 KB (LMDB v2) 09:32:06 [09:32:06.436] INFO: p2p-peer:lmdb-v2 Starting data store with maxReaders 16 09:32:06 [09:32:06.439] INFO: p2p:tx_pool Setting maximum tx mempool size {"maxTxPoolSize":100000000} 09:32:06 [09:32:06.440] VERBOSE: p2p P2P is disabled. Using dummy P2P service. 09:32:06 [09:32:06.453] VERBOSE: world-state:block_stream Starting L2 block stream {"proven":false,"pollIntervalMS":50} 09:32:06 [09:32:06.457] INFO: world_state Started world state synchronizer from block 1 09:32:06 [09:32:06.460] VERBOSE: world-state:block_stream Starting sync from block number 0 09:32:06 [09:32:06.465] INFO: p2p Starting p2p client from block 0 with empty mempools 09:32:06 [09:32:06.466] VERBOSE: p2p:l2-block-stream Starting L2 block stream {"batchSize":20,"pollIntervalMS":100,"startingBlock":0} 09:32:06 [09:32:06.817] INFO: epoch-prune-watcher EpochPruneWatcher initialized 09:32:06 [09:32:06.882] VERBOSE: validator Initialized validator with addresses: 0x6f6c4d7be75f816482b1ff891faabb686927a6f4 09:32:06 [09:32:06.883] VERBOSE: node:MAIN-aztec-node All Aztec Node subsystems synced 09:32:06 [09:32:06.901] INFO: slasher Starting Slasher client... 09:32:06 [09:32:06.912] VERBOSE: p2p:l2-block-stream Starting sync from block number 0 09:32:06 [09:32:06.939] INFO: validator Started validator with addresses: 0x6f6c4d7be75f816482b1ff891faabb686927a6f4 09:32:06 [09:32:06.939] VERBOSE: validator Validators 0x6f6c4d7be75f816482b1ff891faabb686927a6f4 are not on the validator committee for epoch 0 09:32:06 [09:32:06.940] INFO: sequencer Sequencer config set {"transactionPollingIntervalMS":500,"maxTxsPerBlock":32,"minTxsPerBlock":0,"maxL2BlockGas":10000000000,"publishTxsWithProposals":false,"maxDABlockGas":10000000000,"acvmWorkingDirectory":"/tmp/b650f362/acvm","acvmBinaryPath":"../../noir/noir-repo/target/release/acvm","maxBlockSizeInBytes":1048576,"governanceProposerPayload":"0x0000000000000000000000000000000000000000","maxL1TxInclusionTimeIntoSlot":8,"enforceTimeTable":false} 09:32:06 [09:32:06.940] VERBOSE: sequencer Sequencer timetable updated {"enforceTimeTable":false} 09:32:06 [09:32:06.943] INFO: sequencer Sequencer started with address 0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266 09:32:06 [09:32:06.943] VERBOSE: node:MAIN-aztec-node Sequencer started 09:32:06 [09:32:06.944] INFO: node:MAIN-aztec-node Aztec Node version: 0.87.6 09:32:06 [09:32:06.944] INFO: node:MAIN-aztec-node Aztec Node started on chain 0x7a69 {"registryAddress":"0xd79af51b8839ec9bd9c18107eda85523dfd96206","governanceAddress":"0x51e452ef904ffe5dae09faa826966e9cc2125904","governanceProposerAddress":"0x9fd955ba864e81acbf586f1ffcb4ba689bf6cf2a","rollupAddress":"0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf","inboxAddress":"0x8a9b384a6fff1f6bb08e97cd7e5ae4802c595f00","outboxAddress":"0x083b459575a58978cc2368b523dfd7c46d6dc972","feeJuicePortalAddress":"0x0d13d578695a34882ed9770b7a757b68e7a9d8b1","feeJuiceAddress":"0xb8999345da8041f1da51ac5179b1f055a560f397","stakingAssetAddress":"0xbb9e13665cfb3d531f288a11e7312b6b91c59292","rewardDistributorAddress":"0x8c4a6a1d7797dd91749a53a9ce691b7e6cebe5c0","gseAddress":"0xfa2858ca5fdf40129734409f7519b44582b8d091","coinIssuerAddress":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","slashFactoryAddress":"0xf6e203ac765caa944c1e9d16590f53eaf4115b82","feeAssetHandlerAddress":"0xb4ff23c4b1e2bc7c86090d4fbda21a457ee6727f","stakingAssetHandlerAddress":"0x47d6163a580dcef179f23c3e48f56b1c0446f336","zkPassportVerifierAddress":"0xee9f10f38319eae2730dba28fb09081db806c5e5"} 09:32:06 [09:32:06.949] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating and syncing a simulated prover node... 09:32:07 [09:32:07.010] INFO: blob-sink:client:prover-node Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:45123"} 09:32:07 [09:32:07.036] INFO: archiver:lmdb:prover-node Creating archiver data store at directory /tmp/b48ca1e76b7355b2/a66e9cf6caa6e4e3/archiver with map size 134217728 KB (LMDB v2) 09:32:07 [09:32:07.058] VERBOSE: sequencer Preparing proposal for block 1 at slot 2 {"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750239315,"version":2717077031},"chainTipArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","blockNumber":1,"slot":2} 09:32:07 [09:32:07.060] INFO: archiver:lmdb:prover-node Starting data store with maxReaders 16 09:32:07 [09:32:07.190] VERBOSE: block-builder Building block 1 for slot 2 {"slot":2,"slotStart":"2025-06-18T09:35:15.000Z","now":"2025-06-18T09:35:09.005Z","blockNumber":1,"msgCount":0,"opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}} 09:32:07 [09:32:07.376] INFO: simulator:public-processor:prover-node Processed 0 successful txs and 0 failed txs in 0.18010081499999978s {"duration":0.18010081499999978,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 09:32:07 [09:32:07.562] INFO: sequencer Built block 1 for slot 2 with 0 txs and 0 messages. 0 mana/s {"blockHash":"0x00b07fff73d4cff641f1ff1415a860588ec8b79efcc98a630f7ae1ca87aa7bef","globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750239315,"version":2717077031},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":436.889396999999,"publicProcessDuration":182.53635499999837,"rollupCircuitsDuration":378.99888400000054,"txCount":0,"blockNumber":1,"blockTimestamp":1750239315,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 09:32:07 [09:32:07.575] VERBOSE: sequencer Attesting committee is empty 09:32:07 [09:32:07.668] INFO: blob-sink:client:prover-node Testing configured blob sources {"blobSinkUrl":"http://localhost:45123"} 09:32:07 [09:32:07.682] INFO: blob-sink:client:prover-node Blob sink is reachable {"blobSinkUrl":"http://localhost:45123"} 09:32:07 [09:32:07.683] WARN: blob-sink:client:prover-node No L1 consensus host urls configured 09:32:07 [09:32:07.683] WARN: blob-sink:client:prover-node No archive client configured 09:32:07 [09:32:07.688] INFO: archiver:prover-node Starting archiver sync to rollup contract 0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf from L1 block 22 to current L1 block 25 with hash 0x919f4c43fd9f8a88263c65a557b6aacfbbe389b16388bff05cb90b0aa7969550 {"blocksSynchedTo":22,"messagesSynchedTo":{"l1BlockHash":"0xc563fd3cb90f2a1a26555d293aa77a614c5eb1d918a54678acf4c92a650ddfd2","l1BlockNumber":22}} 09:32:07 [09:32:07.800] INFO: archiver:prover-node Initial archiver sync to L1 block 25 complete. {"l1BlockNumber":25,"syncPoint":{"blocksSynchedTo":25},"latest":{"number":0},"proven":{"number":0},"finalized":{"number":0}} 09:32:07 [09:32:07.803] INFO: prover-node:blob-sink:client:prover-node Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:45123"} 09:32:07 [09:32:07.804] VERBOSE: prover-node:prover-node Snapshot sync is disabled. No snapshots URL provided. 09:32:07 [09:32:07.806] VERBOSE: prover-node:prover-node Created archiver and synced to block 0 09:32:07 [09:32:07.820] INFO: world-state:database:prover-node Creating world state data store at directory /tmp/b48ca1e76b7355b2/a66e9cf6caa6e4e3/world_state with map sizes {"archiveTreeMapSizeKb":134217728,"nullifierTreeMapSizeKb":134217728,"noteHashTreeMapSizeKb":134217728,"messageTreeMapSizeKb":134217728,"publicDataTreeMapSizeKb":134217728} and 2 threads. 09:32:07 [09:32:07.858] INFO: world_state:prover-node Created world state synchroniser with block history of 2 09:32:07 [09:32:07.859] VERBOSE: world-state:block_stream:prover-node Starting L2 block stream {"proven":false,"pollIntervalMS":50} 09:32:07 [09:32:07.860] INFO: world_state:prover-node Started world state synchronizer from block 1 09:32:07 [09:32:07.861] VERBOSE: world-state:block_stream:prover-node Starting sync from block number 0 09:32:07 [09:32:07.863] WARN: prover-client:proving-broker-database:prover-node Found invalid epoch directory /tmp/b48ca1e76b7355b2/a66e9cf6caa6e4e3/archiver when loading epoch databases, ignoring 09:32:07 [09:32:07.863] WARN: prover-client:proving-broker-database:prover-node Found invalid epoch directory /tmp/b48ca1e76b7355b2/a66e9cf6caa6e4e3/world_state when loading epoch databases, ignoring 09:32:07 [09:32:07.865] INFO: prover-client:proving-broker:prover-node Proving Broker started 09:32:07 [09:32:07.883] INFO: prover-node:prover-coordination:prover-node Using prover coordination via aztec node 09:32:07 [09:32:07.885] INFO: e2e:e2e_epochs:epochs_upload_failed_proof:prover-node Created and synced prover node {"publisherAddress":"0x3C44CdDdB6a900fa2b585dd299e03d12FA4293BC"} 09:32:07 [09:32:07.886] INFO: prover-node:epoch-monitor:prover-node Started EpochMonitor {"pollingIntervalMs":200} 09:32:07 [09:32:07.895] INFO: prover-node:prover-node Started Prover Node with prover id 0x0000000000000000000000000000000000000000000000000000000000000001 {"proverNodePollingIntervalMs":200,"proverNodeMaxPendingJobs":10,"proverNodeMaxParallelBlocksPerEpoch":32,"txGatheringIntervalMs":1000,"txGatheringBatchSize":10,"txGatheringMaxParallelRequestsPerNode":100,"proverNodeFailedEpochStore":"file:///tmp/failed-proofs-QyvKYy","dataDirectory":"/tmp/b48ca1e76b7355b2/a66e9cf6caa6e4e3","l1ChainId":31337,"rollupVersion":2717077031} 09:32:07 [09:32:07.896] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating a pxe... 09:32:07 [09:32:07.903] INFO: pxe:data:lmdb Creating pxe_data data store at directory /tmp/41fbe9fb47cb382e/pxe_data with map size 134217728 KB (LMDB v2) 09:32:07 [09:32:07.915] INFO: pxe:data:lmdb Starting data store with maxReaders 16 09:32:08 [09:32:08.744] VERBOSE: pxe:service Registered protocol contracts in pxe {"AuthRegistry":"0x0000000000000000000000000000000000000000000000000000000000000001","ContractInstanceDeployer":"0x0000000000000000000000000000000000000000000000000000000000000002","ContractClassRegisterer":"0x0000000000000000000000000000000000000000000000000000000000000003","MultiCallEntrypoint":"0x0000000000000000000000000000000000000000000000000000000000000004","FeeJuice":"0x0000000000000000000000000000000000000000000000000000000000000005","Router":"0x0000000000000000000000000000000000000000000000000000000000000006"} 09:32:08 [09:32:08.745] INFO: pxe:service Started PXE connected to chain 31337 version 2717077031 09:32:08 [09:32:08.752] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L2 genesis at L1 block 22 (timestamp 1750239283) 09:32:08 [09:32:08.753] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting until L1 timestamp 1750239347 is reached as the start of epoch 1 09:32:09 [09:32:09.002] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 25 mined at 09:35:07 with new L2 block 0 for epoch 0 with proof up to L2 block 0 for epoch 0 {"l1Timestamp":1750239307,"l1BlockNumber":25,"l2SlotNumber":1,"l2BlockNumber":0,"l2ProvenBlockNumber":0,"totalL2Messages":0} 09:32:11 [09:32:11.302] VERBOSE: ethereum:tx_delayer Sent tx immediately 0x94cd7afddc2b9d1ab0a652906041e221d9e495a30f01eadd5a038fdbbba3e140 09:32:11 [09:32:11.303] VERBOSE: node:MAIN-aztec-node Sent L1 transaction 0x94cd7afddc2b9d1ab0a652906041e221d9e495a30f01eadd5a038fdbbba3e140 {"gasLimit":470530,"maxFeePerGas":"500","maxPriorityFeePerGas":"500","maxFeePerBlobGas":"0.000000001"} 09:32:13 [09:32:13.216] INFO: sequencer:publisher Bundled [propose] transaction [succeeded] 09:32:13 [09:32:13.217] VERBOSE: sequencer:publisher Published L2 block to L1 rollup contract {"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0x94cd7afddc2b9d1ab0a652906041e221d9e495a30f01eadd5a038fdbbba3e140","calldataSize":1220,"calldataGas":8816,"txCount":0,"blockNumber":1,"blockTimestamp":1750239315,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 09:32:13 [09:32:13.218] VERBOSE: node:blob-sink:client Sending 1 blobs to blob sink 09:32:13 [09:32:13.232] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 26 mined at 09:35:15 with new L2 block 1 for epoch 0 {"l1Timestamp":1750239315,"l1BlockNumber":26,"l2SlotNumber":2,"l2BlockNumber":1,"l2ProvenBlockNumber":0,"totalL2Messages":0} 09:32:13 [09:32:13.249] INFO: blob-sink:server Received blob sidecar for block 0x74bc01d63a5f9604d4c36db0cc62eed21e128bfaa609db50d801626813ff8dc9 09:32:13 [09:32:13.269] INFO: blob-sink:server Blob sidecar stored successfully for block 0x74bc01d63a5f9604d4c36db0cc62eed21e128bfaa609db50d801626813ff8dc9 09:32:13 [09:32:13.381] INFO: archiver:prover-node Downloaded L2 block 1 {"blockHash":"0x00b07fff73d4cff641f1ff1415a860588ec8b79efcc98a630f7ae1ca87aa7bef","blockNumber":1,"txCount":0,"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750239315,"version":2717077031},"archiveRoot":"0x131dfdf59178d3a965008d5409f293632907ffd8dc0dfd6d71a3cbc1b5178539","archiveNextLeafIndex":2} 09:32:13 [09:32:13.405] INFO: archiver Downloaded L2 block 1 {"blockHash":"0x00b07fff73d4cff641f1ff1415a860588ec8b79efcc98a630f7ae1ca87aa7bef","blockNumber":1,"txCount":0,"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750239315,"version":2717077031},"archiveRoot":"0x131dfdf59178d3a965008d5409f293632907ffd8dc0dfd6d71a3cbc1b5178539","archiveNextLeafIndex":2} 09:32:13 [09:32:13.417] INFO: world_state:prover-node World state updated with L2 block 1 {"eventName":"l2-block-handled","duration":6.789955000000191,"unfinalisedBlockNumber":1,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":1,"blockTimestamp":1750239315,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 09:32:13 [09:32:13.468] INFO: world_state World state updated with L2 block 1 {"eventName":"l2-block-handled","duration":9.708979999999428,"unfinalisedBlockNumber":1,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":1,"blockTimestamp":1750239315,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 09:32:13 [09:32:13.522] VERBOSE: p2p Synched to latest block 1 09:32:13 [09:32:13.919] VERBOSE: prover-node:prover-node Fetching 0 tx hashes for block number 1 from coordination 09:32:13 [09:32:13.920] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 09:32:21 [09:32:21.301] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 27 mined at 09:35:23 {"l1Timestamp":1750239323,"l1BlockNumber":27,"l2SlotNumber":2,"l2BlockNumber":1,"l2ProvenBlockNumber":0,"totalL2Messages":0} 09:32:21 [09:32:21.622] VERBOSE: sequencer Preparing proposal for block 2 at slot 3 {"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750239331,"version":2717077031},"chainTipArchive":"0x131dfdf59178d3a965008d5409f293632907ffd8dc0dfd6d71a3cbc1b5178539","blockNumber":2,"slot":3} 09:32:21 [09:32:21.663] VERBOSE: block-builder Building block 2 for slot 3 {"slot":3,"slotStart":"2025-06-18T09:35:31.000Z","now":"2025-06-18T09:35:23.478Z","blockNumber":2,"msgCount":0,"opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}} 09:32:21 [09:32:21.678] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.00404406999999992s {"duration":0.00404406999999992,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 09:32:21 [09:32:21.706] INFO: sequencer Built block 2 for slot 3 with 0 txs and 0 messages. 0 mana/s {"blockHash":"0x2c94c635c1b292b73378bbdf4ad22d7b1dbed55651767b36b8943a4a18979305","globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750239331,"version":2717077031},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":64.62327500000174,"publicProcessDuration":4.697922000003018,"rollupCircuitsDuration":57.022739,"txCount":0,"blockNumber":2,"blockTimestamp":1750239331,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 09:32:21 [09:32:21.710] VERBOSE: sequencer Attesting committee is empty 09:32:21 [09:32:21.820] VERBOSE: ethereum:tx_delayer Sent tx immediately 0x0e721454d084e5c0e4c9d0bf372bf4a0ee5fd62f4b5278b5ab5069cf78131da4 09:32:21 [09:32:21.820] VERBOSE: node:MAIN-aztec-node Sent L1 transaction 0x0e721454d084e5c0e4c9d0bf372bf4a0ee5fd62f4b5278b5ab5069cf78131da4 {"gasLimit":392827,"maxFeePerGas":"1.2659289","maxPriorityFeePerGas":"1.2","maxFeePerBlobGas":"0.000000001"} 09:32:29 [09:32:29.222] INFO: sequencer:publisher Bundled [propose] transaction [succeeded] 09:32:29 [09:32:29.223] VERBOSE: sequencer:publisher Published L2 block to L1 rollup contract {"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0x0e721454d084e5c0e4c9d0bf372bf4a0ee5fd62f4b5278b5ab5069cf78131da4","calldataSize":1220,"calldataGas":8816,"txCount":0,"blockNumber":2,"blockTimestamp":1750239331,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 09:32:29 [09:32:29.224] VERBOSE: node:blob-sink:client Sending 1 blobs to blob sink 09:32:29 [09:32:29.245] INFO: blob-sink:server Received blob sidecar for block 0x8d6653c80527210bb82cd16315072276f5aa0983408335b484bfac4e5ddda778 09:32:29 [09:32:29.258] INFO: blob-sink:server Blob sidecar stored successfully for block 0x8d6653c80527210bb82cd16315072276f5aa0983408335b484bfac4e5ddda778 09:32:29 [09:32:29.333] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 28 mined at 09:35:31 with new L2 block 2 for epoch 0 {"l1Timestamp":1750239331,"l1BlockNumber":28,"l2SlotNumber":3,"l2BlockNumber":2,"l2ProvenBlockNumber":0,"totalL2Messages":0} 09:32:29 [09:32:29.423] INFO: archiver Downloaded L2 block 2 {"blockHash":"0x2c94c635c1b292b73378bbdf4ad22d7b1dbed55651767b36b8943a4a18979305","blockNumber":2,"txCount":0,"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750239331,"version":2717077031},"archiveRoot":"0x05123141c2bb524bafd567184d9e7c12ac02b5b73299a88b1e53527532373d13","archiveNextLeafIndex":3} 09:32:29 [09:32:29.451] INFO: archiver:prover-node Downloaded L2 block 2 {"blockHash":"0x2c94c635c1b292b73378bbdf4ad22d7b1dbed55651767b36b8943a4a18979305","blockNumber":2,"txCount":0,"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750239331,"version":2717077031},"archiveRoot":"0x05123141c2bb524bafd567184d9e7c12ac02b5b73299a88b1e53527532373d13","archiveNextLeafIndex":3} 09:32:29 [09:32:29.483] INFO: world_state World state updated with L2 block 2 {"eventName":"l2-block-handled","duration":4.8360780000002705,"unfinalisedBlockNumber":2,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":2,"blockTimestamp":1750239331,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 09:32:29 [09:32:29.496] INFO: world_state:prover-node World state updated with L2 block 2 {"eventName":"l2-block-handled","duration":16.208719999995083,"unfinalisedBlockNumber":2,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":2,"blockTimestamp":1750239331,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 09:32:29 [09:32:29.573] VERBOSE: p2p Synched to latest block 2 09:32:29 [09:32:29.628] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 09:32:29 [09:32:29.629] VERBOSE: prover-node:prover-node Gathered all 0 txs for epoch 0 {"epochNumber":0} 09:32:29 [09:32:29.630] VERBOSE: prover-node:prover-node Gathered all 0 messages for epoch 0 {"epochNumber":0} 09:32:29 [09:32:29.631] VERBOSE: prover-node:prover-node Gathered previous block header 0 for epoch 0 09:32:29 [09:32:29.631] VERBOSE: prover-node:prover-node Creating proving job for epoch 0 for block range 1 to 2 09:32:29 [09:32:29.634] INFO: prover-node:epoch-proving-job Starting epoch 0 proving job with blocks 1 to 2 {"fromBlock":1,"toBlock":2,"epochSizeBlocks":2,"epochNumber":0,"uuid":"324731de-70e5-451d-802c-8d3b381c98df"} 09:32:29 [09:32:29.655] INFO: prover-client:orchestrator Starting epoch 0 with 2 blocks 09:32:29 [09:32:29.656] VERBOSE: prover-client:broker-circuit-prover-facade Starting BrokerCircuitProverFacade 09:32:29 [09:32:29.658] VERBOSE: prover-node:epoch-proving-job Starting processing block 1 {"number":1,"blockHash":"0x00b07fff73d4cff641f1ff1415a860588ec8b79efcc98a630f7ae1ca87aa7bef","lastArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"324731de-70e5-451d-802c-8d3b381c98df","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x00000000000000000000000000000000000000000000000000000000a1f34e27","blockNumber":1,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 09:32:29 [09:32:29.659] INFO: prover-client:orchestrator Starting block 1 for slot 2 09:32:29 [09:32:29.660] VERBOSE: prover-node:epoch-proving-job Starting processing block 2 {"number":2,"blockHash":"0x2c94c635c1b292b73378bbdf4ad22d7b1dbed55651767b36b8943a4a18979305","lastArchive":"0x131dfdf59178d3a965008d5409f293632907ffd8dc0dfd6d71a3cbc1b5178539","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"324731de-70e5-451d-802c-8d3b381c98df","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x00000000000000000000000000000000000000000000000000000000a1f34e27","blockNumber":2,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000003","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 09:32:29 [09:32:29.660] INFO: prover-client:orchestrator Starting block 2 for slot 3 09:32:29 [09:32:29.715] INFO: prover-client:proving-broker:prover-node New proving job id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a epochNumber=0 {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a"} 09:32:29 [09:32:29.717] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 09:32:29 [09:32:29.718] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 09:32:29 [09:32:29.718] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 09:32:29 [09:32:29.719] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 09:32:29 [09:32:29.719] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 09:32:29 [09:32:29.719] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 09:32:29 [09:32:29.719] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 09:32:29 [09:32:29.721] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000019610999996075407s {"duration":0.000019610999996075407,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 09:32:29 [09:32:29.721] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 09:32:29 [09:32:29.722] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 1 {"blockNumber":1,"blockHash":"0x00b07fff73d4cff641f1ff1415a860588ec8b79efcc98a630f7ae1ca87aa7bef","uuid":"324731de-70e5-451d-802c-8d3b381c98df"} 09:32:29 [09:32:29.722] VERBOSE: prover-client:orchestrator Block 1 completed. Assembling header. 09:32:29 [09:32:29.728] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.00001959099999658065s {"duration":0.00001959099999658065,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 09:32:29 [09:32:29.728] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 09:32:29 [09:32:29.729] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 2 {"blockNumber":2,"blockHash":"0x2c94c635c1b292b73378bbdf4ad22d7b1dbed55651767b36b8943a4a18979305","uuid":"324731de-70e5-451d-802c-8d3b381c98df"} 09:32:29 [09:32:29.729] VERBOSE: prover-client:orchestrator Block 2 completed. Assembling header. 09:32:29 [09:32:29.735] VERBOSE: prover-client:orchestrator Updating archive tree with block 1 header 0x00b07fff73d4cff641f1ff1415a860588ec8b79efcc98a630f7ae1ca87aa7bef 09:32:29 [09:32:29.755] VERBOSE: prover-client:orchestrator Orchestrator finalised block 1 09:32:29 [09:32:29.784] VERBOSE: prover-client:orchestrator Updating archive tree with block 2 header 0x2c94c635c1b292b73378bbdf4ad22d7b1dbed55651767b36b8943a4a18979305 09:32:29 [09:32:29.798] INFO: prover-client:proving-broker-database:prover-node Creating broker database for epoch 0 at /tmp/b48ca1e76b7355b2/a66e9cf6caa6e4e3/0 with map size 134217728 09:32:29 [09:32:29.803] VERBOSE: prover-client:orchestrator Orchestrator finalised block 2 09:32:29 [09:32:29.834] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:32:29 [09:32:29.842] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY epochNumber=0 {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...","status":"not-found","numOutstandingJobs":1} 09:32:29 [09:32:29.880] INFO: prover-client:proving-agent:prover-node Starting job id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input... 09:32:29 [09:32:29.899] INFO: prover-client:proving-agent:job-controller-66bbd9d7 Job controller started jobId=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a {"jobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a"} 09:32:29 [09:32:29.993] VERBOSE: prover-node:prover-node Fetching 0 tx hashes for block number 2 from coordination 09:32:29 [09:32:29.994] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 09:32:30 [09:32:30.049] INFO: prover-client:proving-agent:prover-node Job id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22resul... 09:32:30 [09:32:30.050] INFO: prover-client:proving-broker:prover-node Proving job complete id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY totalAttempts=1 {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a"} 09:32:30 [09:32:30.658] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 09:32:30 [09:32:30.662] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY 09:32:30 [09:32:30.663] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 09:32:30 [09:32:30.689] INFO: prover-client:proving-broker:prover-node New proving job id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa epochNumber=0 {"provingJobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa"} 09:32:30 [09:32:30.700] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY {"provingJobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa","provingJobType":"ROOT_PARITY"} 09:32:30 [09:32:30.753] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY epochNumber=0 {"provingJobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa","provingJobType":"ROOT_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu...","status":"not-found","numOutstandingJobs":1} 09:32:30 [09:32:30.822] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Triggering error on finaliseEpoch 09:32:30 [09:32:30.833] ERROR: prover-node:epoch-proving-job Error running epoch 0 prover job: Error: Fake error while proving epoch 09:32:30 at ServerEpochProver.epochProver.finaliseEpoch (/home/aztec-dev/aztec-packages/yarn-project/end-to-end/src/e2e_epochs/epochs_upload_failed_proof.test.ts:60:15) 09:32:30 at runNextTicks (node:internal/process/task_queues:65:5) 09:32:30 at processTimers (node:internal/timers:520:9) 09:32:30 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:142:64) 09:32:30 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) {"uuid":"324731de-70e5-451d-802c-8d3b381c98df","epochNumber":0} 09:32:30 [09:32:30.833] VERBOSE: prover-client:broker-circuit-prover-facade Stopping BrokerCircuitProverFacade 09:32:30 [09:32:30.835] ERROR: prover-client:broker-circuit-prover-facade Job errored with 'Broker facade stopped' id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY: { 09:32:30 provingJobId: '0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa', 09:32:30 provingJobType: 'ROOT_PARITY' 09:32:30 } 09:32:30 [09:32:30.835] INFO: prover-client:proving-broker:prover-node Cancelling job id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa {"provingJobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa"} 09:32:30 [09:32:30.836] WARN: prover-client:proving-broker:prover-node Proving job id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY not in the in-progress set {"provingJobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa"} 09:32:30 [09:32:30.836] INFO: prover-client:proving-broker:prover-node Marking proving job as failed id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY totalAttempts=1 err=Aborted {"provingJobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa"} 09:32:30 [09:32:30.838] ERROR: prover-client:orchestrator Error thrown when proving job: Error: Broker facade stopped 09:32:30 at BrokerCircuitProverFacade.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/proving_broker/broker_prover_facade.js:142:31) 09:32:30 at runNextTicks (node:internal/process/task_queues:65:5) 09:32:30 at processTimers (node:internal/timers:520:9) 09:32:30 at ServerEpochProver.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/prover-client/server-epoch-prover.js:31:9) 09:32:30 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:183:13) 09:32:30 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) 09:32:30 [09:32:30.838] ERROR: prover-client:orchestrator Error thrown when proving job: Error: Broker facade stopped 09:32:30 at BrokerCircuitProverFacade.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/proving_broker/broker_prover_facade.js:142:31) 09:32:30 at runNextTicks (node:internal/process/task_queues:65:5) 09:32:30 at processTimers (node:internal/timers:520:9) 09:32:30 at ServerEpochProver.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/prover-client/server-epoch-prover.js:31:9) 09:32:30 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:183:13) 09:32:30 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) 09:32:30 [09:32:30.839] ERROR: prover-node:prover-node Job for 0 exited with state failed: { 09:32:30 id: '324731de-70e5-451d-802c-8d3b381c98df', 09:32:30 epochNumber: 0n, 09:32:30 state: 'failed' 09:32:30 } 09:32:30 [09:32:30.839] WARN: prover-node:prover-node Uploading epoch proof failure for 0 to file:///tmp/failed-proofs-QyvKYy {"epochNumber":0,"jobId":"324731de-70e5-451d-802c-8d3b381c98df","location":"file:///tmp/failed-proofs-QyvKYy"} 09:32:30 [09:32:30.843] INFO: stdlib:file-store Creating local file file store at /tmp/failed-proofs-QyvKYy 09:32:30 [09:32:30.857] INFO: prover-node:prover-node Pausing archiver and world state sync to start snapshot upload 09:32:30 [09:32:30.863] INFO: archiver:prover-node Stopped. 09:32:30 [09:32:30.864] INFO: world_state:prover-node Stopped sync 09:32:30 [09:32:30.864] INFO: prover-node:prover-node Creating backups of lmdb environments to /tmp/b48ca1e76b7355b2/a66e9cf6caa6e4e3/epoch-proof-data-YrPYND 09:32:30 [09:32:30.874] INFO: prover-node:prover-node Data stores backed up to /tmp/b48ca1e76b7355b2/a66e9cf6caa6e4e3/epoch-proof-data-YrPYND {"paths":{"l1-to-l2-message-tree":"/tmp/b48ca1e76b7355b2/a66e9cf6caa6e4e3/epoch-proof-data-YrPYND/world-state/L1ToL2MessageTree/data.mdb","archive-tree":"/tmp/b48ca1e76b7355b2/a66e9cf6caa6e4e3/epoch-proof-data-YrPYND/world-state/ArchiveTree/data.mdb","public-data-tree":"/tmp/b48ca1e76b7355b2/a66e9cf6caa6e4e3/epoch-proof-data-YrPYND/world-state/PublicDataTree/data.mdb","note-hash-tree":"/tmp/b48ca1e76b7355b2/a66e9cf6caa6e4e3/epoch-proof-data-YrPYND/world-state/NoteHashTree/data.mdb","nullifier-tree":"/tmp/b48ca1e76b7355b2/a66e9cf6caa6e4e3/epoch-proof-data-YrPYND/world-state/NullifierTree/data.mdb","archiver":"/tmp/b48ca1e76b7355b2/a66e9cf6caa6e4e3/epoch-proof-data-YrPYND/archiver/data.mdb"}} 09:32:30 [09:32:30.875] INFO: prover-node:prover-node Resuming archiver and world state sync 09:32:30 [09:32:30.875] VERBOSE: world-state:block_stream:prover-node Starting L2 block stream {"proven":false,"pollIntervalMS":50} 09:32:30 [09:32:30.875] INFO: world_state:prover-node Resumed sync 09:32:30 [09:32:30.880] INFO: archiver:prover-node Restarting archiver 09:32:30 [09:32:30.936] WARN: prover-node:prover-node Uploaded epoch 0 proof failure data to file:///tmp/failed-proofs-QyvKYy/aztec-31337-2717077031-0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf/0-20250618093230-324731de-70e5-451d-802c-8d3b381c98df {"epochNumber":0,"location":"file:///tmp/failed-proofs-QyvKYy","basePath":"aztec-31337-2717077031-0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf/0-20250618093230-324731de-70e5-451d-802c-8d3b381c98df","metadataUrl":"file:///tmp/failed-proofs-QyvKYy/aztec-31337-2717077031-0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf/0-20250618093230-324731de-70e5-451d-802c-8d3b381c98df/metadata.json","dataUrl":"file:///tmp/failed-proofs-QyvKYy/aztec-31337-2717077031-0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf/0-20250618093230-324731de-70e5-451d-802c-8d3b381c98df/data.bin","metadata":{"l1BlockNumber":28,"l2BlockHash":"0x2c94c635c1b292b73378bbdf4ad22d7b1dbed55651767b36b8943a4a18979305","l2BlockNumber":2,"schemaVersions":{"archiver":2,"worldState":1},"timestamp":1750239150881,"dataUrls":{"l1-to-l2-message-tree":"file:///tmp/failed-proofs-QyvKYy/aztec-31337-2717077031-0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf/0-20250618093230-324731de-70e5-451d-802c-8d3b381c98df/l1-to-l2-message-tree.db","archive-tree":"file:///tmp/failed-proofs-QyvKYy/aztec-31337-2717077031-0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf/0-20250618093230-324731de-70e5-451d-802c-8d3b381c98df/archive-tree.db","public-data-tree":"file:///tmp/failed-proofs-QyvKYy/aztec-31337-2717077031-0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf/0-20250618093230-324731de-70e5-451d-802c-8d3b381c98df/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-QyvKYy/aztec-31337-2717077031-0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf/0-20250618093230-324731de-70e5-451d-802c-8d3b381c98df/note-hash-tree.db","nullifier-tree":"file:///tmp/failed-proofs-QyvKYy/aztec-31337-2717077031-0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf/0-20250618093230-324731de-70e5-451d-802c-8d3b381c98df/nullifier-tree.db","archiver":"file:///tmp/failed-proofs-QyvKYy/aztec-31337-2717077031-0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf/0-20250618093230-324731de-70e5-451d-802c-8d3b381c98df/archiver.db"}},"jobId":"324731de-70e5-451d-802c-8d3b381c98df"} 09:32:30 [09:32:30.937] INFO: prover-node:prover-node Cleaning up backup dir /tmp/b48ca1e76b7355b2/a66e9cf6caa6e4e3/epoch-proof-data-YrPYND 09:32:37 [09:32:37.215] INFO: prover-node:prover-node Stopping ProverNode 09:32:37 [09:32:37.216] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 09:32:37 [09:32:37.216] INFO: archiver:prover-node Stopped. 09:32:37 [09:32:37.219] INFO: world_state:prover-node Stopped world state synchronizer 09:32:37 [09:32:37.220] INFO: prover-node:prover-node Stopped ProverNode 09:32:37 [09:32:37.220] INFO: node:MAIN-aztec-node Stopping Aztec Node 09:32:37 [09:32:37.611] VERBOSE: sequencer Preparing proposal for block 3 at slot 4 {"globalVariables":{"blockNumber":3,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":4,"timestamp":1750239347,"version":2717077031},"chainTipArchive":"0x05123141c2bb524bafd567184d9e7c12ac02b5b73299a88b1e53527532373d13","blockNumber":3,"slot":4} 09:32:37 [09:32:37.655] VERBOSE: block-builder Building block 3 for slot 4 {"slot":4,"slotStart":"2025-06-18T09:35:47.000Z","now":"2025-06-18T09:35:39.470Z","blockNumber":3,"msgCount":0,"opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}} 09:32:37 [09:32:37.663] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.00048186400000122377s {"duration":0.00048186400000122377,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 09:32:37 [09:32:37.729] INFO: sequencer Built block 3 for slot 4 with 0 txs and 0 messages. 0 mana/s {"blockHash":"0x0c52ffcad2c70d9bdba2e185555bb67ca6e807ef50f5268561b39e2333dc5906","globalVariables":{"blockNumber":3,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":4,"timestamp":1750239347,"version":2717077031},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":86.13823199999752,"publicProcessDuration":1.0528920000069775,"rollupCircuitsDuration":74.98096100000112,"txCount":0,"blockNumber":3,"blockTimestamp":1750239347,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 09:32:37 [09:32:37.732] VERBOSE: sequencer Attesting committee is empty 09:32:37 [09:32:37.914] VERBOSE: ethereum:tx_delayer Sent tx immediately 0x56f028dfd5c1003eb9f63813a3b7beff20b8da63390a383e42507a54c2274a15 09:32:37 [09:32:37.915] VERBOSE: node:MAIN-aztec-node Sent L1 transaction 0x56f028dfd5c1003eb9f63813a3b7beff20b8da63390a383e42507a54c2274a15 {"gasLimit":466400,"maxFeePerGas":"1.250604906","maxPriorityFeePerGas":"1.2","maxFeePerBlobGas":"0.000000001"} 09:32:39 [09:32:39.223] INFO: slasher Slasher client stopped. 09:32:45 [09:32:45.180] INFO: sequencer:publisher Bundled [propose] transaction [succeeded] 09:32:45 [09:32:45.182] VERBOSE: sequencer:publisher Published L2 block to L1 rollup contract {"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0x56f028dfd5c1003eb9f63813a3b7beff20b8da63390a383e42507a54c2274a15","calldataSize":1220,"calldataGas":8828,"txCount":0,"blockNumber":3,"blockTimestamp":1750239347,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 09:32:45 [09:32:45.182] VERBOSE: node:blob-sink:client Sending 1 blobs to blob sink 09:32:45 [09:32:45.189] INFO: sequencer Stopped sequencer 09:32:45 [09:32:45.190] INFO: p2p P2P client stopped 09:32:45 [09:32:45.193] INFO: world_state Stopped world state synchronizer 09:32:45 [09:32:45.193] INFO: archiver Stopped. 09:32:45 [09:32:45.193] INFO: node:MAIN-aztec-node Stopped Aztec Node 09:32:45 [09:32:45.197] INFO: blob-sink:server Received blob sidecar for block 0xff7249767ed6d3b2999e2a73088f79986c3ff24bc8bb0a898f1534a2e932d94b 09:32:45 [09:32:45.203] INFO: blob-sink:server Blob sidecar stored successfully for block 0xff7249767ed6d3b2999e2a73088f79986c3ff24bc8bb0a898f1534a2e932d94b 09:32:45 [09:32:45.206] INFO: node:MAIN-aztec-node Stopping Aztec Node 09:32:47 [09:32:47.206] INFO: slasher Slasher client stopped. 09:32:47 [09:32:47.206] WARN: validator Running promise was not started 09:32:47 [09:32:47.207] WARN: sequencer Running promise was not started 09:32:47 [09:32:47.207] INFO: sequencer Stopped sequencer 09:32:47 [09:32:47.207] WARN: p2p:l2-block-stream Running promise was not started 09:32:47 [09:32:47.207] INFO: p2p P2P client stopped 09:32:47 [09:32:47.207] WARN: world-state:block_stream Running promise was not started 09:32:47 [09:32:47.208] INFO: world_state Stopped world state synchronizer 09:32:47 [09:32:47.208] WARN: archiver Running promise was not started 09:32:47 [09:32:47.208] INFO: archiver Stopped. 09:32:47 [09:32:47.208] INFO: node:MAIN-aztec-node Stopped Aztec Node 09:32:47 [09:32:47.209] INFO: prover-node:prover-node Stopping ProverNode 09:32:47 [09:32:47.209] WARN: prover-node:prover-node Running promise was not started 09:32:47 [09:32:47.209] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 09:32:47 [09:32:47.209] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 09:32:47 [09:32:47.209] WARN: archiver:prover-node Running promise was not started 09:32:47 [09:32:47.210] INFO: archiver:prover-node Stopped. 09:32:47 [09:32:47.210] WARN: world-state:block_stream:prover-node Running promise was not started 09:32:47 [09:32:47.210] INFO: world_state:prover-node Stopped world state synchronizer 09:32:47 [09:32:47.210] INFO: prover-node:prover-node Stopped ProverNode 09:32:47 [09:32:47.227] INFO: blob-sink:server Stopping blob sink 09:32:47 [09:32:47.228] INFO: blob-sink:server Blob sink stopped 09:32:47 [09:32:47.233] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data and state {"uploadPath":"/tmp/failed-proofs-QyvKYy","rerunDataDir":"/tmp/rerun-data-U8Er06","rerunDownloadPath":"/tmp/rerun-download-Hky77v/data.bin"} 09:32:47 [09:32:47.234] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data from file:///tmp/failed-proofs-QyvKYy/aztec-31337-2717077031-0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf/0-20250618093230-324731de-70e5-451d-802c-8d3b381c98df 09:32:47 [09:32:47.235] INFO: stdlib:file-store Creating local file file store at /tmp/failed-proofs-QyvKYy/aztec-31337-2717077031-0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf/0-20250618093230-324731de-70e5-451d-802c-8d3b381c98df 09:32:47 [09:32:47.237] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading state snapshot from file:///tmp/failed-proofs-QyvKYy/aztec-31337-2717077031-0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf/0-20250618093230-324731de-70e5-451d-802c-8d3b381c98df to local data directory {"metadata":{"l2BlockNumber":2,"l2BlockHash":"0x2c94c635c1b292b73378bbdf4ad22d7b1dbed55651767b36b8943a4a18979305","l1BlockNumber":28,"l1ChainId":31337,"rollupVersion":2717077031,"rollupAddress":"0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf"},"dataUrls":{"archiver":"file:///tmp/failed-proofs-QyvKYy/aztec-31337-2717077031-0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf/0-20250618093230-324731de-70e5-451d-802c-8d3b381c98df/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-QyvKYy/aztec-31337-2717077031-0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf/0-20250618093230-324731de-70e5-451d-802c-8d3b381c98df/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-QyvKYy/aztec-31337-2717077031-0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf/0-20250618093230-324731de-70e5-451d-802c-8d3b381c98df/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-QyvKYy/aztec-31337-2717077031-0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf/0-20250618093230-324731de-70e5-451d-802c-8d3b381c98df/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-QyvKYy/aztec-31337-2717077031-0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf/0-20250618093230-324731de-70e5-451d-802c-8d3b381c98df/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-QyvKYy/aztec-31337-2717077031-0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf/0-20250618093230-324731de-70e5-451d-802c-8d3b381c98df/l1-to-l2-message-tree.db"}} 09:32:47 [09:32:47.237] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Creating local file file store at /tmp/failed-proofs-QyvKYy/aztec-31337-2717077031-0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf/0-20250618093230-324731de-70e5-451d-802c-8d3b381c98df 09:32:47 [09:32:47.238] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading snapshot to /tmp/rerun-data-U8Er06/download-m2cOZ6 {"snapshot":{"dataUrls":{"archiver":"file:///tmp/failed-proofs-QyvKYy/aztec-31337-2717077031-0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf/0-20250618093230-324731de-70e5-451d-802c-8d3b381c98df/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-QyvKYy/aztec-31337-2717077031-0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf/0-20250618093230-324731de-70e5-451d-802c-8d3b381c98df/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-QyvKYy/aztec-31337-2717077031-0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf/0-20250618093230-324731de-70e5-451d-802c-8d3b381c98df/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-QyvKYy/aztec-31337-2717077031-0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf/0-20250618093230-324731de-70e5-451d-802c-8d3b381c98df/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-QyvKYy/aztec-31337-2717077031-0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf/0-20250618093230-324731de-70e5-451d-802c-8d3b381c98df/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-QyvKYy/aztec-31337-2717077031-0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf/0-20250618093230-324731de-70e5-451d-802c-8d3b381c98df/l1-to-l2-message-tree.db"}},"downloadPaths":{"archiver":"/tmp/rerun-data-U8Er06/download-m2cOZ6/archiver.db","nullifier-tree":"/tmp/rerun-data-U8Er06/download-m2cOZ6/nullifier-tree.db","public-data-tree":"/tmp/rerun-data-U8Er06/download-m2cOZ6/public-data-tree.db","note-hash-tree":"/tmp/rerun-data-U8Er06/download-m2cOZ6/note-hash-tree.db","archive-tree":"/tmp/rerun-data-U8Er06/download-m2cOZ6/archive-tree.db","l1-to-l2-message-tree":"/tmp/rerun-data-U8Er06/download-m2cOZ6/l1-to-l2-message-tree.db"}} 09:32:47 [09:32:47.241] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Snapshot downloaded at /tmp/rerun-data-U8Er06/download-m2cOZ6 {"snapshot":{"dataUrls":{"archiver":"file:///tmp/failed-proofs-QyvKYy/aztec-31337-2717077031-0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf/0-20250618093230-324731de-70e5-451d-802c-8d3b381c98df/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-QyvKYy/aztec-31337-2717077031-0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf/0-20250618093230-324731de-70e5-451d-802c-8d3b381c98df/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-QyvKYy/aztec-31337-2717077031-0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf/0-20250618093230-324731de-70e5-451d-802c-8d3b381c98df/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-QyvKYy/aztec-31337-2717077031-0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf/0-20250618093230-324731de-70e5-451d-802c-8d3b381c98df/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-QyvKYy/aztec-31337-2717077031-0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf/0-20250618093230-324731de-70e5-451d-802c-8d3b381c98df/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-QyvKYy/aztec-31337-2717077031-0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf/0-20250618093230-324731de-70e5-451d-802c-8d3b381c98df/l1-to-l2-message-tree.db"}},"downloadPaths":{"archiver":"/tmp/rerun-data-U8Er06/download-m2cOZ6/archiver.db","nullifier-tree":"/tmp/rerun-data-U8Er06/download-m2cOZ6/nullifier-tree.db","public-data-tree":"/tmp/rerun-data-U8Er06/download-m2cOZ6/public-data-tree.db","note-hash-tree":"/tmp/rerun-data-U8Er06/download-m2cOZ6/note-hash-tree.db","archive-tree":"/tmp/rerun-data-U8Er06/download-m2cOZ6/archive-tree.db","l1-to-l2-message-tree":"/tmp/rerun-data-U8Er06/download-m2cOZ6/l1-to-l2-message-tree.db"}} 09:32:47 [09:32:47.242] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Archiver database set up from snapshot {"path":"/tmp/rerun-data-U8Er06/archiver","dbVersion":2,"rollupAddress":"0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf"} 09:32:47 [09:32:47.244] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database l1-to-l2-message-tree set up from snapshot {"path":"/tmp/rerun-data-U8Er06/world_state/L1ToL2MessageTree","dbVersion":1,"rollupAddress":"0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf"} 09:32:47 [09:32:47.244] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database archive-tree set up from snapshot {"path":"/tmp/rerun-data-U8Er06/world_state/ArchiveTree","dbVersion":1,"rollupAddress":"0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf"} 09:32:47 [09:32:47.245] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database public-data-tree set up from snapshot {"path":"/tmp/rerun-data-U8Er06/world_state/PublicDataTree","dbVersion":1,"rollupAddress":"0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf"} 09:32:47 [09:32:47.245] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database note-hash-tree set up from snapshot {"path":"/tmp/rerun-data-U8Er06/world_state/NoteHashTree","dbVersion":1,"rollupAddress":"0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf"} 09:32:47 [09:32:47.245] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database nullifier-tree set up from snapshot {"path":"/tmp/rerun-data-U8Er06/world_state/NullifierTree","dbVersion":1,"rollupAddress":"0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf"} 09:32:47 [09:32:47.246] INFO: e2e:e2e_epochs:epochs_upload_failed_proof P2P database cleared {"path":"/tmp/rerun-data-U8Er06/p2p"} 09:32:47 [09:32:47.246] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data from file:///tmp/failed-proofs-QyvKYy/aztec-31337-2717077031-0xba51fc42929e2e08ffc4ba54aeb996830cbdffcf/0-20250618093230-324731de-70e5-451d-802c-8d3b381c98df/data.bin to /tmp/rerun-download-Hky77v/data.bin 09:32:47 [09:32:47.248] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Epoch proving job data for epoch 0 downloaded successfully 09:32:47 [09:32:47.248] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Rerunning proving job from /tmp/rerun-download-Hky77v/data.bin 09:32:47 [09:32:47.249] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Using native ACVM binary at ../../noir/noir-repo/target/release/acvm with working directory /tmp/f30ad388/acvm 09:32:47 [09:32:47.250] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Loaded proving job data for epoch 0 09:32:47 [09:32:47.254] INFO: world-state:database Creating world state data store at directory /tmp/rerun-data-U8Er06/world_state with map sizes {"archiveTreeMapSizeKb":1048576,"nullifierTreeMapSizeKb":1048576,"noteHashTreeMapSizeKb":1048576,"messageTreeMapSizeKb":1048576,"publicDataTreeMapSizeKb":1048576} and 2 threads. 09:32:47 [09:32:47.269] INFO: archiver:lmdb Creating archiver data store at directory /tmp/rerun-data-U8Er06/archiver with map size 1048576 KB (LMDB v2) 09:32:47 [09:32:47.270] INFO: archiver:lmdb Starting data store with maxReaders 16 09:32:47 [09:32:47.273] WARN: prover-client:proving-broker-database Found invalid epoch directory /tmp/rerun-data-U8Er06/archiver when loading epoch databases, ignoring 09:32:47 [09:32:47.274] WARN: prover-client:proving-broker-database Found invalid epoch directory /tmp/rerun-data-U8Er06/world_state when loading epoch databases, ignoring 09:32:47 [09:32:47.274] INFO: prover-client:proving-broker Proving Broker started 09:32:47 [09:32:47.275] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Rerunning epoch proving job for epoch 0 09:32:47 [09:32:47.275] INFO: prover-node:epoch-proving-job Starting epoch 0 proving job with blocks 1 to 2 {"fromBlock":1,"toBlock":2,"epochSizeBlocks":2,"epochNumber":0,"uuid":"fb52cb34-b163-4a5d-911e-42a7edda474c"} 09:32:47 [09:32:47.292] INFO: prover-client:orchestrator Starting epoch 0 with 2 blocks 09:32:47 [09:32:47.293] VERBOSE: prover-client:broker-circuit-prover-facade Starting BrokerCircuitProverFacade 09:32:47 [09:32:47.295] VERBOSE: prover-node:epoch-proving-job Starting processing block 1 {"number":1,"blockHash":"0x00b07fff73d4cff641f1ff1415a860588ec8b79efcc98a630f7ae1ca87aa7bef","lastArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"fb52cb34-b163-4a5d-911e-42a7edda474c","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x00000000000000000000000000000000000000000000000000000000a1f34e27","blockNumber":1,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 09:32:47 [09:32:47.296] INFO: prover-client:orchestrator Starting block 1 for slot 2 09:32:47 [09:32:47.296] VERBOSE: prover-node:epoch-proving-job Starting processing block 2 {"number":2,"blockHash":"0x2c94c635c1b292b73378bbdf4ad22d7b1dbed55651767b36b8943a4a18979305","lastArchive":"0x131dfdf59178d3a965008d5409f293632907ffd8dc0dfd6d71a3cbc1b5178539","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"fb52cb34-b163-4a5d-911e-42a7edda474c","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x00000000000000000000000000000000000000000000000000000000a1f34e27","blockNumber":2,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000003","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 09:32:47 [09:32:47.297] INFO: prover-client:orchestrator Starting block 2 for slot 3 09:32:47 [09:32:47.321] INFO: prover-client:proving-broker New proving job id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a epochNumber=0 {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a"} 09:32:47 [09:32:47.321] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 09:32:47 [09:32:47.322] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 09:32:47 [09:32:47.322] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 09:32:47 [09:32:47.323] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 09:32:47 [09:32:47.323] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 09:32:47 [09:32:47.324] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 09:32:47 [09:32:47.324] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 09:32:47 [09:32:47.326] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000030392000000574627s {"duration":0.000030392000000574627,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 09:32:47 [09:32:47.326] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 09:32:47 [09:32:47.326] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 1 {"blockNumber":1,"blockHash":"0x00b07fff73d4cff641f1ff1415a860588ec8b79efcc98a630f7ae1ca87aa7bef","uuid":"fb52cb34-b163-4a5d-911e-42a7edda474c"} 09:32:47 [09:32:47.327] VERBOSE: prover-client:orchestrator Block 1 completed. Assembling header. 09:32:47 [09:32:47.332] VERBOSE: prover-client:orchestrator Updating archive tree with block 1 header 0x00b07fff73d4cff641f1ff1415a860588ec8b79efcc98a630f7ae1ca87aa7bef 09:32:47 [09:32:47.333] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000020580999997036996s {"duration":0.000020580999997036996,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 09:32:47 [09:32:47.334] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 09:32:47 [09:32:47.334] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 2 {"blockNumber":2,"blockHash":"0x2c94c635c1b292b73378bbdf4ad22d7b1dbed55651767b36b8943a4a18979305","uuid":"fb52cb34-b163-4a5d-911e-42a7edda474c"} 09:32:47 [09:32:47.335] VERBOSE: prover-client:orchestrator Block 2 completed. Assembling header. 09:32:47 [09:32:47.335] VERBOSE: prover-client:orchestrator Orchestrator finalised block 1 09:32:47 [09:32:47.349] VERBOSE: prover-client:orchestrator Updating archive tree with block 2 header 0x2c94c635c1b292b73378bbdf4ad22d7b1dbed55651767b36b8943a4a18979305 09:32:47 [09:32:47.356] VERBOSE: prover-client:orchestrator Orchestrator finalised block 2 09:32:47 [09:32:47.373] INFO: prover-client:proving-broker-database Creating broker database for epoch 0 at /tmp/rerun-data-U8Er06/0 with map size 1048576 09:32:47 [09:32:47.374] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:32:47 [09:32:47.377] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY epochNumber=0 {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...","status":"not-found","numOutstandingJobs":1} 09:32:47 [09:32:47.480] INFO: prover-client:proving-agent Starting job id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input... 09:32:47 [09:32:47.482] INFO: prover-client:proving-agent:job-controller-3c962265 Job controller started jobId=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a {"jobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a"} 09:32:47 [09:32:47.571] INFO: prover-client:proving-agent Job id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22resul... 09:32:47 [09:32:47.571] INFO: prover-client:proving-broker Proving job complete id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY totalAttempts=1 {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a"} 09:32:48 [09:32:48.293] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 09:32:48 [09:32:48.296] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY 09:32:48 [09:32:48.296] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 09:32:48 [09:32:48.315] INFO: prover-client:proving-broker New proving job id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa epochNumber=0 {"provingJobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa"} 09:32:48 [09:32:48.324] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY {"provingJobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa","provingJobType":"ROOT_PARITY"} 09:32:48 [09:32:48.369] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY epochNumber=0 {"provingJobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa","provingJobType":"ROOT_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu...","status":"not-found","numOutstandingJobs":1} 09:32:48 [09:32:48.395] INFO: prover-client:proving-agent Starting job id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu... 09:32:48 [09:32:48.435] INFO: prover-client:proving-agent:job-controller-2b806126 Job controller started jobId=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa {"jobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa"} 09:32:48 [09:32:48.590] INFO: prover-client:proving-agent Job id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22resu... 09:32:48 [09:32:48.590] INFO: prover-client:proving-broker Proving job complete id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY totalAttempts=1 {"provingJobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa"} 09:32:49 [09:32:49.298] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 09:32:49 [09:32:49.301] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY 09:32:49 [09:32:49.301] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 09:32:49 [09:32:49.320] INFO: prover-client:proving-broker New proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:076e50ee8123e370b0a4fcd5130b9f454ba722f1637785c95f773301a11a9bef epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:076e50ee8123e370b0a4fcd5130b9f454ba722f1637785c95f773301a11a9bef"} 09:32:49 [09:32:49.326] INFO: prover-client:proving-broker New proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:786be69c56d522dc3942cc23dffa36aae3fa4b6db47048105ebfa6d41fb2f743 epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:786be69c56d522dc3942cc23dffa36aae3fa4b6db47048105ebfa6d41fb2f743"} 09:32:49 [09:32:49.373] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:EMPTY_BLOCK_ROOT_ROLLUP:076e50ee8123e370b0a4fcd5130b9f454ba722f1637785c95f773301a11a9bef type=EMPTY_BLOCK_ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:076e50ee8123e370b0a4fcd5130b9f454ba722f1637785c95f773301a11a9bef","provingJobType":"EMPTY_BLOCK_ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input...","status":"not-found","numOutstandingJobs":2} 09:32:49 [09:32:49.374] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:EMPTY_BLOCK_ROOT_ROLLUP:786be69c56d522dc3942cc23dffa36aae3fa4b6db47048105ebfa6d41fb2f743 type=EMPTY_BLOCK_ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:786be69c56d522dc3942cc23dffa36aae3fa4b6db47048105ebfa6d41fb2f743","provingJobType":"EMPTY_BLOCK_ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input...","status":"not-found","numOutstandingJobs":2} 09:32:49 [09:32:49.446] INFO: prover-client:proving-agent Starting job id=0:EMPTY_BLOCK_ROOT_ROLLUP:076e50ee8123e370b0a4fcd5130b9f454ba722f1637785c95f773301a11a9bef type=EMPTY_BLOCK_ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input... 09:32:49 [09:32:49.466] INFO: prover-client:proving-agent:job-controller-40bfd325 Job controller started jobId=0:EMPTY_BLOCK_ROOT_ROLLUP:076e50ee8123e370b0a4fcd5130b9f454ba722f1637785c95f773301a11a9bef {"jobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:076e50ee8123e370b0a4fcd5130b9f454ba722f1637785c95f773301a11a9bef"} 09:32:49 [09:32:49.469] INFO: prover-client:proving-agent Starting job id=0:EMPTY_BLOCK_ROOT_ROLLUP:786be69c56d522dc3942cc23dffa36aae3fa4b6db47048105ebfa6d41fb2f743 type=EMPTY_BLOCK_ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input... 09:32:49 [09:32:49.477] INFO: prover-client:proving-agent:job-controller-e665a695 Job controller started jobId=0:EMPTY_BLOCK_ROOT_ROLLUP:786be69c56d522dc3942cc23dffa36aae3fa4b6db47048105ebfa6d41fb2f743 {"jobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:786be69c56d522dc3942cc23dffa36aae3fa4b6db47048105ebfa6d41fb2f743"} 09:32:50 [09:32:50.978] INFO: prover-client:proving-agent Job id=0:EMPTY_BLOCK_ROOT_ROLLUP:076e50ee8123e370b0a4fcd5130b9f454ba722f1637785c95f773301a11a9bef type=EMPTY_BLOCK_ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22resul... 09:32:50 [09:32:50.978] INFO: prover-client:proving-broker Proving job complete id=0:EMPTY_BLOCK_ROOT_ROLLUP:076e50ee8123e370b0a4fcd5130b9f454ba722f1637785c95f773301a11a9bef type=EMPTY_BLOCK_ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:076e50ee8123e370b0a4fcd5130b9f454ba722f1637785c95f773301a11a9bef"} 09:32:51 [09:32:51.304] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 2, total jobs ready: 1 09:32:51 [09:32:51.309] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:076e50ee8123e370b0a4fcd5130b9f454ba722f1637785c95f773301a11a9bef type=EMPTY_BLOCK_ROOT_ROLLUP 09:32:51 [09:32:51.309] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 09:32:53 [09:32:53.104] INFO: prover-client:proving-agent Job id=0:EMPTY_BLOCK_ROOT_ROLLUP:786be69c56d522dc3942cc23dffa36aae3fa4b6db47048105ebfa6d41fb2f743 type=EMPTY_BLOCK_ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22resul... 09:32:53 [09:32:53.105] INFO: prover-client:proving-broker Proving job complete id=0:EMPTY_BLOCK_ROOT_ROLLUP:786be69c56d522dc3942cc23dffa36aae3fa4b6db47048105ebfa6d41fb2f743 type=EMPTY_BLOCK_ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:786be69c56d522dc3942cc23dffa36aae3fa4b6db47048105ebfa6d41fb2f743"} 09:32:53 [09:32:53.312] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 09:32:53 [09:32:53.315] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:786be69c56d522dc3942cc23dffa36aae3fa4b6db47048105ebfa6d41fb2f743 type=EMPTY_BLOCK_ROOT_ROLLUP 09:32:53 [09:32:53.315] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 09:32:53 [09:32:53.329] INFO: prover-client:proving-broker New proving job id=0:ROOT_ROLLUP:a8865dba97faf024cb17acd4fc1bad8e81adcc209021463d5779d0fd7ab5f858 epochNumber=0 {"provingJobId":"0:ROOT_ROLLUP:a8865dba97faf024cb17acd4fc1bad8e81adcc209021463d5779d0fd7ab5f858"} 09:32:53 [09:32:53.384] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_ROLLUP:a8865dba97faf024cb17acd4fc1bad8e81adcc209021463d5779d0fd7ab5f858 type=ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:ROOT_ROLLUP:a8865dba97faf024cb17acd4fc1bad8e81adcc209021463d5779d0fd7ab5f858","provingJobType":"ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22input...","status":"not-found","numOutstandingJobs":1} 09:32:53 [09:32:53.411] INFO: prover-client:proving-agent Starting job id=0:ROOT_ROLLUP:a8865dba97faf024cb17acd4fc1bad8e81adcc209021463d5779d0fd7ab5f858 type=ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22input... 09:32:53 [09:32:53.429] INFO: prover-client:proving-agent:job-controller-a4cb9b1e Job controller started jobId=0:ROOT_ROLLUP:a8865dba97faf024cb17acd4fc1bad8e81adcc209021463d5779d0fd7ab5f858 {"jobId":"0:ROOT_ROLLUP:a8865dba97faf024cb17acd4fc1bad8e81adcc209021463d5779d0fd7ab5f858"} 09:32:53 [09:32:53.557] INFO: prover-client:proving-agent Job id=0:ROOT_ROLLUP:a8865dba97faf024cb17acd4fc1bad8e81adcc209021463d5779d0fd7ab5f858 type=ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22resul... 09:32:53 [09:32:53.557] INFO: prover-client:proving-broker Proving job complete id=0:ROOT_ROLLUP:a8865dba97faf024cb17acd4fc1bad8e81adcc209021463d5779d0fd7ab5f858 type=ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:ROOT_ROLLUP:a8865dba97faf024cb17acd4fc1bad8e81adcc209021463d5779d0fd7ab5f858"} 09:32:54 [09:32:54.316] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 09:32:54 [09:32:54.322] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:ROOT_ROLLUP:a8865dba97faf024cb17acd4fc1bad8e81adcc209021463d5779d0fd7ab5f858 type=ROOT_ROLLUP 09:32:54 [09:32:54.324] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 09:32:54 [09:32:54.324] VERBOSE: prover-client:orchestrator Orchestrator completed root rollup for epoch 0 09:32:54 [09:32:54.329] INFO: prover-node:epoch-proving-job Finalised proof for epoch 0 {"epochNumber":0,"uuid":"fb52cb34-b163-4a5d-911e-42a7edda474c","duration":7053.597292999999} 09:32:54 [09:32:54.334] INFO: prover-node:epoch-proving-job Submitted proof for epoch 0 (blocks 1 to 2) {"epochNumber":0,"uuid":"fb52cb34-b163-4a5d-911e-42a7edda474c"} 09:32:54 [09:32:54.335] VERBOSE: prover-client:broker-circuit-prover-facade Stopping BrokerCircuitProverFacade 09:32:54 [09:32:54.335] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Completed job for epoch 0 with status completed 09:32:54 [09:32:54.335] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Test succeeded 09:32:54 [09:32:54.337] INFO: prover-node:prover-node Stopping ProverNode 09:32:54 [09:32:54.337] WARN: prover-node:prover-node Running promise was not started 09:32:54 [09:32:54.337] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 09:32:54 [09:32:54.337] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 09:32:54 [09:32:54.337] WARN: archiver:prover-node Running promise was not started 09:32:54 [09:32:54.337] INFO: archiver:prover-node Stopped. 09:32:54 [09:32:54.338] WARN: world-state:block_stream:prover-node Running promise was not started 09:32:54 [09:32:54.338] INFO: world_state:prover-node Stopped world state synchronizer 09:32:54 [09:32:54.338] INFO: prover-node:prover-node Stopped ProverNode 09:32:54 [09:32:54.338] INFO: node:MAIN-aztec-node Stopping Aztec Node 09:32:56 [09:32:56.339] INFO: slasher Slasher client stopped. 09:32:56 [09:32:56.340] WARN: validator Running promise was not started 09:32:56 [09:32:56.340] WARN: sequencer Running promise was not started 09:32:56 [09:32:56.340] INFO: sequencer Stopped sequencer 09:32:56 [09:32:56.341] WARN: p2p:l2-block-stream Running promise was not started 09:32:56 [09:32:56.341] INFO: p2p P2P client stopped 09:32:56 [09:32:56.341] WARN: world-state:block_stream Running promise was not started 09:32:56 [09:32:56.341] INFO: world_state Stopped world state synchronizer 09:32:56 [09:32:56.341] WARN: archiver Running promise was not started 09:32:56 [09:32:56.341] INFO: archiver Stopped. 09:32:56 [09:32:56.342] INFO: node:MAIN-aztec-node Stopped Aztec Node 09:32:56 [09:32:56.343] INFO: node:MAIN-aztec-node Stopping Aztec Node 09:32:58 [09:32:58.345] INFO: slasher Slasher client stopped. 09:32:58 [09:32:58.345] WARN: validator Running promise was not started 09:32:58 [09:32:58.346] WARN: sequencer Running promise was not started 09:32:58 [09:32:58.346] INFO: sequencer Stopped sequencer 09:32:58 [09:32:58.346] WARN: p2p:l2-block-stream Running promise was not started 09:32:58 [09:32:58.346] INFO: p2p P2P client stopped 09:32:58 [09:32:58.346] WARN: world-state:block_stream Running promise was not started 09:32:58 [09:32:58.346] INFO: world_state Stopped world state synchronizer 09:32:58 [09:32:58.346] WARN: archiver Running promise was not started 09:32:58 [09:32:58.347] INFO: archiver Stopped. 09:32:58 [09:32:58.347] INFO: node:MAIN-aztec-node Stopped Aztec Node 09:32:58 [09:32:58.347] INFO: prover-node:prover-node Stopping ProverNode 09:32:58 [09:32:58.347] WARN: prover-node:prover-node Running promise was not started 09:32:58 [09:32:58.347] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 09:32:58 [09:32:58.347] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 09:32:58 [09:32:58.347] WARN: archiver:prover-node Running promise was not started 09:32:58 [09:32:58.348] INFO: archiver:prover-node Stopped. 09:32:58 [09:32:58.348] WARN: world-state:block_stream:prover-node Running promise was not started 09:32:58 [09:32:58.348] INFO: world_state:prover-node Stopped world state synchronizer 09:32:58 [09:32:58.348] INFO: prover-node:prover-node Stopped ProverNode 09:32:58 [09:32:58.349] INFO: blob-sink:server Stopping blob sink 09:32:58 [09:32:58.349] INFO: blob-sink:server Blob sink already stopped 09:32:58 PASS src/e2e_epochs/epochs_upload_failed_proof.test.ts 09:32:58 e2e_epochs/epochs_upload_failed_proof 09:32:58 ✓ uploads failed proving job state and re-runs it on a fresh instance (55021 ms) 09:32:58 09:32:58 Test Suites: 1 passed, 1 total 09:32:58 Tests: 1 passed, 1 total 09:32:58 Snapshots: 0 total 09:32:58 Time: 64.091 s 09:32:58 Ran all test suites matching src/e2e_epochs/epochs_upload_failed_proof.test.ts. 09:32:58 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?