Parent Log: http://ci.aztec-labs.com/72dfec5668227906 Command: 37aad4e9ebf491ef:ISOLATE=1:NAME=e2e_epochs/epochs_upload_failed_proof yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_upload_failed_proof.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/bbf33e6534f745d2f5a11c2f359583e881120fc4 Env: REF_NAME=gh-readonly-queue/next/pr-15047-e56623c3f6400dc164642e49255b211d6fb03ac6 CURRENT_VERSION=0.87.6 CI_FULL=1 Date: Wed Jun 18 17:01:30 UTC 2025 System: ARCH=amd64 CPUS=128 MEM=493Gi HOSTNAME=pr-15047_amd64_x1-full Resources: CPU_LIST=0-127 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_476a42720cde10eb_next 17:01:30 +++ id -u 17:01:30 +++ id -g 17:01:30 ++ docker run -d --name e2e_epochs_epochs_upload_failed_proof --net=none --cpuset-cpus=0-127 --cpus=2 --memory=8g --user 1000:1000 -v/home/aztec-dev:/home/aztec-dev --mount type=tmpfs,target=/tmp,tmpfs-size=1g --workdir /home/aztec-dev/aztec-packages -e HOME -e VERBOSE -e GIT_CONFIG_GLOBAL=/home/aztec-dev/aztec-packages/build-images/src/home/.gitconfig -e FORCE_COLOR=true -e CPUS -e MEM aztecprotocol/build:3.0 /bin/bash -c 'timeout -v 600s bash -c '\''yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_upload_failed_proof.test.ts'\''' 17:01:31 + cid=0fab4bae5a8dbe3774deb8a6819c184747dfa1ccd2e65e1328ea69599febfb28 17:01:31 + set +x 17:01:32 {"level":25,"time":1750266092046,"pid":12,"hostname":"0fab4bae5a8d","module":"logger","msg":"Logger initialized with level verbose"} 17:01:39 [17:01:39.658] INFO: e2e:epochs_upload_failed_proof Running test: e2e_epochs/epochs_upload_failed_proof uploads failed proving job state and re-runs it on a fresh instance 17:01:39 [17:01:39.803] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Logging metrics to log/e2e_epochs_epochs_upload_failed_proof.jsonl 17:01:40 [17:01:40.050] WARN: ethereum:cheat_codes Set L1 automine to true 17:01:40 [17:01:40.082] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Sent 0.1 ETH to deployer {"deployer":"0x05f32b3cc3888453ff71b01135b34ff8e41263f2","value":100000000000000000} 17:01:40 [17:01:40.106] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Sent 0.1 ETH to deployer {"deployer":"0x05f32b3cc3888453ff71b01135b34ff8e41263f2","value":100000000000000000} 17:01:40 [17:01:40.120] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Multicall3 17:01:40 [17:01:40.121] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Calling anvil_setBlockTimestampInterval with params: [8] 17:01:40 [17:01:40.123] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Set block interval to 8 17:01:40 [17:01:40.124] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contracts from 0xf39Fd6e51aad88F6F4ce6aB8827279cffFb92266 17:01:40 [17:01:40.177] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x8166bb789c828e492198babef9becf8ac44628f059d48e6f68114a9ae2ade6ec {"gasLimit":867658,"maxFeePerGas":"120.351651125","maxPriorityFeePerGas":"118.94979"} 17:01:40 [17:01:40.177] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xB8999345dA8041f1Da51ac5179B1F055A560f397 in tx 0x8166bb789c828e492198babef9becf8ac44628f059d48e6f68114a9ae2ade6ec. 17:01:40 [17:01:40.180] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Fee Asset at 0xb8999345da8041f1da51ac5179b1f055a560f397 17:01:40 [17:01:40.208] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x07d928293fb6819e2a8abf9d0b32b04560f633065cf07cefb5dcf9ca71af1db2 {"gasLimit":867644,"maxFeePerGas":"143.976575211","maxPriorityFeePerGas":"142.739748"} 17:01:40 [17:01:40.209] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xBb9e13665Cfb3d531F288a11E7312b6b91C59292 in tx 0x07d928293fb6819e2a8abf9d0b32b04560f633065cf07cefb5dcf9ca71af1db2. 17:01:40 [17:01:40.210] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Staking Asset at 0xbb9e13665cfb3d531f288a11e7312b6b91c59292 17:01:40 [17:01:40.239] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xaea8901378fc3dd27f030542afe63b646eb508d14ca9b264a18f1b2c0a6c9742 {"gasLimit":3126464,"maxFeePerGas":"172.377275728","maxPriorityFeePerGas":"171.2876976"} 17:01:40 [17:01:40.240] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xFa2858cA5fdf40129734409F7519b44582B8D091 in tx 0xaea8901378fc3dd27f030542afe63b646eb508d14ca9b264a18f1b2c0a6c9742. 17:01:40 [17:01:40.241] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed GSE at 0xfa2858ca5fdf40129734409f7519b44582b8d091 17:01:40 [17:01:40.269] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x16ac847cd12f2ca188dc7c57557698d2e30c717f9ff4b3bee30569e2a009b2df {"gasLimit":1030455,"maxFeePerGas":"206.505096634","maxPriorityFeePerGas":"205.54523712"} 17:01:40 [17:01:40.270] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xd79AF51B8839EC9bd9c18107eDA85523dFd96206 in tx 0x16ac847cd12f2ca188dc7c57557698d2e30c717f9ff4b3bee30569e2a009b2df. 17:01:40 [17:01:40.271] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Registry at 0xd79af51b8839ec9bd9c18107eda85523dfd96206 17:01:40 [17:01:40.310] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xb529fd31d8de51ee1ee5d0f30ab7b6820cf9a392f49a84e4c786ca17f3b69f22 {"gasLimit":1998686,"maxFeePerGas":"247.514707084","maxPriorityFeePerGas":"246.654284544"} 17:01:40 [17:01:40.311] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x9Fd955bA864E81acbF586F1ffcB4ba689bf6cf2a in tx 0xb529fd31d8de51ee1ee5d0f30ab7b6820cf9a392f49a84e4c786ca17f3b69f22. 17:01:40 [17:01:40.312] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed GovernanceProposer at 0x9fd955ba864e81acbf586f1ffcb4ba689bf6cf2a 17:01:40 [17:01:40.347] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x4310bda1d354201e760871a224530a0d6bd9993fe19f752b207a624e0c4e27c3 {"gasLimit":3092007,"maxFeePerGas":"296.744085407","maxPriorityFeePerGas":"295.985141452"} 17:01:40 [17:01:40.348] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x51E452ef904FFE5daE09fAA826966E9CC2125904 in tx 0x4310bda1d354201e760871a224530a0d6bd9993fe19f752b207a624e0c4e27c3. 17:01:40 [17:01:40.349] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Governance at 0x51e452ef904ffe5dae09faa826966e9cc2125904 17:01:40 [17:01:40.370] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x4820abfc3f6804d776b6830cda17e6d053481fd0836a9b72b056297329004de6 {"gasLimit":100000,"maxFeePerGas":"355.856633653","maxPriorityFeePerGas":"355.182169742"} 17:01:40 [17:01:40.371] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Set governance on GSE in 0x4820abfc3f6804d776b6830cda17e6d053481fd0836a9b72b056297329004de6 17:01:40 [17:01:40.399] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xac3e9a225d3bca6d877d7cfde6241a60a1b3f05ba11deadc75e185604ae836b5 {"gasLimit":397405,"maxFeePerGas":"426.823037513","maxPriorityFeePerGas":"426.21860369"} 17:01:40 [17:01:40.399] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xE5006923b8eE541E0c928Bc72d28b18D3f570f62 in tx 0xac3e9a225d3bca6d877d7cfde6241a60a1b3f05ba11deadc75e185604ae836b5. 17:01:40 [17:01:40.400] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed CoinIssuer at 0xe5006923b8ee541e0c928bc72d28b18d3f570f62 17:01:40 [17:01:40.400] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for deployments to complete 17:01:40 [17:01:40.401] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 7 transactions to be mined... 17:01:40 [17:01:40.453] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 17:01:40 [17:01:40.475] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xe2117c4b0e9a1732bc62a3fdeb7fe84f86eccaa9ad097a02985eeb8fc9269a2e {"gasLimit":100000,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 17:01:40 [17:01:40.475] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added coin issuer 0xe5006923b8ee541e0c928bc72d28b18d3f570f62 as minter on fee asset in 0xe2117c4b0e9a1732bc62a3fdeb7fe84f86eccaa9ad097a02985eeb8fc9269a2e 17:01:40 [17:01:40.499] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xc582e4484124769dc3f6e9feb6f06bc1f84b52379b781dbf887eea0f0775571c {"gasLimit":56661,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 17:01:40 [17:01:40.527] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x100b31bd1e3992df58985c26db7e5351f01cbb7b9c2e961c411c57733fb6cfa5 {"gasLimit":344517,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 17:01:40 [17:01:40.527] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xB4fF23c4B1E2Bc7C86090d4FBDa21A457ee6727F in tx 0x100b31bd1e3992df58985c26db7e5351f01cbb7b9c2e961c411c57733fb6cfa5. 17:01:40 [17:01:40.528] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed FeeAssetHandler at 0xb4ff23c4b1e2bc7c86090d4fbda21a457ee6727f 17:01:40 [17:01:40.547] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xc451aae80a23ef806a4bacf2e291d1c2ae150b6200ea2ea4e841b119a7e7c28b {"gasLimit":56804,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 17:01:40 [17:01:40.547] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added fee asset handler 0xb4ff23c4b1e2bc7c86090d4fbda21a457ee6727f as minter on fee asset in 0xc451aae80a23ef806a4bacf2e291d1c2ae150b6200ea2ea4e841b119a7e7c28b 17:01:40 [17:01:40.587] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xaedcfe9ce1d95491a20fcf1be6d0946a0a4edc41326f0c45af543a3a1b893ef2 {"gasLimit":2514655,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 17:01:40 [17:01:40.587] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x9C99b649ab407AF4F630a17af78E2d1218764686 in tx 0xaedcfe9ce1d95491a20fcf1be6d0946a0a4edc41326f0c45af543a3a1b893ef2. 17:01:40 [17:01:40.588] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed StakingAssetHandler at 0x9c99b649ab407af4f630a17af78e2d1218764686 17:01:40 [17:01:40.605] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x9dca4833e8202ce5a19d6e056f5469337ce5deaea9e1458189d2e2adc1e212a2 {"gasLimit":56804,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 17:01:40 [17:01:40.605] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added staking asset handler 0x9c99b649ab407af4f630a17af78e2d1218764686 as minter on staking asset in 0x9dca4833e8202ce5a19d6e056f5469337ce5deaea9e1458189d2e2adc1e212a2 17:01:40 [17:01:40.605] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for deployments to complete 17:01:40 [17:01:40.605] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 9 transactions to be mined... 17:01:40 [17:01:40.648] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 17:01:40 [17:01:40.664] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed shared contracts 17:01:40 [17:01:40.696] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x91a04f69719a84aacd823f2906533fea50245c46fe7ee6d49a467d9048a888a3 {"gasLimit":84837,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 17:01:40 [17:01:40.696] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Funded reward distributor with 10000000000000000000000000 fee asset in 0x91a04f69719a84aacd823f2906533fea50245c46fe7ee6d49a467d9048a888a3 17:01:40 [17:01:40.728] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x6732a13052b668b6ed53c2db691f949dc5751b43ca937a6796aab9388f3cb12a {"gasLimit":154658,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 17:01:40 [17:01:40.729] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x277E22B0C9698d7f2A1cD7C6d857511617587309 in tx 0x6732a13052b668b6ed53c2db691f949dc5751b43ca937a6796aab9388f3cb12a. 17:01:40 [17:01:40.729] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup will use the mock verifier at 0x277e22b0c9698d7f2a1cd7c6d857511617587309 17:01:40 [17:01:40.730] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup config args {"aztecSlotDuration":16,"aztecEpochDuration":4,"targetCommitteeSize":0,"aztecProofSubmissionEpochs":1,"slashingQuorum":6,"slashingRoundSize":10,"manaTarget":10000000000,"entryQueueFlushSizeMin":48,"entryQueueFlushSizeQuotient":2,"provingCostPerMana":100,"rewardConfig":{"sequencerBps":5000,"increment":200000,"maxScore":5000000,"a":5000,"k":1000000,"minimum":100000}} 17:01:40 [17:01:40.745] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xb8abd58c11090ad54ef25e78695dcd575f9386dec80efb3e83e93ba4eaee8ba4 {"gasLimit":87007,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 17:01:40 [17:01:40.745] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x7450C7068b41096BBDF64238985cdF9D33c38308 in tx 0xb8abd58c11090ad54ef25e78695dcd575f9386dec80efb3e83e93ba4eaee8ba4. 17:01:40 [17:01:40.787] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x43b4b8eb7cd73c3728eb21a8f5209a5a4943118902ed1029061e4fd8825180fe {"gasLimit":5114449,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 17:01:40 [17:01:40.788] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x7529F92672f4C7F675e181f225cC2F04abeb06C6 in tx 0x43b4b8eb7cd73c3728eb21a8f5209a5a4943118902ed1029061e4fd8825180fe. 17:01:40 [17:01:40.820] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x3c5776f12ccaa0e6cec7f702a48add2aaa3baea7fde7e578ae060b6759eec37b {"gasLimit":2858979,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 17:01:40 [17:01:40.821] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x9149539e06fe74Ca0B752e8Cd985b18F44cE45c6 in tx 0x3c5776f12ccaa0e6cec7f702a48add2aaa3baea7fde7e578ae060b6759eec37b. 17:01:40 [17:01:40.821] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Awaiting for linked libraries to be deployed 17:01:40 [17:01:40.892] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x6f32bedc04231ec2694ecb9f5fabb2976f2ab5b92c54a5d2df68e31486f06ca3 {"gasLimit":11094688,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 17:01:40 [17:01:40.892] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xe6053F00e88413519A7853Afff55d60FE23C339c in tx 0x6f32bedc04231ec2694ecb9f5fabb2976f2ab5b92c54a5d2df68e31486f06ca3. 17:01:40 [17:01:40.893] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Rollup at 0xe6053f00e88413519a7853afff55d60fe23c339c {"aztecSlotDuration":16,"aztecEpochDuration":4,"targetCommitteeSize":0,"aztecProofSubmissionEpochs":1,"slashingQuorum":6,"slashingRoundSize":10,"manaTarget":10000000000,"entryQueueFlushSizeMin":48,"entryQueueFlushSizeQuotient":2,"provingCostPerMana":100,"rewardConfig":{"sequencerBps":5000,"increment":200000,"maxScore":5000000,"a":5000,"k":1000000,"minimum":100000}} 17:01:40 [17:01:40.893] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 11 transactions to be mined... 17:01:40 [17:01:40.941] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 17:01:40 [17:01:40.941] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof All core contracts have been deployed 17:01:40 [17:01:40.964] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x0ba38952fda43742c98d680b48b5f90e9b534e48dd5d6328f8bd27915e80723e {"gasLimit":1056482,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 17:01:40 [17:01:40.964] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x6FfcC310905e8840C9AFb0bE599aF89858863ce6 in tx 0x0ba38952fda43742c98d680b48b5f90e9b534e48dd5d6328f8bd27915e80723e. 17:01:40 [17:01:40.965] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed SlashFactory at 0x6ffcc310905e8840c9afb0be599af89858863ce6 17:01:41 [17:01:41.003] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xc1a41b07b8b118a5ecb94916bf56da70cdc2e391884b33d9770299caf572cc19 {"gasLimit":116965,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 17:01:41 [17:01:41.004] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Adding rollup 0xe6053f00e88413519a7853afff55d60fe23c339c to registry 0xd79af51b8839ec9bd9c18107eda85523dfd96206 in tx 0xc1a41b07b8b118a5ecb94916bf56da70cdc2e391884b33d9770299caf572cc19 17:01:41 [17:01:41.018] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xcb65ed6497b0ec5ca03cbb930afb5c3f4bab0b7ee6924910436f10610e10b867 {"gasLimit":109464,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 17:01:41 [17:01:41.018] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Adding rollup 0xe6053f00e88413519a7853afff55d60fe23c339c to GSE 0xfa2858ca5fdf40129734409f7519b44582b8d091 in tx 0xcb65ed6497b0ec5ca03cbb930afb5c3f4bab0b7ee6924910436f10610e10b867 17:01:41 [17:01:41.023] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 12 transactions to be mined... 17:01:41 [17:01:41.058] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 17:01:41 [17:01:41.066] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup deployed 17:01:41 [17:01:41.066] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for rollup and slash factory to be deployed 17:01:41 [17:01:41.067] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 12 transactions to be mined... 17:01:41 [17:01:41.097] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 17:01:41 [17:01:41.097] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof All transactions for L1 deployment have been mined 17:01:41 [17:01:41.116] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Aztec L1 contracts initialized {"registryAddress":"0xd79af51b8839ec9bd9c18107eda85523dfd96206","governanceAddress":"0x51e452ef904ffe5dae09faa826966e9cc2125904","governanceProposerAddress":"0x9fd955ba864e81acbf586f1ffcb4ba689bf6cf2a","rollupAddress":"0xe6053f00e88413519a7853afff55d60fe23c339c","inboxAddress":"0x163ce904f5c7d39371cf131e9e49ce89970fbdb5","outboxAddress":"0x58355e9cc582f758f52cc60029b61624e0d93907","feeJuicePortalAddress":"0x1f02bad802a89953c95957a867798d4bbb8c4f4d","feeJuiceAddress":"0xb8999345da8041f1da51ac5179b1f055a560f397","stakingAssetAddress":"0xbb9e13665cfb3d531f288a11e7312b6b91c59292","rewardDistributorAddress":"0x8c4a6a1d7797dd91749a53a9ce691b7e6cebe5c0","gseAddress":"0xfa2858ca5fdf40129734409f7519b44582b8d091","coinIssuerAddress":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266"} 17:01:41 [17:01:41.117] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Handing over to governance 17:01:41 [17:01:41.122] WARN: ethereum:cheat_codes Set L1 automine to false 17:01:41 [17:01:41.124] WARN: ethereum:cheat_codes Set L1 interval mining to 8 seconds 17:01:41 [17:01:41.127] WARN: foundation:test-date-provider Time set to 2025-06-18T17:04:44.000Z {"offset":182873,"timeMs":1750266284000} 17:01:41 [17:01:41.134] INFO: aztecjs:utils:watcher Watcher not started because not auto mining 17:01:41 [17:01:41.134] INFO: telemetry:client Using NoopTelemetryClient 17:01:41 [17:01:41.137] INFO: kv-store:lmdb-v2:blob-sink Creating blob-sink data store at directory /tmp/e014e02d99e23e1f/blob-sink with map size 134217728 KB (LMDB v2) 17:01:41 [17:01:41.149] INFO: kv-store:lmdb-v2:blob-sink Starting data store with maxReaders 16 17:01:41 [17:01:41.161] INFO: blob-sink:server Server is running on http://localhost:43111 17:01:41 [17:01:41.162] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating and synching an aztec node... 17:01:41 [17:01:41.162] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Using native ACVM binary at ../../noir/noir-repo/target/release/acvm with working directory /tmp/53e6c98a/acvm 17:01:41 [17:01:41.163] INFO: node:blob-sink:client Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:43111"} 17:01:41 [17:01:41.206] VERBOSE: node:MAIN-aztec-node Snapshot sync is disabled. No snapshots URL provided. 17:01:41 [17:01:41.207] INFO: archiver:lmdb Creating archiver data store at directory /tmp/e014e02d99e23e1f/archiver with map size 134217728 KB (LMDB v2) 17:01:41 [17:01:41.211] INFO: archiver:lmdb Starting data store with maxReaders 16 17:01:42 [17:01:42.229] INFO: node:blob-sink:client Testing configured blob sources {"blobSinkUrl":"http://localhost:43111"} 17:01:42 [17:01:42.253] INFO: node:blob-sink:client Blob sink is reachable {"blobSinkUrl":"http://localhost:43111"} 17:01:42 [17:01:42.253] WARN: node:blob-sink:client No L1 consensus host urls configured 17:01:42 [17:01:42.253] WARN: node:blob-sink:client No archive client configured 17:01:42 [17:01:42.256] INFO: archiver Starting archiver sync to rollup contract 0xe6053f00e88413519a7853afff55d60fe23c339c from L1 block 22 to current L1 block 25 with hash 0x8d68532bb51a75f0370c0f1d9a40be7f4309440f4c60957d0eea2b36e0cf3b1d {"blocksSynchedTo":22,"messagesSynchedTo":{"l1BlockHash":"0x4f075a2ffa1e7131b3b5076e71c6d9b735634ebd603f7bc12c8d854bb71f94e4","l1BlockNumber":22}} 17:01:42 [17:01:42.278] INFO: archiver Initial archiver sync to L1 block 25 complete. {"l1BlockNumber":25,"syncPoint":{"blocksSynchedTo":25},"latest":{"number":0},"proven":{"number":0},"finalized":{"number":0}} 17:01:42 [17:01:42.292] INFO: world-state:database Creating world state data store at directory /tmp/e014e02d99e23e1f/world_state with map sizes {"archiveTreeMapSizeKb":134217728,"nullifierTreeMapSizeKb":134217728,"noteHashTreeMapSizeKb":134217728,"messageTreeMapSizeKb":134217728,"publicDataTreeMapSizeKb":134217728} and 2 threads. 17:01:42 [17:01:42.335] INFO: world_state Created world state synchroniser with block history of 2 17:01:42 [17:01:42.336] WARN: node:MAIN-aztec-node Aztec node is accepting fake proofs 17:01:42 [17:01:42.336] INFO: bb-prover:queued_ivc_verifier Starting QueuedIVCVerifier with 8 concurrent verifiers 17:01:42 [17:01:42.358] INFO: p2p:lmdb-v2 Creating p2p data store at directory /tmp/e014e02d99e23e1f/p2p with map size 134217728 KB (LMDB v2) 17:01:42 [17:01:42.365] INFO: p2p:lmdb-v2 Starting data store with maxReaders 16 17:01:42 [17:01:42.366] INFO: p2p-archive:lmdb-v2 Creating p2p-archive data store at directory /tmp/e014e02d99e23e1f/p2p-archive with map size 134217728 KB (LMDB v2) 17:01:42 [17:01:42.368] INFO: p2p-archive:lmdb-v2 Starting data store with maxReaders 16 17:01:42 [17:01:42.369] INFO: p2p-peer:lmdb-v2 Creating p2p-peers data store at directory /tmp/e014e02d99e23e1f/p2p-peers with map size 134217728 KB (LMDB v2) 17:01:42 [17:01:42.370] INFO: p2p-peer:lmdb-v2 Starting data store with maxReaders 16 17:01:42 [17:01:42.372] INFO: p2p:tx_pool Setting maximum tx mempool size {"maxTxPoolSize":100000000} 17:01:42 [17:01:42.373] VERBOSE: p2p P2P is disabled. Using dummy P2P service. 17:01:42 [17:01:42.376] VERBOSE: world-state:block_stream Starting L2 block stream {"proven":false,"pollIntervalMS":50} 17:01:42 [17:01:42.377] INFO: world_state Started world state synchronizer from block 1 17:01:42 [17:01:42.379] VERBOSE: world-state:block_stream Starting sync from block number 0 17:01:42 [17:01:42.380] INFO: p2p Starting p2p client from block 0 with empty mempools 17:01:42 [17:01:42.381] VERBOSE: p2p:l2-block-stream Starting L2 block stream {"batchSize":20,"pollIntervalMS":100,"startingBlock":0} 17:01:42 [17:01:42.700] INFO: epoch-prune-watcher EpochPruneWatcher initialized 17:01:42 [17:01:42.748] VERBOSE: validator Initialized validator with addresses: 0x9fdf7b269cbb9c6c6f73addb440fd92c168b4a87 17:01:42 [17:01:42.749] VERBOSE: node:MAIN-aztec-node All Aztec Node subsystems synced 17:01:42 [17:01:42.759] VERBOSE: p2p:l2-block-stream Starting sync from block number 0 17:01:42 [17:01:42.761] INFO: slasher Starting Slasher client... 17:01:42 [17:01:42.788] INFO: validator Started validator with addresses: 0x9fdf7b269cbb9c6c6f73addb440fd92c168b4a87 17:01:42 [17:01:42.792] VERBOSE: validator Validators 0x9fdf7b269cbb9c6c6f73addb440fd92c168b4a87 are not on the validator committee for epoch 0 17:01:42 [17:01:42.793] INFO: sequencer Sequencer config set {"transactionPollingIntervalMS":500,"maxTxsPerBlock":32,"minTxsPerBlock":0,"maxL2BlockGas":10000000000,"publishTxsWithProposals":false,"maxDABlockGas":10000000000,"acvmWorkingDirectory":"/tmp/53e6c98a/acvm","acvmBinaryPath":"../../noir/noir-repo/target/release/acvm","maxBlockSizeInBytes":1048576,"governanceProposerPayload":"0x0000000000000000000000000000000000000000","maxL1TxInclusionTimeIntoSlot":8,"enforceTimeTable":false} 17:01:42 [17:01:42.793] VERBOSE: sequencer Sequencer timetable updated {"enforceTimeTable":false} 17:01:42 [17:01:42.795] INFO: sequencer Sequencer started with address 0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266 17:01:42 [17:01:42.796] VERBOSE: node:MAIN-aztec-node Sequencer started 17:01:42 [17:01:42.799] INFO: node:MAIN-aztec-node Aztec Node version: 0.87.6 17:01:42 [17:01:42.800] INFO: node:MAIN-aztec-node Aztec Node started on chain 0x7a69 {"registryAddress":"0xd79af51b8839ec9bd9c18107eda85523dfd96206","governanceAddress":"0x51e452ef904ffe5dae09faa826966e9cc2125904","governanceProposerAddress":"0x9fd955ba864e81acbf586f1ffcb4ba689bf6cf2a","rollupAddress":"0xe6053f00e88413519a7853afff55d60fe23c339c","inboxAddress":"0x163ce904f5c7d39371cf131e9e49ce89970fbdb5","outboxAddress":"0x58355e9cc582f758f52cc60029b61624e0d93907","feeJuicePortalAddress":"0x1f02bad802a89953c95957a867798d4bbb8c4f4d","feeJuiceAddress":"0xb8999345da8041f1da51ac5179b1f055a560f397","stakingAssetAddress":"0xbb9e13665cfb3d531f288a11e7312b6b91c59292","rewardDistributorAddress":"0x8c4a6a1d7797dd91749a53a9ce691b7e6cebe5c0","gseAddress":"0xfa2858ca5fdf40129734409f7519b44582b8d091","coinIssuerAddress":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","slashFactoryAddress":"0x6ffcc310905e8840c9afb0be599af89858863ce6","feeAssetHandlerAddress":"0xb4ff23c4b1e2bc7c86090d4fbda21a457ee6727f","stakingAssetHandlerAddress":"0x9c99b649ab407af4f630a17af78e2d1218764686","zkPassportVerifierAddress":"0xee9f10f38319eae2730dba28fb09081db806c5e5"} 17:01:42 [17:01:42.801] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating and syncing a simulated prover node... 17:01:42 [17:01:42.858] INFO: blob-sink:client:prover-node Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:43111"} 17:01:42 [17:01:42.874] INFO: archiver:lmdb:prover-node Creating archiver data store at directory /tmp/e014e02d99e23e1f/20becafa7932d028/archiver with map size 134217728 KB (LMDB v2) 17:01:42 [17:01:42.891] VERBOSE: sequencer Preparing proposal for block 1 at slot 2 {"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750266292,"version":3542590205},"chainTipArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","blockNumber":1,"slot":2} 17:01:42 [17:01:42.893] INFO: archiver:lmdb:prover-node Starting data store with maxReaders 16 17:01:43 [17:01:43.020] VERBOSE: block-builder Building block 1 for slot 2 {"slot":2,"slotStart":"2025-06-18T17:04:52.000Z","now":"2025-06-18T17:04:45.893Z","blockNumber":1,"msgCount":0,"opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}} 17:01:43 [17:01:43.202] INFO: simulator:public-processor:prover-node Processed 0 successful txs and 0 failed txs in 0.0037141520000004676s {"duration":0.0037141520000004676,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 17:01:43 [17:01:43.296] INFO: sequencer Built block 1 for slot 2 with 0 txs and 0 messages. 0 mana/s {"blockHash":"0x1f0fffec4c566777f068f9020dcbc2358028d84bcf2811c5fafe4a312b9a866e","globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750266292,"version":3542590205},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":340.3641060000009,"publicProcessDuration":4.979514000000563,"rollupCircuitsDuration":281.31632100000024,"txCount":0,"blockNumber":1,"blockTimestamp":1750266292,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 17:01:43 [17:01:43.340] VERBOSE: sequencer Attesting committee is empty 17:01:43 [17:01:43.372] INFO: blob-sink:client:prover-node Testing configured blob sources {"blobSinkUrl":"http://localhost:43111"} 17:01:43 [17:01:43.387] INFO: blob-sink:client:prover-node Blob sink is reachable {"blobSinkUrl":"http://localhost:43111"} 17:01:43 [17:01:43.388] WARN: blob-sink:client:prover-node No L1 consensus host urls configured 17:01:43 [17:01:43.388] WARN: blob-sink:client:prover-node No archive client configured 17:01:43 [17:01:43.393] INFO: archiver:prover-node Starting archiver sync to rollup contract 0xe6053f00e88413519a7853afff55d60fe23c339c from L1 block 22 to current L1 block 25 with hash 0x8d68532bb51a75f0370c0f1d9a40be7f4309440f4c60957d0eea2b36e0cf3b1d {"blocksSynchedTo":22,"messagesSynchedTo":{"l1BlockHash":"0x4f075a2ffa1e7131b3b5076e71c6d9b735634ebd603f7bc12c8d854bb71f94e4","l1BlockNumber":22}} 17:01:43 [17:01:43.477] INFO: archiver:prover-node Initial archiver sync to L1 block 25 complete. {"l1BlockNumber":25,"syncPoint":{"blocksSynchedTo":25},"latest":{"number":0},"proven":{"number":0},"finalized":{"number":0}} 17:01:43 [17:01:43.484] INFO: prover-node:blob-sink:client:prover-node Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:43111"} 17:01:43 [17:01:43.484] VERBOSE: prover-node:prover-node Snapshot sync is disabled. No snapshots URL provided. 17:01:43 [17:01:43.488] VERBOSE: prover-node:prover-node Created archiver and synced to block 0 17:01:43 [17:01:43.504] INFO: world-state:database:prover-node Creating world state data store at directory /tmp/e014e02d99e23e1f/20becafa7932d028/world_state with map sizes {"archiveTreeMapSizeKb":134217728,"nullifierTreeMapSizeKb":134217728,"noteHashTreeMapSizeKb":134217728,"messageTreeMapSizeKb":134217728,"publicDataTreeMapSizeKb":134217728} and 2 threads. 17:01:43 [17:01:43.557] INFO: world_state:prover-node Created world state synchroniser with block history of 2 17:01:43 [17:01:43.559] VERBOSE: world-state:block_stream:prover-node Starting L2 block stream {"proven":false,"pollIntervalMS":50} 17:01:43 [17:01:43.559] INFO: world_state:prover-node Started world state synchronizer from block 1 17:01:43 [17:01:43.563] VERBOSE: world-state:block_stream:prover-node Starting sync from block number 0 17:01:43 [17:01:43.564] WARN: prover-client:proving-broker-database:prover-node Found invalid epoch directory /tmp/e014e02d99e23e1f/20becafa7932d028/archiver when loading epoch databases, ignoring 17:01:43 [17:01:43.564] WARN: prover-client:proving-broker-database:prover-node Found invalid epoch directory /tmp/e014e02d99e23e1f/20becafa7932d028/world_state when loading epoch databases, ignoring 17:01:43 [17:01:43.565] INFO: prover-client:proving-broker:prover-node Proving Broker started 17:01:43 [17:01:43.582] INFO: prover-node:prover-coordination:prover-node Using prover coordination via aztec node 17:01:43 [17:01:43.584] INFO: e2e:e2e_epochs:epochs_upload_failed_proof:prover-node Created and synced prover node {"publisherAddress":"0x3C44CdDdB6a900fa2b585dd299e03d12FA4293BC"} 17:01:43 [17:01:43.586] INFO: prover-node:epoch-monitor:prover-node Started EpochMonitor {"pollingIntervalMs":200} 17:01:43 [17:01:43.592] INFO: prover-node:prover-node Started Prover Node with prover id 0x0000000000000000000000000000000000000000000000000000000000000001 {"proverNodePollingIntervalMs":200,"proverNodeMaxPendingJobs":10,"proverNodeMaxParallelBlocksPerEpoch":32,"txGatheringIntervalMs":1000,"txGatheringBatchSize":10,"txGatheringMaxParallelRequestsPerNode":100,"proverNodeFailedEpochStore":"file:///tmp/failed-proofs-odaAmF","dataDirectory":"/tmp/e014e02d99e23e1f/20becafa7932d028","l1ChainId":31337,"rollupVersion":3542590205} 17:01:43 [17:01:43.592] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating a pxe... 17:01:43 [17:01:43.615] INFO: pxe:data:lmdb Creating pxe_data data store at directory /tmp/27bfe4b2199a878d/pxe_data with map size 134217728 KB (LMDB v2) 17:01:43 [17:01:43.635] INFO: pxe:data:lmdb Starting data store with maxReaders 16 17:01:44 [17:01:44.173] VERBOSE: pxe:service Registered protocol contracts in pxe {"AuthRegistry":"0x0000000000000000000000000000000000000000000000000000000000000001","ContractInstanceDeployer":"0x0000000000000000000000000000000000000000000000000000000000000002","ContractClassRegisterer":"0x0000000000000000000000000000000000000000000000000000000000000003","MultiCallEntrypoint":"0x0000000000000000000000000000000000000000000000000000000000000004","FeeJuice":"0x0000000000000000000000000000000000000000000000000000000000000005","Router":"0x0000000000000000000000000000000000000000000000000000000000000006"} 17:01:44 [17:01:44.175] INFO: pxe:service Started PXE connected to chain 31337 version 3542590205 17:01:44 [17:01:44.187] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L2 genesis at L1 block 22 (timestamp 1750266260) 17:01:44 [17:01:44.188] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting until L1 timestamp 1750266324 is reached as the start of epoch 1 17:01:44 [17:01:44.414] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 25 mined at 17:04:44 with new L2 block 0 for epoch 0 with proof up to L2 block 0 for epoch 0 {"l1Timestamp":1750266284,"l1BlockNumber":25,"l2SlotNumber":1,"l2BlockNumber":0,"l2ProvenBlockNumber":0,"totalL2Messages":0} 17:01:46 [17:01:46.744] VERBOSE: ethereum:tx_delayer Sent tx immediately 0x13f65f91e378d445133a99dea1b5fb148bb6336e55db38c8fd95faf40a0b3884 17:01:46 [17:01:46.745] VERBOSE: node:MAIN-aztec-node Sent L1 transaction 0x13f65f91e378d445133a99dea1b5fb148bb6336e55db38c8fd95faf40a0b3884 {"gasLimit":470530,"maxFeePerGas":"500","maxPriorityFeePerGas":"500","maxFeePerBlobGas":"0.000000001"} 17:01:49 [17:01:49.180] INFO: sequencer:publisher Bundled [propose] transaction [succeeded] 17:01:49 [17:01:49.181] VERBOSE: sequencer:publisher Published L2 block to L1 rollup contract {"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0x13f65f91e378d445133a99dea1b5fb148bb6336e55db38c8fd95faf40a0b3884","calldataSize":1220,"calldataGas":8816,"txCount":0,"blockNumber":1,"blockTimestamp":1750266292,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 17:01:49 [17:01:49.183] VERBOSE: node:blob-sink:client Sending 1 blobs to blob sink 17:01:49 [17:01:49.213] INFO: blob-sink:server Received blob sidecar for block 0x9beafe670b0f51004225ca265f2f9f8485788f5411ebe4f6e1d9295562129d4a 17:01:49 [17:01:49.229] INFO: blob-sink:server Blob sidecar stored successfully for block 0x9beafe670b0f51004225ca265f2f9f8485788f5411ebe4f6e1d9295562129d4a 17:01:49 [17:01:49.272] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 26 mined at 17:04:52 with new L2 block 1 for epoch 0 {"l1Timestamp":1750266292,"l1BlockNumber":26,"l2SlotNumber":2,"l2BlockNumber":1,"l2ProvenBlockNumber":0,"totalL2Messages":0} 17:01:49 [17:01:49.377] INFO: archiver:prover-node Downloaded L2 block 1 {"blockHash":"0x1f0fffec4c566777f068f9020dcbc2358028d84bcf2811c5fafe4a312b9a866e","blockNumber":1,"txCount":0,"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750266292,"version":3542590205},"archiveRoot":"0x0f936d2c6f037ac8d73d442ccd2f49eca76f161f5ae52ecd9af747b310d24bfb","archiveNextLeafIndex":2} 17:01:49 [17:01:49.379] INFO: archiver Downloaded L2 block 1 {"blockHash":"0x1f0fffec4c566777f068f9020dcbc2358028d84bcf2811c5fafe4a312b9a866e","blockNumber":1,"txCount":0,"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750266292,"version":3542590205},"archiveRoot":"0x0f936d2c6f037ac8d73d442ccd2f49eca76f161f5ae52ecd9af747b310d24bfb","archiveNextLeafIndex":2} 17:01:49 [17:01:49.409] INFO: world_state World state updated with L2 block 1 {"eventName":"l2-block-handled","duration":4.760909000000538,"unfinalisedBlockNumber":1,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":1,"blockTimestamp":1750266292,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 17:01:49 [17:01:49.433] INFO: world_state:prover-node World state updated with L2 block 1 {"eventName":"l2-block-handled","duration":4.790899999999965,"unfinalisedBlockNumber":1,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":1,"blockTimestamp":1750266292,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 17:01:49 [17:01:49.500] VERBOSE: p2p Synched to latest block 1 17:01:49 [17:01:49.608] VERBOSE: prover-node:prover-node Fetching 0 tx hashes for block number 1 from coordination 17:01:49 [17:01:49.609] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 17:01:57 [17:01:57.262] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 27 mined at 17:05:00 {"l1Timestamp":1750266300,"l1BlockNumber":27,"l2SlotNumber":2,"l2BlockNumber":1,"l2ProvenBlockNumber":0,"totalL2Messages":0} 17:01:57 [17:01:57.402] VERBOSE: sequencer Preparing proposal for block 2 at slot 3 {"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750266308,"version":3542590205},"chainTipArchive":"0x0f936d2c6f037ac8d73d442ccd2f49eca76f161f5ae52ecd9af747b310d24bfb","blockNumber":2,"slot":3} 17:01:57 [17:01:57.415] VERBOSE: block-builder Building block 2 for slot 3 {"slot":3,"slotStart":"2025-06-18T17:05:08.000Z","now":"2025-06-18T17:05:00.288Z","blockNumber":2,"msgCount":0,"opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}} 17:01:57 [17:01:57.418] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.0003126780000020517s {"duration":0.0003126780000020517,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 17:01:57 [17:01:57.444] INFO: sequencer Built block 2 for slot 3 with 0 txs and 0 messages. 0 mana/s {"blockHash":"0x06007433cea58e5a310c8057cbcb10ca97890db5fbf7c63138c0b82060dd2954","globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750266308,"version":3542590205},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":35.87972499999887,"publicProcessDuration":0.7388989999999467,"rollupCircuitsDuration":29.314171000001807,"txCount":0,"blockNumber":2,"blockTimestamp":1750266308,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 17:01:57 [17:01:57.449] VERBOSE: sequencer Attesting committee is empty 17:01:57 [17:01:57.593] VERBOSE: ethereum:tx_delayer Sent tx immediately 0xd2457d9fc572cdde405241c4fbbe5cdd78f210a9b442c13fff602b67f0a5cbb1 17:01:57 [17:01:57.594] VERBOSE: node:MAIN-aztec-node Sent L1 transaction 0xd2457d9fc572cdde405241c4fbbe5cdd78f210a9b442c13fff602b67f0a5cbb1 {"gasLimit":391172,"maxFeePerGas":"1.26593145","maxPriorityFeePerGas":"1.2","maxFeePerBlobGas":"0.000000001"} 17:02:05 [17:02:05.187] INFO: sequencer:publisher Bundled [propose] transaction [succeeded] 17:02:05 [17:02:05.188] VERBOSE: sequencer:publisher Published L2 block to L1 rollup contract {"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0xd2457d9fc572cdde405241c4fbbe5cdd78f210a9b442c13fff602b67f0a5cbb1","calldataSize":1220,"calldataGas":8816,"txCount":0,"blockNumber":2,"blockTimestamp":1750266308,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 17:02:05 [17:02:05.189] VERBOSE: node:blob-sink:client Sending 1 blobs to blob sink 17:02:05 [17:02:05.196] INFO: blob-sink:server Received blob sidecar for block 0x11444a63076b988ab29188331e7f5a371dd369d01c00c96f810e9caa5920e65e 17:02:05 [17:02:05.203] INFO: blob-sink:server Blob sidecar stored successfully for block 0x11444a63076b988ab29188331e7f5a371dd369d01c00c96f810e9caa5920e65e 17:02:05 [17:02:05.297] INFO: archiver Downloaded L2 block 2 {"blockHash":"0x06007433cea58e5a310c8057cbcb10ca97890db5fbf7c63138c0b82060dd2954","blockNumber":2,"txCount":0,"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750266308,"version":3542590205},"archiveRoot":"0x1eb22cc7ab5e629c99e4abb093f8cef8763cb248596248fa5e1a6685d7e4fb31","archiveNextLeafIndex":3} 17:02:05 [17:02:05.330] INFO: archiver:prover-node Downloaded L2 block 2 {"blockHash":"0x06007433cea58e5a310c8057cbcb10ca97890db5fbf7c63138c0b82060dd2954","blockNumber":2,"txCount":0,"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750266308,"version":3542590205},"archiveRoot":"0x1eb22cc7ab5e629c99e4abb093f8cef8763cb248596248fa5e1a6685d7e4fb31","archiveNextLeafIndex":3} 17:02:05 [17:02:05.343] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 28 mined at 17:05:08 with new L2 block 2 for epoch 0 {"l1Timestamp":1750266308,"l1BlockNumber":28,"l2SlotNumber":3,"l2BlockNumber":2,"l2ProvenBlockNumber":0,"totalL2Messages":0} 17:02:05 [17:02:05.360] INFO: world_state World state updated with L2 block 2 {"eventName":"l2-block-handled","duration":5.304592000000412,"unfinalisedBlockNumber":2,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":2,"blockTimestamp":1750266308,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 17:02:05 [17:02:05.384] INFO: world_state:prover-node World state updated with L2 block 2 {"eventName":"l2-block-handled","duration":4.322288000003027,"unfinalisedBlockNumber":2,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":2,"blockTimestamp":1750266308,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 17:02:05 [17:02:05.389] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 17:02:05 [17:02:05.389] VERBOSE: prover-node:prover-node Gathered all 0 txs for epoch 0 {"epochNumber":0} 17:02:05 [17:02:05.392] VERBOSE: prover-node:prover-node Gathered all 0 messages for epoch 0 {"epochNumber":0} 17:02:05 [17:02:05.393] VERBOSE: prover-node:prover-node Gathered previous block header 0 for epoch 0 17:02:05 [17:02:05.393] VERBOSE: prover-node:prover-node Creating proving job for epoch 0 for block range 1 to 2 17:02:05 [17:02:05.397] INFO: prover-node:epoch-proving-job Starting epoch 0 proving job with blocks 1 to 2 {"fromBlock":1,"toBlock":2,"epochSizeBlocks":2,"epochNumber":0,"uuid":"25318205-6f74-468f-ad07-ea4336227fa9"} 17:02:05 [17:02:05.414] INFO: prover-client:orchestrator Starting epoch 0 with 2 blocks 17:02:05 [17:02:05.414] VERBOSE: prover-client:broker-circuit-prover-facade Starting BrokerCircuitProverFacade 17:02:05 [17:02:05.416] VERBOSE: prover-node:epoch-proving-job Starting processing block 1 {"number":1,"blockHash":"0x1f0fffec4c566777f068f9020dcbc2358028d84bcf2811c5fafe4a312b9a866e","lastArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"25318205-6f74-468f-ad07-ea4336227fa9","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x00000000000000000000000000000000000000000000000000000000d327a2fd","blockNumber":1,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 17:02:05 [17:02:05.417] INFO: prover-client:orchestrator Starting block 1 for slot 2 17:02:05 [17:02:05.417] VERBOSE: prover-node:epoch-proving-job Starting processing block 2 {"number":2,"blockHash":"0x06007433cea58e5a310c8057cbcb10ca97890db5fbf7c63138c0b82060dd2954","lastArchive":"0x0f936d2c6f037ac8d73d442ccd2f49eca76f161f5ae52ecd9af747b310d24bfb","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"25318205-6f74-468f-ad07-ea4336227fa9","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x00000000000000000000000000000000000000000000000000000000d327a2fd","blockNumber":2,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000003","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 17:02:05 [17:02:05.417] INFO: prover-client:orchestrator Starting block 2 for slot 3 17:02:05 [17:02:05.434] INFO: prover-client:proving-broker:prover-node New proving job id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a epochNumber=0 {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a"} 17:02:05 [17:02:05.435] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 17:02:05 [17:02:05.435] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 17:02:05 [17:02:05.436] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 17:02:05 [17:02:05.439] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000024099999995087273s {"duration":0.000024099999995087273,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 17:02:05 [17:02:05.440] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 17:02:05 [17:02:05.442] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 1 {"blockNumber":1,"blockHash":"0x1f0fffec4c566777f068f9020dcbc2358028d84bcf2811c5fafe4a312b9a866e","uuid":"25318205-6f74-468f-ad07-ea4336227fa9"} 17:02:05 [17:02:05.443] VERBOSE: prover-client:orchestrator Block 1 completed. Assembling header. 17:02:05 [17:02:05.447] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 17:02:05 [17:02:05.447] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 17:02:05 [17:02:05.448] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 17:02:05 [17:02:05.448] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 17:02:05 [17:02:05.454] VERBOSE: prover-client:orchestrator Updating archive tree with block 1 header 0x1f0fffec4c566777f068f9020dcbc2358028d84bcf2811c5fafe4a312b9a866e 17:02:05 [17:02:05.457] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000018660000001545995s {"duration":0.000018660000001545995,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 17:02:05 [17:02:05.458] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 17:02:05 [17:02:05.458] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 2 {"blockNumber":2,"blockHash":"0x06007433cea58e5a310c8057cbcb10ca97890db5fbf7c63138c0b82060dd2954","uuid":"25318205-6f74-468f-ad07-ea4336227fa9"} 17:02:05 [17:02:05.459] VERBOSE: prover-client:orchestrator Block 2 completed. Assembling header. 17:02:05 [17:02:05.460] VERBOSE: prover-client:orchestrator Orchestrator finalised block 1 17:02:05 [17:02:05.472] VERBOSE: p2p Synched to latest block 2 17:02:05 [17:02:05.479] VERBOSE: prover-client:orchestrator Updating archive tree with block 2 header 0x06007433cea58e5a310c8057cbcb10ca97890db5fbf7c63138c0b82060dd2954 17:02:05 [17:02:05.484] VERBOSE: prover-client:orchestrator Orchestrator finalised block 2 17:02:05 [17:02:05.503] INFO: prover-client:proving-broker-database:prover-node Creating broker database for epoch 0 at /tmp/e014e02d99e23e1f/20becafa7932d028/0 with map size 134217728 17:02:05 [17:02:05.515] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:02:05 [17:02:05.522] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY epochNumber=0 {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...","status":"not-found","numOutstandingJobs":1} 17:02:05 [17:02:05.551] INFO: prover-client:proving-agent:prover-node Starting job id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input... 17:02:05 [17:02:05.568] INFO: prover-client:proving-agent:job-controller-0210353c Job controller started jobId=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a {"jobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a"} 17:02:05 [17:02:05.653] VERBOSE: prover-node:prover-node Fetching 0 tx hashes for block number 2 from coordination 17:02:05 [17:02:05.653] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 17:02:05 [17:02:05.736] INFO: prover-client:proving-agent:prover-node Job id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22resul... 17:02:05 [17:02:05.737] INFO: prover-client:proving-broker:prover-node Proving job complete id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY totalAttempts=1 {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a"} 17:02:06 [17:02:06.416] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 17:02:06 [17:02:06.420] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY 17:02:06 [17:02:06.420] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 17:02:06 [17:02:06.445] INFO: prover-client:proving-broker:prover-node New proving job id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa epochNumber=0 {"provingJobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa"} 17:02:06 [17:02:06.452] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY {"provingJobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa","provingJobType":"ROOT_PARITY"} 17:02:06 [17:02:06.497] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY epochNumber=0 {"provingJobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa","provingJobType":"ROOT_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu...","status":"not-found","numOutstandingJobs":1} 17:02:06 [17:02:06.500] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Triggering error on finaliseEpoch 17:02:06 [17:02:06.516] ERROR: prover-node:epoch-proving-job Error running epoch 0 prover job: Error: Fake error while proving epoch 17:02:06 at ServerEpochProver.epochProver.finaliseEpoch (/home/aztec-dev/aztec-packages/yarn-project/end-to-end/src/e2e_epochs/epochs_upload_failed_proof.test.ts:60:15) 17:02:06 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:142:64) 17:02:06 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) {"uuid":"25318205-6f74-468f-ad07-ea4336227fa9","epochNumber":0} 17:02:06 [17:02:06.517] VERBOSE: prover-client:broker-circuit-prover-facade Stopping BrokerCircuitProverFacade 17:02:06 [17:02:06.518] ERROR: prover-client:broker-circuit-prover-facade Job errored with 'Broker facade stopped' id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY: { 17:02:06 provingJobId: '0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa', 17:02:06 provingJobType: 'ROOT_PARITY' 17:02:06 } 17:02:06 [17:02:06.519] INFO: prover-client:proving-broker:prover-node Cancelling job id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa {"provingJobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa"} 17:02:06 [17:02:06.519] WARN: prover-client:proving-broker:prover-node Proving job id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY not in the in-progress set {"provingJobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa"} 17:02:06 [17:02:06.520] INFO: prover-client:proving-broker:prover-node Marking proving job as failed id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY totalAttempts=1 err=Aborted {"provingJobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa"} 17:02:06 [17:02:06.521] ERROR: prover-client:orchestrator Error thrown when proving job: Error: Broker facade stopped 17:02:06 at BrokerCircuitProverFacade.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/proving_broker/broker_prover_facade.js:142:31) 17:02:06 at ServerEpochProver.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/prover-client/server-epoch-prover.js:31:9) 17:02:06 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:183:13) 17:02:06 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) 17:02:06 [17:02:06.521] ERROR: prover-client:orchestrator Error thrown when proving job: Error: Broker facade stopped 17:02:06 at BrokerCircuitProverFacade.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/proving_broker/broker_prover_facade.js:142:31) 17:02:06 at ServerEpochProver.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/prover-client/server-epoch-prover.js:31:9) 17:02:06 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:183:13) 17:02:06 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) 17:02:06 [17:02:06.522] ERROR: prover-node:prover-node Job for 0 exited with state failed: { 17:02:06 id: '25318205-6f74-468f-ad07-ea4336227fa9', 17:02:06 epochNumber: 0n, 17:02:06 state: 'failed' 17:02:06 } 17:02:06 [17:02:06.522] WARN: prover-node:prover-node Uploading epoch proof failure for 0 to file:///tmp/failed-proofs-odaAmF {"epochNumber":0,"jobId":"25318205-6f74-468f-ad07-ea4336227fa9","location":"file:///tmp/failed-proofs-odaAmF"} 17:02:06 [17:02:06.526] INFO: stdlib:file-store Creating local file file store at /tmp/failed-proofs-odaAmF 17:02:06 [17:02:06.537] INFO: prover-node:prover-node Pausing archiver and world state sync to start snapshot upload 17:02:06 [17:02:06.541] INFO: archiver:prover-node Stopped. 17:02:06 [17:02:06.541] INFO: world_state:prover-node Stopped sync 17:02:06 [17:02:06.541] INFO: prover-node:prover-node Creating backups of lmdb environments to /tmp/e014e02d99e23e1f/20becafa7932d028/epoch-proof-data-TKxGt8 17:02:06 [17:02:06.549] INFO: prover-node:prover-node Data stores backed up to /tmp/e014e02d99e23e1f/20becafa7932d028/epoch-proof-data-TKxGt8 {"paths":{"l1-to-l2-message-tree":"/tmp/e014e02d99e23e1f/20becafa7932d028/epoch-proof-data-TKxGt8/world-state/L1ToL2MessageTree/data.mdb","archive-tree":"/tmp/e014e02d99e23e1f/20becafa7932d028/epoch-proof-data-TKxGt8/world-state/ArchiveTree/data.mdb","public-data-tree":"/tmp/e014e02d99e23e1f/20becafa7932d028/epoch-proof-data-TKxGt8/world-state/PublicDataTree/data.mdb","note-hash-tree":"/tmp/e014e02d99e23e1f/20becafa7932d028/epoch-proof-data-TKxGt8/world-state/NoteHashTree/data.mdb","nullifier-tree":"/tmp/e014e02d99e23e1f/20becafa7932d028/epoch-proof-data-TKxGt8/world-state/NullifierTree/data.mdb","archiver":"/tmp/e014e02d99e23e1f/20becafa7932d028/epoch-proof-data-TKxGt8/archiver/data.mdb"}} 17:02:06 [17:02:06.550] INFO: prover-node:prover-node Resuming archiver and world state sync 17:02:06 [17:02:06.550] VERBOSE: world-state:block_stream:prover-node Starting L2 block stream {"proven":false,"pollIntervalMS":50} 17:02:06 [17:02:06.550] INFO: world_state:prover-node Resumed sync 17:02:06 [17:02:06.551] INFO: archiver:prover-node Restarting archiver 17:02:06 [17:02:06.565] WARN: prover-node:prover-node Uploaded epoch 0 proof failure data to file:///tmp/failed-proofs-odaAmF/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618170206-25318205-6f74-468f-ad07-ea4336227fa9 {"epochNumber":0,"location":"file:///tmp/failed-proofs-odaAmF","basePath":"aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618170206-25318205-6f74-468f-ad07-ea4336227fa9","metadataUrl":"file:///tmp/failed-proofs-odaAmF/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618170206-25318205-6f74-468f-ad07-ea4336227fa9/metadata.json","dataUrl":"file:///tmp/failed-proofs-odaAmF/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618170206-25318205-6f74-468f-ad07-ea4336227fa9/data.bin","metadata":{"l1BlockNumber":28,"l2BlockHash":"0x06007433cea58e5a310c8057cbcb10ca97890db5fbf7c63138c0b82060dd2954","l2BlockNumber":2,"schemaVersions":{"archiver":3,"worldState":2},"timestamp":1750266126551,"dataUrls":{"l1-to-l2-message-tree":"file:///tmp/failed-proofs-odaAmF/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618170206-25318205-6f74-468f-ad07-ea4336227fa9/l1-to-l2-message-tree.db","archive-tree":"file:///tmp/failed-proofs-odaAmF/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618170206-25318205-6f74-468f-ad07-ea4336227fa9/archive-tree.db","public-data-tree":"file:///tmp/failed-proofs-odaAmF/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618170206-25318205-6f74-468f-ad07-ea4336227fa9/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-odaAmF/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618170206-25318205-6f74-468f-ad07-ea4336227fa9/note-hash-tree.db","nullifier-tree":"file:///tmp/failed-proofs-odaAmF/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618170206-25318205-6f74-468f-ad07-ea4336227fa9/nullifier-tree.db","archiver":"file:///tmp/failed-proofs-odaAmF/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618170206-25318205-6f74-468f-ad07-ea4336227fa9/archiver.db"}},"jobId":"25318205-6f74-468f-ad07-ea4336227fa9"} 17:02:06 [17:02:06.566] INFO: prover-node:prover-node Cleaning up backup dir /tmp/e014e02d99e23e1f/20becafa7932d028/epoch-proof-data-TKxGt8 17:02:13 [17:02:13.190] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 29 mined at 17:05:16 {"l1Timestamp":1750266316,"l1BlockNumber":29,"l2SlotNumber":3,"l2BlockNumber":2,"l2ProvenBlockNumber":0,"totalL2Messages":0} 17:02:13 [17:02:13.217] INFO: prover-node:prover-node Stopping ProverNode 17:02:13 [17:02:13.217] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 17:02:13 [17:02:13.218] INFO: archiver:prover-node Stopped. 17:02:13 [17:02:13.221] INFO: world_state:prover-node Stopped world state synchronizer 17:02:13 [17:02:13.222] INFO: prover-node:prover-node Stopped ProverNode 17:02:13 [17:02:13.222] INFO: node:MAIN-aztec-node Stopping Aztec Node 17:02:13 [17:02:13.421] VERBOSE: sequencer Preparing proposal for block 3 at slot 4 {"globalVariables":{"blockNumber":3,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":4,"timestamp":1750266324,"version":3542590205},"chainTipArchive":"0x1eb22cc7ab5e629c99e4abb093f8cef8763cb248596248fa5e1a6685d7e4fb31","blockNumber":3,"slot":4} 17:02:13 [17:02:13.439] VERBOSE: block-builder Building block 3 for slot 4 {"slot":4,"slotStart":"2025-06-18T17:05:24.000Z","now":"2025-06-18T17:05:16.312Z","blockNumber":3,"msgCount":0,"opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}} 17:02:13 [17:02:13.447] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.003450305999998818s {"duration":0.003450305999998818,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 17:02:13 [17:02:13.485] INFO: sequencer Built block 3 for slot 4 with 0 txs and 0 messages. 0 mana/s {"blockHash":"0x084960789d186231ec624b9b7c02cb9156c2c5f23950d34151f372238f249f08","globalVariables":{"blockNumber":3,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":4,"timestamp":1750266324,"version":3542590205},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":52.81119200000103,"publicProcessDuration":4.001569000000018,"rollupCircuitsDuration":46.42267199999333,"txCount":0,"blockNumber":3,"blockTimestamp":1750266324,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 17:02:13 [17:02:13.490] VERBOSE: sequencer Attesting committee is empty 17:02:13 [17:02:13.586] VERBOSE: ethereum:tx_delayer Sent tx immediately 0x3a710e16b20ab6016e4889e67c8765a1ab2939dfe0af268479592c2153b459e0 17:02:13 [17:02:13.586] VERBOSE: node:MAIN-aztec-node Sent L1 transaction 0x3a710e16b20ab6016e4889e67c8765a1ab2939dfe0af268479592c2153b459e0 {"gasLimit":464731,"maxFeePerGas":"1.250606201","maxPriorityFeePerGas":"1.2","maxFeePerBlobGas":"0.000000001"} 17:02:15 [17:02:15.224] INFO: slasher Slasher client stopped. 17:02:21 [17:02:21.153] INFO: sequencer:publisher Bundled [propose] transaction [succeeded] 17:02:21 [17:02:21.153] VERBOSE: sequencer:publisher Published L2 block to L1 rollup contract {"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0x3a710e16b20ab6016e4889e67c8765a1ab2939dfe0af268479592c2153b459e0","calldataSize":1220,"calldataGas":8816,"txCount":0,"blockNumber":3,"blockTimestamp":1750266324,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 17:02:21 [17:02:21.154] VERBOSE: node:blob-sink:client Sending 1 blobs to blob sink 17:02:21 [17:02:21.158] INFO: sequencer Stopped sequencer 17:02:21 [17:02:21.158] INFO: p2p P2P client stopped 17:02:21 [17:02:21.160] WARN: archiver Failed to reach L2 block 3 at 29 (latest is 2). Rolling back last synched L1 block number to 28. {"latestLocalL2BlockNumber":2,"latestLocalL2BlockArchive":"0x1eb22cc7ab5e629c99e4abb093f8cef8763cb248596248fa5e1a6685d7e4fb31","blocksSynchedTo":28,"currentL1BlockNumber":29,"provenBlockNumber":0,"provenArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","pendingBlockNumber":3,"pendingArchive":"0x28ea1c37bd87dedf406a8ee53a76ee0c340f0d8a64a7aa2cc2d68e49633606d9"} 17:02:21 [17:02:21.169] INFO: blob-sink:server Received blob sidecar for block 0x4405d5d3a0e8d5fb748c177381976734fe6270a82043efc183306c2d643fcd9b 17:02:21 [17:02:21.172] INFO: world_state Stopped world state synchronizer 17:02:21 [17:02:21.172] INFO: archiver Stopped. 17:02:21 [17:02:21.172] INFO: node:MAIN-aztec-node Stopped Aztec Node 17:02:21 [17:02:21.175] INFO: blob-sink:server Blob sidecar stored successfully for block 0x4405d5d3a0e8d5fb748c177381976734fe6270a82043efc183306c2d643fcd9b 17:02:21 [17:02:21.179] INFO: node:MAIN-aztec-node Stopping Aztec Node 17:02:23 [17:02:23.180] INFO: slasher Slasher client stopped. 17:02:23 [17:02:23.181] WARN: validator Running promise was not started 17:02:23 [17:02:23.181] WARN: sequencer Running promise was not started 17:02:23 [17:02:23.182] INFO: sequencer Stopped sequencer 17:02:23 [17:02:23.182] WARN: p2p:l2-block-stream Running promise was not started 17:02:23 [17:02:23.182] INFO: p2p P2P client stopped 17:02:23 [17:02:23.182] WARN: world-state:block_stream Running promise was not started 17:02:23 [17:02:23.183] INFO: world_state Stopped world state synchronizer 17:02:23 [17:02:23.183] WARN: archiver Running promise was not started 17:02:23 [17:02:23.183] INFO: archiver Stopped. 17:02:23 [17:02:23.183] INFO: node:MAIN-aztec-node Stopped Aztec Node 17:02:23 [17:02:23.183] INFO: prover-node:prover-node Stopping ProverNode 17:02:23 [17:02:23.183] WARN: prover-node:prover-node Running promise was not started 17:02:23 [17:02:23.184] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 17:02:23 [17:02:23.184] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 17:02:23 [17:02:23.184] WARN: archiver:prover-node Running promise was not started 17:02:23 [17:02:23.184] INFO: archiver:prover-node Stopped. 17:02:23 [17:02:23.188] WARN: world-state:block_stream:prover-node Running promise was not started 17:02:23 [17:02:23.189] INFO: world_state:prover-node Stopped world state synchronizer 17:02:23 [17:02:23.190] INFO: prover-node:prover-node Stopped ProverNode 17:02:23 [17:02:23.211] INFO: blob-sink:server Stopping blob sink 17:02:23 [17:02:23.217] INFO: blob-sink:server Blob sink stopped 17:02:23 [17:02:23.237] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data and state {"uploadPath":"/tmp/failed-proofs-odaAmF","rerunDataDir":"/tmp/rerun-data-NJpru3","rerunDownloadPath":"/tmp/rerun-download-9LYdNc/data.bin"} 17:02:23 [17:02:23.238] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data from file:///tmp/failed-proofs-odaAmF/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618170206-25318205-6f74-468f-ad07-ea4336227fa9 17:02:23 [17:02:23.238] INFO: stdlib:file-store Creating local file file store at /tmp/failed-proofs-odaAmF/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618170206-25318205-6f74-468f-ad07-ea4336227fa9 17:02:23 [17:02:23.240] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading state snapshot from file:///tmp/failed-proofs-odaAmF/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618170206-25318205-6f74-468f-ad07-ea4336227fa9 to local data directory {"metadata":{"l2BlockNumber":2,"l2BlockHash":"0x06007433cea58e5a310c8057cbcb10ca97890db5fbf7c63138c0b82060dd2954","l1BlockNumber":28,"l1ChainId":31337,"rollupVersion":3542590205,"rollupAddress":"0xe6053f00e88413519a7853afff55d60fe23c339c"},"dataUrls":{"archiver":"file:///tmp/failed-proofs-odaAmF/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618170206-25318205-6f74-468f-ad07-ea4336227fa9/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-odaAmF/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618170206-25318205-6f74-468f-ad07-ea4336227fa9/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-odaAmF/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618170206-25318205-6f74-468f-ad07-ea4336227fa9/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-odaAmF/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618170206-25318205-6f74-468f-ad07-ea4336227fa9/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-odaAmF/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618170206-25318205-6f74-468f-ad07-ea4336227fa9/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-odaAmF/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618170206-25318205-6f74-468f-ad07-ea4336227fa9/l1-to-l2-message-tree.db"}} 17:02:23 [17:02:23.241] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Creating local file file store at /tmp/failed-proofs-odaAmF/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618170206-25318205-6f74-468f-ad07-ea4336227fa9 17:02:23 [17:02:23.241] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading snapshot to /tmp/rerun-data-NJpru3/download-tdwdlT {"snapshot":{"dataUrls":{"archiver":"file:///tmp/failed-proofs-odaAmF/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618170206-25318205-6f74-468f-ad07-ea4336227fa9/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-odaAmF/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618170206-25318205-6f74-468f-ad07-ea4336227fa9/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-odaAmF/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618170206-25318205-6f74-468f-ad07-ea4336227fa9/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-odaAmF/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618170206-25318205-6f74-468f-ad07-ea4336227fa9/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-odaAmF/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618170206-25318205-6f74-468f-ad07-ea4336227fa9/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-odaAmF/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618170206-25318205-6f74-468f-ad07-ea4336227fa9/l1-to-l2-message-tree.db"}},"downloadPaths":{"archiver":"/tmp/rerun-data-NJpru3/download-tdwdlT/archiver.db","nullifier-tree":"/tmp/rerun-data-NJpru3/download-tdwdlT/nullifier-tree.db","public-data-tree":"/tmp/rerun-data-NJpru3/download-tdwdlT/public-data-tree.db","note-hash-tree":"/tmp/rerun-data-NJpru3/download-tdwdlT/note-hash-tree.db","archive-tree":"/tmp/rerun-data-NJpru3/download-tdwdlT/archive-tree.db","l1-to-l2-message-tree":"/tmp/rerun-data-NJpru3/download-tdwdlT/l1-to-l2-message-tree.db"}} 17:02:23 [17:02:23.245] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Snapshot downloaded at /tmp/rerun-data-NJpru3/download-tdwdlT {"snapshot":{"dataUrls":{"archiver":"file:///tmp/failed-proofs-odaAmF/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618170206-25318205-6f74-468f-ad07-ea4336227fa9/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-odaAmF/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618170206-25318205-6f74-468f-ad07-ea4336227fa9/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-odaAmF/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618170206-25318205-6f74-468f-ad07-ea4336227fa9/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-odaAmF/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618170206-25318205-6f74-468f-ad07-ea4336227fa9/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-odaAmF/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618170206-25318205-6f74-468f-ad07-ea4336227fa9/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-odaAmF/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618170206-25318205-6f74-468f-ad07-ea4336227fa9/l1-to-l2-message-tree.db"}},"downloadPaths":{"archiver":"/tmp/rerun-data-NJpru3/download-tdwdlT/archiver.db","nullifier-tree":"/tmp/rerun-data-NJpru3/download-tdwdlT/nullifier-tree.db","public-data-tree":"/tmp/rerun-data-NJpru3/download-tdwdlT/public-data-tree.db","note-hash-tree":"/tmp/rerun-data-NJpru3/download-tdwdlT/note-hash-tree.db","archive-tree":"/tmp/rerun-data-NJpru3/download-tdwdlT/archive-tree.db","l1-to-l2-message-tree":"/tmp/rerun-data-NJpru3/download-tdwdlT/l1-to-l2-message-tree.db"}} 17:02:23 [17:02:23.247] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Archiver database set up from snapshot {"path":"/tmp/rerun-data-NJpru3/archiver","dbVersion":3,"rollupAddress":"0xe6053f00e88413519a7853afff55d60fe23c339c"} 17:02:23 [17:02:23.249] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database l1-to-l2-message-tree set up from snapshot {"path":"/tmp/rerun-data-NJpru3/world_state/L1ToL2MessageTree","dbVersion":2,"rollupAddress":"0xe6053f00e88413519a7853afff55d60fe23c339c"} 17:02:23 [17:02:23.249] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database archive-tree set up from snapshot {"path":"/tmp/rerun-data-NJpru3/world_state/ArchiveTree","dbVersion":2,"rollupAddress":"0xe6053f00e88413519a7853afff55d60fe23c339c"} 17:02:23 [17:02:23.250] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database public-data-tree set up from snapshot {"path":"/tmp/rerun-data-NJpru3/world_state/PublicDataTree","dbVersion":2,"rollupAddress":"0xe6053f00e88413519a7853afff55d60fe23c339c"} 17:02:23 [17:02:23.250] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database note-hash-tree set up from snapshot {"path":"/tmp/rerun-data-NJpru3/world_state/NoteHashTree","dbVersion":2,"rollupAddress":"0xe6053f00e88413519a7853afff55d60fe23c339c"} 17:02:23 [17:02:23.251] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database nullifier-tree set up from snapshot {"path":"/tmp/rerun-data-NJpru3/world_state/NullifierTree","dbVersion":2,"rollupAddress":"0xe6053f00e88413519a7853afff55d60fe23c339c"} 17:02:23 [17:02:23.251] INFO: e2e:e2e_epochs:epochs_upload_failed_proof P2P database cleared {"path":"/tmp/rerun-data-NJpru3/p2p"} 17:02:23 [17:02:23.252] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data from file:///tmp/failed-proofs-odaAmF/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618170206-25318205-6f74-468f-ad07-ea4336227fa9/data.bin to /tmp/rerun-download-9LYdNc/data.bin 17:02:23 [17:02:23.254] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Epoch proving job data for epoch 0 downloaded successfully 17:02:23 [17:02:23.254] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Rerunning proving job from /tmp/rerun-download-9LYdNc/data.bin 17:02:23 [17:02:23.255] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Using native ACVM binary at ../../noir/noir-repo/target/release/acvm with working directory /tmp/65bdf373/acvm 17:02:23 [17:02:23.256] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Loaded proving job data for epoch 0 17:02:23 [17:02:23.262] INFO: world-state:database Creating world state data store at directory /tmp/rerun-data-NJpru3/world_state with map sizes {"archiveTreeMapSizeKb":1048576,"nullifierTreeMapSizeKb":1048576,"noteHashTreeMapSizeKb":1048576,"messageTreeMapSizeKb":1048576,"publicDataTreeMapSizeKb":1048576} and 2 threads. 17:02:23 [17:02:23.287] INFO: archiver:lmdb Creating archiver data store at directory /tmp/rerun-data-NJpru3/archiver with map size 1048576 KB (LMDB v2) 17:02:23 [17:02:23.289] INFO: archiver:lmdb Starting data store with maxReaders 16 17:02:23 [17:02:23.293] WARN: prover-client:proving-broker-database Found invalid epoch directory /tmp/rerun-data-NJpru3/archiver when loading epoch databases, ignoring 17:02:23 [17:02:23.293] WARN: prover-client:proving-broker-database Found invalid epoch directory /tmp/rerun-data-NJpru3/world_state when loading epoch databases, ignoring 17:02:23 [17:02:23.294] INFO: prover-client:proving-broker Proving Broker started 17:02:23 [17:02:23.297] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Rerunning epoch proving job for epoch 0 17:02:23 [17:02:23.297] INFO: prover-node:epoch-proving-job Starting epoch 0 proving job with blocks 1 to 2 {"fromBlock":1,"toBlock":2,"epochSizeBlocks":2,"epochNumber":0,"uuid":"59053b06-251a-4e5e-830e-b9bab038c6d4"} 17:02:23 [17:02:23.315] INFO: prover-client:orchestrator Starting epoch 0 with 2 blocks 17:02:23 [17:02:23.316] VERBOSE: prover-client:broker-circuit-prover-facade Starting BrokerCircuitProverFacade 17:02:23 [17:02:23.319] VERBOSE: prover-node:epoch-proving-job Starting processing block 1 {"number":1,"blockHash":"0x1f0fffec4c566777f068f9020dcbc2358028d84bcf2811c5fafe4a312b9a866e","lastArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"59053b06-251a-4e5e-830e-b9bab038c6d4","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x00000000000000000000000000000000000000000000000000000000d327a2fd","blockNumber":1,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 17:02:23 [17:02:23.320] INFO: prover-client:orchestrator Starting block 1 for slot 2 17:02:23 [17:02:23.321] VERBOSE: prover-node:epoch-proving-job Starting processing block 2 {"number":2,"blockHash":"0x06007433cea58e5a310c8057cbcb10ca97890db5fbf7c63138c0b82060dd2954","lastArchive":"0x0f936d2c6f037ac8d73d442ccd2f49eca76f161f5ae52ecd9af747b310d24bfb","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"59053b06-251a-4e5e-830e-b9bab038c6d4","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x00000000000000000000000000000000000000000000000000000000d327a2fd","blockNumber":2,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000003","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 17:02:23 [17:02:23.322] INFO: prover-client:orchestrator Starting block 2 for slot 3 17:02:23 [17:02:23.340] INFO: prover-client:proving-broker New proving job id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a epochNumber=0 {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a"} 17:02:23 [17:02:23.342] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 17:02:23 [17:02:23.342] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 17:02:23 [17:02:23.343] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 17:02:23 [17:02:23.345] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.0000700219999998808s {"duration":0.0000700219999998808,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 17:02:23 [17:02:23.346] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 17:02:23 [17:02:23.347] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 1 {"blockNumber":1,"blockHash":"0x1f0fffec4c566777f068f9020dcbc2358028d84bcf2811c5fafe4a312b9a866e","uuid":"59053b06-251a-4e5e-830e-b9bab038c6d4"} 17:02:23 [17:02:23.348] VERBOSE: prover-client:orchestrator Block 1 completed. Assembling header. 17:02:23 [17:02:23.350] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 17:02:23 [17:02:23.351] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 17:02:23 [17:02:23.352] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 17:02:23 [17:02:23.353] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 17:02:23 [17:02:23.355] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.00007484199999453267s {"duration":0.00007484199999453267,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 17:02:23 [17:02:23.356] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 17:02:23 [17:02:23.357] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 2 {"blockNumber":2,"blockHash":"0x06007433cea58e5a310c8057cbcb10ca97890db5fbf7c63138c0b82060dd2954","uuid":"59053b06-251a-4e5e-830e-b9bab038c6d4"} 17:02:23 [17:02:23.358] VERBOSE: prover-client:orchestrator Block 2 completed. Assembling header. 17:02:23 [17:02:23.367] VERBOSE: prover-client:orchestrator Updating archive tree with block 1 header 0x1f0fffec4c566777f068f9020dcbc2358028d84bcf2811c5fafe4a312b9a866e 17:02:23 [17:02:23.380] VERBOSE: prover-client:orchestrator Updating archive tree with block 2 header 0x06007433cea58e5a310c8057cbcb10ca97890db5fbf7c63138c0b82060dd2954 17:02:23 [17:02:23.384] VERBOSE: prover-client:orchestrator Orchestrator finalised block 1 17:02:23 [17:02:23.396] INFO: prover-client:proving-broker-database Creating broker database for epoch 0 at /tmp/rerun-data-NJpru3/0 with map size 1048576 17:02:23 [17:02:23.398] VERBOSE: prover-client:orchestrator Orchestrator finalised block 2 17:02:23 [17:02:23.434] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:02:23 [17:02:23.440] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY epochNumber=0 {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...","status":"not-found","numOutstandingJobs":1} 17:02:23 [17:02:23.499] INFO: prover-client:proving-agent Starting job id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input... 17:02:23 [17:02:23.500] INFO: prover-client:proving-agent:job-controller-11c86d65 Job controller started jobId=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a {"jobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a"} 17:02:23 [17:02:23.622] INFO: prover-client:proving-agent Job id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22resul... 17:02:23 [17:02:23.623] INFO: prover-client:proving-broker Proving job complete id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY totalAttempts=1 {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a"} 17:02:24 [17:02:24.317] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 17:02:24 [17:02:24.319] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY 17:02:24 [17:02:24.320] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 17:02:24 [17:02:24.334] INFO: prover-client:proving-broker New proving job id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa epochNumber=0 {"provingJobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa"} 17:02:24 [17:02:24.342] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY {"provingJobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa","provingJobType":"ROOT_PARITY"} 17:02:24 [17:02:24.388] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY epochNumber=0 {"provingJobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa","provingJobType":"ROOT_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu...","status":"not-found","numOutstandingJobs":1} 17:02:24 [17:02:24.413] INFO: prover-client:proving-agent Starting job id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu... 17:02:24 [17:02:24.439] INFO: prover-client:proving-agent:job-controller-adc25488 Job controller started jobId=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa {"jobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa"} 17:02:24 [17:02:24.606] INFO: prover-client:proving-agent Job id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22resu... 17:02:24 [17:02:24.606] INFO: prover-client:proving-broker Proving job complete id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY totalAttempts=1 {"provingJobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa"} 17:02:25 [17:02:25.321] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 17:02:25 [17:02:25.323] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY 17:02:25 [17:02:25.323] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 17:02:25 [17:02:25.348] INFO: prover-client:proving-broker New proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:f86bd7e2d5b05da80b42b39d927d0d095e19a3b8ace87290b80386ecb6510e46 epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:f86bd7e2d5b05da80b42b39d927d0d095e19a3b8ace87290b80386ecb6510e46"} 17:02:25 [17:02:25.358] INFO: prover-client:proving-broker New proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:625feea5e77f49e7aadb6db8e4795cd44ef54ec33d5846ed3c023b2773a9bf20 epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:625feea5e77f49e7aadb6db8e4795cd44ef54ec33d5846ed3c023b2773a9bf20"} 17:02:25 [17:02:25.403] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:EMPTY_BLOCK_ROOT_ROLLUP:f86bd7e2d5b05da80b42b39d927d0d095e19a3b8ace87290b80386ecb6510e46 type=EMPTY_BLOCK_ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:f86bd7e2d5b05da80b42b39d927d0d095e19a3b8ace87290b80386ecb6510e46","provingJobType":"EMPTY_BLOCK_ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input...","status":"not-found","numOutstandingJobs":2} 17:02:25 [17:02:25.403] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:EMPTY_BLOCK_ROOT_ROLLUP:625feea5e77f49e7aadb6db8e4795cd44ef54ec33d5846ed3c023b2773a9bf20 type=EMPTY_BLOCK_ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:625feea5e77f49e7aadb6db8e4795cd44ef54ec33d5846ed3c023b2773a9bf20","provingJobType":"EMPTY_BLOCK_ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input...","status":"not-found","numOutstandingJobs":2} 17:02:25 [17:02:25.411] INFO: prover-client:proving-agent Starting job id=0:EMPTY_BLOCK_ROOT_ROLLUP:f86bd7e2d5b05da80b42b39d927d0d095e19a3b8ace87290b80386ecb6510e46 type=EMPTY_BLOCK_ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input... 17:02:25 [17:02:25.422] INFO: prover-client:proving-agent:job-controller-9294f653 Job controller started jobId=0:EMPTY_BLOCK_ROOT_ROLLUP:f86bd7e2d5b05da80b42b39d927d0d095e19a3b8ace87290b80386ecb6510e46 {"jobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:f86bd7e2d5b05da80b42b39d927d0d095e19a3b8ace87290b80386ecb6510e46"} 17:02:25 [17:02:25.467] INFO: prover-client:proving-agent Starting job id=0:EMPTY_BLOCK_ROOT_ROLLUP:625feea5e77f49e7aadb6db8e4795cd44ef54ec33d5846ed3c023b2773a9bf20 type=EMPTY_BLOCK_ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input... 17:02:25 [17:02:25.476] INFO: prover-client:proving-agent:job-controller-b05144b1 Job controller started jobId=0:EMPTY_BLOCK_ROOT_ROLLUP:625feea5e77f49e7aadb6db8e4795cd44ef54ec33d5846ed3c023b2773a9bf20 {"jobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:625feea5e77f49e7aadb6db8e4795cd44ef54ec33d5846ed3c023b2773a9bf20"} 17:02:27 [17:02:27.188] INFO: prover-client:proving-agent Job id=0:EMPTY_BLOCK_ROOT_ROLLUP:f86bd7e2d5b05da80b42b39d927d0d095e19a3b8ace87290b80386ecb6510e46 type=EMPTY_BLOCK_ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22resul... 17:02:27 [17:02:27.189] INFO: prover-client:proving-broker Proving job complete id=0:EMPTY_BLOCK_ROOT_ROLLUP:f86bd7e2d5b05da80b42b39d927d0d095e19a3b8ace87290b80386ecb6510e46 type=EMPTY_BLOCK_ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:f86bd7e2d5b05da80b42b39d927d0d095e19a3b8ace87290b80386ecb6510e46"} 17:02:27 [17:02:27.328] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 2, total jobs ready: 1 17:02:27 [17:02:27.331] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:f86bd7e2d5b05da80b42b39d927d0d095e19a3b8ace87290b80386ecb6510e46 type=EMPTY_BLOCK_ROOT_ROLLUP 17:02:27 [17:02:27.331] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 17:02:29 [17:02:29.302] INFO: prover-client:proving-agent Job id=0:EMPTY_BLOCK_ROOT_ROLLUP:625feea5e77f49e7aadb6db8e4795cd44ef54ec33d5846ed3c023b2773a9bf20 type=EMPTY_BLOCK_ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22resul... 17:02:29 [17:02:29.303] INFO: prover-client:proving-broker Proving job complete id=0:EMPTY_BLOCK_ROOT_ROLLUP:625feea5e77f49e7aadb6db8e4795cd44ef54ec33d5846ed3c023b2773a9bf20 type=EMPTY_BLOCK_ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:625feea5e77f49e7aadb6db8e4795cd44ef54ec33d5846ed3c023b2773a9bf20"} 17:02:29 [17:02:29.332] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 17:02:29 [17:02:29.336] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:625feea5e77f49e7aadb6db8e4795cd44ef54ec33d5846ed3c023b2773a9bf20 type=EMPTY_BLOCK_ROOT_ROLLUP 17:02:29 [17:02:29.340] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 17:02:29 [17:02:29.357] INFO: prover-client:proving-broker New proving job id=0:ROOT_ROLLUP:02363c9e568b75372b93f1bef14ae8a163c8acd63c95c8c367b05e8c6880b307 epochNumber=0 {"provingJobId":"0:ROOT_ROLLUP:02363c9e568b75372b93f1bef14ae8a163c8acd63c95c8c367b05e8c6880b307"} 17:02:29 [17:02:29.362] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_ROLLUP:02363c9e568b75372b93f1bef14ae8a163c8acd63c95c8c367b05e8c6880b307 type=ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:ROOT_ROLLUP:02363c9e568b75372b93f1bef14ae8a163c8acd63c95c8c367b05e8c6880b307","provingJobType":"ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22input...","status":"not-found","numOutstandingJobs":1} 17:02:29 [17:02:29.404] INFO: prover-client:proving-agent Starting job id=0:ROOT_ROLLUP:02363c9e568b75372b93f1bef14ae8a163c8acd63c95c8c367b05e8c6880b307 type=ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22input... 17:02:29 [17:02:29.430] INFO: prover-client:proving-agent:job-controller-a2aeb589 Job controller started jobId=0:ROOT_ROLLUP:02363c9e568b75372b93f1bef14ae8a163c8acd63c95c8c367b05e8c6880b307 {"jobId":"0:ROOT_ROLLUP:02363c9e568b75372b93f1bef14ae8a163c8acd63c95c8c367b05e8c6880b307"} 17:02:29 [17:02:29.578] INFO: prover-client:proving-agent Job id=0:ROOT_ROLLUP:02363c9e568b75372b93f1bef14ae8a163c8acd63c95c8c367b05e8c6880b307 type=ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22resul... 17:02:29 [17:02:29.579] INFO: prover-client:proving-broker Proving job complete id=0:ROOT_ROLLUP:02363c9e568b75372b93f1bef14ae8a163c8acd63c95c8c367b05e8c6880b307 type=ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:ROOT_ROLLUP:02363c9e568b75372b93f1bef14ae8a163c8acd63c95c8c367b05e8c6880b307"} 17:02:30 [17:02:30.341] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 17:02:30 [17:02:30.347] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:ROOT_ROLLUP:02363c9e568b75372b93f1bef14ae8a163c8acd63c95c8c367b05e8c6880b307 type=ROOT_ROLLUP 17:02:30 [17:02:30.347] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 17:02:30 [17:02:30.347] VERBOSE: prover-client:orchestrator Orchestrator completed root rollup for epoch 0 17:02:30 [17:02:30.350] INFO: prover-node:epoch-proving-job Finalised proof for epoch 0 {"epochNumber":0,"uuid":"59053b06-251a-4e5e-830e-b9bab038c6d4","duration":7052.326742999998} 17:02:30 [17:02:30.350] INFO: prover-node:epoch-proving-job Submitted proof for epoch 0 (blocks 1 to 2) {"epochNumber":0,"uuid":"59053b06-251a-4e5e-830e-b9bab038c6d4"} 17:02:30 [17:02:30.354] VERBOSE: prover-client:broker-circuit-prover-facade Stopping BrokerCircuitProverFacade 17:02:30 [17:02:30.354] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Completed job for epoch 0 with status completed 17:02:30 [17:02:30.354] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Test succeeded 17:02:30 [17:02:30.355] INFO: prover-node:prover-node Stopping ProverNode 17:02:30 [17:02:30.355] WARN: prover-node:prover-node Running promise was not started 17:02:30 [17:02:30.357] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 17:02:30 [17:02:30.357] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 17:02:30 [17:02:30.357] WARN: archiver:prover-node Running promise was not started 17:02:30 [17:02:30.357] INFO: archiver:prover-node Stopped. 17:02:30 [17:02:30.358] WARN: world-state:block_stream:prover-node Running promise was not started 17:02:30 [17:02:30.358] INFO: world_state:prover-node Stopped world state synchronizer 17:02:30 [17:02:30.358] INFO: prover-node:prover-node Stopped ProverNode 17:02:30 [17:02:30.358] INFO: node:MAIN-aztec-node Stopping Aztec Node 17:02:32 [17:02:32.359] INFO: slasher Slasher client stopped. 17:02:32 [17:02:32.360] WARN: validator Running promise was not started 17:02:32 [17:02:32.361] WARN: sequencer Running promise was not started 17:02:32 [17:02:32.361] INFO: sequencer Stopped sequencer 17:02:32 [17:02:32.362] WARN: p2p:l2-block-stream Running promise was not started 17:02:32 [17:02:32.362] INFO: p2p P2P client stopped 17:02:32 [17:02:32.362] WARN: world-state:block_stream Running promise was not started 17:02:32 [17:02:32.362] INFO: world_state Stopped world state synchronizer 17:02:32 [17:02:32.362] WARN: archiver Running promise was not started 17:02:32 [17:02:32.362] INFO: archiver Stopped. 17:02:32 [17:02:32.362] INFO: node:MAIN-aztec-node Stopped Aztec Node 17:02:32 [17:02:32.364] INFO: node:MAIN-aztec-node Stopping Aztec Node 17:02:34 [17:02:34.365] INFO: slasher Slasher client stopped. 17:02:34 [17:02:34.365] WARN: validator Running promise was not started 17:02:34 [17:02:34.366] WARN: sequencer Running promise was not started 17:02:34 [17:02:34.366] INFO: sequencer Stopped sequencer 17:02:34 [17:02:34.366] WARN: p2p:l2-block-stream Running promise was not started 17:02:34 [17:02:34.366] INFO: p2p P2P client stopped 17:02:34 [17:02:34.367] WARN: world-state:block_stream Running promise was not started 17:02:34 [17:02:34.367] INFO: world_state Stopped world state synchronizer 17:02:34 [17:02:34.367] WARN: archiver Running promise was not started 17:02:34 [17:02:34.367] INFO: archiver Stopped. 17:02:34 [17:02:34.367] INFO: node:MAIN-aztec-node Stopped Aztec Node 17:02:34 [17:02:34.367] INFO: prover-node:prover-node Stopping ProverNode 17:02:34 [17:02:34.368] WARN: prover-node:prover-node Running promise was not started 17:02:34 [17:02:34.368] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 17:02:34 [17:02:34.368] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 17:02:34 [17:02:34.368] WARN: archiver:prover-node Running promise was not started 17:02:34 [17:02:34.368] INFO: archiver:prover-node Stopped. 17:02:34 [17:02:34.368] WARN: world-state:block_stream:prover-node Running promise was not started 17:02:34 [17:02:34.368] INFO: world_state:prover-node Stopped world state synchronizer 17:02:34 [17:02:34.368] INFO: prover-node:prover-node Stopped ProverNode 17:02:34 [17:02:34.369] INFO: blob-sink:server Stopping blob sink 17:02:34 [17:02:34.369] INFO: blob-sink:server Blob sink already stopped 17:02:34 PASS src/e2e_epochs/epochs_upload_failed_proof.test.ts 17:02:34 e2e_epochs/epochs_upload_failed_proof 17:02:34 ✓ uploads failed proving job state and re-runs it on a fresh instance (54721 ms) 17:02:34 17:02:34 Test Suites: 1 passed, 1 total 17:02:34 Tests: 1 passed, 1 total 17:02:34 Snapshots: 0 total 17:02:34 Time: 62.756 s 17:02:34 Ran all test suites matching src/e2e_epochs/epochs_upload_failed_proof.test.ts. 17:02:34 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?