Parent Log: http://ci.aztec-labs.com/2130b691f6e90cdc Command: bcc565b00bd8bb22:ISOLATE=1:NAME=e2e_epochs/epochs_upload_failed_proof yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_upload_failed_proof.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/3c671e0822075208f705135771771f5a47e9652e Env: REF_NAME=gh-readonly-queue/next/pr-15109-9222c7777effe26aa04b5367a455d25be0e7f62e CURRENT_VERSION=0.87.6 CI_FULL=1 Date: Wed Jun 18 16:00:36 UTC 2025 System: ARCH=amd64 CPUS=128 MEM=493Gi HOSTNAME=pr-15109_amd64_x3-full Resources: CPU_LIST=0-127 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_476a42720cde10eb_next 16:00:36 +++ id -u 16:00:36 +++ id -g 16:00:36 ++ docker run -d --name e2e_epochs_epochs_upload_failed_proof --net=none --cpuset-cpus=0-127 --cpus=2 --memory=8g --user 1000:1000 -v/home/aztec-dev:/home/aztec-dev --mount type=tmpfs,target=/tmp,tmpfs-size=1g --workdir /home/aztec-dev/aztec-packages -e HOME -e VERBOSE -e GIT_CONFIG_GLOBAL=/home/aztec-dev/aztec-packages/build-images/src/home/.gitconfig -e FORCE_COLOR=true -e CPUS -e MEM aztecprotocol/build:3.0 /bin/bash -c 'timeout -v 600s bash -c '\''yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_upload_failed_proof.test.ts'\''' 16:00:36 + cid=355623bb7c9362920765a48e7ab7c9e7cc3040134c6c3ca91bd0b5960a6a47a0 16:00:36 + set +x 16:00:37 {"level":25,"time":1750262437756,"pid":12,"hostname":"355623bb7c93","module":"logger","msg":"Logger initialized with level verbose"} 16:00:46 [16:00:46.423] INFO: e2e:epochs_upload_failed_proof Running test: e2e_epochs/epochs_upload_failed_proof uploads failed proving job state and re-runs it on a fresh instance 16:00:46 [16:00:46.619] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Logging metrics to log/e2e_epochs_epochs_upload_failed_proof.jsonl 16:00:46 [16:00:46.940] WARN: ethereum:cheat_codes Set L1 automine to true 16:00:46 [16:00:46.977] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Sent 0.1 ETH to deployer {"deployer":"0x05f32b3cc3888453ff71b01135b34ff8e41263f2","value":100000000000000000} 16:00:46 [16:00:46.994] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Sent 0.1 ETH to deployer {"deployer":"0x05f32b3cc3888453ff71b01135b34ff8e41263f2","value":100000000000000000} 16:00:47 [16:00:47.005] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Multicall3 16:00:47 [16:00:47.010] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Calling anvil_setBlockTimestampInterval with params: [8] 16:00:47 [16:00:47.017] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Set block interval to 8 16:00:47 [16:00:47.018] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contracts from 0xf39Fd6e51aad88F6F4ce6aB8827279cffFb92266 16:00:47 [16:00:47.072] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x8166bb789c828e492198babef9becf8ac44628f059d48e6f68114a9ae2ade6ec {"gasLimit":867658,"maxFeePerGas":"120.351651125","maxPriorityFeePerGas":"118.94979"} 16:00:47 [16:00:47.076] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xB8999345dA8041f1Da51ac5179B1F055A560f397 in tx 0x8166bb789c828e492198babef9becf8ac44628f059d48e6f68114a9ae2ade6ec. 16:00:47 [16:00:47.078] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Fee Asset at 0xb8999345da8041f1da51ac5179b1f055a560f397 16:00:47 [16:00:47.110] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x07d928293fb6819e2a8abf9d0b32b04560f633065cf07cefb5dcf9ca71af1db2 {"gasLimit":867644,"maxFeePerGas":"143.976575211","maxPriorityFeePerGas":"142.739748"} 16:00:47 [16:00:47.110] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xBb9e13665Cfb3d531F288a11E7312b6b91C59292 in tx 0x07d928293fb6819e2a8abf9d0b32b04560f633065cf07cefb5dcf9ca71af1db2. 16:00:47 [16:00:47.112] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Staking Asset at 0xbb9e13665cfb3d531f288a11e7312b6b91c59292 16:00:47 [16:00:47.156] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xaea8901378fc3dd27f030542afe63b646eb508d14ca9b264a18f1b2c0a6c9742 {"gasLimit":3126464,"maxFeePerGas":"172.377275728","maxPriorityFeePerGas":"171.2876976"} 16:00:47 [16:00:47.157] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xFa2858cA5fdf40129734409F7519b44582B8D091 in tx 0xaea8901378fc3dd27f030542afe63b646eb508d14ca9b264a18f1b2c0a6c9742. 16:00:47 [16:00:47.158] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed GSE at 0xfa2858ca5fdf40129734409f7519b44582b8d091 16:00:47 [16:00:47.185] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x16ac847cd12f2ca188dc7c57557698d2e30c717f9ff4b3bee30569e2a009b2df {"gasLimit":1030455,"maxFeePerGas":"206.505096634","maxPriorityFeePerGas":"205.54523712"} 16:00:47 [16:00:47.185] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xd79AF51B8839EC9bd9c18107eDA85523dFd96206 in tx 0x16ac847cd12f2ca188dc7c57557698d2e30c717f9ff4b3bee30569e2a009b2df. 16:00:47 [16:00:47.186] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Registry at 0xd79af51b8839ec9bd9c18107eda85523dfd96206 16:00:47 [16:00:47.223] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xb529fd31d8de51ee1ee5d0f30ab7b6820cf9a392f49a84e4c786ca17f3b69f22 {"gasLimit":1998686,"maxFeePerGas":"247.514707084","maxPriorityFeePerGas":"246.654284544"} 16:00:47 [16:00:47.224] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x9Fd955bA864E81acbF586F1ffcB4ba689bf6cf2a in tx 0xb529fd31d8de51ee1ee5d0f30ab7b6820cf9a392f49a84e4c786ca17f3b69f22. 16:00:47 [16:00:47.225] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed GovernanceProposer at 0x9fd955ba864e81acbf586f1ffcb4ba689bf6cf2a 16:00:47 [16:00:47.276] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x4310bda1d354201e760871a224530a0d6bd9993fe19f752b207a624e0c4e27c3 {"gasLimit":3092007,"maxFeePerGas":"296.744085407","maxPriorityFeePerGas":"295.985141452"} 16:00:47 [16:00:47.277] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x51E452ef904FFE5daE09fAA826966E9CC2125904 in tx 0x4310bda1d354201e760871a224530a0d6bd9993fe19f752b207a624e0c4e27c3. 16:00:47 [16:00:47.279] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Governance at 0x51e452ef904ffe5dae09faa826966e9cc2125904 16:00:47 [16:00:47.307] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x4820abfc3f6804d776b6830cda17e6d053481fd0836a9b72b056297329004de6 {"gasLimit":100000,"maxFeePerGas":"355.856633653","maxPriorityFeePerGas":"355.182169742"} 16:00:47 [16:00:47.308] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Set governance on GSE in 0x4820abfc3f6804d776b6830cda17e6d053481fd0836a9b72b056297329004de6 16:00:47 [16:00:47.347] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xac3e9a225d3bca6d877d7cfde6241a60a1b3f05ba11deadc75e185604ae836b5 {"gasLimit":397405,"maxFeePerGas":"426.823037513","maxPriorityFeePerGas":"426.21860369"} 16:00:47 [16:00:47.348] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xE5006923b8eE541E0c928Bc72d28b18D3f570f62 in tx 0xac3e9a225d3bca6d877d7cfde6241a60a1b3f05ba11deadc75e185604ae836b5. 16:00:47 [16:00:47.349] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed CoinIssuer at 0xe5006923b8ee541e0c928bc72d28b18d3f570f62 16:00:47 [16:00:47.350] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for deployments to complete 16:00:47 [16:00:47.350] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 7 transactions to be mined... 16:00:47 [16:00:47.411] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 16:00:47 [16:00:47.430] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xe2117c4b0e9a1732bc62a3fdeb7fe84f86eccaa9ad097a02985eeb8fc9269a2e {"gasLimit":100000,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 16:00:47 [16:00:47.431] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added coin issuer 0xe5006923b8ee541e0c928bc72d28b18d3f570f62 as minter on fee asset in 0xe2117c4b0e9a1732bc62a3fdeb7fe84f86eccaa9ad097a02985eeb8fc9269a2e 16:00:47 [16:00:47.459] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xc582e4484124769dc3f6e9feb6f06bc1f84b52379b781dbf887eea0f0775571c {"gasLimit":56661,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 16:00:47 [16:00:47.482] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x100b31bd1e3992df58985c26db7e5351f01cbb7b9c2e961c411c57733fb6cfa5 {"gasLimit":344517,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 16:00:47 [16:00:47.483] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xB4fF23c4B1E2Bc7C86090d4FBDa21A457ee6727F in tx 0x100b31bd1e3992df58985c26db7e5351f01cbb7b9c2e961c411c57733fb6cfa5. 16:00:47 [16:00:47.484] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed FeeAssetHandler at 0xb4ff23c4b1e2bc7c86090d4fbda21a457ee6727f 16:00:47 [16:00:47.511] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xc451aae80a23ef806a4bacf2e291d1c2ae150b6200ea2ea4e841b119a7e7c28b {"gasLimit":56804,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 16:00:47 [16:00:47.512] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added fee asset handler 0xb4ff23c4b1e2bc7c86090d4fbda21a457ee6727f as minter on fee asset in 0xc451aae80a23ef806a4bacf2e291d1c2ae150b6200ea2ea4e841b119a7e7c28b 16:00:47 [16:00:47.556] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xaedcfe9ce1d95491a20fcf1be6d0946a0a4edc41326f0c45af543a3a1b893ef2 {"gasLimit":2514655,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 16:00:47 [16:00:47.557] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x9C99b649ab407AF4F630a17af78E2d1218764686 in tx 0xaedcfe9ce1d95491a20fcf1be6d0946a0a4edc41326f0c45af543a3a1b893ef2. 16:00:47 [16:00:47.558] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed StakingAssetHandler at 0x9c99b649ab407af4f630a17af78e2d1218764686 16:00:47 [16:00:47.586] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x9dca4833e8202ce5a19d6e056f5469337ce5deaea9e1458189d2e2adc1e212a2 {"gasLimit":56804,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 16:00:47 [16:00:47.587] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added staking asset handler 0x9c99b649ab407af4f630a17af78e2d1218764686 as minter on staking asset in 0x9dca4833e8202ce5a19d6e056f5469337ce5deaea9e1458189d2e2adc1e212a2 16:00:47 [16:00:47.588] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for deployments to complete 16:00:47 [16:00:47.588] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 9 transactions to be mined... 16:00:47 [16:00:47.623] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 16:00:47 [16:00:47.663] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed shared contracts 16:00:47 [16:00:47.688] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x91a04f69719a84aacd823f2906533fea50245c46fe7ee6d49a467d9048a888a3 {"gasLimit":84837,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 16:00:47 [16:00:47.688] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Funded reward distributor with 10000000000000000000000000 fee asset in 0x91a04f69719a84aacd823f2906533fea50245c46fe7ee6d49a467d9048a888a3 16:00:47 [16:00:47.720] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x6732a13052b668b6ed53c2db691f949dc5751b43ca937a6796aab9388f3cb12a {"gasLimit":154658,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 16:00:47 [16:00:47.721] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x277E22B0C9698d7f2A1cD7C6d857511617587309 in tx 0x6732a13052b668b6ed53c2db691f949dc5751b43ca937a6796aab9388f3cb12a. 16:00:47 [16:00:47.722] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup will use the mock verifier at 0x277e22b0c9698d7f2a1cd7c6d857511617587309 16:00:47 [16:00:47.722] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup config args {"aztecSlotDuration":16,"aztecEpochDuration":4,"targetCommitteeSize":0,"aztecProofSubmissionEpochs":1,"slashingQuorum":6,"slashingRoundSize":10,"manaTarget":10000000000,"entryQueueFlushSizeMin":48,"entryQueueFlushSizeQuotient":2,"provingCostPerMana":100,"rewardConfig":{"sequencerBps":5000,"increment":200000,"maxScore":5000000,"a":5000,"k":1000000,"minimum":100000}} 16:00:47 [16:00:47.741] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xb8abd58c11090ad54ef25e78695dcd575f9386dec80efb3e83e93ba4eaee8ba4 {"gasLimit":87007,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 16:00:47 [16:00:47.742] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x7450C7068b41096BBDF64238985cdF9D33c38308 in tx 0xb8abd58c11090ad54ef25e78695dcd575f9386dec80efb3e83e93ba4eaee8ba4. 16:00:47 [16:00:47.798] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x43b4b8eb7cd73c3728eb21a8f5209a5a4943118902ed1029061e4fd8825180fe {"gasLimit":5114449,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 16:00:47 [16:00:47.798] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x7529F92672f4C7F675e181f225cC2F04abeb06C6 in tx 0x43b4b8eb7cd73c3728eb21a8f5209a5a4943118902ed1029061e4fd8825180fe. 16:00:47 [16:00:47.833] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x3c5776f12ccaa0e6cec7f702a48add2aaa3baea7fde7e578ae060b6759eec37b {"gasLimit":2858979,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 16:00:47 [16:00:47.834] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x9149539e06fe74Ca0B752e8Cd985b18F44cE45c6 in tx 0x3c5776f12ccaa0e6cec7f702a48add2aaa3baea7fde7e578ae060b6759eec37b. 16:00:47 [16:00:47.834] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Awaiting for linked libraries to be deployed 16:00:47 [16:00:47.914] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x6f32bedc04231ec2694ecb9f5fabb2976f2ab5b92c54a5d2df68e31486f06ca3 {"gasLimit":11094688,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 16:00:47 [16:00:47.914] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xe6053F00e88413519A7853Afff55d60FE23C339c in tx 0x6f32bedc04231ec2694ecb9f5fabb2976f2ab5b92c54a5d2df68e31486f06ca3. 16:00:47 [16:00:47.914] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Rollup at 0xe6053f00e88413519a7853afff55d60fe23c339c {"aztecSlotDuration":16,"aztecEpochDuration":4,"targetCommitteeSize":0,"aztecProofSubmissionEpochs":1,"slashingQuorum":6,"slashingRoundSize":10,"manaTarget":10000000000,"entryQueueFlushSizeMin":48,"entryQueueFlushSizeQuotient":2,"provingCostPerMana":100,"rewardConfig":{"sequencerBps":5000,"increment":200000,"maxScore":5000000,"a":5000,"k":1000000,"minimum":100000}} 16:00:47 [16:00:47.915] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 11 transactions to be mined... 16:00:47 [16:00:47.951] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 16:00:47 [16:00:47.952] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof All core contracts have been deployed 16:00:47 [16:00:47.973] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x0ba38952fda43742c98d680b48b5f90e9b534e48dd5d6328f8bd27915e80723e {"gasLimit":1056482,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 16:00:47 [16:00:47.974] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x6FfcC310905e8840C9AFb0bE599aF89858863ce6 in tx 0x0ba38952fda43742c98d680b48b5f90e9b534e48dd5d6328f8bd27915e80723e. 16:00:47 [16:00:47.974] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed SlashFactory at 0x6ffcc310905e8840c9afb0be599af89858863ce6 16:00:48 [16:00:48.014] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xc1a41b07b8b118a5ecb94916bf56da70cdc2e391884b33d9770299caf572cc19 {"gasLimit":116965,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 16:00:48 [16:00:48.015] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Adding rollup 0xe6053f00e88413519a7853afff55d60fe23c339c to registry 0xd79af51b8839ec9bd9c18107eda85523dfd96206 in tx 0xc1a41b07b8b118a5ecb94916bf56da70cdc2e391884b33d9770299caf572cc19 16:00:48 [16:00:48.037] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xcb65ed6497b0ec5ca03cbb930afb5c3f4bab0b7ee6924910436f10610e10b867 {"gasLimit":109464,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 16:00:48 [16:00:48.038] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Adding rollup 0xe6053f00e88413519a7853afff55d60fe23c339c to GSE 0xfa2858ca5fdf40129734409f7519b44582b8d091 in tx 0xcb65ed6497b0ec5ca03cbb930afb5c3f4bab0b7ee6924910436f10610e10b867 16:00:48 [16:00:48.047] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 12 transactions to be mined... 16:00:48 [16:00:48.088] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 16:00:48 [16:00:48.105] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup deployed 16:00:48 [16:00:48.106] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for rollup and slash factory to be deployed 16:00:48 [16:00:48.106] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 12 transactions to be mined... 16:00:48 [16:00:48.167] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 16:00:48 [16:00:48.167] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof All transactions for L1 deployment have been mined 16:00:48 [16:00:48.200] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Aztec L1 contracts initialized {"registryAddress":"0xd79af51b8839ec9bd9c18107eda85523dfd96206","governanceAddress":"0x51e452ef904ffe5dae09faa826966e9cc2125904","governanceProposerAddress":"0x9fd955ba864e81acbf586f1ffcb4ba689bf6cf2a","rollupAddress":"0xe6053f00e88413519a7853afff55d60fe23c339c","inboxAddress":"0x163ce904f5c7d39371cf131e9e49ce89970fbdb5","outboxAddress":"0x58355e9cc582f758f52cc60029b61624e0d93907","feeJuicePortalAddress":"0x1f02bad802a89953c95957a867798d4bbb8c4f4d","feeJuiceAddress":"0xb8999345da8041f1da51ac5179b1f055a560f397","stakingAssetAddress":"0xbb9e13665cfb3d531f288a11e7312b6b91c59292","rewardDistributorAddress":"0x8c4a6a1d7797dd91749a53a9ce691b7e6cebe5c0","gseAddress":"0xfa2858ca5fdf40129734409f7519b44582b8d091","coinIssuerAddress":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266"} 16:00:48 [16:00:48.201] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Handing over to governance 16:00:48 [16:00:48.218] WARN: ethereum:cheat_codes Set L1 automine to false 16:00:48 [16:00:48.221] WARN: ethereum:cheat_codes Set L1 interval mining to 8 seconds 16:00:48 [16:00:48.224] WARN: foundation:test-date-provider Time set to 2025-06-18T16:03:50.000Z {"offset":181776,"timeMs":1750262630000} 16:00:48 [16:00:48.236] INFO: aztecjs:utils:watcher Watcher not started because not auto mining 16:00:48 [16:00:48.236] INFO: telemetry:client Using NoopTelemetryClient 16:00:48 [16:00:48.240] INFO: kv-store:lmdb-v2:blob-sink Creating blob-sink data store at directory /tmp/848e051b34b84fda/blob-sink with map size 134217728 KB (LMDB v2) 16:00:48 [16:00:48.251] INFO: kv-store:lmdb-v2:blob-sink Starting data store with maxReaders 16 16:00:48 [16:00:48.265] INFO: blob-sink:server Server is running on http://localhost:37097 16:00:48 [16:00:48.266] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating and synching an aztec node... 16:00:48 [16:00:48.266] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Using native ACVM binary at ../../noir/noir-repo/target/release/acvm with working directory /tmp/943c5b40/acvm 16:00:48 [16:00:48.268] INFO: node:blob-sink:client Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:37097"} 16:00:48 [16:00:48.325] VERBOSE: node:MAIN-aztec-node Snapshot sync is disabled. No snapshots URL provided. 16:00:48 [16:00:48.326] INFO: archiver:lmdb Creating archiver data store at directory /tmp/848e051b34b84fda/archiver with map size 134217728 KB (LMDB v2) 16:00:48 [16:00:48.327] INFO: archiver:lmdb Starting data store with maxReaders 16 16:00:49 [16:00:49.408] INFO: node:blob-sink:client Testing configured blob sources {"blobSinkUrl":"http://localhost:37097"} 16:00:49 [16:00:49.435] INFO: node:blob-sink:client Blob sink is reachable {"blobSinkUrl":"http://localhost:37097"} 16:00:49 [16:00:49.436] WARN: node:blob-sink:client No L1 consensus host urls configured 16:00:49 [16:00:49.436] WARN: node:blob-sink:client No archive client configured 16:00:49 [16:00:49.441] INFO: archiver Starting archiver sync to rollup contract 0xe6053f00e88413519a7853afff55d60fe23c339c from L1 block 22 to current L1 block 25 with hash 0xcc9e361dec118d8d247688b411c869aa201446079cd2862697b8cdcb2d9fb8e2 {"blocksSynchedTo":22,"messagesSynchedTo":{"l1BlockHash":"0x223fe63b26564e3f0c307bf065c61f9db22a947819f610c62a6942240d6ae0da","l1BlockNumber":22}} 16:00:49 [16:00:49.489] INFO: archiver Initial archiver sync to L1 block 25 complete. {"l1BlockNumber":25,"syncPoint":{"blocksSynchedTo":25},"latest":{"number":0},"proven":{"number":0},"finalized":{"number":0}} 16:00:49 [16:00:49.512] INFO: world-state:database Creating world state data store at directory /tmp/848e051b34b84fda/world_state with map sizes {"archiveTreeMapSizeKb":134217728,"nullifierTreeMapSizeKb":134217728,"noteHashTreeMapSizeKb":134217728,"messageTreeMapSizeKb":134217728,"publicDataTreeMapSizeKb":134217728} and 2 threads. 16:00:49 [16:00:49.556] INFO: world_state Created world state synchroniser with block history of 2 16:00:49 [16:00:49.557] WARN: node:MAIN-aztec-node Aztec node is accepting fake proofs 16:00:49 [16:00:49.558] INFO: bb-prover:queued_ivc_verifier Starting QueuedIVCVerifier with 8 concurrent verifiers 16:00:49 [16:00:49.589] INFO: p2p:lmdb-v2 Creating p2p data store at directory /tmp/848e051b34b84fda/p2p with map size 134217728 KB (LMDB v2) 16:00:49 [16:00:49.603] INFO: p2p:lmdb-v2 Starting data store with maxReaders 16 16:00:49 [16:00:49.609] INFO: p2p-archive:lmdb-v2 Creating p2p-archive data store at directory /tmp/848e051b34b84fda/p2p-archive with map size 134217728 KB (LMDB v2) 16:00:49 [16:00:49.614] INFO: p2p-archive:lmdb-v2 Starting data store with maxReaders 16 16:00:49 [16:00:49.620] INFO: p2p-peer:lmdb-v2 Creating p2p-peers data store at directory /tmp/848e051b34b84fda/p2p-peers with map size 134217728 KB (LMDB v2) 16:00:49 [16:00:49.622] INFO: p2p-peer:lmdb-v2 Starting data store with maxReaders 16 16:00:49 [16:00:49.624] INFO: p2p:tx_pool Setting maximum tx mempool size {"maxTxPoolSize":100000000} 16:00:49 [16:00:49.627] VERBOSE: p2p P2P is disabled. Using dummy P2P service. 16:00:49 [16:00:49.636] VERBOSE: world-state:block_stream Starting L2 block stream {"proven":false,"pollIntervalMS":50} 16:00:49 [16:00:49.641] INFO: world_state Started world state synchronizer from block 1 16:00:49 [16:00:49.645] VERBOSE: world-state:block_stream Starting sync from block number 0 16:00:49 [16:00:49.657] INFO: p2p Starting p2p client from block 0 with empty mempools 16:00:49 [16:00:49.658] VERBOSE: p2p:l2-block-stream Starting L2 block stream {"batchSize":20,"pollIntervalMS":100,"startingBlock":0} 16:00:50 [16:00:50.110] INFO: epoch-prune-watcher EpochPruneWatcher initialized 16:00:50 [16:00:50.176] VERBOSE: validator Initialized validator with addresses: 0x19a3cadf621eebf9d83f56b7a567d5802dabe66a 16:00:50 [16:00:50.177] VERBOSE: node:MAIN-aztec-node All Aztec Node subsystems synced 16:00:50 [16:00:50.190] VERBOSE: p2p:l2-block-stream Starting sync from block number 0 16:00:50 [16:00:50.193] INFO: slasher Starting Slasher client... 16:00:50 [16:00:50.228] INFO: validator Started validator with addresses: 0x19a3cadf621eebf9d83f56b7a567d5802dabe66a 16:00:50 [16:00:50.229] VERBOSE: validator Validators 0x19a3cadf621eebf9d83f56b7a567d5802dabe66a are not on the validator committee for epoch 0 16:00:50 [16:00:50.230] INFO: sequencer Sequencer config set {"transactionPollingIntervalMS":500,"maxTxsPerBlock":32,"minTxsPerBlock":0,"maxL2BlockGas":10000000000,"publishTxsWithProposals":false,"maxDABlockGas":10000000000,"acvmWorkingDirectory":"/tmp/943c5b40/acvm","acvmBinaryPath":"../../noir/noir-repo/target/release/acvm","maxBlockSizeInBytes":1048576,"governanceProposerPayload":"0x0000000000000000000000000000000000000000","maxL1TxInclusionTimeIntoSlot":8,"enforceTimeTable":false} 16:00:50 [16:00:50.231] VERBOSE: sequencer Sequencer timetable updated {"enforceTimeTable":false} 16:00:50 [16:00:50.234] INFO: sequencer Sequencer started with address 0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266 16:00:50 [16:00:50.238] VERBOSE: node:MAIN-aztec-node Sequencer started 16:00:50 [16:00:50.239] INFO: node:MAIN-aztec-node Aztec Node version: 0.87.6 16:00:50 [16:00:50.239] INFO: node:MAIN-aztec-node Aztec Node started on chain 0x7a69 {"registryAddress":"0xd79af51b8839ec9bd9c18107eda85523dfd96206","governanceAddress":"0x51e452ef904ffe5dae09faa826966e9cc2125904","governanceProposerAddress":"0x9fd955ba864e81acbf586f1ffcb4ba689bf6cf2a","rollupAddress":"0xe6053f00e88413519a7853afff55d60fe23c339c","inboxAddress":"0x163ce904f5c7d39371cf131e9e49ce89970fbdb5","outboxAddress":"0x58355e9cc582f758f52cc60029b61624e0d93907","feeJuicePortalAddress":"0x1f02bad802a89953c95957a867798d4bbb8c4f4d","feeJuiceAddress":"0xb8999345da8041f1da51ac5179b1f055a560f397","stakingAssetAddress":"0xbb9e13665cfb3d531f288a11e7312b6b91c59292","rewardDistributorAddress":"0x8c4a6a1d7797dd91749a53a9ce691b7e6cebe5c0","gseAddress":"0xfa2858ca5fdf40129734409f7519b44582b8d091","coinIssuerAddress":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","slashFactoryAddress":"0x6ffcc310905e8840c9afb0be599af89858863ce6","feeAssetHandlerAddress":"0xb4ff23c4b1e2bc7c86090d4fbda21a457ee6727f","stakingAssetHandlerAddress":"0x9c99b649ab407af4f630a17af78e2d1218764686","zkPassportVerifierAddress":"0xee9f10f38319eae2730dba28fb09081db806c5e5"} 16:00:50 [16:00:50.240] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating and syncing a simulated prover node... 16:00:50 [16:00:50.303] INFO: blob-sink:client:prover-node Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:37097"} 16:00:50 [16:00:50.319] INFO: archiver:lmdb:prover-node Creating archiver data store at directory /tmp/848e051b34b84fda/41bc8da47f1ccd68/archiver with map size 134217728 KB (LMDB v2) 16:00:50 [16:00:50.335] VERBOSE: sequencer Preparing proposal for block 1 at slot 2 {"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750262638,"version":3542590205},"chainTipArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","blockNumber":1,"slot":2} 16:00:50 [16:00:50.337] INFO: archiver:lmdb:prover-node Starting data store with maxReaders 16 16:00:50 [16:00:50.470] VERBOSE: block-builder Building block 1 for slot 2 {"slot":2,"slotStart":"2025-06-18T16:03:58.000Z","now":"2025-06-18T16:03:52.246Z","blockNumber":1,"msgCount":0,"opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}} 16:00:50 [16:00:50.688] INFO: simulator:public-processor:prover-node Processed 0 successful txs and 0 failed txs in 0.004603821000000607s {"duration":0.004603821000000607,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 16:00:50 [16:00:50.812] INFO: sequencer Built block 1 for slot 2 with 0 txs and 0 messages. 0 mana/s {"blockHash":"0x16fe2f157a84b22106da2f9433c9e73b3fda937896dd50a6a34af582b8ad4ab3","globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750262638,"version":3542590205},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":414.3366989999995,"publicProcessDuration":6.096553999999742,"rollupCircuitsDuration":345.71396599999935,"txCount":0,"blockNumber":1,"blockTimestamp":1750262638,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 16:00:50 [16:00:50.825] VERBOSE: sequencer Attesting committee is empty 16:00:50 [16:00:50.922] INFO: blob-sink:client:prover-node Testing configured blob sources {"blobSinkUrl":"http://localhost:37097"} 16:00:50 [16:00:50.945] INFO: blob-sink:client:prover-node Blob sink is reachable {"blobSinkUrl":"http://localhost:37097"} 16:00:50 [16:00:50.945] WARN: blob-sink:client:prover-node No L1 consensus host urls configured 16:00:50 [16:00:50.946] WARN: blob-sink:client:prover-node No archive client configured 16:00:50 [16:00:50.965] INFO: archiver:prover-node Starting archiver sync to rollup contract 0xe6053f00e88413519a7853afff55d60fe23c339c from L1 block 22 to current L1 block 25 with hash 0xcc9e361dec118d8d247688b411c869aa201446079cd2862697b8cdcb2d9fb8e2 {"blocksSynchedTo":22,"messagesSynchedTo":{"l1BlockHash":"0x223fe63b26564e3f0c307bf065c61f9db22a947819f610c62a6942240d6ae0da","l1BlockNumber":22}} 16:00:51 [16:00:51.041] INFO: archiver:prover-node Initial archiver sync to L1 block 25 complete. {"l1BlockNumber":25,"syncPoint":{"blocksSynchedTo":25},"latest":{"number":0},"proven":{"number":0},"finalized":{"number":0}} 16:00:51 [16:00:51.048] INFO: prover-node:blob-sink:client:prover-node Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:37097"} 16:00:51 [16:00:51.049] VERBOSE: prover-node:prover-node Snapshot sync is disabled. No snapshots URL provided. 16:00:51 [16:00:51.051] VERBOSE: prover-node:prover-node Created archiver and synced to block 0 16:00:51 [16:00:51.071] INFO: world-state:database:prover-node Creating world state data store at directory /tmp/848e051b34b84fda/41bc8da47f1ccd68/world_state with map sizes {"archiveTreeMapSizeKb":134217728,"nullifierTreeMapSizeKb":134217728,"noteHashTreeMapSizeKb":134217728,"messageTreeMapSizeKb":134217728,"publicDataTreeMapSizeKb":134217728} and 2 threads. 16:00:51 [16:00:51.109] INFO: world_state:prover-node Created world state synchroniser with block history of 2 16:00:51 [16:00:51.112] VERBOSE: world-state:block_stream:prover-node Starting L2 block stream {"proven":false,"pollIntervalMS":50} 16:00:51 [16:00:51.112] INFO: world_state:prover-node Started world state synchronizer from block 1 16:00:51 [16:00:51.115] VERBOSE: world-state:block_stream:prover-node Starting sync from block number 0 16:00:51 [16:00:51.116] WARN: prover-client:proving-broker-database:prover-node Found invalid epoch directory /tmp/848e051b34b84fda/41bc8da47f1ccd68/archiver when loading epoch databases, ignoring 16:00:51 [16:00:51.116] WARN: prover-client:proving-broker-database:prover-node Found invalid epoch directory /tmp/848e051b34b84fda/41bc8da47f1ccd68/world_state when loading epoch databases, ignoring 16:00:51 [16:00:51.117] INFO: prover-client:proving-broker:prover-node Proving Broker started 16:00:51 [16:00:51.144] INFO: prover-node:prover-coordination:prover-node Using prover coordination via aztec node 16:00:51 [16:00:51.146] INFO: e2e:e2e_epochs:epochs_upload_failed_proof:prover-node Created and synced prover node {"publisherAddress":"0x3C44CdDdB6a900fa2b585dd299e03d12FA4293BC"} 16:00:51 [16:00:51.147] INFO: prover-node:epoch-monitor:prover-node Started EpochMonitor {"pollingIntervalMs":200} 16:00:51 [16:00:51.157] INFO: prover-node:prover-node Started Prover Node with prover id 0x0000000000000000000000000000000000000000000000000000000000000001 {"proverNodePollingIntervalMs":200,"proverNodeMaxPendingJobs":10,"proverNodeMaxParallelBlocksPerEpoch":32,"txGatheringIntervalMs":1000,"txGatheringBatchSize":10,"txGatheringMaxParallelRequestsPerNode":100,"proverNodeFailedEpochStore":"file:///tmp/failed-proofs-K8Qozt","dataDirectory":"/tmp/848e051b34b84fda/41bc8da47f1ccd68","l1ChainId":31337,"rollupVersion":3542590205} 16:00:51 [16:00:51.161] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating a pxe... 16:00:51 [16:00:51.170] INFO: pxe:data:lmdb Creating pxe_data data store at directory /tmp/a3969bbcb7b07c68/pxe_data with map size 134217728 KB (LMDB v2) 16:00:51 [16:00:51.176] INFO: pxe:data:lmdb Starting data store with maxReaders 16 16:00:52 [16:00:52.054] VERBOSE: pxe:service Registered protocol contracts in pxe {"AuthRegistry":"0x0000000000000000000000000000000000000000000000000000000000000001","ContractInstanceDeployer":"0x0000000000000000000000000000000000000000000000000000000000000002","ContractClassRegisterer":"0x0000000000000000000000000000000000000000000000000000000000000003","MultiCallEntrypoint":"0x0000000000000000000000000000000000000000000000000000000000000004","FeeJuice":"0x0000000000000000000000000000000000000000000000000000000000000005","Router":"0x0000000000000000000000000000000000000000000000000000000000000006"} 16:00:52 [16:00:52.055] INFO: pxe:service Started PXE connected to chain 31337 version 3542590205 16:00:52 [16:00:52.080] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L2 genesis at L1 block 22 (timestamp 1750262606) 16:00:52 [16:00:52.081] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting until L1 timestamp 1750262670 is reached as the start of epoch 1 16:00:52 [16:00:52.311] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 25 mined at 16:03:50 with new L2 block 0 for epoch 0 with proof up to L2 block 0 for epoch 0 {"l1Timestamp":1750262630,"l1BlockNumber":25,"l2SlotNumber":1,"l2BlockNumber":0,"l2ProvenBlockNumber":0,"totalL2Messages":0} 16:00:54 [16:00:54.626] VERBOSE: ethereum:tx_delayer Sent tx immediately 0x5ddcb5424a8cd74b0f6944be0e72f5835bd79c7cd6b3e4a893d5f2b5c53ca081 16:00:54 [16:00:54.627] VERBOSE: node:MAIN-aztec-node Sent L1 transaction 0x5ddcb5424a8cd74b0f6944be0e72f5835bd79c7cd6b3e4a893d5f2b5c53ca081 {"gasLimit":470530,"maxFeePerGas":"500","maxPriorityFeePerGas":"500","maxFeePerBlobGas":"0.000000001"} 16:00:56 [16:00:56.281] INFO: sequencer:publisher Bundled [propose] transaction [succeeded] 16:00:56 [16:00:56.285] VERBOSE: sequencer:publisher Published L2 block to L1 rollup contract {"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0x5ddcb5424a8cd74b0f6944be0e72f5835bd79c7cd6b3e4a893d5f2b5c53ca081","calldataSize":1220,"calldataGas":8816,"txCount":0,"blockNumber":1,"blockTimestamp":1750262638,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 16:00:56 [16:00:56.286] VERBOSE: node:blob-sink:client Sending 1 blobs to blob sink 16:00:56 [16:00:56.334] INFO: blob-sink:server Received blob sidecar for block 0x676ef8d53279886f461651b133b155a60e3c47ac3ce5a89f32c183f1024c9194 16:00:56 [16:00:56.348] INFO: blob-sink:server Blob sidecar stored successfully for block 0x676ef8d53279886f461651b133b155a60e3c47ac3ce5a89f32c183f1024c9194 16:00:56 [16:00:56.373] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 26 mined at 16:03:58 with new L2 block 1 for epoch 0 {"l1Timestamp":1750262638,"l1BlockNumber":26,"l2SlotNumber":2,"l2BlockNumber":1,"l2ProvenBlockNumber":0,"totalL2Messages":0} 16:00:56 [16:00:56.485] INFO: archiver Downloaded L2 block 1 {"blockHash":"0x16fe2f157a84b22106da2f9433c9e73b3fda937896dd50a6a34af582b8ad4ab3","blockNumber":1,"txCount":0,"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750262638,"version":3542590205},"archiveRoot":"0x0e981d41323ad6f8750f0fddb44d85e4bd914d7e85068d51b11cb4fca5055a03","archiveNextLeafIndex":2} 16:00:56 [16:00:56.518] INFO: archiver:prover-node Downloaded L2 block 1 {"blockHash":"0x16fe2f157a84b22106da2f9433c9e73b3fda937896dd50a6a34af582b8ad4ab3","blockNumber":1,"txCount":0,"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750262638,"version":3542590205},"archiveRoot":"0x0e981d41323ad6f8750f0fddb44d85e4bd914d7e85068d51b11cb4fca5055a03","archiveNextLeafIndex":2} 16:00:56 [16:00:56.522] INFO: world_state World state updated with L2 block 1 {"eventName":"l2-block-handled","duration":6.092323999997461,"unfinalisedBlockNumber":1,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":1,"blockTimestamp":1750262638,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 16:00:56 [16:00:56.545] INFO: world_state:prover-node World state updated with L2 block 1 {"eventName":"l2-block-handled","duration":3.3520339999995485,"unfinalisedBlockNumber":1,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":1,"blockTimestamp":1750262638,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 16:00:56 [16:00:56.646] VERBOSE: p2p Synched to latest block 1 16:00:57 [16:00:57.165] VERBOSE: prover-node:prover-node Fetching 0 tx hashes for block number 1 from coordination 16:00:57 [16:00:57.165] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 16:01:04 [16:01:04.438] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 27 mined at 16:04:06 {"l1Timestamp":1750262646,"l1BlockNumber":27,"l2SlotNumber":2,"l2BlockNumber":1,"l2ProvenBlockNumber":0,"totalL2Messages":0} 16:01:04 [16:01:04.690] VERBOSE: sequencer Preparing proposal for block 2 at slot 3 {"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750262654,"version":3542590205},"chainTipArchive":"0x0e981d41323ad6f8750f0fddb44d85e4bd914d7e85068d51b11cb4fca5055a03","blockNumber":2,"slot":3} 16:01:04 [16:01:04.705] VERBOSE: block-builder Building block 2 for slot 3 {"slot":3,"slotStart":"2025-06-18T16:04:14.000Z","now":"2025-06-18T16:04:06.481Z","blockNumber":2,"msgCount":0,"opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}} 16:01:04 [16:01:04.708] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.0003013570000002801s {"duration":0.0003013570000002801,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 16:01:04 [16:01:04.728] INFO: sequencer Built block 2 for slot 3 with 0 txs and 0 messages. 0 mana/s {"blockHash":"0x0949f720366524b8ff912b085918abd55ded3e7588438af4e4cb4df6fd0ece5e","globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750262654,"version":3542590205},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":28.746179000001575,"publicProcessDuration":0.8696889999991981,"rollupCircuitsDuration":22.290367000001424,"txCount":0,"blockNumber":2,"blockTimestamp":1750262654,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 16:01:04 [16:01:04.732] VERBOSE: sequencer Attesting committee is empty 16:01:04 [16:01:04.948] VERBOSE: ethereum:tx_delayer Sent tx immediately 0xd7cae05b93c878155638ca0fdcd79639470f41d83f0715998f32aa5c8f3ea306 16:01:04 [16:01:04.948] VERBOSE: node:MAIN-aztec-node Sent L1 transaction 0xd7cae05b93c878155638ca0fdcd79639470f41d83f0715998f32aa5c8f3ea306 {"gasLimit":391172,"maxFeePerGas":"1.26593145","maxPriorityFeePerGas":"1.2","maxFeePerBlobGas":"0.000000001"} 16:01:12 [16:01:12.323] INFO: sequencer:publisher Bundled [propose] transaction [succeeded] 16:01:12 [16:01:12.324] VERBOSE: sequencer:publisher Published L2 block to L1 rollup contract {"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0xd7cae05b93c878155638ca0fdcd79639470f41d83f0715998f32aa5c8f3ea306","calldataSize":1220,"calldataGas":8816,"txCount":0,"blockNumber":2,"blockTimestamp":1750262654,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 16:01:12 [16:01:12.324] VERBOSE: node:blob-sink:client Sending 1 blobs to blob sink 16:01:12 [16:01:12.338] WARN: node:blob-sink:client Unable to get blob sidecar for 0xd2d17711f04636f32fbe6160f9618f5ccb670fef1e8d0f06aa820fabb71c03e9: Not Found (404) {"status":404,"statusText":"Not Found","body":"{\"error\":\"Blob not found\"}"} 16:01:12 [16:01:12.338] WARN: node:blob-sink:client Failed to fetch blobs for 0xd2d17711f04636f32fbe6160f9618f5ccb670fef1e8d0f06aa820fabb71c03e9 from all blob sources {"blobSinkUrl":"http://localhost:37097"} 16:01:12 [16:01:12.340] WARN: blob-sink:client:prover-node Unable to get blob sidecar for 0xd2d17711f04636f32fbe6160f9618f5ccb670fef1e8d0f06aa820fabb71c03e9: Not Found (404) {"status":404,"statusText":"Not Found","body":"{\"error\":\"Blob not found\"}"} 16:01:12 [16:01:12.340] WARN: blob-sink:client:prover-node Failed to fetch blobs for 0xd2d17711f04636f32fbe6160f9618f5ccb670fef1e8d0f06aa820fabb71c03e9 from all blob sources {"blobSinkUrl":"http://localhost:37097"} 16:01:12 [16:01:12.344] INFO: blob-sink:server Received blob sidecar for block 0xd2d17711f04636f32fbe6160f9618f5ccb670fef1e8d0f06aa820fabb71c03e9 16:01:12 [16:01:12.356] INFO: blob-sink:server Blob sidecar stored successfully for block 0xd2d17711f04636f32fbe6160f9618f5ccb670fef1e8d0f06aa820fabb71c03e9 16:01:12 [16:01:12.369] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 28 mined at 16:04:14 with new L2 block 2 for epoch 0 {"l1Timestamp":1750262654,"l1BlockNumber":28,"l2SlotNumber":3,"l2BlockNumber":2,"l2ProvenBlockNumber":0,"totalL2Messages":0} 16:01:12 [16:01:12.528] INFO: archiver Downloaded L2 block 2 {"blockHash":"0x0949f720366524b8ff912b085918abd55ded3e7588438af4e4cb4df6fd0ece5e","blockNumber":2,"txCount":0,"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750262654,"version":3542590205},"archiveRoot":"0x0bc41764895a91bb2d483de4d82976c671ff423ea8ca86e56af24bedf2b48909","archiveNextLeafIndex":3} 16:01:12 [16:01:12.557] INFO: archiver:prover-node Downloaded L2 block 2 {"blockHash":"0x0949f720366524b8ff912b085918abd55ded3e7588438af4e4cb4df6fd0ece5e","blockNumber":2,"txCount":0,"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750262654,"version":3542590205},"archiveRoot":"0x0bc41764895a91bb2d483de4d82976c671ff423ea8ca86e56af24bedf2b48909","archiveNextLeafIndex":3} 16:01:12 [16:01:12.584] INFO: world_state:prover-node World state updated with L2 block 2 {"eventName":"l2-block-handled","duration":4.6218709999957355,"unfinalisedBlockNumber":2,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":2,"blockTimestamp":1750262654,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 16:01:12 [16:01:12.587] INFO: world_state World state updated with L2 block 2 {"eventName":"l2-block-handled","duration":9.187251000003016,"unfinalisedBlockNumber":2,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":2,"blockTimestamp":1750262654,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 16:01:12 [16:01:12.671] VERBOSE: p2p Synched to latest block 2 16:01:12 [16:01:12.703] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 16:01:12 [16:01:12.703] VERBOSE: prover-node:prover-node Gathered all 0 txs for epoch 0 {"epochNumber":0} 16:01:12 [16:01:12.705] VERBOSE: prover-node:prover-node Gathered all 0 messages for epoch 0 {"epochNumber":0} 16:01:12 [16:01:12.705] VERBOSE: prover-node:prover-node Gathered previous block header 0 for epoch 0 16:01:12 [16:01:12.706] VERBOSE: prover-node:prover-node Creating proving job for epoch 0 for block range 1 to 2 16:01:12 [16:01:12.708] INFO: prover-node:epoch-proving-job Starting epoch 0 proving job with blocks 1 to 2 {"fromBlock":1,"toBlock":2,"epochSizeBlocks":2,"epochNumber":0,"uuid":"64fea6be-886c-4850-957f-4baf86bbbb11"} 16:01:12 [16:01:12.739] INFO: prover-client:orchestrator Starting epoch 0 with 2 blocks 16:01:12 [16:01:12.740] VERBOSE: prover-client:broker-circuit-prover-facade Starting BrokerCircuitProverFacade 16:01:12 [16:01:12.742] VERBOSE: prover-node:epoch-proving-job Starting processing block 1 {"number":1,"blockHash":"0x16fe2f157a84b22106da2f9433c9e73b3fda937896dd50a6a34af582b8ad4ab3","lastArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"64fea6be-886c-4850-957f-4baf86bbbb11","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x00000000000000000000000000000000000000000000000000000000d327a2fd","blockNumber":1,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 16:01:12 [16:01:12.743] INFO: prover-client:orchestrator Starting block 1 for slot 2 16:01:12 [16:01:12.745] VERBOSE: prover-node:epoch-proving-job Starting processing block 2 {"number":2,"blockHash":"0x0949f720366524b8ff912b085918abd55ded3e7588438af4e4cb4df6fd0ece5e","lastArchive":"0x0e981d41323ad6f8750f0fddb44d85e4bd914d7e85068d51b11cb4fca5055a03","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"64fea6be-886c-4850-957f-4baf86bbbb11","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x00000000000000000000000000000000000000000000000000000000d327a2fd","blockNumber":2,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000003","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 16:01:12 [16:01:12.745] INFO: prover-client:orchestrator Starting block 2 for slot 3 16:01:12 [16:01:12.787] INFO: prover-client:proving-broker:prover-node New proving job id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a epochNumber=0 {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a"} 16:01:12 [16:01:12.787] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 16:01:12 [16:01:12.792] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 16:01:12 [16:01:12.792] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 16:01:12 [16:01:12.794] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000026240999999572524s {"duration":0.000026240999999572524,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 16:01:12 [16:01:12.794] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 16:01:12 [16:01:12.795] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 1 {"blockNumber":1,"blockHash":"0x16fe2f157a84b22106da2f9433c9e73b3fda937896dd50a6a34af582b8ad4ab3","uuid":"64fea6be-886c-4850-957f-4baf86bbbb11"} 16:01:12 [16:01:12.796] VERBOSE: prover-client:orchestrator Block 1 completed. Assembling header. 16:01:12 [16:01:12.797] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 16:01:12 [16:01:12.797] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 16:01:12 [16:01:12.798] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 16:01:12 [16:01:12.798] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 16:01:12 [16:01:12.810] VERBOSE: prover-client:orchestrator Updating archive tree with block 1 header 0x16fe2f157a84b22106da2f9433c9e73b3fda937896dd50a6a34af582b8ad4ab3 16:01:12 [16:01:12.812] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000021919999999227s {"duration":0.000021919999999227,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 16:01:12 [16:01:12.813] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 16:01:12 [16:01:12.815] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 2 {"blockNumber":2,"blockHash":"0x0949f720366524b8ff912b085918abd55ded3e7588438af4e4cb4df6fd0ece5e","uuid":"64fea6be-886c-4850-957f-4baf86bbbb11"} 16:01:12 [16:01:12.816] VERBOSE: prover-client:orchestrator Block 2 completed. Assembling header. 16:01:12 [16:01:12.821] VERBOSE: prover-client:orchestrator Orchestrator finalised block 1 16:01:12 [16:01:12.844] VERBOSE: prover-client:orchestrator Updating archive tree with block 2 header 0x0949f720366524b8ff912b085918abd55ded3e7588438af4e4cb4df6fd0ece5e 16:01:12 [16:01:12.849] INFO: prover-client:proving-broker-database:prover-node Creating broker database for epoch 0 at /tmp/848e051b34b84fda/41bc8da47f1ccd68/0 with map size 134217728 16:01:12 [16:01:12.862] VERBOSE: prover-client:orchestrator Orchestrator finalised block 2 16:01:12 [16:01:12.907] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 16:01:12 [16:01:12.914] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY epochNumber=0 {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...","status":"not-found","numOutstandingJobs":1} 16:01:12 [16:01:12.966] INFO: prover-client:proving-agent:prover-node Starting job id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input... 16:01:12 [16:01:12.979] INFO: prover-client:proving-agent:job-controller-c7ddebb3 Job controller started jobId=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a {"jobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a"} 16:01:13 [16:01:13.121] INFO: prover-client:proving-agent:prover-node Job id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22resul... 16:01:13 [16:01:13.121] INFO: prover-client:proving-broker:prover-node Proving job complete id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY totalAttempts=1 {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a"} 16:01:13 [16:01:13.235] VERBOSE: prover-node:prover-node Fetching 0 tx hashes for block number 2 from coordination 16:01:13 [16:01:13.236] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 16:01:13 [16:01:13.742] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 16:01:13 [16:01:13.746] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY 16:01:13 [16:01:13.746] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 16:01:13 [16:01:13.764] INFO: prover-client:proving-broker:prover-node New proving job id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa epochNumber=0 {"provingJobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa"} 16:01:13 [16:01:13.774] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY {"provingJobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa","provingJobType":"ROOT_PARITY"} 16:01:13 [16:01:13.817] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY epochNumber=0 {"provingJobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa","provingJobType":"ROOT_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu...","status":"not-found","numOutstandingJobs":1} 16:01:13 [16:01:13.837] INFO: prover-client:proving-agent:prover-node Starting job id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu... 16:01:13 [16:01:13.874] INFO: prover-client:proving-agent:job-controller-7b7e683f Job controller started jobId=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa {"jobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa"} 16:01:13 [16:01:13.896] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Triggering error on finaliseEpoch 16:01:13 [16:01:13.918] ERROR: prover-node:epoch-proving-job Error running epoch 0 prover job: Error: Fake error while proving epoch 16:01:13 at ServerEpochProver.epochProver.finaliseEpoch (/home/aztec-dev/aztec-packages/yarn-project/end-to-end/src/e2e_epochs/epochs_upload_failed_proof.test.ts:60:15) 16:01:13 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:142:64) 16:01:13 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) {"uuid":"64fea6be-886c-4850-957f-4baf86bbbb11","epochNumber":0} 16:01:13 [16:01:13.920] VERBOSE: prover-client:broker-circuit-prover-facade Stopping BrokerCircuitProverFacade 16:01:13 [16:01:13.921] ERROR: prover-client:broker-circuit-prover-facade Job errored with 'Broker facade stopped' id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY: { 16:01:13 provingJobId: '0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa', 16:01:13 provingJobType: 'ROOT_PARITY' 16:01:13 } 16:01:13 [16:01:13.923] INFO: prover-client:proving-broker:prover-node Cancelling job id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa {"provingJobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa"} 16:01:13 [16:01:13.923] INFO: prover-client:proving-broker:prover-node Marking proving job as failed id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY totalAttempts=1 err=Aborted {"provingJobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa"} 16:01:13 [16:01:13.925] ERROR: prover-client:orchestrator Error thrown when proving job: Error: Broker facade stopped 16:01:13 at BrokerCircuitProverFacade.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/proving_broker/broker_prover_facade.js:142:31) 16:01:13 at ServerEpochProver.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/prover-client/server-epoch-prover.js:31:9) 16:01:13 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:183:13) 16:01:13 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) 16:01:13 [16:01:13.925] ERROR: prover-client:orchestrator Error thrown when proving job: Error: Broker facade stopped 16:01:13 at BrokerCircuitProverFacade.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/proving_broker/broker_prover_facade.js:142:31) 16:01:13 at ServerEpochProver.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/prover-client/server-epoch-prover.js:31:9) 16:01:13 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:183:13) 16:01:13 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) 16:01:13 [16:01:13.926] ERROR: prover-node:prover-node Job for 0 exited with state failed: { 16:01:13 id: '64fea6be-886c-4850-957f-4baf86bbbb11', 16:01:13 epochNumber: 0n, 16:01:13 state: 'failed' 16:01:13 } 16:01:13 [16:01:13.927] WARN: prover-node:prover-node Uploading epoch proof failure for 0 to file:///tmp/failed-proofs-K8Qozt {"epochNumber":0,"jobId":"64fea6be-886c-4850-957f-4baf86bbbb11","location":"file:///tmp/failed-proofs-K8Qozt"} 16:01:13 [16:01:13.938] INFO: stdlib:file-store Creating local file file store at /tmp/failed-proofs-K8Qozt 16:01:13 [16:01:13.958] INFO: prover-node:prover-node Pausing archiver and world state sync to start snapshot upload 16:01:13 [16:01:13.968] INFO: archiver:prover-node Stopped. 16:01:13 [16:01:13.969] INFO: world_state:prover-node Stopped sync 16:01:13 [16:01:13.969] INFO: prover-node:prover-node Creating backups of lmdb environments to /tmp/848e051b34b84fda/41bc8da47f1ccd68/epoch-proof-data-HxT2DI 16:01:14 [16:01:14.011] WARN: prover-client:proving-broker:prover-node Proving job id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa has already been completed {"provingJobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa"} 16:01:14 [16:01:14.021] INFO: prover-node:prover-node Data stores backed up to /tmp/848e051b34b84fda/41bc8da47f1ccd68/epoch-proof-data-HxT2DI {"paths":{"l1-to-l2-message-tree":"/tmp/848e051b34b84fda/41bc8da47f1ccd68/epoch-proof-data-HxT2DI/world-state/L1ToL2MessageTree/data.mdb","archive-tree":"/tmp/848e051b34b84fda/41bc8da47f1ccd68/epoch-proof-data-HxT2DI/world-state/ArchiveTree/data.mdb","public-data-tree":"/tmp/848e051b34b84fda/41bc8da47f1ccd68/epoch-proof-data-HxT2DI/world-state/PublicDataTree/data.mdb","note-hash-tree":"/tmp/848e051b34b84fda/41bc8da47f1ccd68/epoch-proof-data-HxT2DI/world-state/NoteHashTree/data.mdb","nullifier-tree":"/tmp/848e051b34b84fda/41bc8da47f1ccd68/epoch-proof-data-HxT2DI/world-state/NullifierTree/data.mdb","archiver":"/tmp/848e051b34b84fda/41bc8da47f1ccd68/epoch-proof-data-HxT2DI/archiver/data.mdb"}} 16:01:14 [16:01:14.023] INFO: prover-node:prover-node Resuming archiver and world state sync 16:01:14 [16:01:14.023] VERBOSE: world-state:block_stream:prover-node Starting L2 block stream {"proven":false,"pollIntervalMS":50} 16:01:14 [16:01:14.024] INFO: world_state:prover-node Resumed sync 16:01:14 [16:01:14.024] INFO: archiver:prover-node Restarting archiver 16:01:14 [16:01:14.084] WARN: prover-node:prover-node Uploaded epoch 0 proof failure data to file:///tmp/failed-proofs-K8Qozt/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618160114-64fea6be-886c-4850-957f-4baf86bbbb11 {"epochNumber":0,"location":"file:///tmp/failed-proofs-K8Qozt","basePath":"aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618160114-64fea6be-886c-4850-957f-4baf86bbbb11","metadataUrl":"file:///tmp/failed-proofs-K8Qozt/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618160114-64fea6be-886c-4850-957f-4baf86bbbb11/metadata.json","dataUrl":"file:///tmp/failed-proofs-K8Qozt/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618160114-64fea6be-886c-4850-957f-4baf86bbbb11/data.bin","metadata":{"l1BlockNumber":28,"l2BlockHash":"0x0949f720366524b8ff912b085918abd55ded3e7588438af4e4cb4df6fd0ece5e","l2BlockNumber":2,"schemaVersions":{"archiver":3,"worldState":2},"timestamp":1750262474025,"dataUrls":{"l1-to-l2-message-tree":"file:///tmp/failed-proofs-K8Qozt/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618160114-64fea6be-886c-4850-957f-4baf86bbbb11/l1-to-l2-message-tree.db","archive-tree":"file:///tmp/failed-proofs-K8Qozt/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618160114-64fea6be-886c-4850-957f-4baf86bbbb11/archive-tree.db","public-data-tree":"file:///tmp/failed-proofs-K8Qozt/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618160114-64fea6be-886c-4850-957f-4baf86bbbb11/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-K8Qozt/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618160114-64fea6be-886c-4850-957f-4baf86bbbb11/note-hash-tree.db","nullifier-tree":"file:///tmp/failed-proofs-K8Qozt/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618160114-64fea6be-886c-4850-957f-4baf86bbbb11/nullifier-tree.db","archiver":"file:///tmp/failed-proofs-K8Qozt/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618160114-64fea6be-886c-4850-957f-4baf86bbbb11/archiver.db"}},"jobId":"64fea6be-886c-4850-957f-4baf86bbbb11"} 16:01:14 [16:01:14.087] INFO: prover-node:prover-node Cleaning up backup dir /tmp/848e051b34b84fda/41bc8da47f1ccd68/epoch-proof-data-HxT2DI 16:01:14 [16:01:14.130] WARN: prover-client:proving-broker:prover-node Proving job id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa has already been completed {"provingJobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa"} 16:01:14 [16:01:14.210] INFO: prover-client:proving-agent:prover-node Job id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22resu... 16:01:14 [16:01:14.211] WARN: prover-client:proving-broker:prover-node Proving job id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY not in the in-progress set {"provingJobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa"} 16:01:14 [16:01:14.211] WARN: prover-client:proving-broker:prover-node Proving job id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa already settled, ignoring result {"provingJobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa"} 16:01:20 [16:01:20.244] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 29 mined at 16:04:22 {"l1Timestamp":1750262662,"l1BlockNumber":29,"l2SlotNumber":3,"l2BlockNumber":2,"l2ProvenBlockNumber":0,"totalL2Messages":0} 16:01:20 [16:01:20.251] INFO: prover-node:prover-node Stopping ProverNode 16:01:20 [16:01:20.251] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 16:01:20 [16:01:20.252] INFO: archiver:prover-node Stopped. 16:01:20 [16:01:20.258] INFO: world_state:prover-node Stopped world state synchronizer 16:01:20 [16:01:20.259] INFO: prover-node:prover-node Stopped ProverNode 16:01:20 [16:01:20.259] INFO: node:MAIN-aztec-node Stopping Aztec Node 16:01:20 [16:01:20.760] VERBOSE: sequencer Preparing proposal for block 3 at slot 4 {"globalVariables":{"blockNumber":3,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":4,"timestamp":1750262670,"version":3542590205},"chainTipArchive":"0x0bc41764895a91bb2d483de4d82976c671ff423ea8ca86e56af24bedf2b48909","blockNumber":3,"slot":4} 16:01:20 [16:01:20.797] VERBOSE: block-builder Building block 3 for slot 4 {"slot":4,"slotStart":"2025-06-18T16:04:30.000Z","now":"2025-06-18T16:04:22.573Z","blockNumber":3,"msgCount":0,"opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}} 16:01:20 [16:01:20.803] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.00037971800000377695s {"duration":0.00037971800000377695,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 16:01:20 [16:01:20.822] INFO: sequencer Built block 3 for slot 4 with 0 txs and 0 messages. 0 mana/s {"blockHash":"0x0e9d6d0c4170e28ca15eb2ea9c0ac4840f78d0deb0bde76f2550d63ab3498dc9","globalVariables":{"blockNumber":3,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":4,"timestamp":1750262670,"version":3542590205},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":35.21797299999889,"publicProcessDuration":0.9461599999995087,"rollupCircuitsDuration":26.421363000001293,"txCount":0,"blockNumber":3,"blockTimestamp":1750262670,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 16:01:20 [16:01:20.824] VERBOSE: sequencer Attesting committee is empty 16:01:20 [16:01:20.923] VERBOSE: ethereum:tx_delayer Sent tx immediately 0x9874fd01de04fdc20b6989c848b84357c763535c815949fa72ce0288d1938e69 16:01:20 [16:01:20.924] VERBOSE: node:MAIN-aztec-node Sent L1 transaction 0x9874fd01de04fdc20b6989c848b84357c763535c815949fa72ce0288d1938e69 {"gasLimit":464731,"maxFeePerGas":"1.250606201","maxPriorityFeePerGas":"1.2","maxFeePerBlobGas":"0.000000001"} 16:01:22 [16:01:22.261] INFO: slasher Slasher client stopped. 16:01:28 [16:01:28.295] INFO: sequencer:publisher Bundled [propose] transaction [succeeded] 16:01:28 [16:01:28.296] VERBOSE: sequencer:publisher Published L2 block to L1 rollup contract {"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0x9874fd01de04fdc20b6989c848b84357c763535c815949fa72ce0288d1938e69","calldataSize":1220,"calldataGas":8816,"txCount":0,"blockNumber":3,"blockTimestamp":1750262670,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 16:01:28 [16:01:28.297] VERBOSE: node:blob-sink:client Sending 1 blobs to blob sink 16:01:28 [16:01:28.304] INFO: sequencer Stopped sequencer 16:01:28 [16:01:28.312] INFO: blob-sink:server Received blob sidecar for block 0x3908beafb169f1cacad1bc419cc9294491b7dbccdc5a8c58cd0ab9849764b616 16:01:28 [16:01:28.320] INFO: p2p P2P client stopped 16:01:28 [16:01:28.327] INFO: world_state Stopped world state synchronizer 16:01:28 [16:01:28.332] INFO: blob-sink:server Blob sidecar stored successfully for block 0x3908beafb169f1cacad1bc419cc9294491b7dbccdc5a8c58cd0ab9849764b616 16:01:28 [16:01:28.390] INFO: archiver Downloaded L2 block 3 {"blockHash":"0x0e9d6d0c4170e28ca15eb2ea9c0ac4840f78d0deb0bde76f2550d63ab3498dc9","blockNumber":3,"txCount":0,"globalVariables":{"blockNumber":3,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":4,"timestamp":1750262670,"version":3542590205},"archiveRoot":"0x107e3ba2e8449d69a11714eb38799fce8f2208e7d27fcc2c26d68881224716c3","archiveNextLeafIndex":4} 16:01:28 [16:01:28.402] INFO: archiver Stopped. 16:01:28 [16:01:28.402] INFO: node:MAIN-aztec-node Stopped Aztec Node 16:01:28 [16:01:28.408] INFO: node:MAIN-aztec-node Stopping Aztec Node 16:01:30 [16:01:30.409] INFO: slasher Slasher client stopped. 16:01:30 [16:01:30.410] WARN: validator Running promise was not started 16:01:30 [16:01:30.410] WARN: sequencer Running promise was not started 16:01:30 [16:01:30.411] INFO: sequencer Stopped sequencer 16:01:30 [16:01:30.411] WARN: p2p:l2-block-stream Running promise was not started 16:01:30 [16:01:30.411] INFO: p2p P2P client stopped 16:01:30 [16:01:30.411] WARN: world-state:block_stream Running promise was not started 16:01:30 [16:01:30.411] INFO: world_state Stopped world state synchronizer 16:01:30 [16:01:30.412] WARN: archiver Running promise was not started 16:01:30 [16:01:30.420] INFO: archiver Stopped. 16:01:30 [16:01:30.420] INFO: node:MAIN-aztec-node Stopped Aztec Node 16:01:30 [16:01:30.420] INFO: prover-node:prover-node Stopping ProverNode 16:01:30 [16:01:30.421] WARN: prover-node:prover-node Running promise was not started 16:01:30 [16:01:30.421] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 16:01:30 [16:01:30.421] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 16:01:30 [16:01:30.422] WARN: archiver:prover-node Running promise was not started 16:01:30 [16:01:30.422] INFO: archiver:prover-node Stopped. 16:01:30 [16:01:30.423] WARN: world-state:block_stream:prover-node Running promise was not started 16:01:30 [16:01:30.423] INFO: world_state:prover-node Stopped world state synchronizer 16:01:30 [16:01:30.423] INFO: prover-node:prover-node Stopped ProverNode 16:01:30 [16:01:30.457] INFO: blob-sink:server Stopping blob sink 16:01:30 [16:01:30.458] INFO: blob-sink:server Blob sink stopped 16:01:30 [16:01:30.466] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data and state {"uploadPath":"/tmp/failed-proofs-K8Qozt","rerunDataDir":"/tmp/rerun-data-BWIhCF","rerunDownloadPath":"/tmp/rerun-download-k4SUp4/data.bin"} 16:01:30 [16:01:30.467] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data from file:///tmp/failed-proofs-K8Qozt/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618160114-64fea6be-886c-4850-957f-4baf86bbbb11 16:01:30 [16:01:30.468] INFO: stdlib:file-store Creating local file file store at /tmp/failed-proofs-K8Qozt/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618160114-64fea6be-886c-4850-957f-4baf86bbbb11 16:01:30 [16:01:30.472] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading state snapshot from file:///tmp/failed-proofs-K8Qozt/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618160114-64fea6be-886c-4850-957f-4baf86bbbb11 to local data directory {"metadata":{"l2BlockNumber":2,"l2BlockHash":"0x0949f720366524b8ff912b085918abd55ded3e7588438af4e4cb4df6fd0ece5e","l1BlockNumber":28,"l1ChainId":31337,"rollupVersion":3542590205,"rollupAddress":"0xe6053f00e88413519a7853afff55d60fe23c339c"},"dataUrls":{"archiver":"file:///tmp/failed-proofs-K8Qozt/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618160114-64fea6be-886c-4850-957f-4baf86bbbb11/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-K8Qozt/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618160114-64fea6be-886c-4850-957f-4baf86bbbb11/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-K8Qozt/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618160114-64fea6be-886c-4850-957f-4baf86bbbb11/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-K8Qozt/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618160114-64fea6be-886c-4850-957f-4baf86bbbb11/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-K8Qozt/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618160114-64fea6be-886c-4850-957f-4baf86bbbb11/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-K8Qozt/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618160114-64fea6be-886c-4850-957f-4baf86bbbb11/l1-to-l2-message-tree.db"}} 16:01:30 [16:01:30.473] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Creating local file file store at /tmp/failed-proofs-K8Qozt/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618160114-64fea6be-886c-4850-957f-4baf86bbbb11 16:01:30 [16:01:30.476] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading snapshot to /tmp/rerun-data-BWIhCF/download-i272W8 {"snapshot":{"dataUrls":{"archiver":"file:///tmp/failed-proofs-K8Qozt/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618160114-64fea6be-886c-4850-957f-4baf86bbbb11/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-K8Qozt/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618160114-64fea6be-886c-4850-957f-4baf86bbbb11/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-K8Qozt/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618160114-64fea6be-886c-4850-957f-4baf86bbbb11/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-K8Qozt/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618160114-64fea6be-886c-4850-957f-4baf86bbbb11/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-K8Qozt/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618160114-64fea6be-886c-4850-957f-4baf86bbbb11/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-K8Qozt/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618160114-64fea6be-886c-4850-957f-4baf86bbbb11/l1-to-l2-message-tree.db"}},"downloadPaths":{"archiver":"/tmp/rerun-data-BWIhCF/download-i272W8/archiver.db","nullifier-tree":"/tmp/rerun-data-BWIhCF/download-i272W8/nullifier-tree.db","public-data-tree":"/tmp/rerun-data-BWIhCF/download-i272W8/public-data-tree.db","note-hash-tree":"/tmp/rerun-data-BWIhCF/download-i272W8/note-hash-tree.db","archive-tree":"/tmp/rerun-data-BWIhCF/download-i272W8/archive-tree.db","l1-to-l2-message-tree":"/tmp/rerun-data-BWIhCF/download-i272W8/l1-to-l2-message-tree.db"}} 16:01:30 [16:01:30.489] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Snapshot downloaded at /tmp/rerun-data-BWIhCF/download-i272W8 {"snapshot":{"dataUrls":{"archiver":"file:///tmp/failed-proofs-K8Qozt/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618160114-64fea6be-886c-4850-957f-4baf86bbbb11/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-K8Qozt/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618160114-64fea6be-886c-4850-957f-4baf86bbbb11/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-K8Qozt/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618160114-64fea6be-886c-4850-957f-4baf86bbbb11/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-K8Qozt/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618160114-64fea6be-886c-4850-957f-4baf86bbbb11/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-K8Qozt/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618160114-64fea6be-886c-4850-957f-4baf86bbbb11/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-K8Qozt/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618160114-64fea6be-886c-4850-957f-4baf86bbbb11/l1-to-l2-message-tree.db"}},"downloadPaths":{"archiver":"/tmp/rerun-data-BWIhCF/download-i272W8/archiver.db","nullifier-tree":"/tmp/rerun-data-BWIhCF/download-i272W8/nullifier-tree.db","public-data-tree":"/tmp/rerun-data-BWIhCF/download-i272W8/public-data-tree.db","note-hash-tree":"/tmp/rerun-data-BWIhCF/download-i272W8/note-hash-tree.db","archive-tree":"/tmp/rerun-data-BWIhCF/download-i272W8/archive-tree.db","l1-to-l2-message-tree":"/tmp/rerun-data-BWIhCF/download-i272W8/l1-to-l2-message-tree.db"}} 16:01:30 [16:01:30.492] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Archiver database set up from snapshot {"path":"/tmp/rerun-data-BWIhCF/archiver","dbVersion":3,"rollupAddress":"0xe6053f00e88413519a7853afff55d60fe23c339c"} 16:01:30 [16:01:30.493] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database l1-to-l2-message-tree set up from snapshot {"path":"/tmp/rerun-data-BWIhCF/world_state/L1ToL2MessageTree","dbVersion":2,"rollupAddress":"0xe6053f00e88413519a7853afff55d60fe23c339c"} 16:01:30 [16:01:30.494] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database archive-tree set up from snapshot {"path":"/tmp/rerun-data-BWIhCF/world_state/ArchiveTree","dbVersion":2,"rollupAddress":"0xe6053f00e88413519a7853afff55d60fe23c339c"} 16:01:30 [16:01:30.494] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database public-data-tree set up from snapshot {"path":"/tmp/rerun-data-BWIhCF/world_state/PublicDataTree","dbVersion":2,"rollupAddress":"0xe6053f00e88413519a7853afff55d60fe23c339c"} 16:01:30 [16:01:30.494] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database note-hash-tree set up from snapshot {"path":"/tmp/rerun-data-BWIhCF/world_state/NoteHashTree","dbVersion":2,"rollupAddress":"0xe6053f00e88413519a7853afff55d60fe23c339c"} 16:01:30 [16:01:30.495] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database nullifier-tree set up from snapshot {"path":"/tmp/rerun-data-BWIhCF/world_state/NullifierTree","dbVersion":2,"rollupAddress":"0xe6053f00e88413519a7853afff55d60fe23c339c"} 16:01:30 [16:01:30.495] INFO: e2e:e2e_epochs:epochs_upload_failed_proof P2P database cleared {"path":"/tmp/rerun-data-BWIhCF/p2p"} 16:01:30 [16:01:30.500] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data from file:///tmp/failed-proofs-K8Qozt/aztec-31337-3542590205-0xe6053f00e88413519a7853afff55d60fe23c339c/0-20250618160114-64fea6be-886c-4850-957f-4baf86bbbb11/data.bin to /tmp/rerun-download-k4SUp4/data.bin 16:01:30 [16:01:30.502] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Epoch proving job data for epoch 0 downloaded successfully 16:01:30 [16:01:30.503] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Rerunning proving job from /tmp/rerun-download-k4SUp4/data.bin 16:01:30 [16:01:30.504] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Using native ACVM binary at ../../noir/noir-repo/target/release/acvm with working directory /tmp/369af512/acvm 16:01:30 [16:01:30.505] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Loaded proving job data for epoch 0 16:01:30 [16:01:30.512] INFO: world-state:database Creating world state data store at directory /tmp/rerun-data-BWIhCF/world_state with map sizes {"archiveTreeMapSizeKb":1048576,"nullifierTreeMapSizeKb":1048576,"noteHashTreeMapSizeKb":1048576,"messageTreeMapSizeKb":1048576,"publicDataTreeMapSizeKb":1048576} and 2 threads. 16:01:30 [16:01:30.531] INFO: archiver:lmdb Creating archiver data store at directory /tmp/rerun-data-BWIhCF/archiver with map size 1048576 KB (LMDB v2) 16:01:30 [16:01:30.533] INFO: archiver:lmdb Starting data store with maxReaders 16 16:01:30 [16:01:30.535] WARN: prover-client:proving-broker-database Found invalid epoch directory /tmp/rerun-data-BWIhCF/archiver when loading epoch databases, ignoring 16:01:30 [16:01:30.535] WARN: prover-client:proving-broker-database Found invalid epoch directory /tmp/rerun-data-BWIhCF/world_state when loading epoch databases, ignoring 16:01:30 [16:01:30.536] INFO: prover-client:proving-broker Proving Broker started 16:01:30 [16:01:30.537] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Rerunning epoch proving job for epoch 0 16:01:30 [16:01:30.537] INFO: prover-node:epoch-proving-job Starting epoch 0 proving job with blocks 1 to 2 {"fromBlock":1,"toBlock":2,"epochSizeBlocks":2,"epochNumber":0,"uuid":"2549bd6e-c3e8-4ac0-a2ad-33a4a5603946"} 16:01:30 [16:01:30.557] INFO: prover-client:orchestrator Starting epoch 0 with 2 blocks 16:01:30 [16:01:30.558] VERBOSE: prover-client:broker-circuit-prover-facade Starting BrokerCircuitProverFacade 16:01:30 [16:01:30.561] VERBOSE: prover-node:epoch-proving-job Starting processing block 1 {"number":1,"blockHash":"0x16fe2f157a84b22106da2f9433c9e73b3fda937896dd50a6a34af582b8ad4ab3","lastArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"2549bd6e-c3e8-4ac0-a2ad-33a4a5603946","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x00000000000000000000000000000000000000000000000000000000d327a2fd","blockNumber":1,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 16:01:30 [16:01:30.562] INFO: prover-client:orchestrator Starting block 1 for slot 2 16:01:30 [16:01:30.562] VERBOSE: prover-node:epoch-proving-job Starting processing block 2 {"number":2,"blockHash":"0x0949f720366524b8ff912b085918abd55ded3e7588438af4e4cb4df6fd0ece5e","lastArchive":"0x0e981d41323ad6f8750f0fddb44d85e4bd914d7e85068d51b11cb4fca5055a03","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"2549bd6e-c3e8-4ac0-a2ad-33a4a5603946","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x00000000000000000000000000000000000000000000000000000000d327a2fd","blockNumber":2,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000003","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 16:01:30 [16:01:30.566] INFO: prover-client:orchestrator Starting block 2 for slot 3 16:01:30 [16:01:30.591] INFO: prover-client:proving-broker New proving job id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a epochNumber=0 {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a"} 16:01:30 [16:01:30.592] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 16:01:30 [16:01:30.592] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 16:01:30 [16:01:30.592] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 16:01:30 [16:01:30.596] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 16:01:30 [16:01:30.596] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 16:01:30 [16:01:30.597] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 16:01:30 [16:01:30.597] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY"} 16:01:30 [16:01:30.600] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000050490999994508457s {"duration":0.000050490999994508457,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 16:01:30 [16:01:30.601] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 16:01:30 [16:01:30.601] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 1 {"blockNumber":1,"blockHash":"0x16fe2f157a84b22106da2f9433c9e73b3fda937896dd50a6a34af582b8ad4ab3","uuid":"2549bd6e-c3e8-4ac0-a2ad-33a4a5603946"} 16:01:30 [16:01:30.604] VERBOSE: prover-client:orchestrator Block 1 completed. Assembling header. 16:01:30 [16:01:30.606] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000015309999995224642s {"duration":0.000015309999995224642,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 16:01:30 [16:01:30.606] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 16:01:30 [16:01:30.607] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 2 {"blockNumber":2,"blockHash":"0x0949f720366524b8ff912b085918abd55ded3e7588438af4e4cb4df6fd0ece5e","uuid":"2549bd6e-c3e8-4ac0-a2ad-33a4a5603946"} 16:01:30 [16:01:30.607] VERBOSE: prover-client:orchestrator Block 2 completed. Assembling header. 16:01:30 [16:01:30.618] VERBOSE: prover-client:orchestrator Updating archive tree with block 1 header 0x16fe2f157a84b22106da2f9433c9e73b3fda937896dd50a6a34af582b8ad4ab3 16:01:30 [16:01:30.634] VERBOSE: prover-client:orchestrator Updating archive tree with block 2 header 0x0949f720366524b8ff912b085918abd55ded3e7588438af4e4cb4df6fd0ece5e 16:01:30 [16:01:30.635] VERBOSE: prover-client:orchestrator Orchestrator finalised block 1 16:01:30 [16:01:30.648] INFO: prover-client:proving-broker-database Creating broker database for epoch 0 at /tmp/rerun-data-BWIhCF/0 with map size 1048576 16:01:30 [16:01:30.651] VERBOSE: prover-client:orchestrator Orchestrator finalised block 2 16:01:30 [16:01:30.673] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 16:01:30 [16:01:30.680] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY epochNumber=0 {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a","provingJobType":"BASE_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...","status":"not-found","numOutstandingJobs":1} 16:01:30 [16:01:30.754] INFO: prover-client:proving-agent Starting job id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input... 16:01:30 [16:01:30.755] INFO: prover-client:proving-agent:job-controller-ebabd4f9 Job controller started jobId=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a {"jobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a"} 16:01:30 [16:01:30.885] INFO: prover-client:proving-agent Job id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22resul... 16:01:30 [16:01:30.886] INFO: prover-client:proving-broker Proving job complete id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY totalAttempts=1 {"provingJobId":"0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a"} 16:01:31 [16:01:31.559] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 16:01:31 [16:01:31.561] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:BASE_PARITY:cae376ed067ec58b85d0a93377f554f12feba8a486ce12ea5f307c6ae932448a type=BASE_PARITY 16:01:31 [16:01:31.561] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 16:01:31 [16:01:31.582] INFO: prover-client:proving-broker New proving job id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa epochNumber=0 {"provingJobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa"} 16:01:31 [16:01:31.594] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY {"provingJobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa","provingJobType":"ROOT_PARITY"} 16:01:31 [16:01:31.637] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY epochNumber=0 {"provingJobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa","provingJobType":"ROOT_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu...","status":"not-found","numOutstandingJobs":1} 16:01:31 [16:01:31.664] INFO: prover-client:proving-agent Starting job id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu... 16:01:31 [16:01:31.692] INFO: prover-client:proving-agent:job-controller-6eb87842 Job controller started jobId=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa {"jobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa"} 16:01:31 [16:01:31.901] INFO: prover-client:proving-agent Job id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22resu... 16:01:31 [16:01:31.901] INFO: prover-client:proving-broker Proving job complete id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY totalAttempts=1 {"provingJobId":"0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa"} 16:01:32 [16:01:32.563] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 16:01:32 [16:01:32.566] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:ROOT_PARITY:3a06953125b7bc39ea691aa12173ac50ab5fa04977f09c1561b3c96a4bc1bfaa type=ROOT_PARITY 16:01:32 [16:01:32.566] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 16:01:32 [16:01:32.585] INFO: prover-client:proving-broker New proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:d06c52694fc795771abd0bf3ef284617e478a887081a538b24226322abff8f98 epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:d06c52694fc795771abd0bf3ef284617e478a887081a538b24226322abff8f98"} 16:01:32 [16:01:32.591] INFO: prover-client:proving-broker New proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:d30bd48a4571424d9bc7c68e8c1cb8d5437ee2647ae8d83a3cb2100fc4d2821c epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:d30bd48a4571424d9bc7c68e8c1cb8d5437ee2647ae8d83a3cb2100fc4d2821c"} 16:01:32 [16:01:32.640] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:EMPTY_BLOCK_ROOT_ROLLUP:d06c52694fc795771abd0bf3ef284617e478a887081a538b24226322abff8f98 type=EMPTY_BLOCK_ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:d06c52694fc795771abd0bf3ef284617e478a887081a538b24226322abff8f98","provingJobType":"EMPTY_BLOCK_ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input...","status":"not-found","numOutstandingJobs":2} 16:01:32 [16:01:32.641] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:EMPTY_BLOCK_ROOT_ROLLUP:d30bd48a4571424d9bc7c68e8c1cb8d5437ee2647ae8d83a3cb2100fc4d2821c type=EMPTY_BLOCK_ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:d30bd48a4571424d9bc7c68e8c1cb8d5437ee2647ae8d83a3cb2100fc4d2821c","provingJobType":"EMPTY_BLOCK_ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input...","status":"not-found","numOutstandingJobs":2} 16:01:32 [16:01:32.697] INFO: prover-client:proving-agent Starting job id=0:EMPTY_BLOCK_ROOT_ROLLUP:d06c52694fc795771abd0bf3ef284617e478a887081a538b24226322abff8f98 type=EMPTY_BLOCK_ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input... 16:01:32 [16:01:32.719] INFO: prover-client:proving-agent:job-controller-ac94cfeb Job controller started jobId=0:EMPTY_BLOCK_ROOT_ROLLUP:d06c52694fc795771abd0bf3ef284617e478a887081a538b24226322abff8f98 {"jobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:d06c52694fc795771abd0bf3ef284617e478a887081a538b24226322abff8f98"} 16:01:32 [16:01:32.725] INFO: prover-client:proving-agent Starting job id=0:EMPTY_BLOCK_ROOT_ROLLUP:d30bd48a4571424d9bc7c68e8c1cb8d5437ee2647ae8d83a3cb2100fc4d2821c type=EMPTY_BLOCK_ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input... 16:01:32 [16:01:32.741] INFO: prover-client:proving-agent:job-controller-b74adde7 Job controller started jobId=0:EMPTY_BLOCK_ROOT_ROLLUP:d30bd48a4571424d9bc7c68e8c1cb8d5437ee2647ae8d83a3cb2100fc4d2821c {"jobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:d30bd48a4571424d9bc7c68e8c1cb8d5437ee2647ae8d83a3cb2100fc4d2821c"} 16:01:34 [16:01:34.680] INFO: prover-client:proving-agent Job id=0:EMPTY_BLOCK_ROOT_ROLLUP:d06c52694fc795771abd0bf3ef284617e478a887081a538b24226322abff8f98 type=EMPTY_BLOCK_ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22resul... 16:01:34 [16:01:34.681] INFO: prover-client:proving-broker Proving job complete id=0:EMPTY_BLOCK_ROOT_ROLLUP:d06c52694fc795771abd0bf3ef284617e478a887081a538b24226322abff8f98 type=EMPTY_BLOCK_ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:d06c52694fc795771abd0bf3ef284617e478a887081a538b24226322abff8f98"} 16:01:35 [16:01:35.676] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 2, total jobs ready: 1 16:01:35 [16:01:35.686] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:d06c52694fc795771abd0bf3ef284617e478a887081a538b24226322abff8f98 type=EMPTY_BLOCK_ROOT_ROLLUP 16:01:35 [16:01:35.687] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 16:01:36 [16:01:36.965] INFO: prover-client:proving-agent Job id=0:EMPTY_BLOCK_ROOT_ROLLUP:d30bd48a4571424d9bc7c68e8c1cb8d5437ee2647ae8d83a3cb2100fc4d2821c type=EMPTY_BLOCK_ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22resul... 16:01:36 [16:01:36.965] INFO: prover-client:proving-broker Proving job complete id=0:EMPTY_BLOCK_ROOT_ROLLUP:d30bd48a4571424d9bc7c68e8c1cb8d5437ee2647ae8d83a3cb2100fc4d2821c type=EMPTY_BLOCK_ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:d30bd48a4571424d9bc7c68e8c1cb8d5437ee2647ae8d83a3cb2100fc4d2821c"} 16:01:37 [16:01:37.770] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 16:01:37 [16:01:37.775] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:d30bd48a4571424d9bc7c68e8c1cb8d5437ee2647ae8d83a3cb2100fc4d2821c type=EMPTY_BLOCK_ROOT_ROLLUP 16:01:37 [16:01:37.776] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 16:01:37 [16:01:37.795] INFO: prover-client:proving-broker New proving job id=0:ROOT_ROLLUP:22727ea65d41fa77f27286ff1c496c89bbeb0b76e21a8c22fd773b8006dbc856 epochNumber=0 {"provingJobId":"0:ROOT_ROLLUP:22727ea65d41fa77f27286ff1c496c89bbeb0b76e21a8c22fd773b8006dbc856"} 16:01:37 [16:01:37.854] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_ROLLUP:22727ea65d41fa77f27286ff1c496c89bbeb0b76e21a8c22fd773b8006dbc856 type=ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:ROOT_ROLLUP:22727ea65d41fa77f27286ff1c496c89bbeb0b76e21a8c22fd773b8006dbc856","provingJobType":"ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22input...","status":"not-found","numOutstandingJobs":1} 16:01:37 [16:01:37.890] INFO: prover-client:proving-agent Starting job id=0:ROOT_ROLLUP:22727ea65d41fa77f27286ff1c496c89bbeb0b76e21a8c22fd773b8006dbc856 type=ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22input... 16:01:37 [16:01:37.907] INFO: prover-client:proving-agent:job-controller-b801131d Job controller started jobId=0:ROOT_ROLLUP:22727ea65d41fa77f27286ff1c496c89bbeb0b76e21a8c22fd773b8006dbc856 {"jobId":"0:ROOT_ROLLUP:22727ea65d41fa77f27286ff1c496c89bbeb0b76e21a8c22fd773b8006dbc856"} 16:01:38 [16:01:38.057] INFO: prover-client:proving-agent Job id=0:ROOT_ROLLUP:22727ea65d41fa77f27286ff1c496c89bbeb0b76e21a8c22fd773b8006dbc856 type=ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22resul... 16:01:38 [16:01:38.058] INFO: prover-client:proving-broker Proving job complete id=0:ROOT_ROLLUP:22727ea65d41fa77f27286ff1c496c89bbeb0b76e21a8c22fd773b8006dbc856 type=ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:ROOT_ROLLUP:22727ea65d41fa77f27286ff1c496c89bbeb0b76e21a8c22fd773b8006dbc856"} 16:01:38 [16:01:38.778] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 16:01:38 [16:01:38.782] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:ROOT_ROLLUP:22727ea65d41fa77f27286ff1c496c89bbeb0b76e21a8c22fd773b8006dbc856 type=ROOT_ROLLUP 16:01:38 [16:01:38.784] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 16:01:38 [16:01:38.784] VERBOSE: prover-client:orchestrator Orchestrator completed root rollup for epoch 0 16:01:38 [16:01:38.788] INFO: prover-node:epoch-proving-job Finalised proof for epoch 0 {"epochNumber":0,"uuid":"2549bd6e-c3e8-4ac0-a2ad-33a4a5603946","duration":8251.087290999996} 16:01:38 [16:01:38.789] INFO: prover-node:epoch-proving-job Submitted proof for epoch 0 (blocks 1 to 2) {"epochNumber":0,"uuid":"2549bd6e-c3e8-4ac0-a2ad-33a4a5603946"} 16:01:38 [16:01:38.790] VERBOSE: prover-client:broker-circuit-prover-facade Stopping BrokerCircuitProverFacade 16:01:38 [16:01:38.790] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Completed job for epoch 0 with status completed 16:01:38 [16:01:38.790] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Test succeeded 16:01:38 [16:01:38.791] INFO: prover-node:prover-node Stopping ProverNode 16:01:38 [16:01:38.791] WARN: prover-node:prover-node Running promise was not started 16:01:38 [16:01:38.792] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 16:01:38 [16:01:38.792] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 16:01:38 [16:01:38.792] WARN: archiver:prover-node Running promise was not started 16:01:38 [16:01:38.792] INFO: archiver:prover-node Stopped. 16:01:38 [16:01:38.792] WARN: world-state:block_stream:prover-node Running promise was not started 16:01:38 [16:01:38.793] INFO: world_state:prover-node Stopped world state synchronizer 16:01:38 [16:01:38.793] INFO: prover-node:prover-node Stopped ProverNode 16:01:38 [16:01:38.793] INFO: node:MAIN-aztec-node Stopping Aztec Node 16:01:40 [16:01:40.793] INFO: slasher Slasher client stopped. 16:01:40 [16:01:40.794] WARN: validator Running promise was not started 16:01:40 [16:01:40.794] WARN: sequencer Running promise was not started 16:01:40 [16:01:40.795] INFO: sequencer Stopped sequencer 16:01:40 [16:01:40.795] WARN: p2p:l2-block-stream Running promise was not started 16:01:40 [16:01:40.795] INFO: p2p P2P client stopped 16:01:40 [16:01:40.795] WARN: world-state:block_stream Running promise was not started 16:01:40 [16:01:40.795] INFO: world_state Stopped world state synchronizer 16:01:40 [16:01:40.795] WARN: archiver Running promise was not started 16:01:40 [16:01:40.796] INFO: archiver Stopped. 16:01:40 [16:01:40.800] INFO: node:MAIN-aztec-node Stopped Aztec Node 16:01:40 [16:01:40.801] INFO: node:MAIN-aztec-node Stopping Aztec Node 16:01:42 [16:01:42.801] INFO: slasher Slasher client stopped. 16:01:42 [16:01:42.803] WARN: validator Running promise was not started 16:01:42 [16:01:42.803] WARN: sequencer Running promise was not started 16:01:42 [16:01:42.803] INFO: sequencer Stopped sequencer 16:01:42 [16:01:42.804] WARN: p2p:l2-block-stream Running promise was not started 16:01:42 [16:01:42.804] INFO: p2p P2P client stopped 16:01:42 [16:01:42.804] WARN: world-state:block_stream Running promise was not started 16:01:42 [16:01:42.805] INFO: world_state Stopped world state synchronizer 16:01:42 [16:01:42.805] WARN: archiver Running promise was not started 16:01:42 [16:01:42.805] INFO: archiver Stopped. 16:01:42 [16:01:42.805] INFO: node:MAIN-aztec-node Stopped Aztec Node 16:01:42 [16:01:42.805] INFO: prover-node:prover-node Stopping ProverNode 16:01:42 [16:01:42.806] WARN: prover-node:prover-node Running promise was not started 16:01:42 [16:01:42.806] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 16:01:42 [16:01:42.806] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 16:01:42 [16:01:42.806] WARN: archiver:prover-node Running promise was not started 16:01:42 [16:01:42.806] INFO: archiver:prover-node Stopped. 16:01:42 [16:01:42.807] WARN: world-state:block_stream:prover-node Running promise was not started 16:01:42 [16:01:42.807] INFO: world_state:prover-node Stopped world state synchronizer 16:01:42 [16:01:42.807] INFO: prover-node:prover-node Stopped ProverNode 16:01:42 [16:01:42.809] INFO: blob-sink:server Stopping blob sink 16:01:42 [16:01:42.809] INFO: blob-sink:server Blob sink already stopped 16:01:42 PASS src/e2e_epochs/epochs_upload_failed_proof.test.ts 16:01:42 e2e_epochs/epochs_upload_failed_proof 16:01:42 uploads failed proving job state and re-runs it on a fresh instance (56397 ms) 16:01:42 16:01:42 Test Suites: 1 passed, 1 total 16:01:42 Tests: 1 passed, 1 total 16:01:42 Snapshots: 0 total 16:01:42 Time: 65.464 s 16:01:42 Ran all test suites matching src/e2e_epochs/epochs_upload_failed_proof.test.ts. 16:01:42 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?