ACI ·

Parent Log: http://ci.aztec-labs.com/1105e0e4ebda3b8d Command: d57d38082bbaf86d:ISOLATE=1:NAME=e2e_epochs/epochs_upload_failed_proof yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_upload_failed_proof.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/2d661b35c089f032f50de084b07dded86f0873b8 Env: REF_NAME=gh-readonly-queue/next/pr-15187-301dce04331dcfb583b7508b91491de618d4acf4 CURRENT_VERSION=0.87.6 CI_FULL=1 Date: Mon Jun 23 10:46:35 UTC 2025 System: ARCH=amd64 CPUS=128 MEM=493Gi HOSTNAME=pr-15187_amd64_x4-full Resources: CPU_LIST=0-127 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_476a42720cde10eb_next 10:46:35 +++ id -u 10:46:35 +++ id -g 10:46:35 ++ docker run -d --name e2e_epochs_epochs_upload_failed_proof --net=none --cpuset-cpus=0-127 --cpus=2 --memory=8g --user 1000:1000 -v/home/aztec-dev:/home/aztec-dev --mount type=tmpfs,target=/tmp,tmpfs-size=1g --workdir /home/aztec-dev/aztec-packages -e HOME -e VERBOSE -e GIT_CONFIG_GLOBAL=/home/aztec-dev/aztec-packages/build-images/src/home/.gitconfig -e FORCE_COLOR=true -e CPUS -e MEM aztecprotocol/build:3.0 /bin/bash -c 'timeout -v 600s bash -c '\''yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_upload_failed_proof.test.ts'\''' 10:46:35 + cid=47a82b41ca6ac351dfa678b1fa4960e57800bb5ee77491dffb1c1f9a4b7076c2 10:46:35 + set +x 10:46:36 {"level":25,"time":1750675596690,"pid":12,"hostname":"47a82b41ca6a","module":"logger","msg":"Logger initialized with level verbose"} 10:46:44 [10:46:44.851] INFO: e2e:epochs_upload_failed_proof Running test: e2e_epochs/epochs_upload_failed_proof uploads failed proving job state and re-runs it on a fresh instance 10:46:45 [10:46:45.011] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Logging metrics to log/e2e_epochs_epochs_upload_failed_proof.jsonl 10:46:45 [10:46:45.290] WARN: ethereum:cheat_codes Set L1 automine to true 10:46:45 [10:46:45.327] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Sent 0.1 ETH to deployer {"deployer":"0x05f32b3cc3888453ff71b01135b34ff8e41263f2","value":100000000000000000} 10:46:45 [10:46:45.342] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Sent 0.1 ETH to deployer {"deployer":"0x05f32b3cc3888453ff71b01135b34ff8e41263f2","value":100000000000000000} 10:46:45 [10:46:45.357] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Multicall3 10:46:45 [10:46:45.359] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Calling anvil_setBlockTimestampInterval with params: [8] 10:46:45 [10:46:45.361] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Set block interval to 8 10:46:45 [10:46:45.362] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contracts from 0xf39Fd6e51aad88F6F4ce6aB8827279cffFb92266 10:46:45 [10:46:45.411] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x8166bb789c828e492198babef9becf8ac44628f059d48e6f68114a9ae2ade6ec {"gasLimit":867658,"maxFeePerGas":"120.351651125","maxPriorityFeePerGas":"118.94979"} 10:46:45 [10:46:45.411] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xB8999345dA8041f1Da51ac5179B1F055A560f397 in tx 0x8166bb789c828e492198babef9becf8ac44628f059d48e6f68114a9ae2ade6ec. 10:46:45 [10:46:45.413] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Fee Asset at 0xb8999345da8041f1da51ac5179b1f055a560f397 10:46:45 [10:46:45.441] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x07d928293fb6819e2a8abf9d0b32b04560f633065cf07cefb5dcf9ca71af1db2 {"gasLimit":867644,"maxFeePerGas":"143.976575211","maxPriorityFeePerGas":"142.739748"} 10:46:45 [10:46:45.441] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xBb9e13665Cfb3d531F288a11E7312b6b91C59292 in tx 0x07d928293fb6819e2a8abf9d0b32b04560f633065cf07cefb5dcf9ca71af1db2. 10:46:45 [10:46:45.443] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Staking Asset at 0xbb9e13665cfb3d531f288a11e7312b6b91c59292 10:46:45 [10:46:45.474] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xd90adcaa1621a861dd7b09565f9dc422367574ea376355a4c91cd87ed3fbfeba {"gasLimit":3252094,"maxFeePerGas":"172.377275728","maxPriorityFeePerGas":"171.2876976"} 10:46:45 [10:46:45.474] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x6f26a1916Df432654607f9c75b764e535e65cf3e in tx 0xd90adcaa1621a861dd7b09565f9dc422367574ea376355a4c91cd87ed3fbfeba. 10:46:45 [10:46:45.476] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed GSE at 0x6f26a1916df432654607f9c75b764e535e65cf3e 10:46:45 [10:46:45.498] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xc6bb96b972383aade82d230cb0c861a0362867228d18483a86f9e4a83b780d2d {"gasLimit":1081864,"maxFeePerGas":"206.505096634","maxPriorityFeePerGas":"205.54523712"} 10:46:45 [10:46:45.499] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x3C709AFec1acEaE522c13145005De788a3CC65c8 in tx 0xc6bb96b972383aade82d230cb0c861a0362867228d18483a86f9e4a83b780d2d. 10:46:45 [10:46:45.504] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Registry at 0x3c709afec1aceae522c13145005de788a3cc65c8 10:46:45 [10:46:45.537] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xf8dde39eb44898986f540429eb4a3f0eeec377763a24054290d85bb8101ac8e4 {"gasLimit":2232036,"maxFeePerGas":"247.515532347","maxPriorityFeePerGas":"246.654284544"} 10:46:45 [10:46:45.538] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xEDE9b34af448F9261efea2DafB2364866b09E01A in tx 0xf8dde39eb44898986f540429eb4a3f0eeec377763a24054290d85bb8101ac8e4. 10:46:45 [10:46:45.539] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed GovernanceProposer at 0xede9b34af448f9261efea2dafb2364866b09e01a 10:46:45 [10:46:45.580] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xaf7178913b5905e53367fb0465133faf75227c51bf46428c817f48a06700bb71 {"gasLimit":3092007,"maxFeePerGas":"296.745116241","maxPriorityFeePerGas":"295.985141452"} 10:46:45 [10:46:45.581] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xa49A3d51a71916F87d60f0e919Fb66E4b933b4df in tx 0xaf7178913b5905e53367fb0465133faf75227c51bf46428c817f48a06700bb71. 10:46:45 [10:46:45.582] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Governance at 0xa49a3d51a71916f87d60f0e919fb66e4b933b4df 10:46:45 [10:46:45.601] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x12d6424d782ad27b9fe44dec1624cf29720992859e74e4ee26f6a49bf5e682cc {"gasLimit":100000,"maxFeePerGas":"355.858763396","maxPriorityFeePerGas":"355.182169742"} 10:46:45 [10:46:45.602] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Set governance on GSE in 0x12d6424d782ad27b9fe44dec1624cf29720992859e74e4ee26f6a49bf5e682cc 10:46:45 [10:46:45.618] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x593e4091a1e08f47177928f9a458263f67a911112187ec79e9a4bc019be7546f {"gasLimit":397405,"maxFeePerGas":"426.824946124","maxPriorityFeePerGas":"426.21860369"} 10:46:45 [10:46:45.619] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x705baA0D3bF675F9B7F169fd5FEA260c436Cd50c in tx 0x593e4091a1e08f47177928f9a458263f67a911112187ec79e9a4bc019be7546f. 10:46:45 [10:46:45.619] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed CoinIssuer at 0x705baa0d3bf675f9b7f169fd5fea260c436cd50c 10:46:45 [10:46:45.620] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for deployments to complete 10:46:45 [10:46:45.620] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 7 transactions to be mined... 10:46:45 [10:46:45.654] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 10:46:45 [10:46:45.664] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x5d6132645b455679b93fe6fc019047a89d80cbc5fb7cbc890344c07a449854fc {"gasLimit":100000,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 10:46:45 [10:46:45.664] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added coin issuer 0x705baa0d3bf675f9b7f169fd5fea260c436cd50c as minter on fee asset in 0x5d6132645b455679b93fe6fc019047a89d80cbc5fb7cbc890344c07a449854fc 10:46:45 [10:46:45.689] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xd01ce626c7c7ee3a243b24780a9fd0dc5184345d6bec4ec1cc5aafc15402dc62 {"gasLimit":56661,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 10:46:45 [10:46:45.716] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x100b31bd1e3992df58985c26db7e5351f01cbb7b9c2e961c411c57733fb6cfa5 {"gasLimit":344517,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 10:46:45 [10:46:45.716] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xB4fF23c4B1E2Bc7C86090d4FBDa21A457ee6727F in tx 0x100b31bd1e3992df58985c26db7e5351f01cbb7b9c2e961c411c57733fb6cfa5. 10:46:45 [10:46:45.717] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed FeeAssetHandler at 0xb4ff23c4b1e2bc7c86090d4fbda21a457ee6727f 10:46:45 [10:46:45.732] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xc451aae80a23ef806a4bacf2e291d1c2ae150b6200ea2ea4e841b119a7e7c28b {"gasLimit":56804,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 10:46:45 [10:46:45.733] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added fee asset handler 0xb4ff23c4b1e2bc7c86090d4fbda21a457ee6727f as minter on fee asset in 0xc451aae80a23ef806a4bacf2e291d1c2ae150b6200ea2ea4e841b119a7e7c28b 10:46:45 [10:46:45.771] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x5eb36206bb7f862342335e4fc973eadb56d6dc572165dff06a227b017ac4eafe {"gasLimit":2514655,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 10:46:45 [10:46:45.772] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xF4de5cF63467155F12E722456ff7952Eb95c40b6 in tx 0x5eb36206bb7f862342335e4fc973eadb56d6dc572165dff06a227b017ac4eafe. 10:46:45 [10:46:45.773] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed StakingAssetHandler at 0xf4de5cf63467155f12e722456ff7952eb95c40b6 10:46:45 [10:46:45.796] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x9a5a484b6057f7e812ffb8538d8cd6a948ec2a89522178514f621f05b5f45a01 {"gasLimit":56804,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 10:46:45 [10:46:45.796] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added staking asset handler 0xf4de5cf63467155f12e722456ff7952eb95c40b6 as minter on staking asset in 0x9a5a484b6057f7e812ffb8538d8cd6a948ec2a89522178514f621f05b5f45a01 10:46:45 [10:46:45.796] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for deployments to complete 10:46:45 [10:46:45.796] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 9 transactions to be mined... 10:46:45 [10:46:45.829] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 10:46:45 [10:46:45.850] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed shared contracts 10:46:45 [10:46:45.884] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x3a452c44942037f215b905f38ac51163490a9b231c6bd08b7e958ae2dd00642b {"gasLimit":84837,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 10:46:45 [10:46:45.884] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Funded reward distributor with 10000000000000000000000000 fee asset in 0x3a452c44942037f215b905f38ac51163490a9b231c6bd08b7e958ae2dd00642b 10:46:45 [10:46:45.914] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x6732a13052b668b6ed53c2db691f949dc5751b43ca937a6796aab9388f3cb12a {"gasLimit":154658,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 10:46:45 [10:46:45.915] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x277E22B0C9698d7f2A1cD7C6d857511617587309 in tx 0x6732a13052b668b6ed53c2db691f949dc5751b43ca937a6796aab9388f3cb12a. 10:46:45 [10:46:45.916] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup will use the mock verifier at 0x277e22b0c9698d7f2a1cd7c6d857511617587309 10:46:45 [10:46:45.916] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup config args {"aztecSlotDuration":16,"aztecEpochDuration":4,"targetCommitteeSize":0,"aztecProofSubmissionEpochs":1,"slashingQuorum":6,"slashingRoundSize":10,"manaTarget":10000000000,"entryQueueFlushSizeMin":48,"entryQueueFlushSizeQuotient":2,"provingCostPerMana":100,"rewardConfig":{"sequencerBps":5000,"increment":200000,"maxScore":5000000,"a":5000,"k":1000000,"minimum":100000}} 10:46:45 [10:46:45.944] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x941674e92e61dc030c2e0b4bd254d3a15f2a5a8081781e583d3bf4a48913c47b {"gasLimit":87007,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 10:46:45 [10:46:45.945] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x755f7b0Abc16C7d115c66eCE21A4C10c13e13a5E in tx 0x941674e92e61dc030c2e0b4bd254d3a15f2a5a8081781e583d3bf4a48913c47b. 10:46:45 [10:46:45.987] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x1ae5ce903470036339870770e59a9f970c504838efebc5df55bd42bb8b6d3eb3 {"gasLimit":5120611,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 10:46:45 [10:46:45.987] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x0B53Fb3A333b73bF09FeaA0a7Bf288F52466E450 in tx 0x1ae5ce903470036339870770e59a9f970c504838efebc5df55bd42bb8b6d3eb3. 10:46:46 [10:46:46.023] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xd84a262d0205f720a2ab56aad4125fa4fc618d7008449739b0eb71454d28af13 {"gasLimit":2891348,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 10:46:46 [10:46:46.023] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x8B9450ADB32f406dFF80fFFA24A9a85A72E733c2 in tx 0xd84a262d0205f720a2ab56aad4125fa4fc618d7008449739b0eb71454d28af13. 10:46:46 [10:46:46.024] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Awaiting for linked libraries to be deployed 10:46:46 [10:46:46.121] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xac6d7e1543753f8f545df98c6abdd9090a75d1bd4a8d883391a52d547edb4d77 {"gasLimit":11249762,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 10:46:46 [10:46:46.123] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xDf95FfE275dAc15De988C0E2c61395FddF6f5C0f in tx 0xac6d7e1543753f8f545df98c6abdd9090a75d1bd4a8d883391a52d547edb4d77. 10:46:46 [10:46:46.124] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Rollup at 0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f {"aztecSlotDuration":16,"aztecEpochDuration":4,"targetCommitteeSize":0,"aztecProofSubmissionEpochs":1,"slashingQuorum":6,"slashingRoundSize":10,"manaTarget":10000000000,"entryQueueFlushSizeMin":48,"entryQueueFlushSizeQuotient":2,"provingCostPerMana":100,"rewardConfig":{"sequencerBps":5000,"increment":200000,"maxScore":5000000,"a":5000,"k":1000000,"minimum":100000}} 10:46:46 [10:46:46.124] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 11 transactions to be mined... 10:46:46 [10:46:46.166] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 10:46:46 [10:46:46.166] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof All core contracts have been deployed 10:46:46 [10:46:46.200] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x10b536818a05beeebbfcb4746693765ff76cc181ef823c6e24b05a3331a66043 {"gasLimit":1056482,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 10:46:46 [10:46:46.201] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x8f7c169880fe40C4f7e9E9c50edC25c48e8439e9 in tx 0x10b536818a05beeebbfcb4746693765ff76cc181ef823c6e24b05a3331a66043. 10:46:46 [10:46:46.202] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed SlashFactory at 0x8f7c169880fe40c4f7e9e9c50edc25c48e8439e9 10:46:46 [10:46:46.239] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xb263bc77edc787ea305721a25b1f2f609a987677818bf3afd0abbca89f0cf623 {"gasLimit":117006,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 10:46:46 [10:46:46.240] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Adding rollup 0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f to registry 0x3c709afec1aceae522c13145005de788a3cc65c8 in tx 0xb263bc77edc787ea305721a25b1f2f609a987677818bf3afd0abbca89f0cf623 10:46:46 [10:46:46.259] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xf20abb426a489c1a1124b5b55b6110aa53ebcf179e67f4f8faf8b52635500b1f {"gasLimit":109478,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 10:46:46 [10:46:46.260] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Adding rollup 0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f to GSE 0x6f26a1916df432654607f9c75b764e535e65cf3e in tx 0xf20abb426a489c1a1124b5b55b6110aa53ebcf179e67f4f8faf8b52635500b1f 10:46:46 [10:46:46.266] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 12 transactions to be mined... 10:46:46 [10:46:46.296] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 10:46:46 [10:46:46.302] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup deployed 10:46:46 [10:46:46.302] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for rollup and slash factory to be deployed 10:46:46 [10:46:46.302] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 12 transactions to be mined... 10:46:46 [10:46:46.335] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 10:46:46 [10:46:46.336] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof All transactions for L1 deployment have been mined 10:46:46 [10:46:46.358] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Aztec L1 contracts initialized {"registryAddress":"0x3c709afec1aceae522c13145005de788a3cc65c8","governanceAddress":"0xa49a3d51a71916f87d60f0e919fb66e4b933b4df","governanceProposerAddress":"0xede9b34af448f9261efea2dafb2364866b09e01a","rollupAddress":"0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f","inboxAddress":"0x3d5e31a2517601aeb780ffd68073cd0dcd546726","outboxAddress":"0x13ca9b80bd8c656bea47a67e86d909c6022db9e2","feeJuicePortalAddress":"0xe49dc79b3a81b9cb8fc53163857f50fd26ec6900","feeJuiceAddress":"0xb8999345da8041f1da51ac5179b1f055a560f397","stakingAssetAddress":"0xbb9e13665cfb3d531f288a11e7312b6b91c59292","rewardDistributorAddress":"0x4a51916a6b10a43f6565042be5b6b69d8d613f64","gseAddress":"0x6f26a1916df432654607f9c75b764e535e65cf3e","coinIssuerAddress":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266"} 10:46:46 [10:46:46.359] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Handing over to governance 10:46:46 [10:46:46.369] WARN: ethereum:cheat_codes Set L1 automine to false 10:46:46 [10:46:46.373] WARN: ethereum:cheat_codes Set L1 interval mining to 8 seconds 10:46:46 [10:46:46.384] WARN: foundation:test-date-provider Time set to 2025-06-23T10:49:49.000Z {"offset":182616,"timeMs":1750675789000} 10:46:46 [10:46:46.398] INFO: aztecjs:utils:watcher Watcher not started because not auto mining 10:46:46 [10:46:46.399] INFO: telemetry:client Using NoopTelemetryClient 10:46:46 [10:46:46.406] INFO: kv-store:lmdb-v2:blob-sink Creating blob-sink data store at directory /tmp/f6e227a10e3ab1e7/blob-sink with map size 134217728 KB (LMDB v2) 10:46:46 [10:46:46.410] INFO: kv-store:lmdb-v2:blob-sink Starting data store with maxReaders 16 10:46:46 [10:46:46.422] INFO: blob-sink:server Server is running on http://localhost:45135 10:46:46 [10:46:46.422] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating and synching an aztec node... 10:46:46 [10:46:46.423] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Using native ACVM binary at ../../noir/noir-repo/target/release/acvm with working directory /tmp/8d29f43e/acvm 10:46:46 [10:46:46.424] INFO: node:blob-sink:client Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:45135"} 10:46:46 [10:46:46.452] VERBOSE: node:MAIN-aztec-node Snapshot sync is disabled. No snapshots URL provided. 10:46:46 [10:46:46.453] INFO: archiver:lmdb Creating archiver data store at directory /tmp/f6e227a10e3ab1e7/archiver with map size 134217728 KB (LMDB v2) 10:46:46 [10:46:46.457] INFO: archiver:lmdb Starting data store with maxReaders 16 10:46:47 [10:46:47.489] INFO: node:blob-sink:client Testing configured blob sources {"blobSinkUrl":"http://localhost:45135"} 10:46:47 [10:46:47.517] INFO: node:blob-sink:client Blob sink is reachable {"blobSinkUrl":"http://localhost:45135"} 10:46:47 [10:46:47.518] WARN: node:blob-sink:client No L1 consensus host urls configured 10:46:47 [10:46:47.518] WARN: node:blob-sink:client No archive client configured 10:46:47 [10:46:47.526] INFO: archiver Starting archiver sync to rollup contract 0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f from L1 block 22 to current L1 block 25 with hash 0x1249ca2e6031dbd5e280f561dc5e82df202e47de640a644dab746d96bef1db6c {"blocksSynchedTo":22,"messagesSynchedTo":{"l1BlockHash":"0xf152b089e2a3895571dc778b24b0ea28869aafce10c63a899959652d51a869e8","l1BlockNumber":22}} 10:46:47 [10:46:47.547] INFO: archiver Initial archiver sync to L1 block 25 complete. {"l1BlockNumber":25,"syncPoint":{"blocksSynchedTo":25},"latest":{"number":0},"proven":{"number":0},"finalized":{"number":0}} 10:46:47 [10:46:47.571] INFO: world-state:database Creating world state data store at directory /tmp/f6e227a10e3ab1e7/world_state with map sizes {"archiveTreeMapSizeKb":134217728,"nullifierTreeMapSizeKb":134217728,"noteHashTreeMapSizeKb":134217728,"messageTreeMapSizeKb":134217728,"publicDataTreeMapSizeKb":134217728} and 2 threads. 10:46:47 [10:46:47.626] INFO: world_state Created world state synchroniser with block history of 2 10:46:47 [10:46:47.627] WARN: node:MAIN-aztec-node Aztec node is accepting fake proofs 10:46:47 [10:46:47.627] INFO: bb-prover:queued_ivc_verifier Starting QueuedIVCVerifier with 8 concurrent verifiers 10:46:47 [10:46:47.648] INFO: p2p:lmdb-v2 Creating p2p data store at directory /tmp/f6e227a10e3ab1e7/p2p with map size 134217728 KB (LMDB v2) 10:46:47 [10:46:47.651] INFO: p2p:lmdb-v2 Starting data store with maxReaders 16 10:46:47 [10:46:47.654] INFO: p2p-archive:lmdb-v2 Creating p2p-archive data store at directory /tmp/f6e227a10e3ab1e7/p2p-archive with map size 134217728 KB (LMDB v2) 10:46:47 [10:46:47.655] INFO: p2p-archive:lmdb-v2 Starting data store with maxReaders 16 10:46:47 [10:46:47.658] INFO: p2p-peer:lmdb-v2 Creating p2p-peers data store at directory /tmp/f6e227a10e3ab1e7/p2p-peers with map size 134217728 KB (LMDB v2) 10:46:47 [10:46:47.659] INFO: p2p-peer:lmdb-v2 Starting data store with maxReaders 16 10:46:47 [10:46:47.662] INFO: p2p:tx_pool Setting maximum tx mempool size {"maxTxPoolSize":100000000} 10:46:47 [10:46:47.664] VERBOSE: p2p P2P is disabled. Using dummy P2P service. 10:46:47 [10:46:47.667] VERBOSE: world-state:block_stream Starting L2 block stream {"proven":false,"pollIntervalMS":50} 10:46:47 [10:46:47.669] INFO: world_state Started world state synchronizer from block 1 10:46:47 [10:46:47.672] VERBOSE: world-state:block_stream Starting sync from block number 0 10:46:47 [10:46:47.674] INFO: p2p Starting p2p client from block 0 with empty mempools 10:46:47 [10:46:47.674] VERBOSE: p2p:l2-block-stream Starting L2 block stream {"batchSize":20,"pollIntervalMS":100,"startingBlock":0} 10:46:48 [10:46:48.026] INFO: epoch-prune-watcher EpochPruneWatcher initialized 10:46:48 [10:46:48.076] VERBOSE: validator Initialized validator with addresses: 0xf96bedc02c1b179792391a1f7d361814398474b9 10:46:48 [10:46:48.076] VERBOSE: node:MAIN-aztec-node All Aztec Node subsystems synced 10:46:48 [10:46:48.089] INFO: slasher Starting Slasher client... 10:46:48 [10:46:48.102] VERBOSE: p2p:l2-block-stream Starting sync from block number 0 10:46:48 [10:46:48.112] INFO: validator Started validator with addresses: 0xf96bedc02c1b179792391a1f7d361814398474b9 10:46:48 [10:46:48.112] VERBOSE: validator Validators 0xf96bedc02c1b179792391a1f7d361814398474b9 are not on the validator committee for epoch 0 10:46:48 [10:46:48.113] INFO: sequencer Sequencer config set {"transactionPollingIntervalMS":500,"maxTxsPerBlock":32,"minTxsPerBlock":0,"maxL2BlockGas":10000000000,"publishTxsWithProposals":false,"maxDABlockGas":10000000000,"acvmWorkingDirectory":"/tmp/8d29f43e/acvm","acvmBinaryPath":"../../noir/noir-repo/target/release/acvm","maxBlockSizeInBytes":1048576,"governanceProposerPayload":"0x0000000000000000000000000000000000000000","maxL1TxInclusionTimeIntoSlot":8,"enforceTimeTable":false} 10:46:48 [10:46:48.114] VERBOSE: sequencer Sequencer timetable updated {"enforceTimeTable":false} 10:46:48 [10:46:48.116] INFO: sequencer Sequencer started with address 0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266 10:46:48 [10:46:48.117] VERBOSE: node:MAIN-aztec-node Sequencer started 10:46:48 [10:46:48.117] INFO: node:MAIN-aztec-node Aztec Node version: 0.87.6 10:46:48 [10:46:48.117] INFO: node:MAIN-aztec-node Aztec Node started on chain 0x7a69 {"registryAddress":"0x3c709afec1aceae522c13145005de788a3cc65c8","governanceAddress":"0xa49a3d51a71916f87d60f0e919fb66e4b933b4df","governanceProposerAddress":"0xede9b34af448f9261efea2dafb2364866b09e01a","rollupAddress":"0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f","inboxAddress":"0x3d5e31a2517601aeb780ffd68073cd0dcd546726","outboxAddress":"0x13ca9b80bd8c656bea47a67e86d909c6022db9e2","feeJuicePortalAddress":"0xe49dc79b3a81b9cb8fc53163857f50fd26ec6900","feeJuiceAddress":"0xb8999345da8041f1da51ac5179b1f055a560f397","stakingAssetAddress":"0xbb9e13665cfb3d531f288a11e7312b6b91c59292","rewardDistributorAddress":"0x4a51916a6b10a43f6565042be5b6b69d8d613f64","gseAddress":"0x6f26a1916df432654607f9c75b764e535e65cf3e","coinIssuerAddress":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","slashFactoryAddress":"0x8f7c169880fe40c4f7e9e9c50edc25c48e8439e9","feeAssetHandlerAddress":"0xb4ff23c4b1e2bc7c86090d4fbda21a457ee6727f","stakingAssetHandlerAddress":"0xf4de5cf63467155f12e722456ff7952eb95c40b6","zkPassportVerifierAddress":"0xee9f10f38319eae2730dba28fb09081db806c5e5"} 10:46:48 [10:46:48.119] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating and syncing a simulated prover node... 10:46:48 [10:46:48.193] INFO: blob-sink:client:prover-node Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:45135"} 10:46:48 [10:46:48.200] INFO: archiver:lmdb:prover-node Creating archiver data store at directory /tmp/f6e227a10e3ab1e7/a0f37af707723c26/archiver with map size 134217728 KB (LMDB v2) 10:46:48 [10:46:48.226] VERBOSE: sequencer Preparing proposal for block 1 at slot 2 {"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750675797,"version":115332832},"chainTipArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","blockNumber":1,"slot":2} 10:46:48 [10:46:48.231] INFO: archiver:lmdb:prover-node Starting data store with maxReaders 16 10:46:48 [10:46:48.372] VERBOSE: block-builder Building block 1 for slot 2 {"slot":2,"slotStart":"2025-06-23T10:49:57.000Z","now":"2025-06-23T10:49:50.988Z","blockNumber":1,"msgCount":0,"initialStateReference":{"l1ToL2MessageTree":"0x2e33ee2008411c04b99c24b313513d097a0d21a5040b6193d1f978b8226892d6","noteHashTree":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTree":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTree":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9"},"initialArchiveRoot":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}} 10:46:48 [10:46:48.587] INFO: simulator:public-processor:prover-node Processed 0 successful txs and 0 failed txs in 0.2113970360000003s {"duration":0.2113970360000003,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 10:46:48 [10:46:48.727] INFO: sequencer Built block 1 for slot 2 with 0 txs and 0 messages. 0 mana/s {"blockHash":"0x059e61b99b230212fdd1c65d45123a6ed2e07de3bc89bf1942de296742ba8129","globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750675797,"version":115332832},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":416.9362630000014,"publicProcessDuration":212.52469200000087,"rollupCircuitsDuration":357.2353800000001,"txCount":0,"blockNumber":1,"blockTimestamp":1750675797,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 10:46:48 [10:46:48.735] VERBOSE: sequencer Attesting committee is empty 10:46:48 [10:46:48.823] INFO: blob-sink:client:prover-node Testing configured blob sources {"blobSinkUrl":"http://localhost:45135"} 10:46:48 [10:46:48.828] INFO: blob-sink:client:prover-node Blob sink is reachable {"blobSinkUrl":"http://localhost:45135"} 10:46:48 [10:46:48.829] WARN: blob-sink:client:prover-node No L1 consensus host urls configured 10:46:48 [10:46:48.829] WARN: blob-sink:client:prover-node No archive client configured 10:46:48 [10:46:48.837] INFO: archiver:prover-node Starting archiver sync to rollup contract 0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f from L1 block 22 to current L1 block 25 with hash 0x1249ca2e6031dbd5e280f561dc5e82df202e47de640a644dab746d96bef1db6c {"blocksSynchedTo":22,"messagesSynchedTo":{"l1BlockHash":"0xf152b089e2a3895571dc778b24b0ea28869aafce10c63a899959652d51a869e8","l1BlockNumber":22}} 10:46:48 [10:46:48.922] INFO: archiver:prover-node Initial archiver sync to L1 block 25 complete. {"l1BlockNumber":25,"syncPoint":{"blocksSynchedTo":25},"latest":{"number":0},"proven":{"number":0},"finalized":{"number":0}} 10:46:48 [10:46:48.924] INFO: prover-node:blob-sink:client:prover-node Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:45135"} 10:46:48 [10:46:48.924] VERBOSE: prover-node:prover-node Snapshot sync is disabled. No snapshots URL provided. 10:46:48 [10:46:48.926] VERBOSE: prover-node:prover-node Created archiver and synced to block 0 10:46:48 [10:46:48.932] INFO: world-state:database:prover-node Creating world state data store at directory /tmp/f6e227a10e3ab1e7/a0f37af707723c26/world_state with map sizes {"archiveTreeMapSizeKb":134217728,"nullifierTreeMapSizeKb":134217728,"noteHashTreeMapSizeKb":134217728,"messageTreeMapSizeKb":134217728,"publicDataTreeMapSizeKb":134217728} and 2 threads. 10:46:48 [10:46:48.982] INFO: world_state:prover-node Created world state synchroniser with block history of 2 10:46:48 [10:46:48.983] VERBOSE: world-state:block_stream:prover-node Starting L2 block stream {"proven":false,"pollIntervalMS":50} 10:46:48 [10:46:48.984] INFO: world_state:prover-node Started world state synchronizer from block 1 10:46:48 [10:46:48.986] VERBOSE: world-state:block_stream:prover-node Starting sync from block number 0 10:46:48 [10:46:48.987] WARN: prover-client:proving-broker-database:prover-node Found invalid epoch directory /tmp/f6e227a10e3ab1e7/a0f37af707723c26/archiver when loading epoch databases, ignoring 10:46:48 [10:46:48.987] WARN: prover-client:proving-broker-database:prover-node Found invalid epoch directory /tmp/f6e227a10e3ab1e7/a0f37af707723c26/world_state when loading epoch databases, ignoring 10:46:48 [10:46:48.988] INFO: prover-client:proving-broker:prover-node Proving Broker started 10:46:52 [10:46:52.098] VERBOSE: ethereum:tx_delayer Sent tx immediately 0x54cbfc93376eff848e4f595ab7d88167ef98a8ca90175a9f3c76e93a80fd63f1 10:46:52 [10:46:52.099] VERBOSE: node:MAIN-aztec-node Sent L1 transaction 0x54cbfc93376eff848e4f595ab7d88167ef98a8ca90175a9f3c76e93a80fd63f1 {"gasLimit":470455,"maxFeePerGas":"500","maxPriorityFeePerGas":"500","maxFeePerBlobGas":"0.000000001"} 10:46:52 [10:46:52.146] INFO: prover-node:prover-coordination:prover-node Using prover coordination via aztec node 10:46:52 [10:46:52.149] INFO: e2e:e2e_epochs:epochs_upload_failed_proof:prover-node Created and synced prover node {"publisherAddress":"0x3C44CdDdB6a900fa2b585dd299e03d12FA4293BC"} 10:46:52 [10:46:52.150] INFO: prover-node:epoch-monitor:prover-node Started EpochMonitor {"pollingIntervalMs":200} 10:46:52 [10:46:52.158] INFO: prover-node:prover-node Started Prover Node with prover id 0x0000000000000000000000000000000000000000000000000000000000000001 {"proverNodePollingIntervalMs":200,"proverNodeMaxPendingJobs":10,"proverNodeMaxParallelBlocksPerEpoch":32,"txGatheringIntervalMs":1000,"txGatheringBatchSize":10,"txGatheringMaxParallelRequestsPerNode":100,"proverNodeFailedEpochStore":"file:///tmp/failed-proofs-ItOhao","dataDirectory":"/tmp/f6e227a10e3ab1e7/a0f37af707723c26","l1ChainId":31337,"rollupVersion":115332832} 10:46:52 [10:46:52.159] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating a pxe... 10:46:52 [10:46:52.166] INFO: pxe:data:lmdb Creating pxe_data data store at directory /tmp/5d5d5b87dea6f344/pxe_data with map size 134217728 KB (LMDB v2) 10:46:52 [10:46:52.168] INFO: pxe:data:lmdb Starting data store with maxReaders 16 10:46:52 [10:46:52.655] VERBOSE: pxe:service Registered protocol contracts in pxe {"AuthRegistry":"0x0000000000000000000000000000000000000000000000000000000000000001","ContractInstanceDeployer":"0x0000000000000000000000000000000000000000000000000000000000000002","ContractClassRegisterer":"0x0000000000000000000000000000000000000000000000000000000000000003","MultiCallEntrypoint":"0x0000000000000000000000000000000000000000000000000000000000000004","FeeJuice":"0x0000000000000000000000000000000000000000000000000000000000000005","Router":"0x0000000000000000000000000000000000000000000000000000000000000006"} 10:46:52 [10:46:52.656] INFO: pxe:service Started PXE connected to chain 31337 version 115332832 10:46:52 [10:46:52.666] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L2 genesis at L1 block 22 (timestamp 1750675765) 10:46:52 [10:46:52.668] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting until L1 timestamp 1750675829 is reached as the start of epoch 1 10:46:52 [10:46:52.916] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 25 mined at 10:49:49 with new L2 block 0 for epoch 0 with proof up to L2 block 0 for epoch 0 {"l1Timestamp":1750675789,"l1BlockNumber":25,"l2SlotNumber":1,"l2BlockNumber":0,"l2ProvenBlockNumber":0,"totalL2Messages":0} 10:46:54 [10:46:54.434] INFO: sequencer:publisher Bundled [propose] transaction [succeeded] 10:46:54 [10:46:54.435] VERBOSE: sequencer:publisher Published L2 block to L1 rollup contract {"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0x54cbfc93376eff848e4f595ab7d88167ef98a8ca90175a9f3c76e93a80fd63f1","calldataSize":1220,"calldataGas":8828,"txCount":0,"blockNumber":1,"blockTimestamp":1750675797,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 10:46:54 [10:46:54.435] VERBOSE: node:blob-sink:client Sending 1 blobs to blob sink 10:46:54 [10:46:54.450] WARN: node:blob-sink:client Unable to get blob sidecar for 0x5af243380e309be566b82c7244a9e571812e00af1ee26d0f19cfa982e7b21cf9: Not Found (404) {"status":404,"statusText":"Not Found","body":"{\"error\":\"Blob not found\"}"} 10:46:54 [10:46:54.452] WARN: node:blob-sink:client Failed to fetch blobs for 0x5af243380e309be566b82c7244a9e571812e00af1ee26d0f19cfa982e7b21cf9 from all blob sources {"blobSinkUrl":"http://localhost:45135"} 10:46:54 [10:46:54.469] INFO: blob-sink:server Received blob sidecar for block 0x5af243380e309be566b82c7244a9e571812e00af1ee26d0f19cfa982e7b21cf9 10:46:54 [10:46:54.496] INFO: blob-sink:server Blob sidecar stored successfully for block 0x5af243380e309be566b82c7244a9e571812e00af1ee26d0f19cfa982e7b21cf9 10:46:54 [10:46:54.540] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 26 mined at 10:49:57 with new L2 block 1 for epoch 0 {"l1Timestamp":1750675797,"l1BlockNumber":26,"l2SlotNumber":2,"l2BlockNumber":1,"l2ProvenBlockNumber":0,"totalL2Messages":0} 10:46:54 [10:46:54.597] INFO: archiver:prover-node Downloaded L2 block 1 {"blockHash":"0x059e61b99b230212fdd1c65d45123a6ed2e07de3bc89bf1942de296742ba8129","blockNumber":1,"txCount":0,"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750675797,"version":115332832},"archiveRoot":"0x29e632bdc99ae1b68169de6bab944b379df4cab96f3830733acea170cd973096","archiveNextLeafIndex":2} 10:46:54 [10:46:54.666] INFO: world_state:prover-node World state updated with L2 block 1 {"eventName":"l2-block-handled","duration":7.273861999998189,"unfinalisedBlockNumber":1,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":1,"blockTimestamp":1750675797,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 10:46:54 [10:46:54.667] INFO: archiver Downloaded L2 block 1 {"blockHash":"0x059e61b99b230212fdd1c65d45123a6ed2e07de3bc89bf1942de296742ba8129","blockNumber":1,"txCount":0,"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750675797,"version":115332832},"archiveRoot":"0x29e632bdc99ae1b68169de6bab944b379df4cab96f3830733acea170cd973096","archiveNextLeafIndex":2} 10:46:54 [10:46:54.690] INFO: world_state World state updated with L2 block 1 {"eventName":"l2-block-handled","duration":11.723538000002009,"unfinalisedBlockNumber":1,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":1,"blockTimestamp":1750675797,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 10:46:54 [10:46:54.772] VERBOSE: p2p Synched to latest block 1 10:46:55 [10:46:55.159] VERBOSE: prover-node:prover-node Fetching 0 tx hashes for block number 1 from coordination 10:46:55 [10:46:55.163] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 10:47:02 [10:47:02.534] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 27 mined at 10:50:05 {"l1Timestamp":1750675805,"l1BlockNumber":27,"l2SlotNumber":2,"l2BlockNumber":1,"l2ProvenBlockNumber":0,"totalL2Messages":0} 10:47:02 [10:47:02.701] VERBOSE: sequencer Preparing proposal for block 2 at slot 3 {"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750675813,"version":115332832},"chainTipArchive":"0x29e632bdc99ae1b68169de6bab944b379df4cab96f3830733acea170cd973096","blockNumber":2,"slot":3} 10:47:02 [10:47:02.781] VERBOSE: block-builder Building block 2 for slot 3 {"slot":3,"slotStart":"2025-06-23T10:50:13.000Z","now":"2025-06-23T10:50:05.397Z","blockNumber":2,"msgCount":0,"initialStateReference":{"l1ToL2MessageTree":"0x2e33ee2008411c04b99c24b313513d097a0d21a5040b6193d1f978b8226892d6","noteHashTree":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTree":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTree":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9"},"initialArchiveRoot":"0x29e632bdc99ae1b68169de6bab944b379df4cab96f3830733acea170cd973096","opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}} 10:47:02 [10:47:02.787] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.00027842699999746403s {"duration":0.00027842699999746403,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 10:47:02 [10:47:02.826] INFO: sequencer Built block 2 for slot 3 with 0 txs and 0 messages. 0 mana/s {"blockHash":"0x0235dbac0a871ddf132dad7f7f5aa2e96edd08704f1dafafdabffd8cb88d92f1","globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750675813,"version":115332832},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":59.88937799999985,"publicProcessDuration":0.8139590000027965,"rollupCircuitsDuration":47.25075899999865,"txCount":0,"blockNumber":2,"blockTimestamp":1750675813,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 10:47:02 [10:47:02.828] VERBOSE: sequencer Attesting committee is empty 10:47:02 [10:47:02.998] VERBOSE: ethereum:tx_delayer Sent tx immediately 0xd629cb6519044a70617a8d6ce0afb001a89e723b266e85e1e87c5ca141946aec 10:47:02 [10:47:02.999] VERBOSE: node:MAIN-aztec-node Sent L1 transaction 0xd629cb6519044a70617a8d6ce0afb001a89e723b266e85e1e87c5ca141946aec {"gasLimit":391098,"maxFeePerGas":"1.266232911","maxPriorityFeePerGas":"1.2","maxFeePerBlobGas":"0.000000001"} 10:47:10 [10:47:10.460] INFO: sequencer:publisher Bundled [propose] transaction [succeeded] 10:47:10 [10:47:10.464] VERBOSE: sequencer:publisher Published L2 block to L1 rollup contract {"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0xd629cb6519044a70617a8d6ce0afb001a89e723b266e85e1e87c5ca141946aec","calldataSize":1220,"calldataGas":8828,"txCount":0,"blockNumber":2,"blockTimestamp":1750675813,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 10:47:10 [10:47:10.465] VERBOSE: node:blob-sink:client Sending 1 blobs to blob sink 10:47:10 [10:47:10.491] INFO: blob-sink:server Received blob sidecar for block 0x37eb8d0648db43bc72924c36dee41ff5c43045a5d9ea1d54a8c0ca9e9bf60c7c 10:47:10 [10:47:10.517] INFO: blob-sink:server Blob sidecar stored successfully for block 0x37eb8d0648db43bc72924c36dee41ff5c43045a5d9ea1d54a8c0ca9e9bf60c7c 10:47:10 [10:47:10.519] WARN: archiver Failed to reach L2 block 2 at 27 (latest is 1). Rolling back last synched L1 block number to 26. {"latestLocalL2BlockNumber":1,"latestLocalL2BlockArchive":"0x29e632bdc99ae1b68169de6bab944b379df4cab96f3830733acea170cd973096","blocksSynchedTo":26,"currentL1BlockNumber":27,"provenBlockNumber":0,"provenArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","pendingBlockNumber":2,"pendingArchive":"0x02c628a93a298ace10c1333e195a6e39c395e96d9b4f0883fd34e490280b3789"} 10:47:10 [10:47:10.588] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 28 mined at 10:50:13 with new L2 block 2 for epoch 0 {"l1Timestamp":1750675813,"l1BlockNumber":28,"l2SlotNumber":3,"l2BlockNumber":2,"l2ProvenBlockNumber":0,"totalL2Messages":0} 10:47:10 [10:47:10.723] INFO: archiver:prover-node Downloaded L2 block 2 {"blockHash":"0x0235dbac0a871ddf132dad7f7f5aa2e96edd08704f1dafafdabffd8cb88d92f1","blockNumber":2,"txCount":0,"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750675813,"version":115332832},"archiveRoot":"0x02c628a93a298ace10c1333e195a6e39c395e96d9b4f0883fd34e490280b3789","archiveNextLeafIndex":3} 10:47:10 [10:47:10.754] INFO: archiver Downloaded L2 block 2 {"blockHash":"0x0235dbac0a871ddf132dad7f7f5aa2e96edd08704f1dafafdabffd8cb88d92f1","blockNumber":2,"txCount":0,"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750675813,"version":115332832},"archiveRoot":"0x02c628a93a298ace10c1333e195a6e39c395e96d9b4f0883fd34e490280b3789","archiveNextLeafIndex":3} 10:47:10 [10:47:10.782] INFO: world_state World state updated with L2 block 2 {"eventName":"l2-block-handled","duration":7.063567000004696,"unfinalisedBlockNumber":2,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":2,"blockTimestamp":1750675813,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 10:47:10 [10:47:10.792] INFO: world_state:prover-node World state updated with L2 block 2 {"eventName":"l2-block-handled","duration":12.722230999999738,"unfinalisedBlockNumber":2,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":2,"blockTimestamp":1750675813,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 10:47:10 [10:47:10.867] VERBOSE: p2p Synched to latest block 2 10:47:10 [10:47:10.932] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 10:47:10 [10:47:10.932] VERBOSE: prover-node:prover-node Gathered all 0 txs for epoch 0 {"epochNumber":0} 10:47:10 [10:47:10.934] VERBOSE: prover-node:prover-node Gathered all 0 messages for epoch 0 {"epochNumber":0} 10:47:10 [10:47:10.935] VERBOSE: prover-node:prover-node Gathered previous block header 0 for epoch 0 10:47:10 [10:47:10.935] VERBOSE: prover-node:prover-node Creating proving job for epoch 0 for block range 1 to 2 10:47:10 [10:47:10.938] INFO: prover-node:epoch-proving-job Starting epoch 0 proving job with blocks 1 to 2 {"fromBlock":1,"toBlock":2,"epochSizeBlocks":2,"epochNumber":0,"uuid":"58cfcd7f-e851-4f14-82e8-2fbad6aa7f16"} 10:47:10 [10:47:10.957] INFO: prover-client:orchestrator Starting epoch 0 with 2 blocks 10:47:10 [10:47:10.958] VERBOSE: prover-client:broker-circuit-prover-facade Starting BrokerCircuitProverFacade 10:47:10 [10:47:10.959] VERBOSE: prover-node:epoch-proving-job Starting processing block 1 {"number":1,"blockHash":"0x059e61b99b230212fdd1c65d45123a6ed2e07de3bc89bf1942de296742ba8129","lastArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"58cfcd7f-e851-4f14-82e8-2fbad6aa7f16","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x0000000000000000000000000000000000000000000000000000000006dfd6e0","blockNumber":1,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 10:47:10 [10:47:10.961] INFO: prover-client:orchestrator Starting block 1 for slot 2 10:47:10 [10:47:10.970] VERBOSE: prover-node:epoch-proving-job Starting processing block 2 {"number":2,"blockHash":"0x0235dbac0a871ddf132dad7f7f5aa2e96edd08704f1dafafdabffd8cb88d92f1","lastArchive":"0x29e632bdc99ae1b68169de6bab944b379df4cab96f3830733acea170cd973096","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"58cfcd7f-e851-4f14-82e8-2fbad6aa7f16","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x0000000000000000000000000000000000000000000000000000000006dfd6e0","blockNumber":2,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000003","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 10:47:10 [10:47:10.970] INFO: prover-client:orchestrator Starting block 2 for slot 3 10:47:11 [10:47:11.014] INFO: prover-client:proving-broker:prover-node New proving job id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 epochNumber=0 {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09"} 10:47:11 [10:47:11.015] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09","provingJobType":"BASE_PARITY"} 10:47:11 [10:47:11.016] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09","provingJobType":"BASE_PARITY"} 10:47:11 [10:47:11.016] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09","provingJobType":"BASE_PARITY"} 10:47:11 [10:47:11.018] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09","provingJobType":"BASE_PARITY"} 10:47:11 [10:47:11.018] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09","provingJobType":"BASE_PARITY"} 10:47:11 [10:47:11.018] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09","provingJobType":"BASE_PARITY"} 10:47:11 [10:47:11.019] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09","provingJobType":"BASE_PARITY"} 10:47:11 [10:47:11.028] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000029480999997758772s {"duration":0.000029480999997758772,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 10:47:11 [10:47:11.029] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 10:47:11 [10:47:11.030] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 1 {"blockNumber":1,"blockHash":"0x059e61b99b230212fdd1c65d45123a6ed2e07de3bc89bf1942de296742ba8129","uuid":"58cfcd7f-e851-4f14-82e8-2fbad6aa7f16"} 10:47:11 [10:47:11.030] VERBOSE: prover-client:orchestrator Block 1 completed. Assembling header. 10:47:11 [10:47:11.034] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.00001952100000198698s {"duration":0.00001952100000198698,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 10:47:11 [10:47:11.034] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 10:47:11 [10:47:11.035] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 2 {"blockNumber":2,"blockHash":"0x0235dbac0a871ddf132dad7f7f5aa2e96edd08704f1dafafdabffd8cb88d92f1","uuid":"58cfcd7f-e851-4f14-82e8-2fbad6aa7f16"} 10:47:11 [10:47:11.035] VERBOSE: prover-client:orchestrator Block 2 completed. Assembling header. 10:47:11 [10:47:11.043] VERBOSE: prover-client:orchestrator Updating archive tree with block 1 header 0x059e61b99b230212fdd1c65d45123a6ed2e07de3bc89bf1942de296742ba8129 10:47:11 [10:47:11.062] VERBOSE: prover-client:orchestrator Orchestrator finalised block 1 10:47:11 [10:47:11.085] VERBOSE: prover-client:orchestrator Updating archive tree with block 2 header 0x0235dbac0a871ddf132dad7f7f5aa2e96edd08704f1dafafdabffd8cb88d92f1 10:47:11 [10:47:11.108] INFO: prover-client:proving-broker-database:prover-node Creating broker database for epoch 0 at /tmp/f6e227a10e3ab1e7/a0f37af707723c26/0 with map size 134217728 10:47:11 [10:47:11.121] VERBOSE: prover-client:orchestrator Orchestrator finalised block 2 10:47:11 [10:47:11.189] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:47:11 [10:47:11.199] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY epochNumber=0 {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09","provingJobType":"BASE_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...","status":"not-found","numOutstandingJobs":1} 10:47:11 [10:47:11.201] VERBOSE: prover-node:prover-node Fetching 0 tx hashes for block number 2 from coordination 10:47:11 [10:47:11.201] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 10:47:11 [10:47:11.209] INFO: prover-client:proving-agent:prover-node Starting job id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input... 10:47:11 [10:47:11.230] INFO: prover-client:proving-agent:job-controller-9cfb21c4 Job controller started jobId=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 {"jobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09"} 10:47:11 [10:47:11.381] INFO: prover-client:proving-agent:prover-node Job id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22resul... 10:47:11 [10:47:11.382] INFO: prover-client:proving-broker:prover-node Proving job complete id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY totalAttempts=1 {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09"} 10:47:11 [10:47:11.962] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 10:47:11 [10:47:11.964] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY 10:47:11 [10:47:11.965] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 10:47:11 [10:47:11.983] INFO: prover-client:proving-broker:prover-node New proving job id=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 epochNumber=0 {"provingJobId":"0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6"} 10:47:11 [10:47:11.993] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 type=ROOT_PARITY {"provingJobId":"0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6","provingJobType":"ROOT_PARITY"} 10:47:12 [10:47:12.045] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 type=ROOT_PARITY epochNumber=0 {"provingJobId":"0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6","provingJobType":"ROOT_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu...","status":"not-found","numOutstandingJobs":1} 10:47:12 [10:47:12.151] INFO: prover-client:proving-agent:prover-node Starting job id=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 type=ROOT_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu... 10:47:12 [10:47:12.195] INFO: prover-client:proving-agent:job-controller-983b2705 Job controller started jobId=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 {"jobId":"0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6"} 10:47:12 [10:47:12.200] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Triggering error on finaliseEpoch 10:47:12 [10:47:12.210] ERROR: prover-node:epoch-proving-job Error running epoch 0 prover job: Error: Fake error while proving epoch 10:47:12 at ServerEpochProver.epochProver.finaliseEpoch (/home/aztec-dev/aztec-packages/yarn-project/end-to-end/src/e2e_epochs/epochs_upload_failed_proof.test.ts:60:15) 10:47:12 at runNextTicks (node:internal/process/task_queues:65:5) 10:47:12 at listOnTimeout (node:internal/timers:549:9) 10:47:12 at processTimers (node:internal/timers:523:7) 10:47:12 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:142:64) 10:47:12 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) {"uuid":"58cfcd7f-e851-4f14-82e8-2fbad6aa7f16","epochNumber":0} 10:47:12 [10:47:12.210] VERBOSE: prover-client:broker-circuit-prover-facade Stopping BrokerCircuitProverFacade 10:47:12 [10:47:12.212] ERROR: prover-client:broker-circuit-prover-facade Job errored with 'Broker facade stopped' id=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 type=ROOT_PARITY: { 10:47:12 provingJobId: '0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6', 10:47:12 provingJobType: 'ROOT_PARITY' 10:47:12 } 10:47:12 [10:47:12.213] INFO: prover-client:proving-broker:prover-node Cancelling job id=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 {"provingJobId":"0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6"} 10:47:12 [10:47:12.213] INFO: prover-client:proving-broker:prover-node Marking proving job as failed id=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 type=ROOT_PARITY totalAttempts=1 err=Aborted {"provingJobId":"0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6"} 10:47:12 [10:47:12.215] ERROR: prover-client:orchestrator Error thrown when proving job: Error: Broker facade stopped 10:47:12 at BrokerCircuitProverFacade.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/proving_broker/broker_prover_facade.js:142:31) 10:47:12 at runNextTicks (node:internal/process/task_queues:65:5) 10:47:12 at listOnTimeout (node:internal/timers:549:9) 10:47:12 at processTimers (node:internal/timers:523:7) 10:47:12 at ServerEpochProver.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/prover-client/server-epoch-prover.js:31:9) 10:47:12 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:183:13) 10:47:12 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) 10:47:12 [10:47:12.215] ERROR: prover-client:orchestrator Error thrown when proving job: Error: Broker facade stopped 10:47:12 at BrokerCircuitProverFacade.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/proving_broker/broker_prover_facade.js:142:31) 10:47:12 at runNextTicks (node:internal/process/task_queues:65:5) 10:47:12 at listOnTimeout (node:internal/timers:549:9) 10:47:12 at processTimers (node:internal/timers:523:7) 10:47:12 at ServerEpochProver.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/prover-client/server-epoch-prover.js:31:9) 10:47:12 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:183:13) 10:47:12 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) 10:47:12 [10:47:12.216] ERROR: prover-node:prover-node Job for 0 exited with state failed: { 10:47:12 id: '58cfcd7f-e851-4f14-82e8-2fbad6aa7f16', 10:47:12 epochNumber: 0n, 10:47:12 state: 'failed' 10:47:12 } 10:47:12 [10:47:12.217] WARN: prover-node:prover-node Uploading epoch proof failure for 0 to file:///tmp/failed-proofs-ItOhao {"epochNumber":0,"jobId":"58cfcd7f-e851-4f14-82e8-2fbad6aa7f16","location":"file:///tmp/failed-proofs-ItOhao"} 10:47:12 [10:47:12.227] INFO: stdlib:file-store Creating local file file store at /tmp/failed-proofs-ItOhao 10:47:12 [10:47:12.254] INFO: prover-node:prover-node Pausing archiver and world state sync to start snapshot upload 10:47:12 [10:47:12.262] INFO: archiver:prover-node Stopped. 10:47:12 [10:47:12.262] INFO: world_state:prover-node Stopped sync 10:47:12 [10:47:12.263] INFO: prover-node:prover-node Creating backups of lmdb environments to /tmp/f6e227a10e3ab1e7/a0f37af707723c26/epoch-proof-data-LByISY 10:47:12 [10:47:12.298] WARN: prover-client:proving-broker:prover-node Proving job id=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 has already been completed {"provingJobId":"0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6"} 10:47:12 [10:47:12.301] INFO: prover-node:prover-node Data stores backed up to /tmp/f6e227a10e3ab1e7/a0f37af707723c26/epoch-proof-data-LByISY {"paths":{"l1-to-l2-message-tree":"/tmp/f6e227a10e3ab1e7/a0f37af707723c26/epoch-proof-data-LByISY/world-state/L1ToL2MessageTree/data.mdb","archive-tree":"/tmp/f6e227a10e3ab1e7/a0f37af707723c26/epoch-proof-data-LByISY/world-state/ArchiveTree/data.mdb","public-data-tree":"/tmp/f6e227a10e3ab1e7/a0f37af707723c26/epoch-proof-data-LByISY/world-state/PublicDataTree/data.mdb","note-hash-tree":"/tmp/f6e227a10e3ab1e7/a0f37af707723c26/epoch-proof-data-LByISY/world-state/NoteHashTree/data.mdb","nullifier-tree":"/tmp/f6e227a10e3ab1e7/a0f37af707723c26/epoch-proof-data-LByISY/world-state/NullifierTree/data.mdb","archiver":"/tmp/f6e227a10e3ab1e7/a0f37af707723c26/epoch-proof-data-LByISY/archiver/data.mdb"}} 10:47:12 [10:47:12.302] INFO: prover-node:prover-node Resuming archiver and world state sync 10:47:12 [10:47:12.302] VERBOSE: world-state:block_stream:prover-node Starting L2 block stream {"proven":false,"pollIntervalMS":50} 10:47:12 [10:47:12.303] INFO: world_state:prover-node Resumed sync 10:47:12 [10:47:12.303] INFO: archiver:prover-node Restarting archiver 10:47:12 [10:47:12.336] WARN: prover-node:prover-node Uploaded epoch 0 proof failure data to file:///tmp/failed-proofs-ItOhao/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623104712-58cfcd7f-e851-4f14-82e8-2fbad6aa7f16 {"epochNumber":0,"location":"file:///tmp/failed-proofs-ItOhao","basePath":"aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623104712-58cfcd7f-e851-4f14-82e8-2fbad6aa7f16","metadataUrl":"file:///tmp/failed-proofs-ItOhao/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623104712-58cfcd7f-e851-4f14-82e8-2fbad6aa7f16/metadata.json","dataUrl":"file:///tmp/failed-proofs-ItOhao/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623104712-58cfcd7f-e851-4f14-82e8-2fbad6aa7f16/data.bin","metadata":{"l1BlockNumber":28,"l2BlockHash":"0x0235dbac0a871ddf132dad7f7f5aa2e96edd08704f1dafafdabffd8cb88d92f1","l2BlockNumber":2,"schemaVersions":{"archiver":3,"worldState":2},"timestamp":1750675632305,"dataUrls":{"l1-to-l2-message-tree":"file:///tmp/failed-proofs-ItOhao/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623104712-58cfcd7f-e851-4f14-82e8-2fbad6aa7f16/l1-to-l2-message-tree.db","archive-tree":"file:///tmp/failed-proofs-ItOhao/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623104712-58cfcd7f-e851-4f14-82e8-2fbad6aa7f16/archive-tree.db","public-data-tree":"file:///tmp/failed-proofs-ItOhao/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623104712-58cfcd7f-e851-4f14-82e8-2fbad6aa7f16/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-ItOhao/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623104712-58cfcd7f-e851-4f14-82e8-2fbad6aa7f16/note-hash-tree.db","nullifier-tree":"file:///tmp/failed-proofs-ItOhao/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623104712-58cfcd7f-e851-4f14-82e8-2fbad6aa7f16/nullifier-tree.db","archiver":"file:///tmp/failed-proofs-ItOhao/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623104712-58cfcd7f-e851-4f14-82e8-2fbad6aa7f16/archiver.db"}},"jobId":"58cfcd7f-e851-4f14-82e8-2fbad6aa7f16"} 10:47:12 [10:47:12.337] INFO: prover-node:prover-node Cleaning up backup dir /tmp/f6e227a10e3ab1e7/a0f37af707723c26/epoch-proof-data-LByISY 10:47:12 [10:47:12.402] WARN: prover-client:proving-broker:prover-node Proving job id=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 has already been completed {"provingJobId":"0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6"} 10:47:12 [10:47:12.466] INFO: prover-client:proving-agent:prover-node Job id=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 type=ROOT_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22resu... 10:47:12 [10:47:12.466] WARN: prover-client:proving-broker:prover-node Proving job id=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 type=ROOT_PARITY not in the in-progress set {"provingJobId":"0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6"} 10:47:12 [10:47:12.466] WARN: prover-client:proving-broker:prover-node Proving job id=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 already settled, ignoring result {"provingJobId":"0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6"} 10:47:18 [10:47:18.414] INFO: prover-node:prover-node Stopping ProverNode 10:47:18 [10:47:18.415] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 10:47:18 [10:47:18.415] INFO: archiver:prover-node Stopped. 10:47:18 [10:47:18.419] INFO: world_state:prover-node Stopped world state synchronizer 10:47:18 [10:47:18.419] INFO: prover-node:prover-node Stopped ProverNode 10:47:18 [10:47:18.420] INFO: node:MAIN-aztec-node Stopping Aztec Node 10:47:18 [10:47:18.738] VERBOSE: sequencer Preparing proposal for block 3 at slot 4 {"globalVariables":{"blockNumber":3,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":4,"timestamp":1750675829,"version":115332832},"chainTipArchive":"0x02c628a93a298ace10c1333e195a6e39c395e96d9b4f0883fd34e490280b3789","blockNumber":3,"slot":4} 10:47:18 [10:47:18.758] VERBOSE: block-builder Building block 3 for slot 4 {"slot":4,"slotStart":"2025-06-23T10:50:29.000Z","now":"2025-06-23T10:50:21.374Z","blockNumber":3,"msgCount":0,"initialStateReference":{"l1ToL2MessageTree":"0x2e33ee2008411c04b99c24b313513d097a0d21a5040b6193d1f978b8226892d6","noteHashTree":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTree":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTree":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9"},"initialArchiveRoot":"0x02c628a93a298ace10c1333e195a6e39c395e96d9b4f0883fd34e490280b3789","opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}} 10:47:18 [10:47:18.763] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.0010632150000019465s {"duration":0.0010632150000019465,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 10:47:18 [10:47:18.799] INFO: sequencer Built block 3 for slot 4 with 0 txs and 0 messages. 0 mana/s {"blockHash":"0x0725abae86a666b8d9b940d9dc67f2f9bb11f8c32865f645bf193b363dd3348e","globalVariables":{"blockNumber":3,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":4,"timestamp":1750675829,"version":115332832},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":50.03559200000018,"publicProcessDuration":2.247744000000239,"rollupCircuitsDuration":42.34942900000169,"txCount":0,"blockNumber":3,"blockTimestamp":1750675829,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 10:47:18 [10:47:18.802] VERBOSE: sequencer Attesting committee is empty 10:47:18 [10:47:18.909] VERBOSE: ethereum:tx_delayer Sent tx immediately 0xd62929b55209ff2979579e3afb101c04610f7a424c527017c29da56d91c1242d 10:47:18 [10:47:18.909] VERBOSE: node:MAIN-aztec-node Sent L1 transaction 0xd62929b55209ff2979579e3afb101c04610f7a424c527017c29da56d91c1242d {"gasLimit":464655,"maxFeePerGas":"1.250837558","maxPriorityFeePerGas":"1.2","maxFeePerBlobGas":"0.000000001"} 10:47:20 [10:47:20.422] INFO: slasher Slasher client stopped. 10:47:26 [10:47:26.427] INFO: sequencer:publisher Bundled [propose] transaction [succeeded] 10:47:26 [10:47:26.428] VERBOSE: sequencer:publisher Published L2 block to L1 rollup contract {"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0xd62929b55209ff2979579e3afb101c04610f7a424c527017c29da56d91c1242d","calldataSize":1220,"calldataGas":8828,"txCount":0,"blockNumber":3,"blockTimestamp":1750675829,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 10:47:26 [10:47:26.429] VERBOSE: node:blob-sink:client Sending 1 blobs to blob sink 10:47:26 [10:47:26.435] INFO: sequencer Stopped sequencer 10:47:26 [10:47:26.436] INFO: p2p P2P client stopped 10:47:26 [10:47:26.444] INFO: blob-sink:server Received blob sidecar for block 0xc27640cd84984b25e67ccd236c3498c986a3791899a62076f79c3eae5e0ddad2 10:47:26 [10:47:26.448] INFO: world_state Stopped world state synchronizer 10:47:26 [10:47:26.463] INFO: blob-sink:server Blob sidecar stored successfully for block 0xc27640cd84984b25e67ccd236c3498c986a3791899a62076f79c3eae5e0ddad2 10:47:26 [10:47:26.508] INFO: archiver Downloaded L2 block 3 {"blockHash":"0x0725abae86a666b8d9b940d9dc67f2f9bb11f8c32865f645bf193b363dd3348e","blockNumber":3,"txCount":0,"globalVariables":{"blockNumber":3,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":4,"timestamp":1750675829,"version":115332832},"archiveRoot":"0x187bf4ecbe13869ce01009d3cabbca91c4f874769e4ced4df5cf0eec2f8230ca","archiveNextLeafIndex":4} 10:47:26 [10:47:26.513] INFO: archiver Stopped. 10:47:26 [10:47:26.513] INFO: node:MAIN-aztec-node Stopped Aztec Node 10:47:26 [10:47:26.521] INFO: node:MAIN-aztec-node Stopping Aztec Node 10:47:28 [10:47:28.522] INFO: slasher Slasher client stopped. 10:47:28 [10:47:28.523] WARN: validator Running promise was not started 10:47:28 [10:47:28.523] WARN: sequencer Running promise was not started 10:47:28 [10:47:28.523] INFO: sequencer Stopped sequencer 10:47:28 [10:47:28.523] WARN: p2p:l2-block-stream Running promise was not started 10:47:28 [10:47:28.524] INFO: p2p P2P client stopped 10:47:28 [10:47:28.524] WARN: world-state:block_stream Running promise was not started 10:47:28 [10:47:28.524] INFO: world_state Stopped world state synchronizer 10:47:28 [10:47:28.524] WARN: archiver Running promise was not started 10:47:28 [10:47:28.524] INFO: archiver Stopped. 10:47:28 [10:47:28.524] INFO: node:MAIN-aztec-node Stopped Aztec Node 10:47:28 [10:47:28.524] INFO: prover-node:prover-node Stopping ProverNode 10:47:28 [10:47:28.524] WARN: prover-node:prover-node Running promise was not started 10:47:28 [10:47:28.525] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 10:47:28 [10:47:28.525] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 10:47:28 [10:47:28.525] WARN: archiver:prover-node Running promise was not started 10:47:28 [10:47:28.525] INFO: archiver:prover-node Stopped. 10:47:28 [10:47:28.525] WARN: world-state:block_stream:prover-node Running promise was not started 10:47:28 [10:47:28.525] INFO: world_state:prover-node Stopped world state synchronizer 10:47:28 [10:47:28.525] INFO: prover-node:prover-node Stopped ProverNode 10:47:28 [10:47:28.548] INFO: blob-sink:server Stopping blob sink 10:47:28 [10:47:28.549] INFO: blob-sink:server Blob sink stopped 10:47:28 [10:47:28.565] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data and state {"uploadPath":"/tmp/failed-proofs-ItOhao","rerunDataDir":"/tmp/rerun-data-CbEhFS","rerunDownloadPath":"/tmp/rerun-download-geGiA9/data.bin"} 10:47:28 [10:47:28.566] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data from file:///tmp/failed-proofs-ItOhao/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623104712-58cfcd7f-e851-4f14-82e8-2fbad6aa7f16 10:47:28 [10:47:28.566] INFO: stdlib:file-store Creating local file file store at /tmp/failed-proofs-ItOhao/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623104712-58cfcd7f-e851-4f14-82e8-2fbad6aa7f16 10:47:28 [10:47:28.569] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading state snapshot from file:///tmp/failed-proofs-ItOhao/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623104712-58cfcd7f-e851-4f14-82e8-2fbad6aa7f16 to local data directory {"metadata":{"l2BlockNumber":2,"l2BlockHash":"0x0235dbac0a871ddf132dad7f7f5aa2e96edd08704f1dafafdabffd8cb88d92f1","l1BlockNumber":28,"l1ChainId":31337,"rollupVersion":115332832,"rollupAddress":"0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f"},"dataUrls":{"archiver":"file:///tmp/failed-proofs-ItOhao/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623104712-58cfcd7f-e851-4f14-82e8-2fbad6aa7f16/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-ItOhao/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623104712-58cfcd7f-e851-4f14-82e8-2fbad6aa7f16/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-ItOhao/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623104712-58cfcd7f-e851-4f14-82e8-2fbad6aa7f16/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-ItOhao/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623104712-58cfcd7f-e851-4f14-82e8-2fbad6aa7f16/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-ItOhao/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623104712-58cfcd7f-e851-4f14-82e8-2fbad6aa7f16/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-ItOhao/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623104712-58cfcd7f-e851-4f14-82e8-2fbad6aa7f16/l1-to-l2-message-tree.db"}} 10:47:28 [10:47:28.570] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Creating local file file store at /tmp/failed-proofs-ItOhao/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623104712-58cfcd7f-e851-4f14-82e8-2fbad6aa7f16 10:47:28 [10:47:28.572] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading snapshot to /tmp/rerun-data-CbEhFS/download-TwwXKF {"snapshot":{"dataUrls":{"archiver":"file:///tmp/failed-proofs-ItOhao/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623104712-58cfcd7f-e851-4f14-82e8-2fbad6aa7f16/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-ItOhao/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623104712-58cfcd7f-e851-4f14-82e8-2fbad6aa7f16/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-ItOhao/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623104712-58cfcd7f-e851-4f14-82e8-2fbad6aa7f16/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-ItOhao/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623104712-58cfcd7f-e851-4f14-82e8-2fbad6aa7f16/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-ItOhao/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623104712-58cfcd7f-e851-4f14-82e8-2fbad6aa7f16/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-ItOhao/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623104712-58cfcd7f-e851-4f14-82e8-2fbad6aa7f16/l1-to-l2-message-tree.db"}},"downloadPaths":{"archiver":"/tmp/rerun-data-CbEhFS/download-TwwXKF/archiver.db","nullifier-tree":"/tmp/rerun-data-CbEhFS/download-TwwXKF/nullifier-tree.db","public-data-tree":"/tmp/rerun-data-CbEhFS/download-TwwXKF/public-data-tree.db","note-hash-tree":"/tmp/rerun-data-CbEhFS/download-TwwXKF/note-hash-tree.db","archive-tree":"/tmp/rerun-data-CbEhFS/download-TwwXKF/archive-tree.db","l1-to-l2-message-tree":"/tmp/rerun-data-CbEhFS/download-TwwXKF/l1-to-l2-message-tree.db"}} 10:47:28 [10:47:28.580] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Snapshot downloaded at /tmp/rerun-data-CbEhFS/download-TwwXKF {"snapshot":{"dataUrls":{"archiver":"file:///tmp/failed-proofs-ItOhao/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623104712-58cfcd7f-e851-4f14-82e8-2fbad6aa7f16/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-ItOhao/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623104712-58cfcd7f-e851-4f14-82e8-2fbad6aa7f16/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-ItOhao/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623104712-58cfcd7f-e851-4f14-82e8-2fbad6aa7f16/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-ItOhao/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623104712-58cfcd7f-e851-4f14-82e8-2fbad6aa7f16/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-ItOhao/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623104712-58cfcd7f-e851-4f14-82e8-2fbad6aa7f16/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-ItOhao/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623104712-58cfcd7f-e851-4f14-82e8-2fbad6aa7f16/l1-to-l2-message-tree.db"}},"downloadPaths":{"archiver":"/tmp/rerun-data-CbEhFS/download-TwwXKF/archiver.db","nullifier-tree":"/tmp/rerun-data-CbEhFS/download-TwwXKF/nullifier-tree.db","public-data-tree":"/tmp/rerun-data-CbEhFS/download-TwwXKF/public-data-tree.db","note-hash-tree":"/tmp/rerun-data-CbEhFS/download-TwwXKF/note-hash-tree.db","archive-tree":"/tmp/rerun-data-CbEhFS/download-TwwXKF/archive-tree.db","l1-to-l2-message-tree":"/tmp/rerun-data-CbEhFS/download-TwwXKF/l1-to-l2-message-tree.db"}} 10:47:28 [10:47:28.582] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Archiver database set up from snapshot {"path":"/tmp/rerun-data-CbEhFS/archiver","dbVersion":3,"rollupAddress":"0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f"} 10:47:28 [10:47:28.586] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database l1-to-l2-message-tree set up from snapshot {"path":"/tmp/rerun-data-CbEhFS/world_state/L1ToL2MessageTree","dbVersion":2,"rollupAddress":"0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f"} 10:47:28 [10:47:28.588] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database archive-tree set up from snapshot {"path":"/tmp/rerun-data-CbEhFS/world_state/ArchiveTree","dbVersion":2,"rollupAddress":"0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f"} 10:47:28 [10:47:28.588] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database public-data-tree set up from snapshot {"path":"/tmp/rerun-data-CbEhFS/world_state/PublicDataTree","dbVersion":2,"rollupAddress":"0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f"} 10:47:28 [10:47:28.591] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database note-hash-tree set up from snapshot {"path":"/tmp/rerun-data-CbEhFS/world_state/NoteHashTree","dbVersion":2,"rollupAddress":"0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f"} 10:47:28 [10:47:28.591] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database nullifier-tree set up from snapshot {"path":"/tmp/rerun-data-CbEhFS/world_state/NullifierTree","dbVersion":2,"rollupAddress":"0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f"} 10:47:28 [10:47:28.593] INFO: e2e:e2e_epochs:epochs_upload_failed_proof P2P database cleared {"path":"/tmp/rerun-data-CbEhFS/p2p"} 10:47:28 [10:47:28.594] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data from file:///tmp/failed-proofs-ItOhao/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623104712-58cfcd7f-e851-4f14-82e8-2fbad6aa7f16/data.bin to /tmp/rerun-download-geGiA9/data.bin 10:47:28 [10:47:28.600] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Epoch proving job data for epoch 0 downloaded successfully 10:47:28 [10:47:28.601] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Rerunning proving job from /tmp/rerun-download-geGiA9/data.bin 10:47:28 [10:47:28.607] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Using native ACVM binary at ../../noir/noir-repo/target/release/acvm with working directory /tmp/fe017ab8/acvm 10:47:28 [10:47:28.616] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Loaded proving job data for epoch 0 10:47:28 [10:47:28.625] INFO: world-state:database Creating world state data store at directory /tmp/rerun-data-CbEhFS/world_state with map sizes {"archiveTreeMapSizeKb":1048576,"nullifierTreeMapSizeKb":1048576,"noteHashTreeMapSizeKb":1048576,"messageTreeMapSizeKb":1048576,"publicDataTreeMapSizeKb":1048576} and 2 threads. 10:47:28 [10:47:28.669] INFO: archiver:lmdb Creating archiver data store at directory /tmp/rerun-data-CbEhFS/archiver with map size 1048576 KB (LMDB v2) 10:47:28 [10:47:28.675] INFO: archiver:lmdb Starting data store with maxReaders 16 10:47:28 [10:47:28.682] WARN: prover-client:proving-broker-database Found invalid epoch directory /tmp/rerun-data-CbEhFS/archiver when loading epoch databases, ignoring 10:47:28 [10:47:28.682] WARN: prover-client:proving-broker-database Found invalid epoch directory /tmp/rerun-data-CbEhFS/world_state when loading epoch databases, ignoring 10:47:28 [10:47:28.683] INFO: prover-client:proving-broker Proving Broker started 10:47:28 [10:47:28.684] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Rerunning epoch proving job for epoch 0 10:47:28 [10:47:28.684] INFO: prover-node:epoch-proving-job Starting epoch 0 proving job with blocks 1 to 2 {"fromBlock":1,"toBlock":2,"epochSizeBlocks":2,"epochNumber":0,"uuid":"71d17af6-fa84-4a3b-94e2-76f96d6b6647"} 10:47:28 [10:47:28.705] INFO: prover-client:orchestrator Starting epoch 0 with 2 blocks 10:47:28 [10:47:28.706] VERBOSE: prover-client:broker-circuit-prover-facade Starting BrokerCircuitProverFacade 10:47:28 [10:47:28.707] VERBOSE: prover-node:epoch-proving-job Starting processing block 1 {"number":1,"blockHash":"0x059e61b99b230212fdd1c65d45123a6ed2e07de3bc89bf1942de296742ba8129","lastArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"71d17af6-fa84-4a3b-94e2-76f96d6b6647","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x0000000000000000000000000000000000000000000000000000000006dfd6e0","blockNumber":1,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 10:47:28 [10:47:28.708] INFO: prover-client:orchestrator Starting block 1 for slot 2 10:47:28 [10:47:28.708] VERBOSE: prover-node:epoch-proving-job Starting processing block 2 {"number":2,"blockHash":"0x0235dbac0a871ddf132dad7f7f5aa2e96edd08704f1dafafdabffd8cb88d92f1","lastArchive":"0x29e632bdc99ae1b68169de6bab944b379df4cab96f3830733acea170cd973096","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"71d17af6-fa84-4a3b-94e2-76f96d6b6647","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x0000000000000000000000000000000000000000000000000000000006dfd6e0","blockNumber":2,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000003","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 10:47:28 [10:47:28.708] INFO: prover-client:orchestrator Starting block 2 for slot 3 10:47:28 [10:47:28.731] INFO: prover-client:proving-broker New proving job id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 epochNumber=0 {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09"} 10:47:28 [10:47:28.732] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09","provingJobType":"BASE_PARITY"} 10:47:28 [10:47:28.732] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09","provingJobType":"BASE_PARITY"} 10:47:28 [10:47:28.733] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09","provingJobType":"BASE_PARITY"} 10:47:28 [10:47:28.750] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.00003169000000343658s {"duration":0.00003169000000343658,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 10:47:28 [10:47:28.750] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 10:47:28 [10:47:28.751] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 1 {"blockNumber":1,"blockHash":"0x059e61b99b230212fdd1c65d45123a6ed2e07de3bc89bf1942de296742ba8129","uuid":"71d17af6-fa84-4a3b-94e2-76f96d6b6647"} 10:47:28 [10:47:28.751] VERBOSE: prover-client:orchestrator Block 1 completed. Assembling header. 10:47:28 [10:47:28.753] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09","provingJobType":"BASE_PARITY"} 10:47:28 [10:47:28.753] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09","provingJobType":"BASE_PARITY"} 10:47:28 [10:47:28.753] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09","provingJobType":"BASE_PARITY"} 10:47:28 [10:47:28.753] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09","provingJobType":"BASE_PARITY"} 10:47:28 [10:47:28.772] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000023440999997546896s {"duration":0.000023440999997546896,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 10:47:28 [10:47:28.773] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 10:47:28 [10:47:28.774] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 2 {"blockNumber":2,"blockHash":"0x0235dbac0a871ddf132dad7f7f5aa2e96edd08704f1dafafdabffd8cb88d92f1","uuid":"71d17af6-fa84-4a3b-94e2-76f96d6b6647"} 10:47:28 [10:47:28.774] VERBOSE: prover-client:orchestrator Block 2 completed. Assembling header. 10:47:28 [10:47:28.784] VERBOSE: prover-client:orchestrator Updating archive tree with block 1 header 0x059e61b99b230212fdd1c65d45123a6ed2e07de3bc89bf1942de296742ba8129 10:47:28 [10:47:28.787] INFO: prover-client:proving-broker-database Creating broker database for epoch 0 at /tmp/rerun-data-CbEhFS/0 with map size 1048576 10:47:28 [10:47:28.789] VERBOSE: prover-client:orchestrator Orchestrator finalised block 1 10:47:28 [10:47:28.825] VERBOSE: prover-client:orchestrator Updating archive tree with block 2 header 0x0235dbac0a871ddf132dad7f7f5aa2e96edd08704f1dafafdabffd8cb88d92f1 10:47:28 [10:47:28.830] VERBOSE: prover-client:orchestrator Orchestrator finalised block 2 10:47:28 [10:47:28.853] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:47:28 [10:47:28.857] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY epochNumber=0 {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09","provingJobType":"BASE_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...","status":"not-found","numOutstandingJobs":1} 10:47:28 [10:47:28.899] INFO: prover-client:proving-agent Starting job id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input... 10:47:28 [10:47:28.910] INFO: prover-client:proving-agent:job-controller-49753f2b Job controller started jobId=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 {"jobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09"} 10:47:29 [10:47:29.033] INFO: prover-client:proving-agent Job id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22resul... 10:47:29 [10:47:29.037] INFO: prover-client:proving-broker Proving job complete id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY totalAttempts=1 {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09"} 10:47:29 [10:47:29.708] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 10:47:29 [10:47:29.713] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY 10:47:29 [10:47:29.714] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 10:47:29 [10:47:29.740] INFO: prover-client:proving-broker New proving job id=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 epochNumber=0 {"provingJobId":"0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6"} 10:47:29 [10:47:29.755] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 type=ROOT_PARITY {"provingJobId":"0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6","provingJobType":"ROOT_PARITY"} 10:47:29 [10:47:29.799] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 type=ROOT_PARITY epochNumber=0 {"provingJobId":"0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6","provingJobType":"ROOT_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu...","status":"not-found","numOutstandingJobs":1} 10:47:29 [10:47:29.869] INFO: prover-client:proving-agent Starting job id=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 type=ROOT_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu... 10:47:29 [10:47:29.927] INFO: prover-client:proving-agent:job-controller-5d877942 Job controller started jobId=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 {"jobId":"0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6"} 10:47:30 [10:47:30.151] INFO: prover-client:proving-agent Job id=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 type=ROOT_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22resu... 10:47:30 [10:47:30.151] INFO: prover-client:proving-broker Proving job complete id=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 type=ROOT_PARITY totalAttempts=1 {"provingJobId":"0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6"} 10:47:30 [10:47:30.715] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 10:47:30 [10:47:30.716] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 type=ROOT_PARITY 10:47:30 [10:47:30.717] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 10:47:30 [10:47:30.734] INFO: prover-client:proving-broker New proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:e4b08db83a45ca702b6720859191af48c0ccff90e41a85160380ff01b8d5f290 epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:e4b08db83a45ca702b6720859191af48c0ccff90e41a85160380ff01b8d5f290"} 10:47:30 [10:47:30.738] INFO: prover-client:proving-broker New proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:f1dd29ff780ec495db2863133072f095f0c2f6c0e512e4e7d4d495e4fcd8d2e9 epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:f1dd29ff780ec495db2863133072f095f0c2f6c0e512e4e7d4d495e4fcd8d2e9"} 10:47:30 [10:47:30.786] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:EMPTY_BLOCK_ROOT_ROLLUP:e4b08db83a45ca702b6720859191af48c0ccff90e41a85160380ff01b8d5f290 type=EMPTY_BLOCK_ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:e4b08db83a45ca702b6720859191af48c0ccff90e41a85160380ff01b8d5f290","provingJobType":"EMPTY_BLOCK_ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input...","status":"not-found","numOutstandingJobs":2} 10:47:30 [10:47:30.787] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:EMPTY_BLOCK_ROOT_ROLLUP:f1dd29ff780ec495db2863133072f095f0c2f6c0e512e4e7d4d495e4fcd8d2e9 type=EMPTY_BLOCK_ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:f1dd29ff780ec495db2863133072f095f0c2f6c0e512e4e7d4d495e4fcd8d2e9","provingJobType":"EMPTY_BLOCK_ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input...","status":"not-found","numOutstandingJobs":2} 10:47:30 [10:47:30.809] INFO: prover-client:proving-agent Starting job id=0:EMPTY_BLOCK_ROOT_ROLLUP:e4b08db83a45ca702b6720859191af48c0ccff90e41a85160380ff01b8d5f290 type=EMPTY_BLOCK_ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input... 10:47:30 [10:47:30.820] INFO: prover-client:proving-agent:job-controller-4d8846ea Job controller started jobId=0:EMPTY_BLOCK_ROOT_ROLLUP:e4b08db83a45ca702b6720859191af48c0ccff90e41a85160380ff01b8d5f290 {"jobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:e4b08db83a45ca702b6720859191af48c0ccff90e41a85160380ff01b8d5f290"} 10:47:30 [10:47:30.886] INFO: prover-client:proving-agent Starting job id=0:EMPTY_BLOCK_ROOT_ROLLUP:f1dd29ff780ec495db2863133072f095f0c2f6c0e512e4e7d4d495e4fcd8d2e9 type=EMPTY_BLOCK_ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input... 10:47:30 [10:47:30.903] INFO: prover-client:proving-agent:job-controller-639b5c3a Job controller started jobId=0:EMPTY_BLOCK_ROOT_ROLLUP:f1dd29ff780ec495db2863133072f095f0c2f6c0e512e4e7d4d495e4fcd8d2e9 {"jobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:f1dd29ff780ec495db2863133072f095f0c2f6c0e512e4e7d4d495e4fcd8d2e9"} 10:47:32 [10:47:32.812] INFO: prover-client:proving-agent Job id=0:EMPTY_BLOCK_ROOT_ROLLUP:e4b08db83a45ca702b6720859191af48c0ccff90e41a85160380ff01b8d5f290 type=EMPTY_BLOCK_ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22resul... 10:47:32 [10:47:32.812] INFO: prover-client:proving-broker Proving job complete id=0:EMPTY_BLOCK_ROOT_ROLLUP:e4b08db83a45ca702b6720859191af48c0ccff90e41a85160380ff01b8d5f290 type=EMPTY_BLOCK_ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:e4b08db83a45ca702b6720859191af48c0ccff90e41a85160380ff01b8d5f290"} 10:47:33 [10:47:33.810] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 2, total jobs ready: 1 10:47:33 [10:47:33.813] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:e4b08db83a45ca702b6720859191af48c0ccff90e41a85160380ff01b8d5f290 type=EMPTY_BLOCK_ROOT_ROLLUP 10:47:33 [10:47:33.813] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 10:47:34 [10:47:34.786] INFO: prover-client:proving-agent Job id=0:EMPTY_BLOCK_ROOT_ROLLUP:f1dd29ff780ec495db2863133072f095f0c2f6c0e512e4e7d4d495e4fcd8d2e9 type=EMPTY_BLOCK_ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22resul... 10:47:34 [10:47:34.786] INFO: prover-client:proving-broker Proving job complete id=0:EMPTY_BLOCK_ROOT_ROLLUP:f1dd29ff780ec495db2863133072f095f0c2f6c0e512e4e7d4d495e4fcd8d2e9 type=EMPTY_BLOCK_ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:f1dd29ff780ec495db2863133072f095f0c2f6c0e512e4e7d4d495e4fcd8d2e9"} 10:47:34 [10:47:34.817] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 10:47:34 [10:47:34.823] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:f1dd29ff780ec495db2863133072f095f0c2f6c0e512e4e7d4d495e4fcd8d2e9 type=EMPTY_BLOCK_ROOT_ROLLUP 10:47:34 [10:47:34.823] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 10:47:34 [10:47:34.840] INFO: prover-client:proving-broker New proving job id=0:ROOT_ROLLUP:37a86af3467969b190e6d4ccbe648d1730ef09382ae2a739855eb23580cad578 epochNumber=0 {"provingJobId":"0:ROOT_ROLLUP:37a86af3467969b190e6d4ccbe648d1730ef09382ae2a739855eb23580cad578"} 10:47:34 [10:47:34.847] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_ROLLUP:37a86af3467969b190e6d4ccbe648d1730ef09382ae2a739855eb23580cad578 type=ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:ROOT_ROLLUP:37a86af3467969b190e6d4ccbe648d1730ef09382ae2a739855eb23580cad578","provingJobType":"ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22input...","status":"not-found","numOutstandingJobs":1} 10:47:34 [10:47:34.883] INFO: prover-client:proving-agent Starting job id=0:ROOT_ROLLUP:37a86af3467969b190e6d4ccbe648d1730ef09382ae2a739855eb23580cad578 type=ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22input... 10:47:34 [10:47:34.902] INFO: prover-client:proving-agent:job-controller-7a5c9eed Job controller started jobId=0:ROOT_ROLLUP:37a86af3467969b190e6d4ccbe648d1730ef09382ae2a739855eb23580cad578 {"jobId":"0:ROOT_ROLLUP:37a86af3467969b190e6d4ccbe648d1730ef09382ae2a739855eb23580cad578"} 10:47:35 [10:47:35.078] INFO: prover-client:proving-agent Job id=0:ROOT_ROLLUP:37a86af3467969b190e6d4ccbe648d1730ef09382ae2a739855eb23580cad578 type=ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22resul... 10:47:35 [10:47:35.078] INFO: prover-client:proving-broker Proving job complete id=0:ROOT_ROLLUP:37a86af3467969b190e6d4ccbe648d1730ef09382ae2a739855eb23580cad578 type=ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:ROOT_ROLLUP:37a86af3467969b190e6d4ccbe648d1730ef09382ae2a739855eb23580cad578"} 10:47:35 [10:47:35.824] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 10:47:35 [10:47:35.828] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:ROOT_ROLLUP:37a86af3467969b190e6d4ccbe648d1730ef09382ae2a739855eb23580cad578 type=ROOT_ROLLUP 10:47:35 [10:47:35.828] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 10:47:35 [10:47:35.829] VERBOSE: prover-client:orchestrator Orchestrator completed root rollup for epoch 0 10:47:35 [10:47:35.832] INFO: prover-node:epoch-proving-job Finalised proof for epoch 0 {"epochNumber":0,"uuid":"71d17af6-fa84-4a3b-94e2-76f96d6b6647","duration":7147.348037000003} 10:47:35 [10:47:35.832] INFO: prover-node:epoch-proving-job Submitted proof for epoch 0 (blocks 1 to 2) {"epochNumber":0,"uuid":"71d17af6-fa84-4a3b-94e2-76f96d6b6647"} 10:47:35 [10:47:35.832] VERBOSE: prover-client:broker-circuit-prover-facade Stopping BrokerCircuitProverFacade 10:47:35 [10:47:35.833] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Completed job for epoch 0 with status completed 10:47:35 [10:47:35.833] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Test succeeded 10:47:35 [10:47:35.833] INFO: prover-node:prover-node Stopping ProverNode 10:47:35 [10:47:35.834] WARN: prover-node:prover-node Running promise was not started 10:47:35 [10:47:35.834] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 10:47:35 [10:47:35.834] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 10:47:35 [10:47:35.834] WARN: archiver:prover-node Running promise was not started 10:47:35 [10:47:35.834] INFO: archiver:prover-node Stopped. 10:47:35 [10:47:35.834] WARN: world-state:block_stream:prover-node Running promise was not started 10:47:35 [10:47:35.835] INFO: world_state:prover-node Stopped world state synchronizer 10:47:35 [10:47:35.835] INFO: prover-node:prover-node Stopped ProverNode 10:47:35 [10:47:35.835] INFO: node:MAIN-aztec-node Stopping Aztec Node 10:47:37 [10:47:37.836] INFO: slasher Slasher client stopped. 10:47:37 [10:47:37.836] WARN: validator Running promise was not started 10:47:37 [10:47:37.836] WARN: sequencer Running promise was not started 10:47:37 [10:47:37.837] INFO: sequencer Stopped sequencer 10:47:37 [10:47:37.837] WARN: p2p:l2-block-stream Running promise was not started 10:47:37 [10:47:37.837] INFO: p2p P2P client stopped 10:47:37 [10:47:37.837] WARN: world-state:block_stream Running promise was not started 10:47:37 [10:47:37.837] INFO: world_state Stopped world state synchronizer 10:47:37 [10:47:37.837] WARN: archiver Running promise was not started 10:47:37 [10:47:37.837] INFO: archiver Stopped. 10:47:37 [10:47:37.838] INFO: node:MAIN-aztec-node Stopped Aztec Node 10:47:37 [10:47:37.843] INFO: node:MAIN-aztec-node Stopping Aztec Node 10:47:39 [10:47:39.844] INFO: slasher Slasher client stopped. 10:47:39 [10:47:39.844] WARN: validator Running promise was not started 10:47:39 [10:47:39.845] WARN: sequencer Running promise was not started 10:47:39 [10:47:39.845] INFO: sequencer Stopped sequencer 10:47:39 [10:47:39.845] WARN: p2p:l2-block-stream Running promise was not started 10:47:39 [10:47:39.846] INFO: p2p P2P client stopped 10:47:39 [10:47:39.846] WARN: world-state:block_stream Running promise was not started 10:47:39 [10:47:39.846] INFO: world_state Stopped world state synchronizer 10:47:39 [10:47:39.846] WARN: archiver Running promise was not started 10:47:39 [10:47:39.847] INFO: archiver Stopped. 10:47:39 [10:47:39.847] INFO: node:MAIN-aztec-node Stopped Aztec Node 10:47:39 [10:47:39.847] INFO: prover-node:prover-node Stopping ProverNode 10:47:39 [10:47:39.847] WARN: prover-node:prover-node Running promise was not started 10:47:39 [10:47:39.847] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 10:47:39 [10:47:39.847] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 10:47:39 [10:47:39.847] WARN: archiver:prover-node Running promise was not started 10:47:39 [10:47:39.847] INFO: archiver:prover-node Stopped. 10:47:39 [10:47:39.848] WARN: world-state:block_stream:prover-node Running promise was not started 10:47:39 [10:47:39.848] INFO: world_state:prover-node Stopped world state synchronizer 10:47:39 [10:47:39.848] INFO: prover-node:prover-node Stopped ProverNode 10:47:39 [10:47:39.849] INFO: blob-sink:server Stopping blob sink 10:47:39 [10:47:39.849] INFO: blob-sink:server Blob sink already stopped 10:47:39 PASS src/e2e_epochs/epochs_upload_failed_proof.test.ts 10:47:39 e2e_epochs/epochs_upload_failed_proof 10:47:39 ✓ uploads failed proving job state and re-runs it on a fresh instance (55007 ms) 10:47:39 10:47:39 Test Suites: 1 passed, 1 total 10:47:39 Tests: 1 passed, 1 total 10:47:39 Snapshots: 0 total 10:47:39 Time: 63.559 s 10:47:39 Ran all test suites matching src/e2e_epochs/epochs_upload_failed_proof.test.ts. 10:47:39 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?