Parent Log: http://ci.aztec-labs.com/d5d17dd399bede03 Command: fab700985fdda05e:ISOLATE=1:NAME=e2e_epochs/epochs_upload_failed_proof yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_upload_failed_proof.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/9164f0ea2d1bd891bbde066fe27f2239188ddec9 Env: REF_NAME=gh-readonly-queue/next/pr-15169-301dce04331dcfb583b7508b91491de618d4acf4 CURRENT_VERSION=0.87.6 CI_FULL=1 Date: Mon Jun 23 11:21:59 UTC 2025 System: ARCH=amd64 CPUS=128 MEM=493Gi HOSTNAME=pr-15169_amd64_x3-full Resources: CPU_LIST=0-127 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_476a42720cde10eb_next 11:21:59 +++ id -u 11:21:59 +++ id -g 11:21:59 ++ docker run -d --name e2e_epochs_epochs_upload_failed_proof --net=none --cpuset-cpus=0-127 --cpus=2 --memory=8g --user 1000:1000 -v/home/aztec-dev:/home/aztec-dev --mount type=tmpfs,target=/tmp,tmpfs-size=1g --workdir /home/aztec-dev/aztec-packages -e HOME -e VERBOSE -e GIT_CONFIG_GLOBAL=/home/aztec-dev/aztec-packages/build-images/src/home/.gitconfig -e FORCE_COLOR=true -e CPUS -e MEM aztecprotocol/build:3.0 /bin/bash -c 'timeout -v 600s bash -c '\''yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_upload_failed_proof.test.ts'\''' 11:21:59 + cid=d23c2fb90ff414e8f11ede202ab8304c6a5612a0e6ebc14bb1cd94f84358f2a9 11:21:59 + set +x 11:22:00 {"level":25,"time":1750677720913,"pid":12,"hostname":"d23c2fb90ff4","module":"logger","msg":"Logger initialized with level verbose"} 11:22:08 [11:22:08.541] INFO: e2e:epochs_upload_failed_proof Running test: e2e_epochs/epochs_upload_failed_proof uploads failed proving job state and re-runs it on a fresh instance 11:22:08 [11:22:08.693] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Logging metrics to log/e2e_epochs_epochs_upload_failed_proof.jsonl 11:22:08 [11:22:08.969] WARN: ethereum:cheat_codes Set L1 automine to true 11:22:09 [11:22:09.008] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Sent 0.1 ETH to deployer {"deployer":"0x05f32b3cc3888453ff71b01135b34ff8e41263f2","value":100000000000000000} 11:22:09 [11:22:09.021] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Sent 0.1 ETH to deployer {"deployer":"0x05f32b3cc3888453ff71b01135b34ff8e41263f2","value":100000000000000000} 11:22:09 [11:22:09.031] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Multicall3 11:22:09 [11:22:09.032] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Calling anvil_setBlockTimestampInterval with params: [8] 11:22:09 [11:22:09.034] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Set block interval to 8 11:22:09 [11:22:09.035] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contracts from 0xf39Fd6e51aad88F6F4ce6aB8827279cffFb92266 11:22:09 [11:22:09.084] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x8166bb789c828e492198babef9becf8ac44628f059d48e6f68114a9ae2ade6ec {"gasLimit":867658,"maxFeePerGas":"120.351651125","maxPriorityFeePerGas":"118.94979"} 11:22:09 [11:22:09.085] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xB8999345dA8041f1Da51ac5179B1F055A560f397 in tx 0x8166bb789c828e492198babef9becf8ac44628f059d48e6f68114a9ae2ade6ec. 11:22:09 [11:22:09.087] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Fee Asset at 0xb8999345da8041f1da51ac5179b1f055a560f397 11:22:09 [11:22:09.121] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x07d928293fb6819e2a8abf9d0b32b04560f633065cf07cefb5dcf9ca71af1db2 {"gasLimit":867644,"maxFeePerGas":"143.976575211","maxPriorityFeePerGas":"142.739748"} 11:22:09 [11:22:09.122] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xBb9e13665Cfb3d531F288a11E7312b6b91C59292 in tx 0x07d928293fb6819e2a8abf9d0b32b04560f633065cf07cefb5dcf9ca71af1db2. 11:22:09 [11:22:09.123] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Staking Asset at 0xbb9e13665cfb3d531f288a11e7312b6b91c59292 11:22:09 [11:22:09.155] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xd90adcaa1621a861dd7b09565f9dc422367574ea376355a4c91cd87ed3fbfeba {"gasLimit":3252094,"maxFeePerGas":"172.377275728","maxPriorityFeePerGas":"171.2876976"} 11:22:09 [11:22:09.156] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x6f26a1916Df432654607f9c75b764e535e65cf3e in tx 0xd90adcaa1621a861dd7b09565f9dc422367574ea376355a4c91cd87ed3fbfeba. 11:22:09 [11:22:09.157] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed GSE at 0x6f26a1916df432654607f9c75b764e535e65cf3e 11:22:09 [11:22:09.184] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xc6bb96b972383aade82d230cb0c861a0362867228d18483a86f9e4a83b780d2d {"gasLimit":1081864,"maxFeePerGas":"206.505096634","maxPriorityFeePerGas":"205.54523712"} 11:22:09 [11:22:09.184] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x3C709AFec1acEaE522c13145005De788a3CC65c8 in tx 0xc6bb96b972383aade82d230cb0c861a0362867228d18483a86f9e4a83b780d2d. 11:22:09 [11:22:09.186] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Registry at 0x3c709afec1aceae522c13145005de788a3cc65c8 11:22:09 [11:22:09.216] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xf8dde39eb44898986f540429eb4a3f0eeec377763a24054290d85bb8101ac8e4 {"gasLimit":2232036,"maxFeePerGas":"247.515532347","maxPriorityFeePerGas":"246.654284544"} 11:22:09 [11:22:09.217] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xEDE9b34af448F9261efea2DafB2364866b09E01A in tx 0xf8dde39eb44898986f540429eb4a3f0eeec377763a24054290d85bb8101ac8e4. 11:22:09 [11:22:09.219] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed GovernanceProposer at 0xede9b34af448f9261efea2dafb2364866b09e01a 11:22:09 [11:22:09.246] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xaf7178913b5905e53367fb0465133faf75227c51bf46428c817f48a06700bb71 {"gasLimit":3092007,"maxFeePerGas":"296.745116241","maxPriorityFeePerGas":"295.985141452"} 11:22:09 [11:22:09.246] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xa49A3d51a71916F87d60f0e919Fb66E4b933b4df in tx 0xaf7178913b5905e53367fb0465133faf75227c51bf46428c817f48a06700bb71. 11:22:09 [11:22:09.247] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Governance at 0xa49a3d51a71916f87d60f0e919fb66e4b933b4df 11:22:09 [11:22:09.278] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x12d6424d782ad27b9fe44dec1624cf29720992859e74e4ee26f6a49bf5e682cc {"gasLimit":100000,"maxFeePerGas":"355.858763396","maxPriorityFeePerGas":"355.182169742"} 11:22:09 [11:22:09.279] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Set governance on GSE in 0x12d6424d782ad27b9fe44dec1624cf29720992859e74e4ee26f6a49bf5e682cc 11:22:09 [11:22:09.318] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x593e4091a1e08f47177928f9a458263f67a911112187ec79e9a4bc019be7546f {"gasLimit":397405,"maxFeePerGas":"426.824946124","maxPriorityFeePerGas":"426.21860369"} 11:22:09 [11:22:09.318] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x705baA0D3bF675F9B7F169fd5FEA260c436Cd50c in tx 0x593e4091a1e08f47177928f9a458263f67a911112187ec79e9a4bc019be7546f. 11:22:09 [11:22:09.319] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed CoinIssuer at 0x705baa0d3bf675f9b7f169fd5fea260c436cd50c 11:22:09 [11:22:09.319] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for deployments to complete 11:22:09 [11:22:09.320] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 7 transactions to be mined... 11:22:09 [11:22:09.370] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 11:22:09 [11:22:09.383] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x5d6132645b455679b93fe6fc019047a89d80cbc5fb7cbc890344c07a449854fc {"gasLimit":100000,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 11:22:09 [11:22:09.383] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added coin issuer 0x705baa0d3bf675f9b7f169fd5fea260c436cd50c as minter on fee asset in 0x5d6132645b455679b93fe6fc019047a89d80cbc5fb7cbc890344c07a449854fc 11:22:09 [11:22:09.398] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xd01ce626c7c7ee3a243b24780a9fd0dc5184345d6bec4ec1cc5aafc15402dc62 {"gasLimit":56661,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 11:22:09 [11:22:09.414] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x100b31bd1e3992df58985c26db7e5351f01cbb7b9c2e961c411c57733fb6cfa5 {"gasLimit":344517,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 11:22:09 [11:22:09.415] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xB4fF23c4B1E2Bc7C86090d4FBDa21A457ee6727F in tx 0x100b31bd1e3992df58985c26db7e5351f01cbb7b9c2e961c411c57733fb6cfa5. 11:22:09 [11:22:09.415] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed FeeAssetHandler at 0xb4ff23c4b1e2bc7c86090d4fbda21a457ee6727f 11:22:09 [11:22:09.434] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xc451aae80a23ef806a4bacf2e291d1c2ae150b6200ea2ea4e841b119a7e7c28b {"gasLimit":56804,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 11:22:09 [11:22:09.434] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added fee asset handler 0xb4ff23c4b1e2bc7c86090d4fbda21a457ee6727f as minter on fee asset in 0xc451aae80a23ef806a4bacf2e291d1c2ae150b6200ea2ea4e841b119a7e7c28b 11:22:09 [11:22:09.472] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x5eb36206bb7f862342335e4fc973eadb56d6dc572165dff06a227b017ac4eafe {"gasLimit":2514655,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 11:22:09 [11:22:09.472] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xF4de5cF63467155F12E722456ff7952Eb95c40b6 in tx 0x5eb36206bb7f862342335e4fc973eadb56d6dc572165dff06a227b017ac4eafe. 11:22:09 [11:22:09.473] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed StakingAssetHandler at 0xf4de5cf63467155f12e722456ff7952eb95c40b6 11:22:09 [11:22:09.504] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x9a5a484b6057f7e812ffb8538d8cd6a948ec2a89522178514f621f05b5f45a01 {"gasLimit":56804,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 11:22:09 [11:22:09.504] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added staking asset handler 0xf4de5cf63467155f12e722456ff7952eb95c40b6 as minter on staking asset in 0x9a5a484b6057f7e812ffb8538d8cd6a948ec2a89522178514f621f05b5f45a01 11:22:09 [11:22:09.504] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for deployments to complete 11:22:09 [11:22:09.505] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 9 transactions to be mined... 11:22:09 [11:22:09.539] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 11:22:09 [11:22:09.552] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed shared contracts 11:22:09 [11:22:09.573] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x3a452c44942037f215b905f38ac51163490a9b231c6bd08b7e958ae2dd00642b {"gasLimit":84837,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 11:22:09 [11:22:09.574] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Funded reward distributor with 10000000000000000000000000 fee asset in 0x3a452c44942037f215b905f38ac51163490a9b231c6bd08b7e958ae2dd00642b 11:22:09 [11:22:09.593] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x6732a13052b668b6ed53c2db691f949dc5751b43ca937a6796aab9388f3cb12a {"gasLimit":154658,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 11:22:09 [11:22:09.595] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x277E22B0C9698d7f2A1cD7C6d857511617587309 in tx 0x6732a13052b668b6ed53c2db691f949dc5751b43ca937a6796aab9388f3cb12a. 11:22:09 [11:22:09.595] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup will use the mock verifier at 0x277e22b0c9698d7f2a1cd7c6d857511617587309 11:22:09 [11:22:09.596] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup config args {"aztecSlotDuration":16,"aztecEpochDuration":4,"targetCommitteeSize":0,"aztecProofSubmissionEpochs":1,"slashingQuorum":6,"slashingRoundSize":10,"manaTarget":10000000000,"entryQueueFlushSizeMin":48,"entryQueueFlushSizeQuotient":2,"provingCostPerMana":100,"rewardConfig":{"sequencerBps":5000,"increment":200000,"maxScore":5000000,"a":5000,"k":1000000,"minimum":100000}} 11:22:09 [11:22:09.611] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x941674e92e61dc030c2e0b4bd254d3a15f2a5a8081781e583d3bf4a48913c47b {"gasLimit":87007,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 11:22:09 [11:22:09.611] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x755f7b0Abc16C7d115c66eCE21A4C10c13e13a5E in tx 0x941674e92e61dc030c2e0b4bd254d3a15f2a5a8081781e583d3bf4a48913c47b. 11:22:09 [11:22:09.660] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x1ae5ce903470036339870770e59a9f970c504838efebc5df55bd42bb8b6d3eb3 {"gasLimit":5120611,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 11:22:09 [11:22:09.660] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x0B53Fb3A333b73bF09FeaA0a7Bf288F52466E450 in tx 0x1ae5ce903470036339870770e59a9f970c504838efebc5df55bd42bb8b6d3eb3. 11:22:09 [11:22:09.688] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xd84a262d0205f720a2ab56aad4125fa4fc618d7008449739b0eb71454d28af13 {"gasLimit":2891348,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 11:22:09 [11:22:09.689] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x8B9450ADB32f406dFF80fFFA24A9a85A72E733c2 in tx 0xd84a262d0205f720a2ab56aad4125fa4fc618d7008449739b0eb71454d28af13. 11:22:09 [11:22:09.689] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Awaiting for linked libraries to be deployed 11:22:09 [11:22:09.769] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xac6d7e1543753f8f545df98c6abdd9090a75d1bd4a8d883391a52d547edb4d77 {"gasLimit":11249762,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 11:22:09 [11:22:09.770] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xDf95FfE275dAc15De988C0E2c61395FddF6f5C0f in tx 0xac6d7e1543753f8f545df98c6abdd9090a75d1bd4a8d883391a52d547edb4d77. 11:22:09 [11:22:09.770] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Rollup at 0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f {"aztecSlotDuration":16,"aztecEpochDuration":4,"targetCommitteeSize":0,"aztecProofSubmissionEpochs":1,"slashingQuorum":6,"slashingRoundSize":10,"manaTarget":10000000000,"entryQueueFlushSizeMin":48,"entryQueueFlushSizeQuotient":2,"provingCostPerMana":100,"rewardConfig":{"sequencerBps":5000,"increment":200000,"maxScore":5000000,"a":5000,"k":1000000,"minimum":100000}} 11:22:09 [11:22:09.771] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 11 transactions to be mined... 11:22:09 [11:22:09.806] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 11:22:09 [11:22:09.807] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof All core contracts have been deployed 11:22:09 [11:22:09.834] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x10b536818a05beeebbfcb4746693765ff76cc181ef823c6e24b05a3331a66043 {"gasLimit":1056482,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 11:22:09 [11:22:09.834] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x8f7c169880fe40C4f7e9E9c50edC25c48e8439e9 in tx 0x10b536818a05beeebbfcb4746693765ff76cc181ef823c6e24b05a3331a66043. 11:22:09 [11:22:09.835] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed SlashFactory at 0x8f7c169880fe40c4f7e9e9c50edc25c48e8439e9 11:22:09 [11:22:09.871] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xb263bc77edc787ea305721a25b1f2f609a987677818bf3afd0abbca89f0cf623 {"gasLimit":117006,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 11:22:09 [11:22:09.871] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Adding rollup 0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f to registry 0x3c709afec1aceae522c13145005de788a3cc65c8 in tx 0xb263bc77edc787ea305721a25b1f2f609a987677818bf3afd0abbca89f0cf623 11:22:09 [11:22:09.900] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xf20abb426a489c1a1124b5b55b6110aa53ebcf179e67f4f8faf8b52635500b1f {"gasLimit":109478,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 11:22:09 [11:22:09.901] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Adding rollup 0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f to GSE 0x6f26a1916df432654607f9c75b764e535e65cf3e in tx 0xf20abb426a489c1a1124b5b55b6110aa53ebcf179e67f4f8faf8b52635500b1f 11:22:09 [11:22:09.907] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 12 transactions to be mined... 11:22:09 [11:22:09.949] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 11:22:09 [11:22:09.956] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup deployed 11:22:09 [11:22:09.957] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for rollup and slash factory to be deployed 11:22:09 [11:22:09.957] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 12 transactions to be mined... 11:22:09 [11:22:09.988] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 11:22:09 [11:22:09.989] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof All transactions for L1 deployment have been mined 11:22:10 [11:22:10.014] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Aztec L1 contracts initialized {"registryAddress":"0x3c709afec1aceae522c13145005de788a3cc65c8","governanceAddress":"0xa49a3d51a71916f87d60f0e919fb66e4b933b4df","governanceProposerAddress":"0xede9b34af448f9261efea2dafb2364866b09e01a","rollupAddress":"0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f","inboxAddress":"0x3d5e31a2517601aeb780ffd68073cd0dcd546726","outboxAddress":"0x13ca9b80bd8c656bea47a67e86d909c6022db9e2","feeJuicePortalAddress":"0xe49dc79b3a81b9cb8fc53163857f50fd26ec6900","feeJuiceAddress":"0xb8999345da8041f1da51ac5179b1f055a560f397","stakingAssetAddress":"0xbb9e13665cfb3d531f288a11e7312b6b91c59292","rewardDistributorAddress":"0x4a51916a6b10a43f6565042be5b6b69d8d613f64","gseAddress":"0x6f26a1916df432654607f9c75b764e535e65cf3e","coinIssuerAddress":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266"} 11:22:10 [11:22:10.015] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Handing over to governance 11:22:10 [11:22:10.023] WARN: ethereum:cheat_codes Set L1 automine to false 11:22:10 [11:22:10.024] WARN: ethereum:cheat_codes Set L1 interval mining to 8 seconds 11:22:10 [11:22:10.027] WARN: foundation:test-date-provider Time set to 2025-06-23T11:25:13.000Z {"offset":182973,"timeMs":1750677913000} 11:22:10 [11:22:10.034] INFO: aztecjs:utils:watcher Watcher not started because not auto mining 11:22:10 [11:22:10.035] INFO: telemetry:client Using NoopTelemetryClient 11:22:10 [11:22:10.040] INFO: kv-store:lmdb-v2:blob-sink Creating blob-sink data store at directory /tmp/a072b44e67546838/blob-sink with map size 134217728 KB (LMDB v2) 11:22:10 [11:22:10.050] INFO: kv-store:lmdb-v2:blob-sink Starting data store with maxReaders 16 11:22:10 [11:22:10.076] INFO: blob-sink:server Server is running on http://localhost:33181 11:22:10 [11:22:10.077] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating and synching an aztec node... 11:22:10 [11:22:10.078] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Using native ACVM binary at ../../noir/noir-repo/target/release/acvm with working directory /tmp/bad16724/acvm 11:22:10 [11:22:10.079] INFO: node:blob-sink:client Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:33181"} 11:22:10 [11:22:10.119] VERBOSE: node:MAIN-aztec-node Snapshot sync is disabled. No snapshots URL provided. 11:22:10 [11:22:10.119] INFO: archiver:lmdb Creating archiver data store at directory /tmp/a072b44e67546838/archiver with map size 134217728 KB (LMDB v2) 11:22:10 [11:22:10.121] INFO: archiver:lmdb Starting data store with maxReaders 16 11:22:10 [11:22:10.968] INFO: node:blob-sink:client Testing configured blob sources {"blobSinkUrl":"http://localhost:33181"} 11:22:10 [11:22:10.990] INFO: node:blob-sink:client Blob sink is reachable {"blobSinkUrl":"http://localhost:33181"} 11:22:10 [11:22:10.991] WARN: node:blob-sink:client No L1 consensus host urls configured 11:22:10 [11:22:10.991] WARN: node:blob-sink:client No archive client configured 11:22:10 [11:22:10.995] INFO: archiver Starting archiver sync to rollup contract 0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f from L1 block 22 to current L1 block 25 with hash 0xe1b1d2f72c1225d714192a8f9e23ebaf92a08e1ea9d9683de75bdab69bc1b871 {"blocksSynchedTo":22,"messagesSynchedTo":{"l1BlockHash":"0xf9725518a111fd0d0d75f09bad78ccfc917728021308d41dc1ea5352a5564817","l1BlockNumber":22}} 11:22:11 [11:22:11.022] INFO: archiver Initial archiver sync to L1 block 25 complete. {"l1BlockNumber":25,"syncPoint":{"blocksSynchedTo":25},"latest":{"number":0},"proven":{"number":0},"finalized":{"number":0}} 11:22:11 [11:22:11.038] INFO: world-state:database Creating world state data store at directory /tmp/a072b44e67546838/world_state with map sizes {"archiveTreeMapSizeKb":134217728,"nullifierTreeMapSizeKb":134217728,"noteHashTreeMapSizeKb":134217728,"messageTreeMapSizeKb":134217728,"publicDataTreeMapSizeKb":134217728} and 2 threads. 11:22:11 [11:22:11.075] INFO: world_state Created world state synchroniser with block history of 2 11:22:11 [11:22:11.075] WARN: node:MAIN-aztec-node Aztec node is accepting fake proofs 11:22:11 [11:22:11.076] INFO: bb-prover:queued_ivc_verifier Starting QueuedIVCVerifier with 8 concurrent verifiers 11:22:11 [11:22:11.095] INFO: p2p:lmdb-v2 Creating p2p data store at directory /tmp/a072b44e67546838/p2p with map size 134217728 KB (LMDB v2) 11:22:11 [11:22:11.100] INFO: p2p:lmdb-v2 Starting data store with maxReaders 16 11:22:11 [11:22:11.101] INFO: p2p-archive:lmdb-v2 Creating p2p-archive data store at directory /tmp/a072b44e67546838/p2p-archive with map size 134217728 KB (LMDB v2) 11:22:11 [11:22:11.103] INFO: p2p-archive:lmdb-v2 Starting data store with maxReaders 16 11:22:11 [11:22:11.105] INFO: p2p-peer:lmdb-v2 Creating p2p-peers data store at directory /tmp/a072b44e67546838/p2p-peers with map size 134217728 KB (LMDB v2) 11:22:11 [11:22:11.110] INFO: p2p-peer:lmdb-v2 Starting data store with maxReaders 16 11:22:11 [11:22:11.111] INFO: p2p:tx_pool Setting maximum tx mempool size {"maxTxPoolSize":100000000} 11:22:11 [11:22:11.112] VERBOSE: p2p P2P is disabled. Using dummy P2P service. 11:22:11 [11:22:11.115] VERBOSE: world-state:block_stream Starting L2 block stream {"proven":false,"pollIntervalMS":50} 11:22:11 [11:22:11.116] INFO: world_state Started world state synchronizer from block 1 11:22:11 [11:22:11.118] VERBOSE: world-state:block_stream Starting sync from block number 0 11:22:11 [11:22:11.123] INFO: p2p Starting p2p client from block 0 with empty mempools 11:22:11 [11:22:11.123] VERBOSE: p2p:l2-block-stream Starting L2 block stream {"batchSize":20,"pollIntervalMS":100,"startingBlock":0} 11:22:11 [11:22:11.497] INFO: epoch-prune-watcher EpochPruneWatcher initialized 11:22:11 [11:22:11.550] VERBOSE: validator Initialized validator with addresses: 0xc915d80955ffa7df78d0f917187cf92191472746 11:22:11 [11:22:11.551] VERBOSE: node:MAIN-aztec-node All Aztec Node subsystems synced 11:22:11 [11:22:11.562] INFO: slasher Starting Slasher client... 11:22:11 [11:22:11.572] VERBOSE: p2p:l2-block-stream Starting sync from block number 0 11:22:11 [11:22:11.587] INFO: validator Started validator with addresses: 0xc915d80955ffa7df78d0f917187cf92191472746 11:22:11 [11:22:11.588] VERBOSE: validator Validators 0xc915d80955ffa7df78d0f917187cf92191472746 are not on the validator committee for epoch 0 11:22:11 [11:22:11.588] INFO: sequencer Sequencer config set {"transactionPollingIntervalMS":500,"maxTxsPerBlock":32,"minTxsPerBlock":0,"maxL2BlockGas":10000000000,"publishTxsWithProposals":false,"maxDABlockGas":10000000000,"acvmWorkingDirectory":"/tmp/bad16724/acvm","acvmBinaryPath":"../../noir/noir-repo/target/release/acvm","maxBlockSizeInBytes":1048576,"governanceProposerPayload":"0x0000000000000000000000000000000000000000","maxL1TxInclusionTimeIntoSlot":8,"enforceTimeTable":false} 11:22:11 [11:22:11.589] VERBOSE: sequencer Sequencer timetable updated {"enforceTimeTable":false} 11:22:11 [11:22:11.591] INFO: sequencer Sequencer started with address 0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266 11:22:11 [11:22:11.591] VERBOSE: node:MAIN-aztec-node Sequencer started 11:22:11 [11:22:11.592] INFO: node:MAIN-aztec-node Aztec Node version: 0.87.6 11:22:11 [11:22:11.592] INFO: node:MAIN-aztec-node Aztec Node started on chain 0x7a69 {"registryAddress":"0x3c709afec1aceae522c13145005de788a3cc65c8","governanceAddress":"0xa49a3d51a71916f87d60f0e919fb66e4b933b4df","governanceProposerAddress":"0xede9b34af448f9261efea2dafb2364866b09e01a","rollupAddress":"0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f","inboxAddress":"0x3d5e31a2517601aeb780ffd68073cd0dcd546726","outboxAddress":"0x13ca9b80bd8c656bea47a67e86d909c6022db9e2","feeJuicePortalAddress":"0xe49dc79b3a81b9cb8fc53163857f50fd26ec6900","feeJuiceAddress":"0xb8999345da8041f1da51ac5179b1f055a560f397","stakingAssetAddress":"0xbb9e13665cfb3d531f288a11e7312b6b91c59292","rewardDistributorAddress":"0x4a51916a6b10a43f6565042be5b6b69d8d613f64","gseAddress":"0x6f26a1916df432654607f9c75b764e535e65cf3e","coinIssuerAddress":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","slashFactoryAddress":"0x8f7c169880fe40c4f7e9e9c50edc25c48e8439e9","feeAssetHandlerAddress":"0xb4ff23c4b1e2bc7c86090d4fbda21a457ee6727f","stakingAssetHandlerAddress":"0xf4de5cf63467155f12e722456ff7952eb95c40b6","zkPassportVerifierAddress":"0xee9f10f38319eae2730dba28fb09081db806c5e5"} 11:22:11 [11:22:11.593] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating and syncing a simulated prover node... 11:22:11 [11:22:11.648] INFO: blob-sink:client:prover-node Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:33181"} 11:22:11 [11:22:11.656] INFO: archiver:lmdb:prover-node Creating archiver data store at directory /tmp/a072b44e67546838/abe2d4e7f5390567/archiver with map size 134217728 KB (LMDB v2) 11:22:11 [11:22:11.667] INFO: archiver:lmdb:prover-node Starting data store with maxReaders 16 11:22:11 [11:22:11.670] VERBOSE: sequencer Preparing proposal for block 1 at slot 2 {"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750677921,"version":115332832},"chainTipArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","blockNumber":1,"slot":2} 11:22:11 [11:22:11.988] VERBOSE: block-builder Building block 1 for slot 2 {"slot":2,"slotStart":"2025-06-23T11:25:21.000Z","now":"2025-06-23T11:25:14.960Z","blockNumber":1,"msgCount":0,"initialStateReference":{"l1ToL2MessageTree":"0x2e33ee2008411c04b99c24b313513d097a0d21a5040b6193d1f978b8226892d6","noteHashTree":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTree":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTree":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9"},"initialArchiveRoot":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}} 11:22:12 [11:22:12.017] INFO: simulator:public-processor:prover-node Processed 0 successful txs and 0 failed txs in 0.0020488459999996847s {"duration":0.0020488459999996847,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 11:22:12 [11:22:12.140] INFO: sequencer Built block 1 for slot 2 with 0 txs and 0 messages. 0 mana/s {"blockHash":"0x2d3f081577a4fcc83888fb742ec737a11335087b26e51228a66aeb316e8f5ad0","globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750677921,"version":115332832},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":354.6362419999987,"publicProcessDuration":3.0467639999988023,"rollupCircuitsDuration":162.00292799999988,"txCount":0,"blockNumber":1,"blockTimestamp":1750677921,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 11:22:12 [11:22:12.143] INFO: blob-sink:client:prover-node Testing configured blob sources {"blobSinkUrl":"http://localhost:33181"} 11:22:12 [11:22:12.144] VERBOSE: sequencer Attesting committee is empty 11:22:12 [11:22:12.162] INFO: blob-sink:client:prover-node Blob sink is reachable {"blobSinkUrl":"http://localhost:33181"} 11:22:12 [11:22:12.163] WARN: blob-sink:client:prover-node No L1 consensus host urls configured 11:22:12 [11:22:12.163] WARN: blob-sink:client:prover-node No archive client configured 11:22:12 [11:22:12.171] INFO: archiver:prover-node Starting archiver sync to rollup contract 0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f from L1 block 22 to current L1 block 25 with hash 0xe1b1d2f72c1225d714192a8f9e23ebaf92a08e1ea9d9683de75bdab69bc1b871 {"blocksSynchedTo":22,"messagesSynchedTo":{"l1BlockHash":"0xf9725518a111fd0d0d75f09bad78ccfc917728021308d41dc1ea5352a5564817","l1BlockNumber":22}} 11:22:12 [11:22:12.253] INFO: archiver:prover-node Initial archiver sync to L1 block 25 complete. {"l1BlockNumber":25,"syncPoint":{"blocksSynchedTo":25},"latest":{"number":0},"proven":{"number":0},"finalized":{"number":0}} 11:22:12 [11:22:12.262] INFO: prover-node:blob-sink:client:prover-node Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:33181"} 11:22:12 [11:22:12.262] VERBOSE: prover-node:prover-node Snapshot sync is disabled. No snapshots URL provided. 11:22:12 [11:22:12.270] VERBOSE: prover-node:prover-node Created archiver and synced to block 0 11:22:12 [11:22:12.314] INFO: world-state:database:prover-node Creating world state data store at directory /tmp/a072b44e67546838/abe2d4e7f5390567/world_state with map sizes {"archiveTreeMapSizeKb":134217728,"nullifierTreeMapSizeKb":134217728,"noteHashTreeMapSizeKb":134217728,"messageTreeMapSizeKb":134217728,"publicDataTreeMapSizeKb":134217728} and 2 threads. 11:22:12 [11:22:12.347] INFO: world_state:prover-node Created world state synchroniser with block history of 2 11:22:12 [11:22:12.348] VERBOSE: world-state:block_stream:prover-node Starting L2 block stream {"proven":false,"pollIntervalMS":50} 11:22:12 [11:22:12.348] INFO: world_state:prover-node Started world state synchronizer from block 1 11:22:12 [11:22:12.350] VERBOSE: world-state:block_stream:prover-node Starting sync from block number 0 11:22:12 [11:22:12.351] WARN: prover-client:proving-broker-database:prover-node Found invalid epoch directory /tmp/a072b44e67546838/abe2d4e7f5390567/archiver when loading epoch databases, ignoring 11:22:12 [11:22:12.351] WARN: prover-client:proving-broker-database:prover-node Found invalid epoch directory /tmp/a072b44e67546838/abe2d4e7f5390567/world_state when loading epoch databases, ignoring 11:22:12 [11:22:12.352] INFO: prover-client:proving-broker:prover-node Proving Broker started 11:22:12 [11:22:12.400] INFO: prover-node:prover-coordination:prover-node Using prover coordination via aztec node 11:22:12 [11:22:12.402] INFO: e2e:e2e_epochs:epochs_upload_failed_proof:prover-node Created and synced prover node {"publisherAddress":"0x3C44CdDdB6a900fa2b585dd299e03d12FA4293BC"} 11:22:12 [11:22:12.403] INFO: prover-node:epoch-monitor:prover-node Started EpochMonitor {"pollingIntervalMs":200} 11:22:12 [11:22:12.414] INFO: prover-node:prover-node Started Prover Node with prover id 0x0000000000000000000000000000000000000000000000000000000000000001 {"proverNodePollingIntervalMs":200,"proverNodeMaxPendingJobs":10,"proverNodeMaxParallelBlocksPerEpoch":32,"txGatheringIntervalMs":1000,"txGatheringBatchSize":10,"txGatheringMaxParallelRequestsPerNode":100,"proverNodeFailedEpochStore":"file:///tmp/failed-proofs-7Hl398","dataDirectory":"/tmp/a072b44e67546838/abe2d4e7f5390567","l1ChainId":31337,"rollupVersion":115332832} 11:22:12 [11:22:12.415] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating a pxe... 11:22:12 [11:22:12.426] INFO: pxe:data:lmdb Creating pxe_data data store at directory /tmp/df2b965c411ac88e/pxe_data with map size 134217728 KB (LMDB v2) 11:22:12 [11:22:12.427] INFO: pxe:data:lmdb Starting data store with maxReaders 16 11:22:13 [11:22:13.113] VERBOSE: pxe:service Registered protocol contracts in pxe {"AuthRegistry":"0x0000000000000000000000000000000000000000000000000000000000000001","ContractInstanceDeployer":"0x0000000000000000000000000000000000000000000000000000000000000002","ContractClassRegisterer":"0x0000000000000000000000000000000000000000000000000000000000000003","MultiCallEntrypoint":"0x0000000000000000000000000000000000000000000000000000000000000004","FeeJuice":"0x0000000000000000000000000000000000000000000000000000000000000005","Router":"0x0000000000000000000000000000000000000000000000000000000000000006"} 11:22:13 [11:22:13.113] INFO: pxe:service Started PXE connected to chain 31337 version 115332832 11:22:13 [11:22:13.124] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L2 genesis at L1 block 22 (timestamp 1750677889) 11:22:13 [11:22:13.125] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting until L1 timestamp 1750677953 is reached as the start of epoch 1 11:22:13 [11:22:13.365] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 25 mined at 11:25:13 with new L2 block 0 for epoch 0 with proof up to L2 block 0 for epoch 0 {"l1Timestamp":1750677913,"l1BlockNumber":25,"l2SlotNumber":1,"l2BlockNumber":0,"l2ProvenBlockNumber":0,"totalL2Messages":0} 11:22:15 [11:22:15.814] VERBOSE: ethereum:tx_delayer Sent tx immediately 0x910db96335e3a87b150b1c010aac2c30315b4a7fe65b2611ece29d67de065ede 11:22:15 [11:22:15.815] VERBOSE: node:MAIN-aztec-node Sent L1 transaction 0x910db96335e3a87b150b1c010aac2c30315b4a7fe65b2611ece29d67de065ede {"gasLimit":470440,"maxFeePerGas":"500","maxPriorityFeePerGas":"500","maxFeePerBlobGas":"0.000000001"} 11:22:18 [11:22:18.145] INFO: sequencer:publisher Bundled [propose] transaction [succeeded] 11:22:18 [11:22:18.146] VERBOSE: sequencer:publisher Published L2 block to L1 rollup contract {"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0x910db96335e3a87b150b1c010aac2c30315b4a7fe65b2611ece29d67de065ede","calldataSize":1220,"calldataGas":8816,"txCount":0,"blockNumber":1,"blockTimestamp":1750677921,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 11:22:18 [11:22:18.147] VERBOSE: node:blob-sink:client Sending 1 blobs to blob sink 11:22:18 [11:22:18.155] WARN: blob-sink:client:prover-node Unable to get blob sidecar for 0x9bbfca3c2c87ccb25c2b935e575a56f9b19bef268dcaa277f6b49552404f8011: Not Found (404) {"status":404,"statusText":"Not Found","body":"{\"error\":\"Blob not found\"}"} 11:22:18 [11:22:18.157] WARN: blob-sink:client:prover-node Failed to fetch blobs for 0x9bbfca3c2c87ccb25c2b935e575a56f9b19bef268dcaa277f6b49552404f8011 from all blob sources {"blobSinkUrl":"http://localhost:33181"} 11:22:18 [11:22:18.188] INFO: blob-sink:server Received blob sidecar for block 0x9bbfca3c2c87ccb25c2b935e575a56f9b19bef268dcaa277f6b49552404f8011 11:22:18 [11:22:18.196] WARN: node:blob-sink:client Unable to get blob sidecar for 0x9bbfca3c2c87ccb25c2b935e575a56f9b19bef268dcaa277f6b49552404f8011: Not Found (404) {"status":404,"statusText":"Not Found","body":"{\"error\":\"Blob not found\"}"} 11:22:18 [11:22:18.196] WARN: node:blob-sink:client Failed to fetch blobs for 0x9bbfca3c2c87ccb25c2b935e575a56f9b19bef268dcaa277f6b49552404f8011 from all blob sources {"blobSinkUrl":"http://localhost:33181"} 11:22:18 [11:22:18.204] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 26 mined at 11:25:21 with new L2 block 1 for epoch 0 {"l1Timestamp":1750677921,"l1BlockNumber":26,"l2SlotNumber":2,"l2BlockNumber":1,"l2ProvenBlockNumber":0,"totalL2Messages":0} 11:22:18 [11:22:18.208] INFO: blob-sink:server Blob sidecar stored successfully for block 0x9bbfca3c2c87ccb25c2b935e575a56f9b19bef268dcaa277f6b49552404f8011 11:22:18 [11:22:18.312] INFO: archiver:prover-node Downloaded L2 block 1 {"blockHash":"0x2d3f081577a4fcc83888fb742ec737a11335087b26e51228a66aeb316e8f5ad0","blockNumber":1,"txCount":0,"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750677921,"version":115332832},"archiveRoot":"0x2befd30fa7e8b9a5130c03f800e60eb0eb439166f365f584c9d54809c592683a","archiveNextLeafIndex":2} 11:22:18 [11:22:18.379] INFO: archiver Downloaded L2 block 1 {"blockHash":"0x2d3f081577a4fcc83888fb742ec737a11335087b26e51228a66aeb316e8f5ad0","blockNumber":1,"txCount":0,"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750677921,"version":115332832},"archiveRoot":"0x2befd30fa7e8b9a5130c03f800e60eb0eb439166f365f584c9d54809c592683a","archiveNextLeafIndex":2} 11:22:18 [11:22:18.387] INFO: world_state:prover-node World state updated with L2 block 1 {"eventName":"l2-block-handled","duration":6.261230000000069,"unfinalisedBlockNumber":1,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":1,"blockTimestamp":1750677921,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 11:22:18 [11:22:18.424] VERBOSE: p2p Synched to latest block 1 11:22:18 [11:22:18.430] VERBOSE: prover-node:prover-node Fetching 0 tx hashes for block number 1 from coordination 11:22:18 [11:22:18.431] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 11:22:18 [11:22:18.432] INFO: world_state World state updated with L2 block 1 {"eventName":"l2-block-handled","duration":4.30302600000141,"unfinalisedBlockNumber":1,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":1,"blockTimestamp":1750677921,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 11:22:26 [11:22:26.210] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 27 mined at 11:25:29 {"l1Timestamp":1750677929,"l1BlockNumber":27,"l2SlotNumber":2,"l2BlockNumber":1,"l2ProvenBlockNumber":0,"totalL2Messages":0} 11:22:26 [11:22:26.485] VERBOSE: sequencer Preparing proposal for block 2 at slot 3 {"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750677937,"version":115332832},"chainTipArchive":"0x2befd30fa7e8b9a5130c03f800e60eb0eb439166f365f584c9d54809c592683a","blockNumber":2,"slot":3} 11:22:26 [11:22:26.557] VERBOSE: block-builder Building block 2 for slot 3 {"slot":3,"slotStart":"2025-06-23T11:25:37.000Z","now":"2025-06-23T11:25:29.530Z","blockNumber":2,"msgCount":0,"initialStateReference":{"l1ToL2MessageTree":"0x2e33ee2008411c04b99c24b313513d097a0d21a5040b6193d1f978b8226892d6","noteHashTree":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTree":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTree":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9"},"initialArchiveRoot":"0x2befd30fa7e8b9a5130c03f800e60eb0eb439166f365f584c9d54809c592683a","opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}} 11:22:26 [11:22:26.560] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.0004478789999993751s {"duration":0.0004478789999993751,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 11:22:26 [11:22:26.589] INFO: sequencer Built block 2 for slot 3 with 0 txs and 0 messages. 0 mana/s {"blockHash":"0x207032a8b30455620de139e115b1f90388ce45097489a1bde0461b540288ac96","globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750677937,"version":115332832},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":47.33686899999884,"publicProcessDuration":1.0816389999999956,"rollupCircuitsDuration":37.32816399999865,"txCount":0,"blockNumber":2,"blockTimestamp":1750677937,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 11:22:26 [11:22:26.592] VERBOSE: sequencer Attesting committee is empty 11:22:26 [11:22:26.736] VERBOSE: ethereum:tx_delayer Sent tx immediately 0x871c3f49ecc8f075d6d648729dc8f3c72a4385a4c395534aac984941734802ed 11:22:26 [11:22:26.736] VERBOSE: node:MAIN-aztec-node Sent L1 transaction 0x871c3f49ecc8f075d6d648729dc8f3c72a4385a4c395534aac984941734802ed {"gasLimit":391083,"maxFeePerGas":"1.266232903","maxPriorityFeePerGas":"1.2","maxFeePerBlobGas":"0.000000001"} 11:22:34 [11:22:34.058] INFO: sequencer:publisher Bundled [propose] transaction [succeeded] 11:22:34 [11:22:34.059] VERBOSE: sequencer:publisher Published L2 block to L1 rollup contract {"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0x871c3f49ecc8f075d6d648729dc8f3c72a4385a4c395534aac984941734802ed","calldataSize":1220,"calldataGas":8816,"txCount":0,"blockNumber":2,"blockTimestamp":1750677937,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 11:22:34 [11:22:34.060] VERBOSE: node:blob-sink:client Sending 1 blobs to blob sink 11:22:34 [11:22:34.069] INFO: blob-sink:server Received blob sidecar for block 0xdc2e1807074f625b40fddda488d7de0aaffc8b37fbd73ac25e8034b302f20a4f 11:22:34 [11:22:34.075] INFO: blob-sink:server Blob sidecar stored successfully for block 0xdc2e1807074f625b40fddda488d7de0aaffc8b37fbd73ac25e8034b302f20a4f 11:22:34 [11:22:34.106] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 28 mined at 11:25:37 with new L2 block 2 for epoch 0 {"l1Timestamp":1750677937,"l1BlockNumber":28,"l2SlotNumber":3,"l2BlockNumber":2,"l2ProvenBlockNumber":0,"totalL2Messages":0} 11:22:34 [11:22:34.225] INFO: archiver:prover-node Downloaded L2 block 2 {"blockHash":"0x207032a8b30455620de139e115b1f90388ce45097489a1bde0461b540288ac96","blockNumber":2,"txCount":0,"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750677937,"version":115332832},"archiveRoot":"0x08066a7bb05057f79e0269909516fe5ecdacc97aa0dde87e8b6ab371f716fa73","archiveNextLeafIndex":3} 11:22:34 [11:22:34.275] INFO: archiver Downloaded L2 block 2 {"blockHash":"0x207032a8b30455620de139e115b1f90388ce45097489a1bde0461b540288ac96","blockNumber":2,"txCount":0,"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750677937,"version":115332832},"archiveRoot":"0x08066a7bb05057f79e0269909516fe5ecdacc97aa0dde87e8b6ab371f716fa73","archiveNextLeafIndex":3} 11:22:34 [11:22:34.284] INFO: world_state:prover-node World state updated with L2 block 2 {"eventName":"l2-block-handled","duration":4.9478369999997085,"unfinalisedBlockNumber":2,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":2,"blockTimestamp":1750677937,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 11:22:34 [11:22:34.291] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 11:22:34 [11:22:34.291] VERBOSE: prover-node:prover-node Gathered all 0 txs for epoch 0 {"epochNumber":0} 11:22:34 [11:22:34.296] VERBOSE: prover-node:prover-node Gathered all 0 messages for epoch 0 {"epochNumber":0} 11:22:34 [11:22:34.297] VERBOSE: prover-node:prover-node Gathered previous block header 0 for epoch 0 11:22:34 [11:22:34.297] VERBOSE: prover-node:prover-node Creating proving job for epoch 0 for block range 1 to 2 11:22:34 [11:22:34.301] INFO: prover-node:epoch-proving-job Starting epoch 0 proving job with blocks 1 to 2 {"fromBlock":1,"toBlock":2,"epochSizeBlocks":2,"epochNumber":0,"uuid":"9f962964-54c2-4e83-9de5-14582b30580a"} 11:22:34 [11:22:34.332] INFO: prover-client:orchestrator Starting epoch 0 with 2 blocks 11:22:34 [11:22:34.333] VERBOSE: prover-client:broker-circuit-prover-facade Starting BrokerCircuitProverFacade 11:22:34 [11:22:34.341] VERBOSE: prover-node:epoch-proving-job Starting processing block 1 {"number":1,"blockHash":"0x2d3f081577a4fcc83888fb742ec737a11335087b26e51228a66aeb316e8f5ad0","lastArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"9f962964-54c2-4e83-9de5-14582b30580a","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x0000000000000000000000000000000000000000000000000000000006dfd6e0","blockNumber":1,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 11:22:34 [11:22:34.343] INFO: prover-client:orchestrator Starting block 1 for slot 2 11:22:34 [11:22:34.344] VERBOSE: prover-node:epoch-proving-job Starting processing block 2 {"number":2,"blockHash":"0x207032a8b30455620de139e115b1f90388ce45097489a1bde0461b540288ac96","lastArchive":"0x2befd30fa7e8b9a5130c03f800e60eb0eb439166f365f584c9d54809c592683a","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"9f962964-54c2-4e83-9de5-14582b30580a","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x0000000000000000000000000000000000000000000000000000000006dfd6e0","blockNumber":2,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000003","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 11:22:34 [11:22:34.344] INFO: prover-client:orchestrator Starting block 2 for slot 3 11:22:34 [11:22:34.394] INFO: prover-client:proving-broker:prover-node New proving job id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 epochNumber=0 {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09"} 11:22:34 [11:22:34.396] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09","provingJobType":"BASE_PARITY"} 11:22:34 [11:22:34.397] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09","provingJobType":"BASE_PARITY"} 11:22:34 [11:22:34.398] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09","provingJobType":"BASE_PARITY"} 11:22:34 [11:22:34.398] INFO: world_state World state updated with L2 block 2 {"eventName":"l2-block-handled","duration":24.21394400000281,"unfinalisedBlockNumber":2,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":2,"blockTimestamp":1750677937,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 11:22:34 [11:22:34.401] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000021830000005138572s {"duration":0.000021830000005138572,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 11:22:34 [11:22:34.401] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 11:22:34 [11:22:34.403] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09","provingJobType":"BASE_PARITY"} 11:22:34 [11:22:34.403] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09","provingJobType":"BASE_PARITY"} 11:22:34 [11:22:34.403] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09","provingJobType":"BASE_PARITY"} 11:22:34 [11:22:34.404] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09","provingJobType":"BASE_PARITY"} 11:22:34 [11:22:34.404] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 2 {"blockNumber":2,"blockHash":"0x207032a8b30455620de139e115b1f90388ce45097489a1bde0461b540288ac96","uuid":"9f962964-54c2-4e83-9de5-14582b30580a"} 11:22:34 [11:22:34.405] VERBOSE: prover-client:orchestrator Block 2 completed. Assembling header. 11:22:34 [11:22:34.410] VERBOSE: p2p Synched to latest block 2 11:22:34 [11:22:34.410] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.00001571999999578111s {"duration":0.00001571999999578111,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 11:22:34 [11:22:34.411] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 11:22:34 [11:22:34.412] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 1 {"blockNumber":1,"blockHash":"0x2d3f081577a4fcc83888fb742ec737a11335087b26e51228a66aeb316e8f5ad0","uuid":"9f962964-54c2-4e83-9de5-14582b30580a"} 11:22:34 [11:22:34.412] VERBOSE: prover-client:orchestrator Block 1 completed. Assembling header. 11:22:34 [11:22:34.421] VERBOSE: prover-client:orchestrator Updating archive tree with block 2 header 0x207032a8b30455620de139e115b1f90388ce45097489a1bde0461b540288ac96 11:22:34 [11:22:34.448] VERBOSE: prover-client:orchestrator Updating archive tree with block 1 header 0x2d3f081577a4fcc83888fb742ec737a11335087b26e51228a66aeb316e8f5ad0 11:22:34 [11:22:34.457] VERBOSE: prover-client:orchestrator Orchestrator finalised block 2 11:22:34 [11:22:34.469] INFO: prover-client:proving-broker-database:prover-node Creating broker database for epoch 0 at /tmp/a072b44e67546838/abe2d4e7f5390567/0 with map size 134217728 11:22:34 [11:22:34.476] VERBOSE: prover-client:orchestrator Orchestrator finalised block 1 11:22:34 [11:22:34.498] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 11:22:34 [11:22:34.502] VERBOSE: prover-node:prover-node Fetching 0 tx hashes for block number 2 from coordination 11:22:34 [11:22:34.503] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 11:22:34 [11:22:34.507] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY epochNumber=0 {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09","provingJobType":"BASE_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...","status":"not-found","numOutstandingJobs":1} 11:22:34 [11:22:34.568] INFO: prover-client:proving-agent:prover-node Starting job id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input... 11:22:34 [11:22:34.590] INFO: prover-client:proving-agent:job-controller-c5446fbe Job controller started jobId=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 {"jobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09"} 11:22:34 [11:22:34.752] INFO: prover-client:proving-agent:prover-node Job id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22resul... 11:22:34 [11:22:34.753] INFO: prover-client:proving-broker:prover-node Proving job complete id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY totalAttempts=1 {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09"} 11:22:35 [11:22:35.343] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 11:22:35 [11:22:35.345] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY 11:22:35 [11:22:35.345] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 11:22:35 [11:22:35.386] INFO: prover-client:proving-broker:prover-node New proving job id=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 epochNumber=0 {"provingJobId":"0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6"} 11:22:35 [11:22:35.394] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 type=ROOT_PARITY {"provingJobId":"0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6","provingJobType":"ROOT_PARITY"} 11:22:35 [11:22:35.450] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 type=ROOT_PARITY epochNumber=0 {"provingJobId":"0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6","provingJobType":"ROOT_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu...","status":"not-found","numOutstandingJobs":1} 11:22:35 [11:22:35.493] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Triggering error on finaliseEpoch 11:22:35 [11:22:35.508] ERROR: prover-node:epoch-proving-job Error running epoch 0 prover job: Error: Fake error while proving epoch 11:22:35 at ServerEpochProver.epochProver.finaliseEpoch (/home/aztec-dev/aztec-packages/yarn-project/end-to-end/src/e2e_epochs/epochs_upload_failed_proof.test.ts:60:15) 11:22:35 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:142:64) 11:22:35 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) {"uuid":"9f962964-54c2-4e83-9de5-14582b30580a","epochNumber":0} 11:22:35 [11:22:35.508] VERBOSE: prover-client:broker-circuit-prover-facade Stopping BrokerCircuitProverFacade 11:22:35 [11:22:35.509] ERROR: prover-client:broker-circuit-prover-facade Job errored with 'Broker facade stopped' id=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 type=ROOT_PARITY: { 11:22:35 provingJobId: '0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6', 11:22:35 provingJobType: 'ROOT_PARITY' 11:22:35 } 11:22:35 [11:22:35.510] INFO: prover-client:proving-broker:prover-node Cancelling job id=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 {"provingJobId":"0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6"} 11:22:35 [11:22:35.513] WARN: prover-client:proving-broker:prover-node Proving job id=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 type=ROOT_PARITY not in the in-progress set {"provingJobId":"0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6"} 11:22:35 [11:22:35.513] INFO: prover-client:proving-broker:prover-node Marking proving job as failed id=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 type=ROOT_PARITY totalAttempts=1 err=Aborted {"provingJobId":"0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6"} 11:22:35 [11:22:35.514] ERROR: prover-client:orchestrator Error thrown when proving job: Error: Broker facade stopped 11:22:35 at BrokerCircuitProverFacade.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/proving_broker/broker_prover_facade.js:142:31) 11:22:35 at ServerEpochProver.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/prover-client/server-epoch-prover.js:31:9) 11:22:35 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:183:13) 11:22:35 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) 11:22:35 [11:22:35.514] ERROR: prover-client:orchestrator Error thrown when proving job: Error: Broker facade stopped 11:22:35 at BrokerCircuitProverFacade.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/proving_broker/broker_prover_facade.js:142:31) 11:22:35 at ServerEpochProver.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/prover-client/server-epoch-prover.js:31:9) 11:22:35 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:183:13) 11:22:35 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) 11:22:35 [11:22:35.515] ERROR: prover-node:prover-node Job for 0 exited with state failed: { 11:22:35 id: '9f962964-54c2-4e83-9de5-14582b30580a', 11:22:35 epochNumber: 0n, 11:22:35 state: 'failed' 11:22:35 } 11:22:35 [11:22:35.515] WARN: prover-node:prover-node Uploading epoch proof failure for 0 to file:///tmp/failed-proofs-7Hl398 {"epochNumber":0,"jobId":"9f962964-54c2-4e83-9de5-14582b30580a","location":"file:///tmp/failed-proofs-7Hl398"} 11:22:35 [11:22:35.519] INFO: stdlib:file-store Creating local file file store at /tmp/failed-proofs-7Hl398 11:22:35 [11:22:35.521] INFO: prover-node:prover-node Pausing archiver and world state sync to start snapshot upload 11:22:35 [11:22:35.522] INFO: archiver:prover-node Stopped. 11:22:35 [11:22:35.522] INFO: world_state:prover-node Stopped sync 11:22:35 [11:22:35.522] INFO: prover-node:prover-node Creating backups of lmdb environments to /tmp/a072b44e67546838/abe2d4e7f5390567/epoch-proof-data-R0JQ3d 11:22:35 [11:22:35.535] INFO: prover-node:prover-node Data stores backed up to /tmp/a072b44e67546838/abe2d4e7f5390567/epoch-proof-data-R0JQ3d {"paths":{"l1-to-l2-message-tree":"/tmp/a072b44e67546838/abe2d4e7f5390567/epoch-proof-data-R0JQ3d/world-state/L1ToL2MessageTree/data.mdb","archive-tree":"/tmp/a072b44e67546838/abe2d4e7f5390567/epoch-proof-data-R0JQ3d/world-state/ArchiveTree/data.mdb","public-data-tree":"/tmp/a072b44e67546838/abe2d4e7f5390567/epoch-proof-data-R0JQ3d/world-state/PublicDataTree/data.mdb","note-hash-tree":"/tmp/a072b44e67546838/abe2d4e7f5390567/epoch-proof-data-R0JQ3d/world-state/NoteHashTree/data.mdb","nullifier-tree":"/tmp/a072b44e67546838/abe2d4e7f5390567/epoch-proof-data-R0JQ3d/world-state/NullifierTree/data.mdb","archiver":"/tmp/a072b44e67546838/abe2d4e7f5390567/epoch-proof-data-R0JQ3d/archiver/data.mdb"}} 11:22:35 [11:22:35.536] INFO: prover-node:prover-node Resuming archiver and world state sync 11:22:35 [11:22:35.536] VERBOSE: world-state:block_stream:prover-node Starting L2 block stream {"proven":false,"pollIntervalMS":50} 11:22:35 [11:22:35.537] INFO: world_state:prover-node Resumed sync 11:22:35 [11:22:35.537] INFO: archiver:prover-node Restarting archiver 11:22:35 [11:22:35.558] WARN: prover-node:prover-node Uploaded epoch 0 proof failure data to file:///tmp/failed-proofs-7Hl398/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623112235-9f962964-54c2-4e83-9de5-14582b30580a {"epochNumber":0,"location":"file:///tmp/failed-proofs-7Hl398","basePath":"aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623112235-9f962964-54c2-4e83-9de5-14582b30580a","metadataUrl":"file:///tmp/failed-proofs-7Hl398/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623112235-9f962964-54c2-4e83-9de5-14582b30580a/metadata.json","dataUrl":"file:///tmp/failed-proofs-7Hl398/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623112235-9f962964-54c2-4e83-9de5-14582b30580a/data.bin","metadata":{"l1BlockNumber":28,"l2BlockHash":"0x207032a8b30455620de139e115b1f90388ce45097489a1bde0461b540288ac96","l2BlockNumber":2,"schemaVersions":{"archiver":3,"worldState":2},"timestamp":1750677755538,"dataUrls":{"l1-to-l2-message-tree":"file:///tmp/failed-proofs-7Hl398/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623112235-9f962964-54c2-4e83-9de5-14582b30580a/l1-to-l2-message-tree.db","archive-tree":"file:///tmp/failed-proofs-7Hl398/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623112235-9f962964-54c2-4e83-9de5-14582b30580a/archive-tree.db","public-data-tree":"file:///tmp/failed-proofs-7Hl398/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623112235-9f962964-54c2-4e83-9de5-14582b30580a/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-7Hl398/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623112235-9f962964-54c2-4e83-9de5-14582b30580a/note-hash-tree.db","nullifier-tree":"file:///tmp/failed-proofs-7Hl398/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623112235-9f962964-54c2-4e83-9de5-14582b30580a/nullifier-tree.db","archiver":"file:///tmp/failed-proofs-7Hl398/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623112235-9f962964-54c2-4e83-9de5-14582b30580a/archiver.db"}},"jobId":"9f962964-54c2-4e83-9de5-14582b30580a"} 11:22:35 [11:22:35.559] INFO: prover-node:prover-node Cleaning up backup dir /tmp/a072b44e67546838/abe2d4e7f5390567/epoch-proof-data-R0JQ3d 11:22:42 [11:22:42.126] INFO: prover-node:prover-node Stopping ProverNode 11:22:42 [11:22:42.126] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 11:22:42 [11:22:42.127] INFO: archiver:prover-node Stopped. 11:22:42 [11:22:42.129] INFO: world_state:prover-node Stopped world state synchronizer 11:22:42 [11:22:42.129] INFO: prover-node:prover-node Stopped ProverNode 11:22:42 [11:22:42.129] INFO: node:MAIN-aztec-node Stopping Aztec Node 11:22:42 [11:22:42.253] VERBOSE: sequencer Preparing proposal for block 3 at slot 4 {"globalVariables":{"blockNumber":3,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":4,"timestamp":1750677953,"version":115332832},"chainTipArchive":"0x08066a7bb05057f79e0269909516fe5ecdacc97aa0dde87e8b6ab371f716fa73","blockNumber":3,"slot":4} 11:22:42 [11:22:42.273] VERBOSE: block-builder Building block 3 for slot 4 {"slot":4,"slotStart":"2025-06-23T11:25:53.000Z","now":"2025-06-23T11:25:45.246Z","blockNumber":3,"msgCount":0,"initialStateReference":{"l1ToL2MessageTree":"0x2e33ee2008411c04b99c24b313513d097a0d21a5040b6193d1f978b8226892d6","noteHashTree":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTree":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTree":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9"},"initialArchiveRoot":"0x08066a7bb05057f79e0269909516fe5ecdacc97aa0dde87e8b6ab371f716fa73","opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}} 11:22:42 [11:22:42.275] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.0003260860000009416s {"duration":0.0003260860000009416,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 11:22:42 [11:22:42.292] INFO: sequencer Built block 3 for slot 4 with 0 txs and 0 messages. 0 mana/s {"blockHash":"0x0cdba30a744719b3b15c0a4469b58bdce12ef52e0073e8d1b08dd7a94d966e55","globalVariables":{"blockNumber":3,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":4,"timestamp":1750677953,"version":115332832},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":25.30170299999736,"publicProcessDuration":0.8822559999971418,"rollupCircuitsDuration":20.434337999999116,"txCount":0,"blockNumber":3,"blockTimestamp":1750677953,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 11:22:42 [11:22:42.296] VERBOSE: sequencer Attesting committee is empty 11:22:42 [11:22:42.413] VERBOSE: ethereum:tx_delayer Sent tx immediately 0xb054314022dcca0df3794dad5dc1084e0ca5002ed38224a1bbe8f741a0ee4e46 11:22:42 [11:22:42.414] VERBOSE: node:MAIN-aztec-node Sent L1 transaction 0xb054314022dcca0df3794dad5dc1084e0ca5002ed38224a1bbe8f741a0ee4e46 {"gasLimit":464655,"maxFeePerGas":"1.250837549","maxPriorityFeePerGas":"1.2","maxFeePerBlobGas":"0.000000001"} 11:22:44 [11:22:44.132] INFO: slasher Slasher client stopped. 11:22:50 [11:22:50.046] INFO: sequencer:publisher Bundled [propose] transaction [succeeded] 11:22:50 [11:22:50.049] VERBOSE: sequencer:publisher Published L2 block to L1 rollup contract {"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0xb054314022dcca0df3794dad5dc1084e0ca5002ed38224a1bbe8f741a0ee4e46","calldataSize":1220,"calldataGas":8828,"txCount":0,"blockNumber":3,"blockTimestamp":1750677953,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 11:22:50 [11:22:50.050] VERBOSE: node:blob-sink:client Sending 1 blobs to blob sink 11:22:50 [11:22:50.063] INFO: sequencer Stopped sequencer 11:22:50 [11:22:50.064] INFO: p2p P2P client stopped 11:22:50 [11:22:50.078] INFO: blob-sink:server Received blob sidecar for block 0x1484aea1bf2d1d368ad004487ad199216ff2addc289bdaa07feac9272ab810f3 11:22:50 [11:22:50.083] INFO: world_state Stopped world state synchronizer 11:22:50 [11:22:50.089] INFO: blob-sink:server Blob sidecar stored successfully for block 0x1484aea1bf2d1d368ad004487ad199216ff2addc289bdaa07feac9272ab810f3 11:22:50 [11:22:50.147] INFO: archiver Downloaded L2 block 3 {"blockHash":"0x0cdba30a744719b3b15c0a4469b58bdce12ef52e0073e8d1b08dd7a94d966e55","blockNumber":3,"txCount":0,"globalVariables":{"blockNumber":3,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":4,"timestamp":1750677953,"version":115332832},"archiveRoot":"0x1aed80bccb3bde26a0721371e206ae25e24a7b644322ff27e87d8f5e64dd1a99","archiveNextLeafIndex":4} 11:22:50 [11:22:50.155] INFO: archiver Stopped. 11:22:50 [11:22:50.155] INFO: node:MAIN-aztec-node Stopped Aztec Node 11:22:50 [11:22:50.157] INFO: node:MAIN-aztec-node Stopping Aztec Node 11:22:52 [11:22:52.158] INFO: slasher Slasher client stopped. 11:22:52 [11:22:52.159] WARN: validator Running promise was not started 11:22:52 [11:22:52.159] WARN: sequencer Running promise was not started 11:22:52 [11:22:52.159] INFO: sequencer Stopped sequencer 11:22:52 [11:22:52.159] WARN: p2p:l2-block-stream Running promise was not started 11:22:52 [11:22:52.159] INFO: p2p P2P client stopped 11:22:52 [11:22:52.160] WARN: world-state:block_stream Running promise was not started 11:22:52 [11:22:52.160] INFO: world_state Stopped world state synchronizer 11:22:52 [11:22:52.160] WARN: archiver Running promise was not started 11:22:52 [11:22:52.160] INFO: archiver Stopped. 11:22:52 [11:22:52.160] INFO: node:MAIN-aztec-node Stopped Aztec Node 11:22:52 [11:22:52.160] INFO: prover-node:prover-node Stopping ProverNode 11:22:52 [11:22:52.161] WARN: prover-node:prover-node Running promise was not started 11:22:52 [11:22:52.161] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 11:22:52 [11:22:52.161] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 11:22:52 [11:22:52.161] WARN: archiver:prover-node Running promise was not started 11:22:52 [11:22:52.161] INFO: archiver:prover-node Stopped. 11:22:52 [11:22:52.162] WARN: world-state:block_stream:prover-node Running promise was not started 11:22:52 [11:22:52.162] INFO: world_state:prover-node Stopped world state synchronizer 11:22:52 [11:22:52.162] INFO: prover-node:prover-node Stopped ProverNode 11:22:52 [11:22:52.187] INFO: blob-sink:server Stopping blob sink 11:22:52 [11:22:52.188] INFO: blob-sink:server Blob sink stopped 11:22:52 [11:22:52.198] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data and state {"uploadPath":"/tmp/failed-proofs-7Hl398","rerunDataDir":"/tmp/rerun-data-Ei6NoF","rerunDownloadPath":"/tmp/rerun-download-i0cbxM/data.bin"} 11:22:52 [11:22:52.199] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data from file:///tmp/failed-proofs-7Hl398/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623112235-9f962964-54c2-4e83-9de5-14582b30580a 11:22:52 [11:22:52.200] INFO: stdlib:file-store Creating local file file store at /tmp/failed-proofs-7Hl398/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623112235-9f962964-54c2-4e83-9de5-14582b30580a 11:22:52 [11:22:52.206] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading state snapshot from file:///tmp/failed-proofs-7Hl398/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623112235-9f962964-54c2-4e83-9de5-14582b30580a to local data directory {"metadata":{"l2BlockNumber":2,"l2BlockHash":"0x207032a8b30455620de139e115b1f90388ce45097489a1bde0461b540288ac96","l1BlockNumber":28,"l1ChainId":31337,"rollupVersion":115332832,"rollupAddress":"0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f"},"dataUrls":{"archiver":"file:///tmp/failed-proofs-7Hl398/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623112235-9f962964-54c2-4e83-9de5-14582b30580a/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-7Hl398/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623112235-9f962964-54c2-4e83-9de5-14582b30580a/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-7Hl398/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623112235-9f962964-54c2-4e83-9de5-14582b30580a/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-7Hl398/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623112235-9f962964-54c2-4e83-9de5-14582b30580a/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-7Hl398/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623112235-9f962964-54c2-4e83-9de5-14582b30580a/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-7Hl398/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623112235-9f962964-54c2-4e83-9de5-14582b30580a/l1-to-l2-message-tree.db"}} 11:22:52 [11:22:52.207] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Creating local file file store at /tmp/failed-proofs-7Hl398/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623112235-9f962964-54c2-4e83-9de5-14582b30580a 11:22:52 [11:22:52.207] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading snapshot to /tmp/rerun-data-Ei6NoF/download-tnolGm {"snapshot":{"dataUrls":{"archiver":"file:///tmp/failed-proofs-7Hl398/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623112235-9f962964-54c2-4e83-9de5-14582b30580a/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-7Hl398/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623112235-9f962964-54c2-4e83-9de5-14582b30580a/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-7Hl398/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623112235-9f962964-54c2-4e83-9de5-14582b30580a/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-7Hl398/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623112235-9f962964-54c2-4e83-9de5-14582b30580a/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-7Hl398/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623112235-9f962964-54c2-4e83-9de5-14582b30580a/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-7Hl398/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623112235-9f962964-54c2-4e83-9de5-14582b30580a/l1-to-l2-message-tree.db"}},"downloadPaths":{"archiver":"/tmp/rerun-data-Ei6NoF/download-tnolGm/archiver.db","nullifier-tree":"/tmp/rerun-data-Ei6NoF/download-tnolGm/nullifier-tree.db","public-data-tree":"/tmp/rerun-data-Ei6NoF/download-tnolGm/public-data-tree.db","note-hash-tree":"/tmp/rerun-data-Ei6NoF/download-tnolGm/note-hash-tree.db","archive-tree":"/tmp/rerun-data-Ei6NoF/download-tnolGm/archive-tree.db","l1-to-l2-message-tree":"/tmp/rerun-data-Ei6NoF/download-tnolGm/l1-to-l2-message-tree.db"}} 11:22:52 [11:22:52.210] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Snapshot downloaded at /tmp/rerun-data-Ei6NoF/download-tnolGm {"snapshot":{"dataUrls":{"archiver":"file:///tmp/failed-proofs-7Hl398/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623112235-9f962964-54c2-4e83-9de5-14582b30580a/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-7Hl398/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623112235-9f962964-54c2-4e83-9de5-14582b30580a/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-7Hl398/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623112235-9f962964-54c2-4e83-9de5-14582b30580a/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-7Hl398/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623112235-9f962964-54c2-4e83-9de5-14582b30580a/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-7Hl398/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623112235-9f962964-54c2-4e83-9de5-14582b30580a/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-7Hl398/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623112235-9f962964-54c2-4e83-9de5-14582b30580a/l1-to-l2-message-tree.db"}},"downloadPaths":{"archiver":"/tmp/rerun-data-Ei6NoF/download-tnolGm/archiver.db","nullifier-tree":"/tmp/rerun-data-Ei6NoF/download-tnolGm/nullifier-tree.db","public-data-tree":"/tmp/rerun-data-Ei6NoF/download-tnolGm/public-data-tree.db","note-hash-tree":"/tmp/rerun-data-Ei6NoF/download-tnolGm/note-hash-tree.db","archive-tree":"/tmp/rerun-data-Ei6NoF/download-tnolGm/archive-tree.db","l1-to-l2-message-tree":"/tmp/rerun-data-Ei6NoF/download-tnolGm/l1-to-l2-message-tree.db"}} 11:22:52 [11:22:52.216] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Archiver database set up from snapshot {"path":"/tmp/rerun-data-Ei6NoF/archiver","dbVersion":3,"rollupAddress":"0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f"} 11:22:52 [11:22:52.226] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database l1-to-l2-message-tree set up from snapshot {"path":"/tmp/rerun-data-Ei6NoF/world_state/L1ToL2MessageTree","dbVersion":2,"rollupAddress":"0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f"} 11:22:52 [11:22:52.228] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database archive-tree set up from snapshot {"path":"/tmp/rerun-data-Ei6NoF/world_state/ArchiveTree","dbVersion":2,"rollupAddress":"0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f"} 11:22:52 [11:22:52.229] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database public-data-tree set up from snapshot {"path":"/tmp/rerun-data-Ei6NoF/world_state/PublicDataTree","dbVersion":2,"rollupAddress":"0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f"} 11:22:52 [11:22:52.229] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database note-hash-tree set up from snapshot {"path":"/tmp/rerun-data-Ei6NoF/world_state/NoteHashTree","dbVersion":2,"rollupAddress":"0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f"} 11:22:52 [11:22:52.230] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database nullifier-tree set up from snapshot {"path":"/tmp/rerun-data-Ei6NoF/world_state/NullifierTree","dbVersion":2,"rollupAddress":"0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f"} 11:22:52 [11:22:52.230] INFO: e2e:e2e_epochs:epochs_upload_failed_proof P2P database cleared {"path":"/tmp/rerun-data-Ei6NoF/p2p"} 11:22:52 [11:22:52.230] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data from file:///tmp/failed-proofs-7Hl398/aztec-31337-115332832-0xdf95ffe275dac15de988c0e2c61395fddf6f5c0f/0-20250623112235-9f962964-54c2-4e83-9de5-14582b30580a/data.bin to /tmp/rerun-download-i0cbxM/data.bin 11:22:52 [11:22:52.240] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Epoch proving job data for epoch 0 downloaded successfully 11:22:52 [11:22:52.241] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Rerunning proving job from /tmp/rerun-download-i0cbxM/data.bin 11:22:52 [11:22:52.244] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Using native ACVM binary at ../../noir/noir-repo/target/release/acvm with working directory /tmp/872eb294/acvm 11:22:52 [11:22:52.245] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Loaded proving job data for epoch 0 11:22:52 [11:22:52.264] INFO: world-state:database Creating world state data store at directory /tmp/rerun-data-Ei6NoF/world_state with map sizes {"archiveTreeMapSizeKb":1048576,"nullifierTreeMapSizeKb":1048576,"noteHashTreeMapSizeKb":1048576,"messageTreeMapSizeKb":1048576,"publicDataTreeMapSizeKb":1048576} and 2 threads. 11:22:52 [11:22:52.293] INFO: archiver:lmdb Creating archiver data store at directory /tmp/rerun-data-Ei6NoF/archiver with map size 1048576 KB (LMDB v2) 11:22:52 [11:22:52.295] INFO: archiver:lmdb Starting data store with maxReaders 16 11:22:52 [11:22:52.298] WARN: prover-client:proving-broker-database Found invalid epoch directory /tmp/rerun-data-Ei6NoF/archiver when loading epoch databases, ignoring 11:22:52 [11:22:52.298] WARN: prover-client:proving-broker-database Found invalid epoch directory /tmp/rerun-data-Ei6NoF/world_state when loading epoch databases, ignoring 11:22:52 [11:22:52.299] INFO: prover-client:proving-broker Proving Broker started 11:22:52 [11:22:52.299] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Rerunning epoch proving job for epoch 0 11:22:52 [11:22:52.299] INFO: prover-node:epoch-proving-job Starting epoch 0 proving job with blocks 1 to 2 {"fromBlock":1,"toBlock":2,"epochSizeBlocks":2,"epochNumber":0,"uuid":"2e4e9cde-e863-4216-8b4e-297908b41303"} 11:22:52 [11:22:52.323] INFO: prover-client:orchestrator Starting epoch 0 with 2 blocks 11:22:52 [11:22:52.324] VERBOSE: prover-client:broker-circuit-prover-facade Starting BrokerCircuitProverFacade 11:22:52 [11:22:52.326] VERBOSE: prover-node:epoch-proving-job Starting processing block 1 {"number":1,"blockHash":"0x2d3f081577a4fcc83888fb742ec737a11335087b26e51228a66aeb316e8f5ad0","lastArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"2e4e9cde-e863-4216-8b4e-297908b41303","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x0000000000000000000000000000000000000000000000000000000006dfd6e0","blockNumber":1,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 11:22:52 [11:22:52.326] INFO: prover-client:orchestrator Starting block 1 for slot 2 11:22:52 [11:22:52.327] VERBOSE: prover-node:epoch-proving-job Starting processing block 2 {"number":2,"blockHash":"0x207032a8b30455620de139e115b1f90388ce45097489a1bde0461b540288ac96","lastArchive":"0x2befd30fa7e8b9a5130c03f800e60eb0eb439166f365f584c9d54809c592683a","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"2e4e9cde-e863-4216-8b4e-297908b41303","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x0000000000000000000000000000000000000000000000000000000006dfd6e0","blockNumber":2,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000003","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 11:22:52 [11:22:52.328] INFO: prover-client:orchestrator Starting block 2 for slot 3 11:22:52 [11:22:52.376] INFO: prover-client:proving-broker New proving job id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 epochNumber=0 {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09"} 11:22:52 [11:22:52.386] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09","provingJobType":"BASE_PARITY"} 11:22:52 [11:22:52.386] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09","provingJobType":"BASE_PARITY"} 11:22:52 [11:22:52.387] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09","provingJobType":"BASE_PARITY"} 11:22:52 [11:22:52.388] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.00003621099999872968s {"duration":0.00003621099999872968,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 11:22:52 [11:22:52.389] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 11:22:52 [11:22:52.389] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09","provingJobType":"BASE_PARITY"} 11:22:52 [11:22:52.389] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09","provingJobType":"BASE_PARITY"} 11:22:52 [11:22:52.391] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09","provingJobType":"BASE_PARITY"} 11:22:52 [11:22:52.392] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09","provingJobType":"BASE_PARITY"} 11:22:52 [11:22:52.399] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 1 {"blockNumber":1,"blockHash":"0x2d3f081577a4fcc83888fb742ec737a11335087b26e51228a66aeb316e8f5ad0","uuid":"2e4e9cde-e863-4216-8b4e-297908b41303"} 11:22:52 [11:22:52.399] VERBOSE: prover-client:orchestrator Block 1 completed. Assembling header. 11:22:52 [11:22:52.400] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.00002051999999821419s {"duration":0.00002051999999821419,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 11:22:52 [11:22:52.401] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 11:22:52 [11:22:52.402] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 2 {"blockNumber":2,"blockHash":"0x207032a8b30455620de139e115b1f90388ce45097489a1bde0461b540288ac96","uuid":"2e4e9cde-e863-4216-8b4e-297908b41303"} 11:22:52 [11:22:52.402] VERBOSE: prover-client:orchestrator Block 2 completed. Assembling header. 11:22:52 [11:22:52.411] VERBOSE: prover-client:orchestrator Updating archive tree with block 1 header 0x2d3f081577a4fcc83888fb742ec737a11335087b26e51228a66aeb316e8f5ad0 11:22:52 [11:22:52.423] VERBOSE: prover-client:orchestrator Updating archive tree with block 2 header 0x207032a8b30455620de139e115b1f90388ce45097489a1bde0461b540288ac96 11:22:52 [11:22:52.430] INFO: prover-client:proving-broker-database Creating broker database for epoch 0 at /tmp/rerun-data-Ei6NoF/0 with map size 1048576 11:22:52 [11:22:52.430] VERBOSE: prover-client:orchestrator Orchestrator finalised block 1 11:22:52 [11:22:52.477] VERBOSE: prover-client:orchestrator Orchestrator finalised block 2 11:22:52 [11:22:52.499] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 11:22:52 [11:22:52.506] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY epochNumber=0 {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09","provingJobType":"BASE_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...","status":"not-found","numOutstandingJobs":1} 11:22:52 [11:22:52.604] INFO: prover-client:proving-agent Starting job id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input... 11:22:52 [11:22:52.606] INFO: prover-client:proving-agent:job-controller-7c735d2e Job controller started jobId=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 {"jobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09"} 11:22:52 [11:22:52.737] INFO: prover-client:proving-agent Job id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22resul... 11:22:52 [11:22:52.741] INFO: prover-client:proving-broker Proving job complete id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY totalAttempts=1 {"provingJobId":"0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09"} 11:22:53 [11:22:53.324] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 11:22:53 [11:22:53.326] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:BASE_PARITY:8be55594363c3abfeac9deaa1ca8db1ca4c1eec691f0633cca7c2b439439ec09 type=BASE_PARITY 11:22:53 [11:22:53.327] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 11:22:53 [11:22:53.342] INFO: prover-client:proving-broker New proving job id=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 epochNumber=0 {"provingJobId":"0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6"} 11:22:53 [11:22:53.351] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 type=ROOT_PARITY {"provingJobId":"0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6","provingJobType":"ROOT_PARITY"} 11:22:53 [11:22:53.396] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 type=ROOT_PARITY epochNumber=0 {"provingJobId":"0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6","provingJobType":"ROOT_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu...","status":"not-found","numOutstandingJobs":1} 11:22:53 [11:22:53.406] INFO: prover-client:proving-agent Starting job id=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 type=ROOT_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu... 11:22:53 [11:22:53.444] INFO: prover-client:proving-agent:job-controller-868411a6 Job controller started jobId=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 {"jobId":"0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6"} 11:22:53 [11:22:53.647] INFO: prover-client:proving-agent Job id=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 type=ROOT_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22resu... 11:22:53 [11:22:53.647] INFO: prover-client:proving-broker Proving job complete id=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 type=ROOT_PARITY totalAttempts=1 {"provingJobId":"0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6"} 11:22:54 [11:22:54.330] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 11:22:54 [11:22:54.331] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:ROOT_PARITY:03b2183be6e219edd8f11ece671ac82c1cf9c9ee3ade9772137fe18520dbb5b6 type=ROOT_PARITY 11:22:54 [11:22:54.332] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 11:22:54 [11:22:54.348] INFO: prover-client:proving-broker New proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:3634613431d5d2a42071a84c23b2a4ce814c2f4f675813a7c76def450e8ff9a5 epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:3634613431d5d2a42071a84c23b2a4ce814c2f4f675813a7c76def450e8ff9a5"} 11:22:54 [11:22:54.352] INFO: prover-client:proving-broker New proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:48823517dd6d67f6d85b58fc29b66a5316240fb98862ded5a1039ef357643d40 epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:48823517dd6d67f6d85b58fc29b66a5316240fb98862ded5a1039ef357643d40"} 11:22:54 [11:22:54.400] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:EMPTY_BLOCK_ROOT_ROLLUP:3634613431d5d2a42071a84c23b2a4ce814c2f4f675813a7c76def450e8ff9a5 type=EMPTY_BLOCK_ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:3634613431d5d2a42071a84c23b2a4ce814c2f4f675813a7c76def450e8ff9a5","provingJobType":"EMPTY_BLOCK_ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input...","status":"not-found","numOutstandingJobs":2} 11:22:54 [11:22:54.401] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:EMPTY_BLOCK_ROOT_ROLLUP:48823517dd6d67f6d85b58fc29b66a5316240fb98862ded5a1039ef357643d40 type=EMPTY_BLOCK_ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:48823517dd6d67f6d85b58fc29b66a5316240fb98862ded5a1039ef357643d40","provingJobType":"EMPTY_BLOCK_ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input...","status":"not-found","numOutstandingJobs":2} 11:22:54 [11:22:54.416] INFO: prover-client:proving-agent Starting job id=0:EMPTY_BLOCK_ROOT_ROLLUP:3634613431d5d2a42071a84c23b2a4ce814c2f4f675813a7c76def450e8ff9a5 type=EMPTY_BLOCK_ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input... 11:22:54 [11:22:54.429] INFO: prover-client:proving-agent:job-controller-c6e6f55d Job controller started jobId=0:EMPTY_BLOCK_ROOT_ROLLUP:3634613431d5d2a42071a84c23b2a4ce814c2f4f675813a7c76def450e8ff9a5 {"jobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:3634613431d5d2a42071a84c23b2a4ce814c2f4f675813a7c76def450e8ff9a5"} 11:22:54 [11:22:54.483] INFO: prover-client:proving-agent Starting job id=0:EMPTY_BLOCK_ROOT_ROLLUP:48823517dd6d67f6d85b58fc29b66a5316240fb98862ded5a1039ef357643d40 type=EMPTY_BLOCK_ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input... 11:22:54 [11:22:54.491] INFO: prover-client:proving-agent:job-controller-3167fa7a Job controller started jobId=0:EMPTY_BLOCK_ROOT_ROLLUP:48823517dd6d67f6d85b58fc29b66a5316240fb98862ded5a1039ef357643d40 {"jobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:48823517dd6d67f6d85b58fc29b66a5316240fb98862ded5a1039ef357643d40"} 11:22:55 [11:22:55.931] INFO: prover-client:proving-agent Job id=0:EMPTY_BLOCK_ROOT_ROLLUP:3634613431d5d2a42071a84c23b2a4ce814c2f4f675813a7c76def450e8ff9a5 type=EMPTY_BLOCK_ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22resul... 11:22:55 [11:22:55.931] INFO: prover-client:proving-broker Proving job complete id=0:EMPTY_BLOCK_ROOT_ROLLUP:3634613431d5d2a42071a84c23b2a4ce814c2f4f675813a7c76def450e8ff9a5 type=EMPTY_BLOCK_ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:3634613431d5d2a42071a84c23b2a4ce814c2f4f675813a7c76def450e8ff9a5"} 11:22:56 [11:22:56.341] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 2, total jobs ready: 1 11:22:56 [11:22:56.346] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:3634613431d5d2a42071a84c23b2a4ce814c2f4f675813a7c76def450e8ff9a5 type=EMPTY_BLOCK_ROOT_ROLLUP 11:22:56 [11:22:56.347] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 11:22:57 [11:22:57.977] INFO: prover-client:proving-agent Job id=0:EMPTY_BLOCK_ROOT_ROLLUP:48823517dd6d67f6d85b58fc29b66a5316240fb98862ded5a1039ef357643d40 type=EMPTY_BLOCK_ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22resul... 11:22:57 [11:22:57.979] INFO: prover-client:proving-broker Proving job complete id=0:EMPTY_BLOCK_ROOT_ROLLUP:48823517dd6d67f6d85b58fc29b66a5316240fb98862ded5a1039ef357643d40 type=EMPTY_BLOCK_ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:48823517dd6d67f6d85b58fc29b66a5316240fb98862ded5a1039ef357643d40"} 11:22:58 [11:22:58.348] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 11:22:58 [11:22:58.351] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:48823517dd6d67f6d85b58fc29b66a5316240fb98862ded5a1039ef357643d40 type=EMPTY_BLOCK_ROOT_ROLLUP 11:22:58 [11:22:58.352] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 11:22:58 [11:22:58.363] INFO: prover-client:proving-broker New proving job id=0:ROOT_ROLLUP:cef095746b40805430f61635f01f17806c6df6e3dc99fda36941018d243066c4 epochNumber=0 {"provingJobId":"0:ROOT_ROLLUP:cef095746b40805430f61635f01f17806c6df6e3dc99fda36941018d243066c4"} 11:22:58 [11:22:58.416] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_ROLLUP:cef095746b40805430f61635f01f17806c6df6e3dc99fda36941018d243066c4 type=ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:ROOT_ROLLUP:cef095746b40805430f61635f01f17806c6df6e3dc99fda36941018d243066c4","provingJobType":"ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22input...","status":"not-found","numOutstandingJobs":1} 11:22:58 [11:22:58.444] INFO: prover-client:proving-agent Starting job id=0:ROOT_ROLLUP:cef095746b40805430f61635f01f17806c6df6e3dc99fda36941018d243066c4 type=ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22input... 11:22:58 [11:22:58.464] INFO: prover-client:proving-agent:job-controller-46ff98fb Job controller started jobId=0:ROOT_ROLLUP:cef095746b40805430f61635f01f17806c6df6e3dc99fda36941018d243066c4 {"jobId":"0:ROOT_ROLLUP:cef095746b40805430f61635f01f17806c6df6e3dc99fda36941018d243066c4"} 11:22:58 [11:22:58.617] INFO: prover-client:proving-agent Job id=0:ROOT_ROLLUP:cef095746b40805430f61635f01f17806c6df6e3dc99fda36941018d243066c4 type=ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22resul... 11:22:58 [11:22:58.618] INFO: prover-client:proving-broker Proving job complete id=0:ROOT_ROLLUP:cef095746b40805430f61635f01f17806c6df6e3dc99fda36941018d243066c4 type=ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:ROOT_ROLLUP:cef095746b40805430f61635f01f17806c6df6e3dc99fda36941018d243066c4"} 11:22:59 [11:22:59.352] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 11:22:59 [11:22:59.354] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:ROOT_ROLLUP:cef095746b40805430f61635f01f17806c6df6e3dc99fda36941018d243066c4 type=ROOT_ROLLUP 11:22:59 [11:22:59.355] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 11:22:59 [11:22:59.358] VERBOSE: prover-client:orchestrator Orchestrator completed root rollup for epoch 0 11:22:59 [11:22:59.361] INFO: prover-node:epoch-proving-job Finalised proof for epoch 0 {"epochNumber":0,"uuid":"2e4e9cde-e863-4216-8b4e-297908b41303","duration":7061.346709000005} 11:22:59 [11:22:59.361] INFO: prover-node:epoch-proving-job Submitted proof for epoch 0 (blocks 1 to 2) {"epochNumber":0,"uuid":"2e4e9cde-e863-4216-8b4e-297908b41303"} 11:22:59 [11:22:59.362] VERBOSE: prover-client:broker-circuit-prover-facade Stopping BrokerCircuitProverFacade 11:22:59 [11:22:59.362] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Completed job for epoch 0 with status completed 11:22:59 [11:22:59.362] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Test succeeded 11:22:59 [11:22:59.363] INFO: prover-node:prover-node Stopping ProverNode 11:22:59 [11:22:59.364] WARN: prover-node:prover-node Running promise was not started 11:22:59 [11:22:59.364] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 11:22:59 [11:22:59.364] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 11:22:59 [11:22:59.364] WARN: archiver:prover-node Running promise was not started 11:22:59 [11:22:59.364] INFO: archiver:prover-node Stopped. 11:22:59 [11:22:59.364] WARN: world-state:block_stream:prover-node Running promise was not started 11:22:59 [11:22:59.365] INFO: world_state:prover-node Stopped world state synchronizer 11:22:59 [11:22:59.365] INFO: prover-node:prover-node Stopped ProverNode 11:22:59 [11:22:59.365] INFO: node:MAIN-aztec-node Stopping Aztec Node 11:23:01 [11:23:01.366] INFO: slasher Slasher client stopped. 11:23:01 [11:23:01.366] WARN: validator Running promise was not started 11:23:01 [11:23:01.367] WARN: sequencer Running promise was not started 11:23:01 [11:23:01.367] INFO: sequencer Stopped sequencer 11:23:01 [11:23:01.367] WARN: p2p:l2-block-stream Running promise was not started 11:23:01 [11:23:01.367] INFO: p2p P2P client stopped 11:23:01 [11:23:01.367] WARN: world-state:block_stream Running promise was not started 11:23:01 [11:23:01.367] INFO: world_state Stopped world state synchronizer 11:23:01 [11:23:01.368] WARN: archiver Running promise was not started 11:23:01 [11:23:01.368] INFO: archiver Stopped. 11:23:01 [11:23:01.368] INFO: node:MAIN-aztec-node Stopped Aztec Node 11:23:01 [11:23:01.370] INFO: node:MAIN-aztec-node Stopping Aztec Node 11:23:03 [11:23:03.370] INFO: slasher Slasher client stopped. 11:23:03 [11:23:03.371] WARN: validator Running promise was not started 11:23:03 [11:23:03.371] WARN: sequencer Running promise was not started 11:23:03 [11:23:03.371] INFO: sequencer Stopped sequencer 11:23:03 [11:23:03.371] WARN: p2p:l2-block-stream Running promise was not started 11:23:03 [11:23:03.371] INFO: p2p P2P client stopped 11:23:03 [11:23:03.371] WARN: world-state:block_stream Running promise was not started 11:23:03 [11:23:03.371] INFO: world_state Stopped world state synchronizer 11:23:03 [11:23:03.371] WARN: archiver Running promise was not started 11:23:03 [11:23:03.372] INFO: archiver Stopped. 11:23:03 [11:23:03.372] INFO: node:MAIN-aztec-node Stopped Aztec Node 11:23:03 [11:23:03.372] INFO: prover-node:prover-node Stopping ProverNode 11:23:03 [11:23:03.372] WARN: prover-node:prover-node Running promise was not started 11:23:03 [11:23:03.372] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 11:23:03 [11:23:03.372] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 11:23:03 [11:23:03.372] WARN: archiver:prover-node Running promise was not started 11:23:03 [11:23:03.372] INFO: archiver:prover-node Stopped. 11:23:03 [11:23:03.372] WARN: world-state:block_stream:prover-node Running promise was not started 11:23:03 [11:23:03.373] INFO: world_state:prover-node Stopped world state synchronizer 11:23:03 [11:23:03.373] INFO: prover-node:prover-node Stopped ProverNode 11:23:03 [11:23:03.373] INFO: blob-sink:server Stopping blob sink 11:23:03 [11:23:03.374] INFO: blob-sink:server Blob sink already stopped 11:23:03 PASS src/e2e_epochs/epochs_upload_failed_proof.test.ts 11:23:03 e2e_epochs/epochs_upload_failed_proof 11:23:03 ✓ uploads failed proving job state and re-runs it on a fresh instance (54840 ms) 11:23:03 11:23:03 Test Suites: 1 passed, 1 total 11:23:03 Tests: 1 passed, 1 total 11:23:03 Snapshots: 0 total 11:23:03 Time: 62.827 s 11:23:03 Ran all test suites matching src/e2e_epochs/epochs_upload_failed_proof.test.ts. 11:23:03 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?