Parent Log: http://ci.aztec-labs.com/bad7d4089c78c89a Command: a8cc061dbe484831:ISOLATE=1:NAME=e2e_epochs/epochs_upload_failed_proof yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_upload_failed_proof.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/58696523cc93fda453138a4f2c2dff72b21f0bfa Env: REF_NAME=gh-readonly-queue/next/pr-15180-a923b0dd4c74291fcefa86c41b3b5dffca7e4178 CURRENT_VERSION=0.87.6 CI_FULL=1 Date: Fri Jun 20 13:05:53 UTC 2025 System: ARCH=amd64 CPUS=128 MEM=493Gi HOSTNAME=pr-15180_amd64_x3-full Resources: CPU_LIST=0-127 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_476a42720cde10eb_next 13:05:53 +++ id -u 13:05:53 +++ id -g 13:05:53 ++ docker run -d --name e2e_epochs_epochs_upload_failed_proof --net=none --cpuset-cpus=0-127 --cpus=2 --memory=8g --user 1000:1000 -v/home/aztec-dev:/home/aztec-dev --mount type=tmpfs,target=/tmp,tmpfs-size=1g --workdir /home/aztec-dev/aztec-packages -e HOME -e VERBOSE -e GIT_CONFIG_GLOBAL=/home/aztec-dev/aztec-packages/build-images/src/home/.gitconfig -e FORCE_COLOR=true -e CPUS -e MEM aztecprotocol/build:3.0 /bin/bash -c 'timeout -v 600s bash -c '\''yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_upload_failed_proof.test.ts'\''' 13:05:53 + cid=e20050c8a9265639050d78ad74ad25d8e74b03f247c6999c177b4258bfafd543 13:05:53 + set +x 13:05:55 {"level":25,"time":1750424755049,"pid":12,"hostname":"e20050c8a926","module":"logger","msg":"Logger initialized with level verbose"} 13:06:03 [13:06:03.619] INFO: e2e:epochs_upload_failed_proof Running test: e2e_epochs/epochs_upload_failed_proof uploads failed proving job state and re-runs it on a fresh instance 13:06:03 [13:06:03.773] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Logging metrics to log/e2e_epochs_epochs_upload_failed_proof.jsonl 13:06:04 [13:06:04.034] WARN: ethereum:cheat_codes Set L1 automine to true 13:06:04 [13:06:04.079] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Sent 0.1 ETH to deployer {"deployer":"0x05f32b3cc3888453ff71b01135b34ff8e41263f2","value":100000000000000000} 13:06:04 [13:06:04.095] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Sent 0.1 ETH to deployer {"deployer":"0x05f32b3cc3888453ff71b01135b34ff8e41263f2","value":100000000000000000} 13:06:04 [13:06:04.104] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Multicall3 13:06:04 [13:06:04.105] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Calling anvil_setBlockTimestampInterval with params: [8] 13:06:04 [13:06:04.107] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Set block interval to 8 13:06:04 [13:06:04.108] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contracts from 0xf39Fd6e51aad88F6F4ce6aB8827279cffFb92266 13:06:04 [13:06:04.152] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x8166bb789c828e492198babef9becf8ac44628f059d48e6f68114a9ae2ade6ec {"gasLimit":867658,"maxFeePerGas":"120.351651125","maxPriorityFeePerGas":"118.94979"} 13:06:04 [13:06:04.152] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xB8999345dA8041f1Da51ac5179B1F055A560f397 in tx 0x8166bb789c828e492198babef9becf8ac44628f059d48e6f68114a9ae2ade6ec. 13:06:04 [13:06:04.154] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Fee Asset at 0xb8999345da8041f1da51ac5179b1f055a560f397 13:06:04 [13:06:04.182] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x07d928293fb6819e2a8abf9d0b32b04560f633065cf07cefb5dcf9ca71af1db2 {"gasLimit":867644,"maxFeePerGas":"143.976575211","maxPriorityFeePerGas":"142.739748"} 13:06:04 [13:06:04.183] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xBb9e13665Cfb3d531F288a11E7312b6b91C59292 in tx 0x07d928293fb6819e2a8abf9d0b32b04560f633065cf07cefb5dcf9ca71af1db2. 13:06:04 [13:06:04.184] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Staking Asset at 0xbb9e13665cfb3d531f288a11e7312b6b91c59292 13:06:04 [13:06:04.213] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xd90adcaa1621a861dd7b09565f9dc422367574ea376355a4c91cd87ed3fbfeba {"gasLimit":3252094,"maxFeePerGas":"172.377275728","maxPriorityFeePerGas":"171.2876976"} 13:06:04 [13:06:04.213] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x6f26a1916Df432654607f9c75b764e535e65cf3e in tx 0xd90adcaa1621a861dd7b09565f9dc422367574ea376355a4c91cd87ed3fbfeba. 13:06:04 [13:06:04.214] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed GSE at 0x6f26a1916df432654607f9c75b764e535e65cf3e 13:06:04 [13:06:04.251] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xc6bb96b972383aade82d230cb0c861a0362867228d18483a86f9e4a83b780d2d {"gasLimit":1081864,"maxFeePerGas":"206.505096634","maxPriorityFeePerGas":"205.54523712"} 13:06:04 [13:06:04.252] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x3C709AFec1acEaE522c13145005De788a3CC65c8 in tx 0xc6bb96b972383aade82d230cb0c861a0362867228d18483a86f9e4a83b780d2d. 13:06:04 [13:06:04.255] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Registry at 0x3c709afec1aceae522c13145005de788a3cc65c8 13:06:04 [13:06:04.295] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xf8dde39eb44898986f540429eb4a3f0eeec377763a24054290d85bb8101ac8e4 {"gasLimit":2232036,"maxFeePerGas":"247.515532347","maxPriorityFeePerGas":"246.654284544"} 13:06:04 [13:06:04.295] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xEDE9b34af448F9261efea2DafB2364866b09E01A in tx 0xf8dde39eb44898986f540429eb4a3f0eeec377763a24054290d85bb8101ac8e4. 13:06:04 [13:06:04.296] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed GovernanceProposer at 0xede9b34af448f9261efea2dafb2364866b09e01a 13:06:04 [13:06:04.327] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xaf7178913b5905e53367fb0465133faf75227c51bf46428c817f48a06700bb71 {"gasLimit":3092007,"maxFeePerGas":"296.745116241","maxPriorityFeePerGas":"295.985141452"} 13:06:04 [13:06:04.327] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xa49A3d51a71916F87d60f0e919Fb66E4b933b4df in tx 0xaf7178913b5905e53367fb0465133faf75227c51bf46428c817f48a06700bb71. 13:06:04 [13:06:04.328] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Governance at 0xa49a3d51a71916f87d60f0e919fb66e4b933b4df 13:06:04 [13:06:04.342] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x12d6424d782ad27b9fe44dec1624cf29720992859e74e4ee26f6a49bf5e682cc {"gasLimit":100000,"maxFeePerGas":"355.858763396","maxPriorityFeePerGas":"355.182169742"} 13:06:04 [13:06:04.343] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Set governance on GSE in 0x12d6424d782ad27b9fe44dec1624cf29720992859e74e4ee26f6a49bf5e682cc 13:06:04 [13:06:04.361] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x593e4091a1e08f47177928f9a458263f67a911112187ec79e9a4bc019be7546f {"gasLimit":397405,"maxFeePerGas":"426.824946124","maxPriorityFeePerGas":"426.21860369"} 13:06:04 [13:06:04.362] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x705baA0D3bF675F9B7F169fd5FEA260c436Cd50c in tx 0x593e4091a1e08f47177928f9a458263f67a911112187ec79e9a4bc019be7546f. 13:06:04 [13:06:04.362] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed CoinIssuer at 0x705baa0d3bf675f9b7f169fd5fea260c436cd50c 13:06:04 [13:06:04.363] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for deployments to complete 13:06:04 [13:06:04.364] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 7 transactions to be mined... 13:06:04 [13:06:04.394] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 13:06:04 [13:06:04.412] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x5d6132645b455679b93fe6fc019047a89d80cbc5fb7cbc890344c07a449854fc {"gasLimit":100000,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 13:06:04 [13:06:04.412] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added coin issuer 0x705baa0d3bf675f9b7f169fd5fea260c436cd50c as minter on fee asset in 0x5d6132645b455679b93fe6fc019047a89d80cbc5fb7cbc890344c07a449854fc 13:06:04 [13:06:04.428] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xd01ce626c7c7ee3a243b24780a9fd0dc5184345d6bec4ec1cc5aafc15402dc62 {"gasLimit":56661,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 13:06:04 [13:06:04.446] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x100b31bd1e3992df58985c26db7e5351f01cbb7b9c2e961c411c57733fb6cfa5 {"gasLimit":344517,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 13:06:04 [13:06:04.446] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xB4fF23c4B1E2Bc7C86090d4FBDa21A457ee6727F in tx 0x100b31bd1e3992df58985c26db7e5351f01cbb7b9c2e961c411c57733fb6cfa5. 13:06:04 [13:06:04.447] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed FeeAssetHandler at 0xb4ff23c4b1e2bc7c86090d4fbda21a457ee6727f 13:06:04 [13:06:04.463] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xc451aae80a23ef806a4bacf2e291d1c2ae150b6200ea2ea4e841b119a7e7c28b {"gasLimit":56804,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 13:06:04 [13:06:04.463] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added fee asset handler 0xb4ff23c4b1e2bc7c86090d4fbda21a457ee6727f as minter on fee asset in 0xc451aae80a23ef806a4bacf2e291d1c2ae150b6200ea2ea4e841b119a7e7c28b 13:06:04 [13:06:04.493] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x5eb36206bb7f862342335e4fc973eadb56d6dc572165dff06a227b017ac4eafe {"gasLimit":2514655,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 13:06:04 [13:06:04.493] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xF4de5cF63467155F12E722456ff7952Eb95c40b6 in tx 0x5eb36206bb7f862342335e4fc973eadb56d6dc572165dff06a227b017ac4eafe. 13:06:04 [13:06:04.494] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed StakingAssetHandler at 0xf4de5cf63467155f12e722456ff7952eb95c40b6 13:06:04 [13:06:04.508] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x9a5a484b6057f7e812ffb8538d8cd6a948ec2a89522178514f621f05b5f45a01 {"gasLimit":56804,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 13:06:04 [13:06:04.508] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added staking asset handler 0xf4de5cf63467155f12e722456ff7952eb95c40b6 as minter on staking asset in 0x9a5a484b6057f7e812ffb8538d8cd6a948ec2a89522178514f621f05b5f45a01 13:06:04 [13:06:04.508] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for deployments to complete 13:06:04 [13:06:04.509] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 9 transactions to be mined... 13:06:04 [13:06:04.534] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 13:06:04 [13:06:04.546] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed shared contracts 13:06:04 [13:06:04.590] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x3a452c44942037f215b905f38ac51163490a9b231c6bd08b7e958ae2dd00642b {"gasLimit":84837,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 13:06:04 [13:06:04.590] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Funded reward distributor with 10000000000000000000000000 fee asset in 0x3a452c44942037f215b905f38ac51163490a9b231c6bd08b7e958ae2dd00642b 13:06:04 [13:06:04.614] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x6732a13052b668b6ed53c2db691f949dc5751b43ca937a6796aab9388f3cb12a {"gasLimit":154658,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 13:06:04 [13:06:04.614] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x277E22B0C9698d7f2A1cD7C6d857511617587309 in tx 0x6732a13052b668b6ed53c2db691f949dc5751b43ca937a6796aab9388f3cb12a. 13:06:04 [13:06:04.615] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup will use the mock verifier at 0x277e22b0c9698d7f2a1cd7c6d857511617587309 13:06:04 [13:06:04.616] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup config args {"aztecSlotDuration":16,"aztecEpochDuration":4,"targetCommitteeSize":0,"aztecProofSubmissionEpochs":1,"slashingQuorum":6,"slashingRoundSize":10,"manaTarget":10000000000,"entryQueueFlushSizeMin":48,"entryQueueFlushSizeQuotient":2,"provingCostPerMana":100,"rewardConfig":{"sequencerBps":5000,"increment":200000,"maxScore":5000000,"a":5000,"k":1000000,"minimum":100000}} 13:06:04 [13:06:04.633] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x941674e92e61dc030c2e0b4bd254d3a15f2a5a8081781e583d3bf4a48913c47b {"gasLimit":87007,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 13:06:04 [13:06:04.633] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x755f7b0Abc16C7d115c66eCE21A4C10c13e13a5E in tx 0x941674e92e61dc030c2e0b4bd254d3a15f2a5a8081781e583d3bf4a48913c47b. 13:06:04 [13:06:04.677] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x1ae5ce903470036339870770e59a9f970c504838efebc5df55bd42bb8b6d3eb3 {"gasLimit":5120611,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 13:06:04 [13:06:04.677] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x0B53Fb3A333b73bF09FeaA0a7Bf288F52466E450 in tx 0x1ae5ce903470036339870770e59a9f970c504838efebc5df55bd42bb8b6d3eb3. 13:06:04 [13:06:04.705] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xd84a262d0205f720a2ab56aad4125fa4fc618d7008449739b0eb71454d28af13 {"gasLimit":2891348,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 13:06:04 [13:06:04.706] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x8B9450ADB32f406dFF80fFFA24A9a85A72E733c2 in tx 0xd84a262d0205f720a2ab56aad4125fa4fc618d7008449739b0eb71454d28af13. 13:06:04 [13:06:04.707] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Awaiting for linked libraries to be deployed 13:06:04 [13:06:04.787] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x7f2f90508fd5ce2b2380286b1ea7465885f951dccc1b2b02e72d89d025cf2db0 {"gasLimit":11249776,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 13:06:04 [13:06:04.787] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xCb77a82307Ec5f97C12f4f77fA255C654Cd64ec2 in tx 0x7f2f90508fd5ce2b2380286b1ea7465885f951dccc1b2b02e72d89d025cf2db0. 13:06:04 [13:06:04.788] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Rollup at 0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2 {"aztecSlotDuration":16,"aztecEpochDuration":4,"targetCommitteeSize":0,"aztecProofSubmissionEpochs":1,"slashingQuorum":6,"slashingRoundSize":10,"manaTarget":10000000000,"entryQueueFlushSizeMin":48,"entryQueueFlushSizeQuotient":2,"provingCostPerMana":100,"rewardConfig":{"sequencerBps":5000,"increment":200000,"maxScore":5000000,"a":5000,"k":1000000,"minimum":100000}} 13:06:04 [13:06:04.789] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 11 transactions to be mined... 13:06:04 [13:06:04.837] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 13:06:04 [13:06:04.837] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof All core contracts have been deployed 13:06:04 [13:06:04.854] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xe49e532a36b4903864a807fd35734baaf12b33afdfba52af8a7f1afa0a886d5a {"gasLimit":1056482,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 13:06:04 [13:06:04.855] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x67A59c92a93eF63feb6eda36993B54704E969e42 in tx 0xe49e532a36b4903864a807fd35734baaf12b33afdfba52af8a7f1afa0a886d5a. 13:06:04 [13:06:04.855] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed SlashFactory at 0x67a59c92a93ef63feb6eda36993b54704e969e42 13:06:04 [13:06:04.883] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xc68c039cce7ca1f8aec75d9631483b9d1f2aebf031a990b88e875fd0f41664ec {"gasLimit":117006,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 13:06:04 [13:06:04.883] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Adding rollup 0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2 to registry 0x3c709afec1aceae522c13145005de788a3cc65c8 in tx 0xc68c039cce7ca1f8aec75d9631483b9d1f2aebf031a990b88e875fd0f41664ec 13:06:04 [13:06:04.901] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xfcb7b18dd7a489be41c89e5fd3141f8fcc7993c465fcd79e2bd4d8537e2f9dbf {"gasLimit":109478,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 13:06:04 [13:06:04.901] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Adding rollup 0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2 to GSE 0x6f26a1916df432654607f9c75b764e535e65cf3e in tx 0xfcb7b18dd7a489be41c89e5fd3141f8fcc7993c465fcd79e2bd4d8537e2f9dbf 13:06:04 [13:06:04.905] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 12 transactions to be mined... 13:06:04 [13:06:04.937] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 13:06:04 [13:06:04.943] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup deployed 13:06:04 [13:06:04.944] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for rollup and slash factory to be deployed 13:06:04 [13:06:04.944] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 12 transactions to be mined... 13:06:04 [13:06:04.971] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 13:06:04 [13:06:04.971] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof All transactions for L1 deployment have been mined 13:06:04 [13:06:04.988] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Aztec L1 contracts initialized {"registryAddress":"0x3c709afec1aceae522c13145005de788a3cc65c8","governanceAddress":"0xa49a3d51a71916f87d60f0e919fb66e4b933b4df","governanceProposerAddress":"0xede9b34af448f9261efea2dafb2364866b09e01a","rollupAddress":"0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2","inboxAddress":"0x73738763080313c926909e6501e9c7825e13a003","outboxAddress":"0x5efa5b0696494885604dd68d2a11c41ca646a199","feeJuicePortalAddress":"0x3ea0582b3c6a3eb1d6fadd3ad18154bf15b84388","feeJuiceAddress":"0xb8999345da8041f1da51ac5179b1f055a560f397","stakingAssetAddress":"0xbb9e13665cfb3d531f288a11e7312b6b91c59292","rewardDistributorAddress":"0x4a51916a6b10a43f6565042be5b6b69d8d613f64","gseAddress":"0x6f26a1916df432654607f9c75b764e535e65cf3e","coinIssuerAddress":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266"} 13:06:04 [13:06:04.988] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Handing over to governance 13:06:05 [13:06:04.997] WARN: ethereum:cheat_codes Set L1 automine to false 13:06:05 [13:06:04.999] WARN: ethereum:cheat_codes Set L1 interval mining to 8 seconds 13:06:05 [13:06:05.002] WARN: foundation:test-date-provider Time set to 2025-06-20T13:09:08.000Z {"offset":182999,"timeMs":1750424948000} 13:06:05 [13:06:05.007] INFO: aztecjs:utils:watcher Watcher not started because not auto mining 13:06:05 [13:06:05.007] INFO: telemetry:client Using NoopTelemetryClient 13:06:05 [13:06:05.010] INFO: kv-store:lmdb-v2:blob-sink Creating blob-sink data store at directory /tmp/4dfe570e8ed8c11d/blob-sink with map size 134217728 KB (LMDB v2) 13:06:05 [13:06:05.015] INFO: kv-store:lmdb-v2:blob-sink Starting data store with maxReaders 16 13:06:05 [13:06:05.027] INFO: blob-sink:server Server is running on http://localhost:41847 13:06:05 [13:06:05.027] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating and synching an aztec node... 13:06:05 [13:06:05.031] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Using native ACVM binary at ../../noir/noir-repo/target/release/acvm with working directory /tmp/0fad0fde/acvm 13:06:05 [13:06:05.032] INFO: node:blob-sink:client Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:41847"} 13:06:05 [13:06:05.090] VERBOSE: node:MAIN-aztec-node Snapshot sync is disabled. No snapshots URL provided. 13:06:05 [13:06:05.091] INFO: archiver:lmdb Creating archiver data store at directory /tmp/4dfe570e8ed8c11d/archiver with map size 134217728 KB (LMDB v2) 13:06:05 [13:06:05.095] INFO: archiver:lmdb Starting data store with maxReaders 16 13:06:05 [13:06:05.977] INFO: node:blob-sink:client Testing configured blob sources {"blobSinkUrl":"http://localhost:41847"} 13:06:05 [13:06:05.996] INFO: node:blob-sink:client Blob sink is reachable {"blobSinkUrl":"http://localhost:41847"} 13:06:05 [13:06:05.996] WARN: node:blob-sink:client No L1 consensus host urls configured 13:06:05 [13:06:05.996] WARN: node:blob-sink:client No archive client configured 13:06:06 [13:06:06.000] INFO: archiver Starting archiver sync to rollup contract 0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2 from L1 block 22 to current L1 block 25 with hash 0xa9ee3a63afbd9ed9fa4a6099bf4a024e6e479c4ff38b502dd257c2f4b81bc27f {"blocksSynchedTo":22,"messagesSynchedTo":{"l1BlockHash":"0xc038ef49c5a9d91129f430e84e1698d1660b17f189c0287863fb3deca02664dc","l1BlockNumber":22}} 13:06:06 [13:06:06.022] INFO: archiver Initial archiver sync to L1 block 25 complete. {"l1BlockNumber":25,"syncPoint":{"blocksSynchedTo":25},"latest":{"number":0},"proven":{"number":0},"finalized":{"number":0}} 13:06:06 [13:06:06.036] INFO: world-state:database Creating world state data store at directory /tmp/4dfe570e8ed8c11d/world_state with map sizes {"archiveTreeMapSizeKb":134217728,"nullifierTreeMapSizeKb":134217728,"noteHashTreeMapSizeKb":134217728,"messageTreeMapSizeKb":134217728,"publicDataTreeMapSizeKb":134217728} and 2 threads. 13:06:06 [13:06:06.082] INFO: world_state Created world state synchroniser with block history of 2 13:06:06 [13:06:06.082] WARN: node:MAIN-aztec-node Aztec node is accepting fake proofs 13:06:06 [13:06:06.082] INFO: bb-prover:queued_ivc_verifier Starting QueuedIVCVerifier with 8 concurrent verifiers 13:06:06 [13:06:06.099] INFO: p2p:lmdb-v2 Creating p2p data store at directory /tmp/4dfe570e8ed8c11d/p2p with map size 134217728 KB (LMDB v2) 13:06:06 [13:06:06.103] INFO: p2p:lmdb-v2 Starting data store with maxReaders 16 13:06:06 [13:06:06.105] INFO: p2p-archive:lmdb-v2 Creating p2p-archive data store at directory /tmp/4dfe570e8ed8c11d/p2p-archive with map size 134217728 KB (LMDB v2) 13:06:06 [13:06:06.107] INFO: p2p-archive:lmdb-v2 Starting data store with maxReaders 16 13:06:06 [13:06:06.111] INFO: p2p-peer:lmdb-v2 Creating p2p-peers data store at directory /tmp/4dfe570e8ed8c11d/p2p-peers with map size 134217728 KB (LMDB v2) 13:06:06 [13:06:06.113] INFO: p2p-peer:lmdb-v2 Starting data store with maxReaders 16 13:06:06 [13:06:06.117] INFO: p2p:tx_pool Setting maximum tx mempool size {"maxTxPoolSize":100000000} 13:06:06 [13:06:06.118] VERBOSE: p2p P2P is disabled. Using dummy P2P service. 13:06:06 [13:06:06.121] VERBOSE: world-state:block_stream Starting L2 block stream {"proven":false,"pollIntervalMS":50} 13:06:06 [13:06:06.122] INFO: world_state Started world state synchronizer from block 1 13:06:06 [13:06:06.124] VERBOSE: world-state:block_stream Starting sync from block number 0 13:06:06 [13:06:06.129] INFO: p2p Starting p2p client from block 0 with empty mempools 13:06:06 [13:06:06.129] VERBOSE: p2p:l2-block-stream Starting L2 block stream {"batchSize":20,"pollIntervalMS":100,"startingBlock":0} 13:06:06 [13:06:06.441] INFO: epoch-prune-watcher EpochPruneWatcher initialized 13:06:06 [13:06:06.494] VERBOSE: validator Initialized validator with addresses: 0xd0467fc5cf50bb2e56dec5678de6f0410f40ccb9 13:06:06 [13:06:06.494] VERBOSE: node:MAIN-aztec-node All Aztec Node subsystems synced 13:06:06 [13:06:06.505] INFO: slasher Starting Slasher client... 13:06:06 [13:06:06.514] VERBOSE: p2p:l2-block-stream Starting sync from block number 0 13:06:06 [13:06:06.527] INFO: validator Started validator with addresses: 0xd0467fc5cf50bb2e56dec5678de6f0410f40ccb9 13:06:06 [13:06:06.528] VERBOSE: validator Validators 0xd0467fc5cf50bb2e56dec5678de6f0410f40ccb9 are not on the validator committee for epoch 0 13:06:06 [13:06:06.528] INFO: sequencer Sequencer config set {"transactionPollingIntervalMS":500,"maxTxsPerBlock":32,"minTxsPerBlock":0,"maxL2BlockGas":10000000000,"publishTxsWithProposals":false,"maxDABlockGas":10000000000,"acvmWorkingDirectory":"/tmp/0fad0fde/acvm","acvmBinaryPath":"../../noir/noir-repo/target/release/acvm","maxBlockSizeInBytes":1048576,"governanceProposerPayload":"0x0000000000000000000000000000000000000000","maxL1TxInclusionTimeIntoSlot":8,"enforceTimeTable":false} 13:06:06 [13:06:06.529] VERBOSE: sequencer Sequencer timetable updated {"enforceTimeTable":false} 13:06:06 [13:06:06.531] INFO: sequencer Sequencer started with address 0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266 13:06:06 [13:06:06.531] VERBOSE: node:MAIN-aztec-node Sequencer started 13:06:06 [13:06:06.532] INFO: node:MAIN-aztec-node Aztec Node version: 0.87.6 13:06:06 [13:06:06.532] INFO: node:MAIN-aztec-node Aztec Node started on chain 0x7a69 {"registryAddress":"0x3c709afec1aceae522c13145005de788a3cc65c8","governanceAddress":"0xa49a3d51a71916f87d60f0e919fb66e4b933b4df","governanceProposerAddress":"0xede9b34af448f9261efea2dafb2364866b09e01a","rollupAddress":"0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2","inboxAddress":"0x73738763080313c926909e6501e9c7825e13a003","outboxAddress":"0x5efa5b0696494885604dd68d2a11c41ca646a199","feeJuicePortalAddress":"0x3ea0582b3c6a3eb1d6fadd3ad18154bf15b84388","feeJuiceAddress":"0xb8999345da8041f1da51ac5179b1f055a560f397","stakingAssetAddress":"0xbb9e13665cfb3d531f288a11e7312b6b91c59292","rewardDistributorAddress":"0x4a51916a6b10a43f6565042be5b6b69d8d613f64","gseAddress":"0x6f26a1916df432654607f9c75b764e535e65cf3e","coinIssuerAddress":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","slashFactoryAddress":"0x67a59c92a93ef63feb6eda36993b54704e969e42","feeAssetHandlerAddress":"0xb4ff23c4b1e2bc7c86090d4fbda21a457ee6727f","stakingAssetHandlerAddress":"0xf4de5cf63467155f12e722456ff7952eb95c40b6","zkPassportVerifierAddress":"0xee9f10f38319eae2730dba28fb09081db806c5e5"} 13:06:06 [13:06:06.536] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating and syncing a simulated prover node... 13:06:06 [13:06:06.595] INFO: blob-sink:client:prover-node Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:41847"} 13:06:06 [13:06:06.605] INFO: archiver:lmdb:prover-node Creating archiver data store at directory /tmp/4dfe570e8ed8c11d/f7387d1dbb31aa50/archiver with map size 134217728 KB (LMDB v2) 13:06:06 [13:06:06.631] VERBOSE: sequencer Preparing proposal for block 1 at slot 2 {"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750424956,"version":3403976925},"chainTipArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","blockNumber":1,"slot":2} 13:06:06 [13:06:06.636] INFO: archiver:lmdb:prover-node Starting data store with maxReaders 16 13:06:06 [13:06:06.792] VERBOSE: block-builder Building block 1 for slot 2 {"slot":2,"slotStart":"2025-06-20T13:09:16.000Z","now":"2025-06-20T13:09:09.791Z","blockNumber":1,"msgCount":0,"initialStateReference":{"l1ToL2MessageTree":"0x2e33ee2008411c04b99c24b313513d097a0d21a5040b6193d1f978b8226892d6","noteHashTree":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTree":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTree":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9"},"initialArchiveRoot":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}} 13:06:06 [13:06:06.997] INFO: simulator:public-processor:prover-node Processed 0 successful txs and 0 failed txs in 0.2021962710000007s {"duration":0.2021962710000007,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 13:06:07 [13:06:07.175] INFO: sequencer Built block 1 for slot 2 with 0 txs and 0 messages. 0 mana/s {"blockHash":"0x0f04841f4ac4b5fe3674d373abba766a38a7400ed979d5b3dacbae666823917c","globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750424956,"version":3403976925},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":463.1442110000007,"publicProcessDuration":203.39310300000034,"rollupCircuitsDuration":387.01983499999915,"txCount":0,"blockNumber":1,"blockTimestamp":1750424956,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 13:06:07 [13:06:07.179] VERBOSE: sequencer Attesting committee is empty 13:06:07 [13:06:07.207] INFO: blob-sink:client:prover-node Testing configured blob sources {"blobSinkUrl":"http://localhost:41847"} 13:06:07 [13:06:07.212] INFO: blob-sink:client:prover-node Blob sink is reachable {"blobSinkUrl":"http://localhost:41847"} 13:06:07 [13:06:07.213] WARN: blob-sink:client:prover-node No L1 consensus host urls configured 13:06:07 [13:06:07.213] WARN: blob-sink:client:prover-node No archive client configured 13:06:07 [13:06:07.225] INFO: archiver:prover-node Starting archiver sync to rollup contract 0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2 from L1 block 22 to current L1 block 25 with hash 0xa9ee3a63afbd9ed9fa4a6099bf4a024e6e479c4ff38b502dd257c2f4b81bc27f {"blocksSynchedTo":22,"messagesSynchedTo":{"l1BlockHash":"0xc038ef49c5a9d91129f430e84e1698d1660b17f189c0287863fb3deca02664dc","l1BlockNumber":22}} 13:06:07 [13:06:07.275] INFO: archiver:prover-node Initial archiver sync to L1 block 25 complete. {"l1BlockNumber":25,"syncPoint":{"blocksSynchedTo":25},"latest":{"number":0},"proven":{"number":0},"finalized":{"number":0}} 13:06:07 [13:06:07.279] INFO: prover-node:blob-sink:client:prover-node Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:41847"} 13:06:07 [13:06:07.279] VERBOSE: prover-node:prover-node Snapshot sync is disabled. No snapshots URL provided. 13:06:07 [13:06:07.282] VERBOSE: prover-node:prover-node Created archiver and synced to block 0 13:06:07 [13:06:07.314] INFO: world-state:database:prover-node Creating world state data store at directory /tmp/4dfe570e8ed8c11d/f7387d1dbb31aa50/world_state with map sizes {"archiveTreeMapSizeKb":134217728,"nullifierTreeMapSizeKb":134217728,"noteHashTreeMapSizeKb":134217728,"messageTreeMapSizeKb":134217728,"publicDataTreeMapSizeKb":134217728} and 2 threads. 13:06:07 [13:06:07.351] INFO: world_state:prover-node Created world state synchroniser with block history of 2 13:06:07 [13:06:07.353] VERBOSE: world-state:block_stream:prover-node Starting L2 block stream {"proven":false,"pollIntervalMS":50} 13:06:07 [13:06:07.354] INFO: world_state:prover-node Started world state synchronizer from block 1 13:06:07 [13:06:07.357] VERBOSE: world-state:block_stream:prover-node Starting sync from block number 0 13:06:07 [13:06:07.358] WARN: prover-client:proving-broker-database:prover-node Found invalid epoch directory /tmp/4dfe570e8ed8c11d/f7387d1dbb31aa50/archiver when loading epoch databases, ignoring 13:06:07 [13:06:07.358] WARN: prover-client:proving-broker-database:prover-node Found invalid epoch directory /tmp/4dfe570e8ed8c11d/f7387d1dbb31aa50/world_state when loading epoch databases, ignoring 13:06:07 [13:06:07.359] INFO: prover-client:proving-broker:prover-node Proving Broker started 13:06:07 [13:06:07.378] INFO: prover-node:prover-coordination:prover-node Using prover coordination via aztec node 13:06:07 [13:06:07.380] INFO: e2e:e2e_epochs:epochs_upload_failed_proof:prover-node Created and synced prover node {"publisherAddress":"0x3C44CdDdB6a900fa2b585dd299e03d12FA4293BC"} 13:06:07 [13:06:07.381] INFO: prover-node:epoch-monitor:prover-node Started EpochMonitor {"pollingIntervalMs":200} 13:06:07 [13:06:07.387] INFO: prover-node:prover-node Started Prover Node with prover id 0x0000000000000000000000000000000000000000000000000000000000000001 {"proverNodePollingIntervalMs":200,"proverNodeMaxPendingJobs":10,"proverNodeMaxParallelBlocksPerEpoch":32,"txGatheringIntervalMs":1000,"txGatheringBatchSize":10,"txGatheringMaxParallelRequestsPerNode":100,"proverNodeFailedEpochStore":"file:///tmp/failed-proofs-XdMbqR","dataDirectory":"/tmp/4dfe570e8ed8c11d/f7387d1dbb31aa50","l1ChainId":31337,"rollupVersion":3403976925} 13:06:07 [13:06:07.387] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating a pxe... 13:06:07 [13:06:07.392] INFO: pxe:data:lmdb Creating pxe_data data store at directory /tmp/30d1f8af7ab80482/pxe_data with map size 134217728 KB (LMDB v2) 13:06:07 [13:06:07.399] INFO: pxe:data:lmdb Starting data store with maxReaders 16 13:06:07 [13:06:07.926] VERBOSE: pxe:service Registered protocol contracts in pxe {"AuthRegistry":"0x0000000000000000000000000000000000000000000000000000000000000001","ContractInstanceDeployer":"0x0000000000000000000000000000000000000000000000000000000000000002","ContractClassRegisterer":"0x0000000000000000000000000000000000000000000000000000000000000003","MultiCallEntrypoint":"0x0000000000000000000000000000000000000000000000000000000000000004","FeeJuice":"0x0000000000000000000000000000000000000000000000000000000000000005","Router":"0x0000000000000000000000000000000000000000000000000000000000000006"} 13:06:07 [13:06:07.927] INFO: pxe:service Started PXE connected to chain 31337 version 3403976925 13:06:07 [13:06:07.939] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L2 genesis at L1 block 22 (timestamp 1750424924) 13:06:07 [13:06:07.940] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting until L1 timestamp 1750424988 is reached as the start of epoch 1 13:06:08 [13:06:08.164] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 25 mined at 13:09:08 with new L2 block 0 for epoch 0 with proof up to L2 block 0 for epoch 0 {"l1Timestamp":1750424948,"l1BlockNumber":25,"l2SlotNumber":1,"l2BlockNumber":0,"l2ProvenBlockNumber":0,"totalL2Messages":0} 13:06:10 [13:06:10.490] VERBOSE: ethereum:tx_delayer Sent tx immediately 0x1cbe1df3e92456f6e63f77dafd3f4d8edd57eee342f6b622bf83ae2ff1ba3553 13:06:10 [13:06:10.491] VERBOSE: node:MAIN-aztec-node Sent L1 transaction 0x1cbe1df3e92456f6e63f77dafd3f4d8edd57eee342f6b622bf83ae2ff1ba3553 {"gasLimit":470455,"maxFeePerGas":"500","maxPriorityFeePerGas":"500","maxFeePerBlobGas":"0.000000001"} 13:06:13 [13:06:13.077] INFO: sequencer:publisher Bundled [propose] transaction [succeeded] 13:06:13 [13:06:13.079] VERBOSE: sequencer:publisher Published L2 block to L1 rollup contract {"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0x1cbe1df3e92456f6e63f77dafd3f4d8edd57eee342f6b622bf83ae2ff1ba3553","calldataSize":1220,"calldataGas":8828,"txCount":0,"blockNumber":1,"blockTimestamp":1750424956,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 13:06:13 [13:06:13.080] VERBOSE: node:blob-sink:client Sending 1 blobs to blob sink 13:06:13 [13:06:13.085] WARN: blob-sink:client:prover-node Unable to get blob sidecar for 0x9aae641c72c2a20eb0eb210e38a8e5196935cbbe3990004bd24fb13fe8775b88: Not Found (404) {"status":404,"statusText":"Not Found","body":"{\"error\":\"Blob not found\"}"} 13:06:13 [13:06:13.086] WARN: blob-sink:client:prover-node Failed to fetch blobs for 0x9aae641c72c2a20eb0eb210e38a8e5196935cbbe3990004bd24fb13fe8775b88 from all blob sources {"blobSinkUrl":"http://localhost:41847"} 13:06:13 [13:06:13.108] INFO: blob-sink:server Received blob sidecar for block 0x9aae641c72c2a20eb0eb210e38a8e5196935cbbe3990004bd24fb13fe8775b88 13:06:13 [13:06:13.121] INFO: blob-sink:server Blob sidecar stored successfully for block 0x9aae641c72c2a20eb0eb210e38a8e5196935cbbe3990004bd24fb13fe8775b88 13:06:13 [13:06:13.193] INFO: archiver Downloaded L2 block 1 {"blockHash":"0x0f04841f4ac4b5fe3674d373abba766a38a7400ed979d5b3dacbae666823917c","blockNumber":1,"txCount":0,"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750424956,"version":3403976925},"archiveRoot":"0x2342a7167f60527d4611855b3e2d4ed762d56f94effed9fd5d541a828db5f724","archiveNextLeafIndex":2} 13:06:13 [13:06:13.207] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 26 mined at 13:09:16 with new L2 block 1 for epoch 0 {"l1Timestamp":1750424956,"l1BlockNumber":26,"l2SlotNumber":2,"l2BlockNumber":1,"l2ProvenBlockNumber":0,"totalL2Messages":0} 13:06:13 [13:06:13.277] INFO: archiver:prover-node Downloaded L2 block 1 {"blockHash":"0x0f04841f4ac4b5fe3674d373abba766a38a7400ed979d5b3dacbae666823917c","blockNumber":1,"txCount":0,"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750424956,"version":3403976925},"archiveRoot":"0x2342a7167f60527d4611855b3e2d4ed762d56f94effed9fd5d541a828db5f724","archiveNextLeafIndex":2} 13:06:13 [13:06:13.287] VERBOSE: p2p Synched to latest block 1 13:06:13 [13:06:13.289] INFO: world_state World state updated with L2 block 1 {"eventName":"l2-block-handled","duration":11.145730000000185,"unfinalisedBlockNumber":1,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":1,"blockTimestamp":1750424956,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 13:06:13 [13:06:13.325] INFO: world_state:prover-node World state updated with L2 block 1 {"eventName":"l2-block-handled","duration":3.9077849999994214,"unfinalisedBlockNumber":1,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":1,"blockTimestamp":1750424956,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 13:06:13 [13:06:13.392] VERBOSE: prover-node:prover-node Fetching 0 tx hashes for block number 1 from coordination 13:06:13 [13:06:13.397] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 13:06:21 [13:06:21.181] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 27 mined at 13:09:24 {"l1Timestamp":1750424964,"l1BlockNumber":27,"l2SlotNumber":2,"l2BlockNumber":1,"l2ProvenBlockNumber":0,"totalL2Messages":0} 13:06:21 [13:06:21.258] VERBOSE: sequencer Preparing proposal for block 2 at slot 3 {"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750424972,"version":3403976925},"chainTipArchive":"0x2342a7167f60527d4611855b3e2d4ed762d56f94effed9fd5d541a828db5f724","blockNumber":2,"slot":3} 13:06:21 [13:06:21.292] VERBOSE: block-builder Building block 2 for slot 3 {"slot":3,"slotStart":"2025-06-20T13:09:32.000Z","now":"2025-06-20T13:09:24.291Z","blockNumber":2,"msgCount":0,"initialStateReference":{"l1ToL2MessageTree":"0x2e33ee2008411c04b99c24b313513d097a0d21a5040b6193d1f978b8226892d6","noteHashTree":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTree":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTree":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9"},"initialArchiveRoot":"0x2342a7167f60527d4611855b3e2d4ed762d56f94effed9fd5d541a828db5f724","opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}} 13:06:21 [13:06:21.297] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.001499790000001667s {"duration":0.001499790000001667,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 13:06:21 [13:06:21.329] INFO: sequencer Built block 2 for slot 3 with 0 txs and 0 messages. 0 mana/s {"blockHash":"0x0a40ddd2e4b06b219ba44573aca1659dc477c75d44ce6c6eb965f33f8c5d51bf","globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750424972,"version":3403976925},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":53.51094400000147,"publicProcessDuration":1.9706929999993008,"rollupCircuitsDuration":41.8777399999999,"txCount":0,"blockNumber":2,"blockTimestamp":1750424972,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 13:06:21 [13:06:21.333] VERBOSE: sequencer Attesting committee is empty 13:06:21 [13:06:21.486] VERBOSE: ethereum:tx_delayer Sent tx immediately 0x1ebe0d58afd6552511f44129980f360f999fbae6133326043b19c1baf0d13ba4 13:06:21 [13:06:21.486] VERBOSE: node:MAIN-aztec-node Sent L1 transaction 0x1ebe0d58afd6552511f44129980f360f999fbae6133326043b19c1baf0d13ba4 {"gasLimit":391098,"maxFeePerGas":"1.266232918","maxPriorityFeePerGas":"1.2","maxFeePerBlobGas":"0.000000001"} 13:06:29 [13:06:29.038] INFO: sequencer:publisher Bundled [propose] transaction [succeeded] 13:06:29 [13:06:29.039] VERBOSE: sequencer:publisher Published L2 block to L1 rollup contract {"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0x1ebe0d58afd6552511f44129980f360f999fbae6133326043b19c1baf0d13ba4","calldataSize":1220,"calldataGas":8828,"txCount":0,"blockNumber":2,"blockTimestamp":1750424972,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 13:06:29 [13:06:29.039] VERBOSE: node:blob-sink:client Sending 1 blobs to blob sink 13:06:29 [13:06:29.041] WARN: archiver:prover-node Failed to reach L2 block 2 at 27 (latest is 1). Rolling back last synched L1 block number to 26. {"latestLocalL2BlockNumber":1,"latestLocalL2BlockArchive":"0x2342a7167f60527d4611855b3e2d4ed762d56f94effed9fd5d541a828db5f724","blocksSynchedTo":26,"currentL1BlockNumber":27,"provenBlockNumber":0,"provenArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","pendingBlockNumber":2,"pendingArchive":"0x2e91a25a2d3727fac1956bff917cba1abbb2a99a75d0414579bfa60117d38e2a"} 13:06:29 [13:06:29.048] WARN: archiver Failed to reach L2 block 2 at 27 (latest is 1). Rolling back last synched L1 block number to 26. {"latestLocalL2BlockNumber":1,"latestLocalL2BlockArchive":"0x2342a7167f60527d4611855b3e2d4ed762d56f94effed9fd5d541a828db5f724","blocksSynchedTo":26,"currentL1BlockNumber":27,"provenBlockNumber":0,"provenArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","pendingBlockNumber":2,"pendingArchive":"0x2e91a25a2d3727fac1956bff917cba1abbb2a99a75d0414579bfa60117d38e2a"} 13:06:29 [13:06:29.052] INFO: blob-sink:server Received blob sidecar for block 0x984fac66cd9e3bc150cede5f48c8fe415732a4948d60473e222852348e95f32a 13:06:29 [13:06:29.058] INFO: blob-sink:server Blob sidecar stored successfully for block 0x984fac66cd9e3bc150cede5f48c8fe415732a4948d60473e222852348e95f32a 13:06:29 [13:06:29.228] INFO: archiver:prover-node Downloaded L2 block 2 {"blockHash":"0x0a40ddd2e4b06b219ba44573aca1659dc477c75d44ce6c6eb965f33f8c5d51bf","blockNumber":2,"txCount":0,"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750424972,"version":3403976925},"archiveRoot":"0x2e91a25a2d3727fac1956bff917cba1abbb2a99a75d0414579bfa60117d38e2a","archiveNextLeafIndex":3} 13:06:29 [13:06:29.232] INFO: archiver Downloaded L2 block 2 {"blockHash":"0x0a40ddd2e4b06b219ba44573aca1659dc477c75d44ce6c6eb965f33f8c5d51bf","blockNumber":2,"txCount":0,"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750424972,"version":3403976925},"archiveRoot":"0x2e91a25a2d3727fac1956bff917cba1abbb2a99a75d0414579bfa60117d38e2a","archiveNextLeafIndex":3} 13:06:29 [13:06:29.241] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 28 mined at 13:09:32 with new L2 block 2 for epoch 0 {"l1Timestamp":1750424972,"l1BlockNumber":28,"l2SlotNumber":3,"l2BlockNumber":2,"l2ProvenBlockNumber":0,"totalL2Messages":0} 13:06:29 [13:06:29.289] INFO: world_state:prover-node World state updated with L2 block 2 {"eventName":"l2-block-handled","duration":8.998622999999498,"unfinalisedBlockNumber":2,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":2,"blockTimestamp":1750424972,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 13:06:29 [13:06:29.307] INFO: world_state World state updated with L2 block 2 {"eventName":"l2-block-handled","duration":6.081954000001133,"unfinalisedBlockNumber":2,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":2,"blockTimestamp":1750424972,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 13:06:29 [13:06:29.328] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 13:06:29 [13:06:29.329] VERBOSE: prover-node:prover-node Gathered all 0 txs for epoch 0 {"epochNumber":0} 13:06:29 [13:06:29.330] VERBOSE: prover-node:prover-node Gathered all 0 messages for epoch 0 {"epochNumber":0} 13:06:29 [13:06:29.331] VERBOSE: prover-node:prover-node Gathered previous block header 0 for epoch 0 13:06:29 [13:06:29.331] VERBOSE: prover-node:prover-node Creating proving job for epoch 0 for block range 1 to 2 13:06:29 [13:06:29.338] INFO: prover-node:epoch-proving-job Starting epoch 0 proving job with blocks 1 to 2 {"fromBlock":1,"toBlock":2,"epochSizeBlocks":2,"epochNumber":0,"uuid":"af454cdc-9480-4c07-940b-04ae943dfb25"} 13:06:29 [13:06:29.363] INFO: prover-client:orchestrator Starting epoch 0 with 2 blocks 13:06:29 [13:06:29.364] VERBOSE: prover-client:broker-circuit-prover-facade Starting BrokerCircuitProverFacade 13:06:29 [13:06:29.365] VERBOSE: prover-node:epoch-proving-job Starting processing block 1 {"number":1,"blockHash":"0x0f04841f4ac4b5fe3674d373abba766a38a7400ed979d5b3dacbae666823917c","lastArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"af454cdc-9480-4c07-940b-04ae943dfb25","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x00000000000000000000000000000000000000000000000000000000cae490dd","blockNumber":1,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 13:06:29 [13:06:29.366] INFO: prover-client:orchestrator Starting block 1 for slot 2 13:06:29 [13:06:29.367] VERBOSE: prover-node:epoch-proving-job Starting processing block 2 {"number":2,"blockHash":"0x0a40ddd2e4b06b219ba44573aca1659dc477c75d44ce6c6eb965f33f8c5d51bf","lastArchive":"0x2342a7167f60527d4611855b3e2d4ed762d56f94effed9fd5d541a828db5f724","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"af454cdc-9480-4c07-940b-04ae943dfb25","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x00000000000000000000000000000000000000000000000000000000cae490dd","blockNumber":2,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000003","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 13:06:29 [13:06:29.367] INFO: prover-client:orchestrator Starting block 2 for slot 3 13:06:29 [13:06:29.413] VERBOSE: p2p Synched to latest block 2 13:06:29 [13:06:29.417] INFO: prover-client:proving-broker:prover-node New proving job id=0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06 epochNumber=0 {"provingJobId":"0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06"} 13:06:29 [13:06:29.417] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06","provingJobType":"BASE_PARITY"} 13:06:29 [13:06:29.418] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06","provingJobType":"BASE_PARITY"} 13:06:29 [13:06:29.418] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06","provingJobType":"BASE_PARITY"} 13:06:29 [13:06:29.421] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000020500999999057966s {"duration":0.000020500999999057966,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 13:06:29 [13:06:29.421] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 13:06:29 [13:06:29.422] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 1 {"blockNumber":1,"blockHash":"0x0f04841f4ac4b5fe3674d373abba766a38a7400ed979d5b3dacbae666823917c","uuid":"af454cdc-9480-4c07-940b-04ae943dfb25"} 13:06:29 [13:06:29.422] VERBOSE: prover-client:orchestrator Block 1 completed. Assembling header. 13:06:29 [13:06:29.423] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06","provingJobType":"BASE_PARITY"} 13:06:29 [13:06:29.426] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06","provingJobType":"BASE_PARITY"} 13:06:29 [13:06:29.427] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06","provingJobType":"BASE_PARITY"} 13:06:29 [13:06:29.427] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06","provingJobType":"BASE_PARITY"} 13:06:29 [13:06:29.429] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000017469999998866115s {"duration":0.000017469999998866115,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 13:06:29 [13:06:29.429] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 13:06:29 [13:06:29.429] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 2 {"blockNumber":2,"blockHash":"0x0a40ddd2e4b06b219ba44573aca1659dc477c75d44ce6c6eb965f33f8c5d51bf","uuid":"af454cdc-9480-4c07-940b-04ae943dfb25"} 13:06:29 [13:06:29.429] VERBOSE: prover-client:orchestrator Block 2 completed. Assembling header. 13:06:29 [13:06:29.436] VERBOSE: prover-client:orchestrator Updating archive tree with block 1 header 0x0f04841f4ac4b5fe3674d373abba766a38a7400ed979d5b3dacbae666823917c 13:06:29 [13:06:29.444] VERBOSE: prover-client:orchestrator Updating archive tree with block 2 header 0x0a40ddd2e4b06b219ba44573aca1659dc477c75d44ce6c6eb965f33f8c5d51bf 13:06:29 [13:06:29.446] VERBOSE: prover-client:orchestrator Orchestrator finalised block 1 13:06:29 [13:06:29.472] VERBOSE: prover-client:orchestrator Orchestrator finalised block 2 13:06:29 [13:06:29.497] INFO: prover-client:proving-broker-database:prover-node Creating broker database for epoch 0 at /tmp/4dfe570e8ed8c11d/f7387d1dbb31aa50/0 with map size 134217728 13:06:29 [13:06:29.498] VERBOSE: prover-node:prover-node Fetching 0 tx hashes for block number 2 from coordination 13:06:29 [13:06:29.498] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 13:06:29 [13:06:29.507] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 13:06:29 [13:06:29.510] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06 type=BASE_PARITY epochNumber=0 {"provingJobId":"0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06","provingJobType":"BASE_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...","status":"not-found","numOutstandingJobs":1} 13:06:29 [13:06:29.598] INFO: prover-client:proving-agent:prover-node Starting job id=0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06 type=BASE_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input... 13:06:29 [13:06:29.611] INFO: prover-client:proving-agent:job-controller-3a2c1a27 Job controller started jobId=0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06 {"jobId":"0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06"} 13:06:29 [13:06:29.742] INFO: prover-client:proving-agent:prover-node Job id=0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06 type=BASE_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22resul... 13:06:29 [13:06:29.743] INFO: prover-client:proving-broker:prover-node Proving job complete id=0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06 type=BASE_PARITY totalAttempts=1 {"provingJobId":"0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06"} 13:06:30 [13:06:30.366] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 13:06:30 [13:06:30.369] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06 type=BASE_PARITY 13:06:30 [13:06:30.370] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 13:06:30 [13:06:30.386] INFO: prover-client:proving-broker:prover-node New proving job id=0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d epochNumber=0 {"provingJobId":"0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d"} 13:06:30 [13:06:30.395] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d type=ROOT_PARITY {"provingJobId":"0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d","provingJobType":"ROOT_PARITY"} 13:06:30 [13:06:30.439] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d type=ROOT_PARITY epochNumber=0 {"provingJobId":"0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d","provingJobType":"ROOT_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu...","status":"not-found","numOutstandingJobs":1} 13:06:30 [13:06:30.448] INFO: prover-client:proving-agent:prover-node Starting job id=0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d type=ROOT_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu... 13:06:30 [13:06:30.483] INFO: prover-client:proving-agent:job-controller-47a94a0f Job controller started jobId=0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d {"jobId":"0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d"} 13:06:30 [13:06:30.495] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Triggering error on finaliseEpoch 13:06:30 [13:06:30.506] ERROR: prover-node:epoch-proving-job Error running epoch 0 prover job: Error: Fake error while proving epoch 13:06:30 at ServerEpochProver.epochProver.finaliseEpoch (/home/aztec-dev/aztec-packages/yarn-project/end-to-end/src/e2e_epochs/epochs_upload_failed_proof.test.ts:60:15) 13:06:30 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:142:64) 13:06:30 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) {"uuid":"af454cdc-9480-4c07-940b-04ae943dfb25","epochNumber":0} 13:06:30 [13:06:30.506] VERBOSE: prover-client:broker-circuit-prover-facade Stopping BrokerCircuitProverFacade 13:06:30 [13:06:30.507] ERROR: prover-client:broker-circuit-prover-facade Job errored with 'Broker facade stopped' id=0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d type=ROOT_PARITY: { 13:06:30 provingJobId: '0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d', 13:06:30 provingJobType: 'ROOT_PARITY' 13:06:30 } 13:06:30 [13:06:30.508] INFO: prover-client:proving-broker:prover-node Cancelling job id=0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d {"provingJobId":"0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d"} 13:06:30 [13:06:30.509] INFO: prover-client:proving-broker:prover-node Marking proving job as failed id=0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d type=ROOT_PARITY totalAttempts=1 err=Aborted {"provingJobId":"0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d"} 13:06:30 [13:06:30.510] ERROR: prover-client:orchestrator Error thrown when proving job: Error: Broker facade stopped 13:06:30 at BrokerCircuitProverFacade.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/proving_broker/broker_prover_facade.js:142:31) 13:06:30 at ServerEpochProver.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/prover-client/server-epoch-prover.js:31:9) 13:06:30 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:183:13) 13:06:30 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) 13:06:30 [13:06:30.511] ERROR: prover-client:orchestrator Error thrown when proving job: Error: Broker facade stopped 13:06:30 at BrokerCircuitProverFacade.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/proving_broker/broker_prover_facade.js:142:31) 13:06:30 at ServerEpochProver.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/prover-client/server-epoch-prover.js:31:9) 13:06:30 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:183:13) 13:06:30 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) 13:06:30 [13:06:30.511] ERROR: prover-node:prover-node Job for 0 exited with state failed: { 13:06:30 id: 'af454cdc-9480-4c07-940b-04ae943dfb25', 13:06:30 epochNumber: 0n, 13:06:30 state: 'failed' 13:06:30 } 13:06:30 [13:06:30.512] WARN: prover-node:prover-node Uploading epoch proof failure for 0 to file:///tmp/failed-proofs-XdMbqR {"epochNumber":0,"jobId":"af454cdc-9480-4c07-940b-04ae943dfb25","location":"file:///tmp/failed-proofs-XdMbqR"} 13:06:30 [13:06:30.518] INFO: stdlib:file-store Creating local file file store at /tmp/failed-proofs-XdMbqR 13:06:30 [13:06:30.529] INFO: prover-node:prover-node Pausing archiver and world state sync to start snapshot upload 13:06:30 [13:06:30.532] INFO: archiver:prover-node Stopped. 13:06:30 [13:06:30.532] INFO: world_state:prover-node Stopped sync 13:06:30 [13:06:30.533] INFO: prover-node:prover-node Creating backups of lmdb environments to /tmp/4dfe570e8ed8c11d/f7387d1dbb31aa50/epoch-proof-data-9wxbMa 13:06:30 [13:06:30.573] INFO: prover-node:prover-node Data stores backed up to /tmp/4dfe570e8ed8c11d/f7387d1dbb31aa50/epoch-proof-data-9wxbMa {"paths":{"l1-to-l2-message-tree":"/tmp/4dfe570e8ed8c11d/f7387d1dbb31aa50/epoch-proof-data-9wxbMa/world-state/L1ToL2MessageTree/data.mdb","archive-tree":"/tmp/4dfe570e8ed8c11d/f7387d1dbb31aa50/epoch-proof-data-9wxbMa/world-state/ArchiveTree/data.mdb","public-data-tree":"/tmp/4dfe570e8ed8c11d/f7387d1dbb31aa50/epoch-proof-data-9wxbMa/world-state/PublicDataTree/data.mdb","note-hash-tree":"/tmp/4dfe570e8ed8c11d/f7387d1dbb31aa50/epoch-proof-data-9wxbMa/world-state/NoteHashTree/data.mdb","nullifier-tree":"/tmp/4dfe570e8ed8c11d/f7387d1dbb31aa50/epoch-proof-data-9wxbMa/world-state/NullifierTree/data.mdb","archiver":"/tmp/4dfe570e8ed8c11d/f7387d1dbb31aa50/epoch-proof-data-9wxbMa/archiver/data.mdb"}} 13:06:30 [13:06:30.573] INFO: prover-node:prover-node Resuming archiver and world state sync 13:06:30 [13:06:30.574] VERBOSE: world-state:block_stream:prover-node Starting L2 block stream {"proven":false,"pollIntervalMS":50} 13:06:30 [13:06:30.574] INFO: world_state:prover-node Resumed sync 13:06:30 [13:06:30.574] INFO: archiver:prover-node Restarting archiver 13:06:30 [13:06:30.591] WARN: prover-client:proving-broker:prover-node Proving job id=0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d has already been completed {"provingJobId":"0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d"} 13:06:30 [13:06:30.633] WARN: prover-node:prover-node Uploaded epoch 0 proof failure data to file:///tmp/failed-proofs-XdMbqR/aztec-31337-3403976925-0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2/0-20250620130630-af454cdc-9480-4c07-940b-04ae943dfb25 {"epochNumber":0,"location":"file:///tmp/failed-proofs-XdMbqR","basePath":"aztec-31337-3403976925-0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2/0-20250620130630-af454cdc-9480-4c07-940b-04ae943dfb25","metadataUrl":"file:///tmp/failed-proofs-XdMbqR/aztec-31337-3403976925-0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2/0-20250620130630-af454cdc-9480-4c07-940b-04ae943dfb25/metadata.json","dataUrl":"file:///tmp/failed-proofs-XdMbqR/aztec-31337-3403976925-0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2/0-20250620130630-af454cdc-9480-4c07-940b-04ae943dfb25/data.bin","metadata":{"l1BlockNumber":28,"l2BlockHash":"0x0a40ddd2e4b06b219ba44573aca1659dc477c75d44ce6c6eb965f33f8c5d51bf","l2BlockNumber":2,"schemaVersions":{"archiver":3,"worldState":2},"timestamp":1750424790575,"dataUrls":{"l1-to-l2-message-tree":"file:///tmp/failed-proofs-XdMbqR/aztec-31337-3403976925-0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2/0-20250620130630-af454cdc-9480-4c07-940b-04ae943dfb25/l1-to-l2-message-tree.db","archive-tree":"file:///tmp/failed-proofs-XdMbqR/aztec-31337-3403976925-0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2/0-20250620130630-af454cdc-9480-4c07-940b-04ae943dfb25/archive-tree.db","public-data-tree":"file:///tmp/failed-proofs-XdMbqR/aztec-31337-3403976925-0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2/0-20250620130630-af454cdc-9480-4c07-940b-04ae943dfb25/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-XdMbqR/aztec-31337-3403976925-0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2/0-20250620130630-af454cdc-9480-4c07-940b-04ae943dfb25/note-hash-tree.db","nullifier-tree":"file:///tmp/failed-proofs-XdMbqR/aztec-31337-3403976925-0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2/0-20250620130630-af454cdc-9480-4c07-940b-04ae943dfb25/nullifier-tree.db","archiver":"file:///tmp/failed-proofs-XdMbqR/aztec-31337-3403976925-0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2/0-20250620130630-af454cdc-9480-4c07-940b-04ae943dfb25/archiver.db"}},"jobId":"af454cdc-9480-4c07-940b-04ae943dfb25"} 13:06:30 [13:06:30.633] INFO: prover-node:prover-node Cleaning up backup dir /tmp/4dfe570e8ed8c11d/f7387d1dbb31aa50/epoch-proof-data-9wxbMa 13:06:30 [13:06:30.698] WARN: prover-client:proving-broker:prover-node Proving job id=0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d has already been completed {"provingJobId":"0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d"} 13:06:30 [13:06:30.702] INFO: prover-client:proving-agent:prover-node Job id=0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d type=ROOT_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22resu... 13:06:30 [13:06:30.702] WARN: prover-client:proving-broker:prover-node Proving job id=0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d type=ROOT_PARITY not in the in-progress set {"provingJobId":"0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d"} 13:06:30 [13:06:30.702] WARN: prover-client:proving-broker:prover-node Proving job id=0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d already settled, ignoring result {"provingJobId":"0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d"} 13:06:37 [13:06:37.069] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 29 mined at 13:09:40 {"l1Timestamp":1750424980,"l1BlockNumber":29,"l2SlotNumber":3,"l2BlockNumber":2,"l2ProvenBlockNumber":0,"totalL2Messages":0} 13:06:37 [13:06:37.070] INFO: prover-node:prover-node Stopping ProverNode 13:06:37 [13:06:37.070] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 13:06:37 [13:06:37.075] INFO: archiver:prover-node Stopped. 13:06:37 [13:06:37.078] INFO: world_state:prover-node Stopped world state synchronizer 13:06:37 [13:06:37.078] INFO: prover-node:prover-node Stopped ProverNode 13:06:37 [13:06:37.078] INFO: node:MAIN-aztec-node Stopping Aztec Node 13:06:37 [13:06:37.272] VERBOSE: sequencer Preparing proposal for block 3 at slot 4 {"globalVariables":{"blockNumber":3,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":4,"timestamp":1750424988,"version":3403976925},"chainTipArchive":"0x2e91a25a2d3727fac1956bff917cba1abbb2a99a75d0414579bfa60117d38e2a","blockNumber":3,"slot":4} 13:06:37 [13:06:37.299] VERBOSE: block-builder Building block 3 for slot 4 {"slot":4,"slotStart":"2025-06-20T13:09:48.000Z","now":"2025-06-20T13:09:40.298Z","blockNumber":3,"msgCount":0,"initialStateReference":{"l1ToL2MessageTree":"0x2e33ee2008411c04b99c24b313513d097a0d21a5040b6193d1f978b8226892d6","noteHashTree":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTree":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTree":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9"},"initialArchiveRoot":"0x2e91a25a2d3727fac1956bff917cba1abbb2a99a75d0414579bfa60117d38e2a","opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}} 13:06:37 [13:06:37.303] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000962785999996413s {"duration":0.000962785999996413,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 13:06:37 [13:06:37.330] INFO: sequencer Built block 3 for slot 4 with 0 txs and 0 messages. 0 mana/s {"blockHash":"0x068fcb665052996028b4f00312a85806a7c471df80884dd531aed83858ae4331","globalVariables":{"blockNumber":3,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":4,"timestamp":1750424988,"version":3403976925},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":44.90241999999853,"publicProcessDuration":1.7039460000014515,"rollupCircuitsDuration":37.948232999995525,"txCount":0,"blockNumber":3,"blockTimestamp":1750424988,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 13:06:37 [13:06:37.334] VERBOSE: sequencer Attesting committee is empty 13:06:37 [13:06:37.461] VERBOSE: ethereum:tx_delayer Sent tx immediately 0x69f5fb2628bb682f6ec3e63ca13535479bf8a27060ba50cff4704bba9e6dd196 13:06:37 [13:06:37.461] VERBOSE: node:MAIN-aztec-node Sent L1 transaction 0x69f5fb2628bb682f6ec3e63ca13535479bf8a27060ba50cff4704bba9e6dd196 {"gasLimit":464655,"maxFeePerGas":"1.250837566","maxPriorityFeePerGas":"1.2","maxFeePerBlobGas":"0.000000001"} 13:06:39 [13:06:39.080] INFO: slasher Slasher client stopped. 13:06:45 [13:06:45.051] INFO: sequencer:publisher Bundled [propose] transaction [succeeded] 13:06:45 [13:06:45.052] VERBOSE: sequencer:publisher Published L2 block to L1 rollup contract {"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0x69f5fb2628bb682f6ec3e63ca13535479bf8a27060ba50cff4704bba9e6dd196","calldataSize":1220,"calldataGas":8828,"txCount":0,"blockNumber":3,"blockTimestamp":1750424988,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 13:06:45 [13:06:45.054] VERBOSE: node:blob-sink:client Sending 1 blobs to blob sink 13:06:45 [13:06:45.065] INFO: sequencer Stopped sequencer 13:06:45 [13:06:45.066] INFO: p2p P2P client stopped 13:06:45 [13:06:45.071] INFO: blob-sink:server Received blob sidecar for block 0x29ba96ca1766b76daefd665b003a48f0cbcbd8b254b3dea8c839e66c8cfb0f6f 13:06:45 [13:06:45.074] INFO: world_state Stopped world state synchronizer 13:06:45 [13:06:45.084] INFO: blob-sink:server Blob sidecar stored successfully for block 0x29ba96ca1766b76daefd665b003a48f0cbcbd8b254b3dea8c839e66c8cfb0f6f 13:06:45 [13:06:45.173] INFO: archiver Downloaded L2 block 3 {"blockHash":"0x068fcb665052996028b4f00312a85806a7c471df80884dd531aed83858ae4331","blockNumber":3,"txCount":0,"globalVariables":{"blockNumber":3,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":4,"timestamp":1750424988,"version":3403976925},"archiveRoot":"0x231a623051de963026d72d11f5c944326e7b463a591768c6449a6824be53ce18","archiveNextLeafIndex":4} 13:06:45 [13:06:45.179] INFO: archiver Stopped. 13:06:45 [13:06:45.179] INFO: node:MAIN-aztec-node Stopped Aztec Node 13:06:45 [13:06:45.181] INFO: node:MAIN-aztec-node Stopping Aztec Node 13:06:47 [13:06:47.181] INFO: slasher Slasher client stopped. 13:06:47 [13:06:47.182] WARN: validator Running promise was not started 13:06:47 [13:06:47.182] WARN: sequencer Running promise was not started 13:06:47 [13:06:47.182] INFO: sequencer Stopped sequencer 13:06:47 [13:06:47.182] WARN: p2p:l2-block-stream Running promise was not started 13:06:47 [13:06:47.183] INFO: p2p P2P client stopped 13:06:47 [13:06:47.183] WARN: world-state:block_stream Running promise was not started 13:06:47 [13:06:47.183] INFO: world_state Stopped world state synchronizer 13:06:47 [13:06:47.183] WARN: archiver Running promise was not started 13:06:47 [13:06:47.183] INFO: archiver Stopped. 13:06:47 [13:06:47.183] INFO: node:MAIN-aztec-node Stopped Aztec Node 13:06:47 [13:06:47.184] INFO: prover-node:prover-node Stopping ProverNode 13:06:47 [13:06:47.184] WARN: prover-node:prover-node Running promise was not started 13:06:47 [13:06:47.184] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 13:06:47 [13:06:47.184] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 13:06:47 [13:06:47.184] WARN: archiver:prover-node Running promise was not started 13:06:47 [13:06:47.184] INFO: archiver:prover-node Stopped. 13:06:47 [13:06:47.184] WARN: world-state:block_stream:prover-node Running promise was not started 13:06:47 [13:06:47.187] INFO: world_state:prover-node Stopped world state synchronizer 13:06:47 [13:06:47.187] INFO: prover-node:prover-node Stopped ProverNode 13:06:47 [13:06:47.208] INFO: blob-sink:server Stopping blob sink 13:06:47 [13:06:47.209] INFO: blob-sink:server Blob sink stopped 13:06:47 [13:06:47.214] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data and state {"uploadPath":"/tmp/failed-proofs-XdMbqR","rerunDataDir":"/tmp/rerun-data-57u4Iq","rerunDownloadPath":"/tmp/rerun-download-K124iK/data.bin"} 13:06:47 [13:06:47.215] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data from file:///tmp/failed-proofs-XdMbqR/aztec-31337-3403976925-0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2/0-20250620130630-af454cdc-9480-4c07-940b-04ae943dfb25 13:06:47 [13:06:47.215] INFO: stdlib:file-store Creating local file file store at /tmp/failed-proofs-XdMbqR/aztec-31337-3403976925-0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2/0-20250620130630-af454cdc-9480-4c07-940b-04ae943dfb25 13:06:47 [13:06:47.217] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading state snapshot from file:///tmp/failed-proofs-XdMbqR/aztec-31337-3403976925-0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2/0-20250620130630-af454cdc-9480-4c07-940b-04ae943dfb25 to local data directory {"metadata":{"l2BlockNumber":2,"l2BlockHash":"0x0a40ddd2e4b06b219ba44573aca1659dc477c75d44ce6c6eb965f33f8c5d51bf","l1BlockNumber":28,"l1ChainId":31337,"rollupVersion":3403976925,"rollupAddress":"0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2"},"dataUrls":{"archiver":"file:///tmp/failed-proofs-XdMbqR/aztec-31337-3403976925-0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2/0-20250620130630-af454cdc-9480-4c07-940b-04ae943dfb25/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-XdMbqR/aztec-31337-3403976925-0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2/0-20250620130630-af454cdc-9480-4c07-940b-04ae943dfb25/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-XdMbqR/aztec-31337-3403976925-0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2/0-20250620130630-af454cdc-9480-4c07-940b-04ae943dfb25/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-XdMbqR/aztec-31337-3403976925-0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2/0-20250620130630-af454cdc-9480-4c07-940b-04ae943dfb25/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-XdMbqR/aztec-31337-3403976925-0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2/0-20250620130630-af454cdc-9480-4c07-940b-04ae943dfb25/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-XdMbqR/aztec-31337-3403976925-0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2/0-20250620130630-af454cdc-9480-4c07-940b-04ae943dfb25/l1-to-l2-message-tree.db"}} 13:06:47 [13:06:47.218] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Creating local file file store at /tmp/failed-proofs-XdMbqR/aztec-31337-3403976925-0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2/0-20250620130630-af454cdc-9480-4c07-940b-04ae943dfb25 13:06:47 [13:06:47.219] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading snapshot to /tmp/rerun-data-57u4Iq/download-b5zFDY {"snapshot":{"dataUrls":{"archiver":"file:///tmp/failed-proofs-XdMbqR/aztec-31337-3403976925-0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2/0-20250620130630-af454cdc-9480-4c07-940b-04ae943dfb25/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-XdMbqR/aztec-31337-3403976925-0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2/0-20250620130630-af454cdc-9480-4c07-940b-04ae943dfb25/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-XdMbqR/aztec-31337-3403976925-0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2/0-20250620130630-af454cdc-9480-4c07-940b-04ae943dfb25/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-XdMbqR/aztec-31337-3403976925-0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2/0-20250620130630-af454cdc-9480-4c07-940b-04ae943dfb25/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-XdMbqR/aztec-31337-3403976925-0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2/0-20250620130630-af454cdc-9480-4c07-940b-04ae943dfb25/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-XdMbqR/aztec-31337-3403976925-0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2/0-20250620130630-af454cdc-9480-4c07-940b-04ae943dfb25/l1-to-l2-message-tree.db"}},"downloadPaths":{"archiver":"/tmp/rerun-data-57u4Iq/download-b5zFDY/archiver.db","nullifier-tree":"/tmp/rerun-data-57u4Iq/download-b5zFDY/nullifier-tree.db","public-data-tree":"/tmp/rerun-data-57u4Iq/download-b5zFDY/public-data-tree.db","note-hash-tree":"/tmp/rerun-data-57u4Iq/download-b5zFDY/note-hash-tree.db","archive-tree":"/tmp/rerun-data-57u4Iq/download-b5zFDY/archive-tree.db","l1-to-l2-message-tree":"/tmp/rerun-data-57u4Iq/download-b5zFDY/l1-to-l2-message-tree.db"}} 13:06:47 [13:06:47.221] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Snapshot downloaded at /tmp/rerun-data-57u4Iq/download-b5zFDY {"snapshot":{"dataUrls":{"archiver":"file:///tmp/failed-proofs-XdMbqR/aztec-31337-3403976925-0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2/0-20250620130630-af454cdc-9480-4c07-940b-04ae943dfb25/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-XdMbqR/aztec-31337-3403976925-0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2/0-20250620130630-af454cdc-9480-4c07-940b-04ae943dfb25/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-XdMbqR/aztec-31337-3403976925-0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2/0-20250620130630-af454cdc-9480-4c07-940b-04ae943dfb25/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-XdMbqR/aztec-31337-3403976925-0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2/0-20250620130630-af454cdc-9480-4c07-940b-04ae943dfb25/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-XdMbqR/aztec-31337-3403976925-0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2/0-20250620130630-af454cdc-9480-4c07-940b-04ae943dfb25/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-XdMbqR/aztec-31337-3403976925-0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2/0-20250620130630-af454cdc-9480-4c07-940b-04ae943dfb25/l1-to-l2-message-tree.db"}},"downloadPaths":{"archiver":"/tmp/rerun-data-57u4Iq/download-b5zFDY/archiver.db","nullifier-tree":"/tmp/rerun-data-57u4Iq/download-b5zFDY/nullifier-tree.db","public-data-tree":"/tmp/rerun-data-57u4Iq/download-b5zFDY/public-data-tree.db","note-hash-tree":"/tmp/rerun-data-57u4Iq/download-b5zFDY/note-hash-tree.db","archive-tree":"/tmp/rerun-data-57u4Iq/download-b5zFDY/archive-tree.db","l1-to-l2-message-tree":"/tmp/rerun-data-57u4Iq/download-b5zFDY/l1-to-l2-message-tree.db"}} 13:06:47 [13:06:47.223] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Archiver database set up from snapshot {"path":"/tmp/rerun-data-57u4Iq/archiver","dbVersion":3,"rollupAddress":"0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2"} 13:06:47 [13:06:47.224] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database l1-to-l2-message-tree set up from snapshot {"path":"/tmp/rerun-data-57u4Iq/world_state/L1ToL2MessageTree","dbVersion":2,"rollupAddress":"0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2"} 13:06:47 [13:06:47.225] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database archive-tree set up from snapshot {"path":"/tmp/rerun-data-57u4Iq/world_state/ArchiveTree","dbVersion":2,"rollupAddress":"0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2"} 13:06:47 [13:06:47.225] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database public-data-tree set up from snapshot {"path":"/tmp/rerun-data-57u4Iq/world_state/PublicDataTree","dbVersion":2,"rollupAddress":"0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2"} 13:06:47 [13:06:47.225] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database note-hash-tree set up from snapshot {"path":"/tmp/rerun-data-57u4Iq/world_state/NoteHashTree","dbVersion":2,"rollupAddress":"0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2"} 13:06:47 [13:06:47.226] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database nullifier-tree set up from snapshot {"path":"/tmp/rerun-data-57u4Iq/world_state/NullifierTree","dbVersion":2,"rollupAddress":"0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2"} 13:06:47 [13:06:47.226] INFO: e2e:e2e_epochs:epochs_upload_failed_proof P2P database cleared {"path":"/tmp/rerun-data-57u4Iq/p2p"} 13:06:47 [13:06:47.227] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data from file:///tmp/failed-proofs-XdMbqR/aztec-31337-3403976925-0xcb77a82307ec5f97c12f4f77fa255c654cd64ec2/0-20250620130630-af454cdc-9480-4c07-940b-04ae943dfb25/data.bin to /tmp/rerun-download-K124iK/data.bin 13:06:47 [13:06:47.229] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Epoch proving job data for epoch 0 downloaded successfully 13:06:47 [13:06:47.229] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Rerunning proving job from /tmp/rerun-download-K124iK/data.bin 13:06:47 [13:06:47.230] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Using native ACVM binary at ../../noir/noir-repo/target/release/acvm with working directory /tmp/e0253358/acvm 13:06:47 [13:06:47.231] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Loaded proving job data for epoch 0 13:06:47 [13:06:47.237] INFO: world-state:database Creating world state data store at directory /tmp/rerun-data-57u4Iq/world_state with map sizes {"archiveTreeMapSizeKb":1048576,"nullifierTreeMapSizeKb":1048576,"noteHashTreeMapSizeKb":1048576,"messageTreeMapSizeKb":1048576,"publicDataTreeMapSizeKb":1048576} and 2 threads. 13:06:47 [13:06:47.251] INFO: archiver:lmdb Creating archiver data store at directory /tmp/rerun-data-57u4Iq/archiver with map size 1048576 KB (LMDB v2) 13:06:47 [13:06:47.253] INFO: archiver:lmdb Starting data store with maxReaders 16 13:06:47 [13:06:47.256] WARN: prover-client:proving-broker-database Found invalid epoch directory /tmp/rerun-data-57u4Iq/archiver when loading epoch databases, ignoring 13:06:47 [13:06:47.257] WARN: prover-client:proving-broker-database Found invalid epoch directory /tmp/rerun-data-57u4Iq/world_state when loading epoch databases, ignoring 13:06:47 [13:06:47.257] INFO: prover-client:proving-broker Proving Broker started 13:06:47 [13:06:47.258] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Rerunning epoch proving job for epoch 0 13:06:47 [13:06:47.258] INFO: prover-node:epoch-proving-job Starting epoch 0 proving job with blocks 1 to 2 {"fromBlock":1,"toBlock":2,"epochSizeBlocks":2,"epochNumber":0,"uuid":"f8c7942a-0fe8-4134-963b-4618cf423768"} 13:06:47 [13:06:47.278] INFO: prover-client:orchestrator Starting epoch 0 with 2 blocks 13:06:47 [13:06:47.278] VERBOSE: prover-client:broker-circuit-prover-facade Starting BrokerCircuitProverFacade 13:06:47 [13:06:47.280] VERBOSE: prover-node:epoch-proving-job Starting processing block 1 {"number":1,"blockHash":"0x0f04841f4ac4b5fe3674d373abba766a38a7400ed979d5b3dacbae666823917c","lastArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"f8c7942a-0fe8-4134-963b-4618cf423768","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x00000000000000000000000000000000000000000000000000000000cae490dd","blockNumber":1,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 13:06:47 [13:06:47.281] INFO: prover-client:orchestrator Starting block 1 for slot 2 13:06:47 [13:06:47.281] VERBOSE: prover-node:epoch-proving-job Starting processing block 2 {"number":2,"blockHash":"0x0a40ddd2e4b06b219ba44573aca1659dc477c75d44ce6c6eb965f33f8c5d51bf","lastArchive":"0x2342a7167f60527d4611855b3e2d4ed762d56f94effed9fd5d541a828db5f724","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"f8c7942a-0fe8-4134-963b-4618cf423768","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x00000000000000000000000000000000000000000000000000000000cae490dd","blockNumber":2,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000003","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 13:06:47 [13:06:47.282] INFO: prover-client:orchestrator Starting block 2 for slot 3 13:06:47 [13:06:47.308] INFO: prover-client:proving-broker New proving job id=0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06 epochNumber=0 {"provingJobId":"0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06"} 13:06:47 [13:06:47.309] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06","provingJobType":"BASE_PARITY"} 13:06:47 [13:06:47.309] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06","provingJobType":"BASE_PARITY"} 13:06:47 [13:06:47.309] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06","provingJobType":"BASE_PARITY"} 13:06:47 [13:06:47.311] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06","provingJobType":"BASE_PARITY"} 13:06:47 [13:06:47.311] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06","provingJobType":"BASE_PARITY"} 13:06:47 [13:06:47.311] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06","provingJobType":"BASE_PARITY"} 13:06:47 [13:06:47.311] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06","provingJobType":"BASE_PARITY"} 13:06:47 [13:06:47.313] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000018330999999307094s {"duration":0.000018330999999307094,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 13:06:47 [13:06:47.313] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 13:06:47 [13:06:47.314] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 1 {"blockNumber":1,"blockHash":"0x0f04841f4ac4b5fe3674d373abba766a38a7400ed979d5b3dacbae666823917c","uuid":"f8c7942a-0fe8-4134-963b-4618cf423768"} 13:06:47 [13:06:47.314] VERBOSE: prover-client:orchestrator Block 1 completed. Assembling header. 13:06:47 [13:06:47.325] VERBOSE: prover-client:orchestrator Updating archive tree with block 1 header 0x0f04841f4ac4b5fe3674d373abba766a38a7400ed979d5b3dacbae666823917c 13:06:47 [13:06:47.326] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000012060000000928995s {"duration":0.000012060000000928995,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 13:06:47 [13:06:47.326] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 13:06:47 [13:06:47.327] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 2 {"blockNumber":2,"blockHash":"0x0a40ddd2e4b06b219ba44573aca1659dc477c75d44ce6c6eb965f33f8c5d51bf","uuid":"f8c7942a-0fe8-4134-963b-4618cf423768"} 13:06:47 [13:06:47.327] VERBOSE: prover-client:orchestrator Block 2 completed. Assembling header. 13:06:47 [13:06:47.333] VERBOSE: prover-client:orchestrator Orchestrator finalised block 1 13:06:47 [13:06:47.365] VERBOSE: prover-client:orchestrator Updating archive tree with block 2 header 0x0a40ddd2e4b06b219ba44573aca1659dc477c75d44ce6c6eb965f33f8c5d51bf 13:06:47 [13:06:47.368] INFO: prover-client:proving-broker-database Creating broker database for epoch 0 at /tmp/rerun-data-57u4Iq/0 with map size 1048576 13:06:47 [13:06:47.373] VERBOSE: prover-client:orchestrator Orchestrator finalised block 2 13:06:47 [13:06:47.397] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 13:06:47 [13:06:47.403] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06 type=BASE_PARITY epochNumber=0 {"provingJobId":"0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06","provingJobType":"BASE_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...","status":"not-found","numOutstandingJobs":1} 13:06:47 [13:06:47.468] INFO: prover-client:proving-agent Starting job id=0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06 type=BASE_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input... 13:06:47 [13:06:47.470] INFO: prover-client:proving-agent:job-controller-80bf3337 Job controller started jobId=0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06 {"jobId":"0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06"} 13:06:47 [13:06:47.581] INFO: prover-client:proving-agent Job id=0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06 type=BASE_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22resul... 13:06:47 [13:06:47.583] INFO: prover-client:proving-broker Proving job complete id=0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06 type=BASE_PARITY totalAttempts=1 {"provingJobId":"0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06"} 13:06:48 [13:06:48.279] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 13:06:48 [13:06:48.282] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:BASE_PARITY:1f34fbd707da4bb86c8718ebfb082db0b940e39a407fad1e1daac365c9cbde06 type=BASE_PARITY 13:06:48 [13:06:48.282] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 13:06:48 [13:06:48.295] INFO: prover-client:proving-broker New proving job id=0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d epochNumber=0 {"provingJobId":"0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d"} 13:06:48 [13:06:48.304] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d type=ROOT_PARITY {"provingJobId":"0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d","provingJobType":"ROOT_PARITY"} 13:06:48 [13:06:48.350] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d type=ROOT_PARITY epochNumber=0 {"provingJobId":"0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d","provingJobType":"ROOT_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu...","status":"not-found","numOutstandingJobs":1} 13:06:48 [13:06:48.407] INFO: prover-client:proving-agent Starting job id=0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d type=ROOT_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu... 13:06:48 [13:06:48.425] INFO: prover-client:proving-agent:job-controller-4f52320f Job controller started jobId=0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d {"jobId":"0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d"} 13:06:48 [13:06:48.621] INFO: prover-client:proving-agent Job id=0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d type=ROOT_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22resu... 13:06:48 [13:06:48.622] INFO: prover-client:proving-broker Proving job complete id=0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d type=ROOT_PARITY totalAttempts=1 {"provingJobId":"0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d"} 13:06:49 [13:06:49.283] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 13:06:49 [13:06:49.286] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:ROOT_PARITY:6e5490dfb2e80b2003d45c3d86e08d425786a2f20dafcb8113bd6b32b0dba21d type=ROOT_PARITY 13:06:49 [13:06:49.286] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 13:06:49 [13:06:49.305] INFO: prover-client:proving-broker New proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:1805b2bc4292e792a309478f2448b6fa850a867b5f81403f7de9ec3e1e22100d epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:1805b2bc4292e792a309478f2448b6fa850a867b5f81403f7de9ec3e1e22100d"} 13:06:49 [13:06:49.310] INFO: prover-client:proving-broker New proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:d759b3780466ab41d7da297691a294fe97a5f1b59f5128093d24814ba7aed41f epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:d759b3780466ab41d7da297691a294fe97a5f1b59f5128093d24814ba7aed41f"} 13:06:49 [13:06:49.360] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:EMPTY_BLOCK_ROOT_ROLLUP:1805b2bc4292e792a309478f2448b6fa850a867b5f81403f7de9ec3e1e22100d type=EMPTY_BLOCK_ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:1805b2bc4292e792a309478f2448b6fa850a867b5f81403f7de9ec3e1e22100d","provingJobType":"EMPTY_BLOCK_ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input...","status":"not-found","numOutstandingJobs":2} 13:06:49 [13:06:49.360] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:EMPTY_BLOCK_ROOT_ROLLUP:d759b3780466ab41d7da297691a294fe97a5f1b59f5128093d24814ba7aed41f type=EMPTY_BLOCK_ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:d759b3780466ab41d7da297691a294fe97a5f1b59f5128093d24814ba7aed41f","provingJobType":"EMPTY_BLOCK_ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input...","status":"not-found","numOutstandingJobs":2} 13:06:49 [13:06:49.377] INFO: prover-client:proving-agent Starting job id=0:EMPTY_BLOCK_ROOT_ROLLUP:1805b2bc4292e792a309478f2448b6fa850a867b5f81403f7de9ec3e1e22100d type=EMPTY_BLOCK_ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input... 13:06:49 [13:06:49.393] INFO: prover-client:proving-agent:job-controller-cda64655 Job controller started jobId=0:EMPTY_BLOCK_ROOT_ROLLUP:1805b2bc4292e792a309478f2448b6fa850a867b5f81403f7de9ec3e1e22100d {"jobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:1805b2bc4292e792a309478f2448b6fa850a867b5f81403f7de9ec3e1e22100d"} 13:06:49 [13:06:49.450] INFO: prover-client:proving-agent Starting job id=0:EMPTY_BLOCK_ROOT_ROLLUP:d759b3780466ab41d7da297691a294fe97a5f1b59f5128093d24814ba7aed41f type=EMPTY_BLOCK_ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input... 13:06:49 [13:06:49.459] INFO: prover-client:proving-agent:job-controller-aa4f0a1c Job controller started jobId=0:EMPTY_BLOCK_ROOT_ROLLUP:d759b3780466ab41d7da297691a294fe97a5f1b59f5128093d24814ba7aed41f {"jobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:d759b3780466ab41d7da297691a294fe97a5f1b59f5128093d24814ba7aed41f"} 13:06:51 [13:06:51.195] INFO: prover-client:proving-agent Job id=0:EMPTY_BLOCK_ROOT_ROLLUP:1805b2bc4292e792a309478f2448b6fa850a867b5f81403f7de9ec3e1e22100d type=EMPTY_BLOCK_ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22resul... 13:06:51 [13:06:51.196] INFO: prover-client:proving-broker Proving job complete id=0:EMPTY_BLOCK_ROOT_ROLLUP:1805b2bc4292e792a309478f2448b6fa850a867b5f81403f7de9ec3e1e22100d type=EMPTY_BLOCK_ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:1805b2bc4292e792a309478f2448b6fa850a867b5f81403f7de9ec3e1e22100d"} 13:06:51 [13:06:51.289] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 2, total jobs ready: 1 13:06:51 [13:06:51.292] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:1805b2bc4292e792a309478f2448b6fa850a867b5f81403f7de9ec3e1e22100d type=EMPTY_BLOCK_ROOT_ROLLUP 13:06:51 [13:06:51.292] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 13:06:53 [13:06:53.203] INFO: prover-client:proving-agent Job id=0:EMPTY_BLOCK_ROOT_ROLLUP:d759b3780466ab41d7da297691a294fe97a5f1b59f5128093d24814ba7aed41f type=EMPTY_BLOCK_ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22resul... 13:06:53 [13:06:53.203] INFO: prover-client:proving-broker Proving job complete id=0:EMPTY_BLOCK_ROOT_ROLLUP:d759b3780466ab41d7da297691a294fe97a5f1b59f5128093d24814ba7aed41f type=EMPTY_BLOCK_ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:d759b3780466ab41d7da297691a294fe97a5f1b59f5128093d24814ba7aed41f"} 13:06:53 [13:06:53.295] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 13:06:53 [13:06:53.298] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:d759b3780466ab41d7da297691a294fe97a5f1b59f5128093d24814ba7aed41f type=EMPTY_BLOCK_ROOT_ROLLUP 13:06:53 [13:06:53.298] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 13:06:53 [13:06:53.309] INFO: prover-client:proving-broker New proving job id=0:ROOT_ROLLUP:506959f7aa9c6c1c99afc16d93c6b7657a6387af7bb9c2c91e2065104612c3ac epochNumber=0 {"provingJobId":"0:ROOT_ROLLUP:506959f7aa9c6c1c99afc16d93c6b7657a6387af7bb9c2c91e2065104612c3ac"} 13:06:53 [13:06:53.361] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_ROLLUP:506959f7aa9c6c1c99afc16d93c6b7657a6387af7bb9c2c91e2065104612c3ac type=ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:ROOT_ROLLUP:506959f7aa9c6c1c99afc16d93c6b7657a6387af7bb9c2c91e2065104612c3ac","provingJobType":"ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22input...","status":"not-found","numOutstandingJobs":1} 13:06:53 [13:06:53.413] INFO: prover-client:proving-agent Starting job id=0:ROOT_ROLLUP:506959f7aa9c6c1c99afc16d93c6b7657a6387af7bb9c2c91e2065104612c3ac type=ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22input... 13:06:53 [13:06:53.425] INFO: prover-client:proving-agent:job-controller-577e39ea Job controller started jobId=0:ROOT_ROLLUP:506959f7aa9c6c1c99afc16d93c6b7657a6387af7bb9c2c91e2065104612c3ac {"jobId":"0:ROOT_ROLLUP:506959f7aa9c6c1c99afc16d93c6b7657a6387af7bb9c2c91e2065104612c3ac"} 13:06:53 [13:06:53.592] INFO: prover-client:proving-agent Job id=0:ROOT_ROLLUP:506959f7aa9c6c1c99afc16d93c6b7657a6387af7bb9c2c91e2065104612c3ac type=ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22resul... 13:06:53 [13:06:53.592] INFO: prover-client:proving-broker Proving job complete id=0:ROOT_ROLLUP:506959f7aa9c6c1c99afc16d93c6b7657a6387af7bb9c2c91e2065104612c3ac type=ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:ROOT_ROLLUP:506959f7aa9c6c1c99afc16d93c6b7657a6387af7bb9c2c91e2065104612c3ac"} 13:06:54 [13:06:54.299] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 13:06:54 [13:06:54.301] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:ROOT_ROLLUP:506959f7aa9c6c1c99afc16d93c6b7657a6387af7bb9c2c91e2065104612c3ac type=ROOT_ROLLUP 13:06:54 [13:06:54.301] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 13:06:54 [13:06:54.302] VERBOSE: prover-client:orchestrator Orchestrator completed root rollup for epoch 0 13:06:54 [13:06:54.305] INFO: prover-node:epoch-proving-job Finalised proof for epoch 0 {"epochNumber":0,"uuid":"f8c7942a-0fe8-4134-963b-4618cf423768","duration":7047.068453} 13:06:54 [13:06:54.306] INFO: prover-node:epoch-proving-job Submitted proof for epoch 0 (blocks 1 to 2) {"epochNumber":0,"uuid":"f8c7942a-0fe8-4134-963b-4618cf423768"} 13:06:54 [13:06:54.306] VERBOSE: prover-client:broker-circuit-prover-facade Stopping BrokerCircuitProverFacade 13:06:54 [13:06:54.306] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Completed job for epoch 0 with status completed 13:06:54 [13:06:54.306] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Test succeeded 13:06:54 [13:06:54.307] INFO: prover-node:prover-node Stopping ProverNode 13:06:54 [13:06:54.307] WARN: prover-node:prover-node Running promise was not started 13:06:54 [13:06:54.307] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 13:06:54 [13:06:54.307] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 13:06:54 [13:06:54.308] WARN: archiver:prover-node Running promise was not started 13:06:54 [13:06:54.308] INFO: archiver:prover-node Stopped. 13:06:54 [13:06:54.308] WARN: world-state:block_stream:prover-node Running promise was not started 13:06:54 [13:06:54.308] INFO: world_state:prover-node Stopped world state synchronizer 13:06:54 [13:06:54.308] INFO: prover-node:prover-node Stopped ProverNode 13:06:54 [13:06:54.308] INFO: node:MAIN-aztec-node Stopping Aztec Node 13:06:56 [13:06:56.309] INFO: slasher Slasher client stopped. 13:06:56 [13:06:56.310] WARN: validator Running promise was not started 13:06:56 [13:06:56.310] WARN: sequencer Running promise was not started 13:06:56 [13:06:56.310] INFO: sequencer Stopped sequencer 13:06:56 [13:06:56.310] WARN: p2p:l2-block-stream Running promise was not started 13:06:56 [13:06:56.311] INFO: p2p P2P client stopped 13:06:56 [13:06:56.311] WARN: world-state:block_stream Running promise was not started 13:06:56 [13:06:56.311] INFO: world_state Stopped world state synchronizer 13:06:56 [13:06:56.311] WARN: archiver Running promise was not started 13:06:56 [13:06:56.312] INFO: archiver Stopped. 13:06:56 [13:06:56.312] INFO: node:MAIN-aztec-node Stopped Aztec Node 13:06:56 [13:06:56.312] INFO: node:MAIN-aztec-node Stopping Aztec Node 13:06:58 [13:06:58.313] INFO: slasher Slasher client stopped. 13:06:58 [13:06:58.314] WARN: validator Running promise was not started 13:06:58 [13:06:58.314] WARN: sequencer Running promise was not started 13:06:58 [13:06:58.314] INFO: sequencer Stopped sequencer 13:06:58 [13:06:58.314] WARN: p2p:l2-block-stream Running promise was not started 13:06:58 [13:06:58.314] INFO: p2p P2P client stopped 13:06:58 [13:06:58.314] WARN: world-state:block_stream Running promise was not started 13:06:58 [13:06:58.315] INFO: world_state Stopped world state synchronizer 13:06:58 [13:06:58.315] WARN: archiver Running promise was not started 13:06:58 [13:06:58.315] INFO: archiver Stopped. 13:06:58 [13:06:58.315] INFO: node:MAIN-aztec-node Stopped Aztec Node 13:06:58 [13:06:58.315] INFO: prover-node:prover-node Stopping ProverNode 13:06:58 [13:06:58.315] WARN: prover-node:prover-node Running promise was not started 13:06:58 [13:06:58.316] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 13:06:58 [13:06:58.316] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 13:06:58 [13:06:58.316] WARN: archiver:prover-node Running promise was not started 13:06:58 [13:06:58.316] INFO: archiver:prover-node Stopped. 13:06:58 [13:06:58.316] WARN: world-state:block_stream:prover-node Running promise was not started 13:06:58 [13:06:58.317] INFO: world_state:prover-node Stopped world state synchronizer 13:06:58 [13:06:58.317] INFO: prover-node:prover-node Stopped ProverNode 13:06:58 [13:06:58.318] INFO: blob-sink:server Stopping blob sink 13:06:58 [13:06:58.318] INFO: blob-sink:server Blob sink already stopped 13:06:58 PASS src/e2e_epochs/epochs_upload_failed_proof.test.ts 13:06:58 e2e_epochs/epochs_upload_failed_proof 13:06:58 ✓ uploads failed proving job state and re-runs it on a fresh instance (54708 ms) 13:06:58 13:06:58 Test Suites: 1 passed, 1 total 13:06:58 Tests: 1 passed, 1 total 13:06:58 Snapshots: 0 total 13:06:58 Time: 63.638 s 13:06:58 Ran all test suites matching src/e2e_epochs/epochs_upload_failed_proof.test.ts. 13:06:58 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?