Parent Log: http://ci.aztec-labs.com/778f0cf50fd384fb Command: d8033ca60b1dba76:ISOLATE=1:NAME=e2e_epochs/epochs_upload_failed_proof yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_upload_failed_proof.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/9ddf7d35886489afed34aca3cb819b32c86194b4 Env: REF_NAME=gh-readonly-queue/next/pr-15215-99e234fe4473771b32124e0402885610a6a3f98a CURRENT_VERSION=0.87.6 CI_FULL=1 Date: Tue Jun 24 09:18:38 UTC 2025 System: ARCH=amd64 CPUS=128 MEM=493Gi HOSTNAME=pr-15215_amd64_x4-full Resources: CPU_LIST=0-127 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_476a42720cde10eb_next 09:18:38 +++ id -u 09:18:38 +++ id -g 09:18:38 ++ docker run -d --name e2e_epochs_epochs_upload_failed_proof --net=none --cpuset-cpus=0-127 --cpus=2 --memory=8g --user 1000:1000 -v/home/aztec-dev:/home/aztec-dev --mount type=tmpfs,target=/tmp,tmpfs-size=1g --workdir /home/aztec-dev/aztec-packages -e HOME -e VERBOSE -e GIT_CONFIG_GLOBAL=/home/aztec-dev/aztec-packages/build-images/src/home/.gitconfig -e FORCE_COLOR=true -e CPUS -e MEM aztecprotocol/build:3.0 /bin/bash -c 'timeout -v 600s bash -c '\''yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_upload_failed_proof.test.ts'\''' 09:18:38 + cid=3070b65f5e93cf6c1e30817cf3baede998399dd6fbdbdb1bb5f6e2cd6e989bee 09:18:38 + set +x 09:18:39 {"level":25,"time":1750756719941,"pid":12,"hostname":"3070b65f5e93","module":"logger","msg":"Logger initialized with level verbose"} 09:18:47 [09:18:47.612] INFO: e2e:epochs_upload_failed_proof Running test: e2e_epochs/epochs_upload_failed_proof uploads failed proving job state and re-runs it on a fresh instance 09:18:47 [09:18:47.744] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Logging metrics to log/e2e_epochs_epochs_upload_failed_proof.jsonl 09:18:48 [09:18:48.010] WARN: ethereum:cheat_codes Set L1 automine to true 09:18:48 [09:18:48.050] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Sent 0.1 ETH to deployer {"deployer":"0x05f32b3cc3888453ff71b01135b34ff8e41263f2","value":100000000000000000} 09:18:48 [09:18:48.068] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Sent 0.1 ETH to deployer {"deployer":"0x05f32b3cc3888453ff71b01135b34ff8e41263f2","value":100000000000000000} 09:18:48 [09:18:48.079] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Multicall3 09:18:48 [09:18:48.081] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Calling anvil_setBlockTimestampInterval with params: [8] 09:18:48 [09:18:48.083] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Set block interval to 8 09:18:48 [09:18:48.084] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contracts from 0xf39Fd6e51aad88F6F4ce6aB8827279cffFb92266 09:18:48 [09:18:48.087] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 09:18:48 [09:18:48.136] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x8166bb789c828e492198babef9becf8ac44628f059d48e6f68114a9ae2ade6ec {"gasLimit":867658,"maxFeePerGas":"120.351651125","maxPriorityFeePerGas":"118.94979"} 09:18:48 [09:18:48.137] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xB8999345dA8041f1Da51ac5179B1F055A560f397 in tx 0x8166bb789c828e492198babef9becf8ac44628f059d48e6f68114a9ae2ade6ec. 09:18:48 [09:18:48.140] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Fee Asset at 0xb8999345da8041f1da51ac5179b1f055a560f397 09:18:48 [09:18:48.141] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 09:18:48 [09:18:48.167] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x07d928293fb6819e2a8abf9d0b32b04560f633065cf07cefb5dcf9ca71af1db2 {"gasLimit":867644,"maxFeePerGas":"143.976575211","maxPriorityFeePerGas":"142.739748"} 09:18:48 [09:18:48.168] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xBb9e13665Cfb3d531F288a11E7312b6b91C59292 in tx 0x07d928293fb6819e2a8abf9d0b32b04560f633065cf07cefb5dcf9ca71af1db2. 09:18:48 [09:18:48.169] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Staking Asset at 0xbb9e13665cfb3d531f288a11e7312b6b91c59292 09:18:48 [09:18:48.169] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 09:18:48 [09:18:48.209] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xd90adcaa1621a861dd7b09565f9dc422367574ea376355a4c91cd87ed3fbfeba {"gasLimit":3252094,"maxFeePerGas":"172.377275728","maxPriorityFeePerGas":"171.2876976"} 09:18:48 [09:18:48.211] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x6f26a1916Df432654607f9c75b764e535e65cf3e in tx 0xd90adcaa1621a861dd7b09565f9dc422367574ea376355a4c91cd87ed3fbfeba. 09:18:48 [09:18:48.212] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed GSE at 0x6f26a1916df432654607f9c75b764e535e65cf3e 09:18:48 [09:18:48.212] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 09:18:48 [09:18:48.245] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xc6bb96b972383aade82d230cb0c861a0362867228d18483a86f9e4a83b780d2d {"gasLimit":1081864,"maxFeePerGas":"206.505096634","maxPriorityFeePerGas":"205.54523712"} 09:18:48 [09:18:48.248] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x3C709AFec1acEaE522c13145005De788a3CC65c8 in tx 0xc6bb96b972383aade82d230cb0c861a0362867228d18483a86f9e4a83b780d2d. 09:18:48 [09:18:48.249] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Registry at 0x3c709afec1aceae522c13145005de788a3cc65c8 09:18:48 [09:18:48.249] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 09:18:48 [09:18:48.279] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xf8dde39eb44898986f540429eb4a3f0eeec377763a24054290d85bb8101ac8e4 {"gasLimit":2232036,"maxFeePerGas":"247.515532347","maxPriorityFeePerGas":"246.654284544"} 09:18:48 [09:18:48.280] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xEDE9b34af448F9261efea2DafB2364866b09E01A in tx 0xf8dde39eb44898986f540429eb4a3f0eeec377763a24054290d85bb8101ac8e4. 09:18:48 [09:18:48.281] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed GovernanceProposer at 0xede9b34af448f9261efea2dafb2364866b09e01a 09:18:48 [09:18:48.281] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 09:18:48 [09:18:48.317] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xaf7178913b5905e53367fb0465133faf75227c51bf46428c817f48a06700bb71 {"gasLimit":3092007,"maxFeePerGas":"296.745116241","maxPriorityFeePerGas":"295.985141452"} 09:18:48 [09:18:48.317] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xa49A3d51a71916F87d60f0e919Fb66E4b933b4df in tx 0xaf7178913b5905e53367fb0465133faf75227c51bf46428c817f48a06700bb71. 09:18:48 [09:18:48.318] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Governance at 0xa49a3d51a71916f87d60f0e919fb66e4b933b4df 09:18:48 [09:18:48.332] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x12d6424d782ad27b9fe44dec1624cf29720992859e74e4ee26f6a49bf5e682cc {"gasLimit":100000,"maxFeePerGas":"355.858763396","maxPriorityFeePerGas":"355.182169742"} 09:18:48 [09:18:48.334] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Set governance on GSE in 0x12d6424d782ad27b9fe44dec1624cf29720992859e74e4ee26f6a49bf5e682cc 09:18:48 [09:18:48.334] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 09:18:48 [09:18:48.351] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x593e4091a1e08f47177928f9a458263f67a911112187ec79e9a4bc019be7546f {"gasLimit":397405,"maxFeePerGas":"426.824946124","maxPriorityFeePerGas":"426.21860369"} 09:18:48 [09:18:48.352] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x705baA0D3bF675F9B7F169fd5FEA260c436Cd50c in tx 0x593e4091a1e08f47177928f9a458263f67a911112187ec79e9a4bc019be7546f. 09:18:48 [09:18:48.353] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed CoinIssuer at 0x705baa0d3bf675f9b7f169fd5fea260c436cd50c 09:18:48 [09:18:48.353] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for deployments to complete 09:18:48 [09:18:48.353] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 7 transactions to be mined... 09:18:48 [09:18:48.399] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 09:18:48 [09:18:48.413] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x5d6132645b455679b93fe6fc019047a89d80cbc5fb7cbc890344c07a449854fc {"gasLimit":100000,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 09:18:48 [09:18:48.413] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added coin issuer 0x705baa0d3bf675f9b7f169fd5fea260c436cd50c as minter on fee asset in 0x5d6132645b455679b93fe6fc019047a89d80cbc5fb7cbc890344c07a449854fc 09:18:48 [09:18:48.443] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xd01ce626c7c7ee3a243b24780a9fd0dc5184345d6bec4ec1cc5aafc15402dc62 {"gasLimit":56661,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 09:18:48 [09:18:48.444] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 09:18:48 [09:18:48.461] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x100b31bd1e3992df58985c26db7e5351f01cbb7b9c2e961c411c57733fb6cfa5 {"gasLimit":344517,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 09:18:48 [09:18:48.461] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xB4fF23c4B1E2Bc7C86090d4FBDa21A457ee6727F in tx 0x100b31bd1e3992df58985c26db7e5351f01cbb7b9c2e961c411c57733fb6cfa5. 09:18:48 [09:18:48.462] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed FeeAssetHandler at 0xb4ff23c4b1e2bc7c86090d4fbda21a457ee6727f 09:18:48 [09:18:48.476] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xc451aae80a23ef806a4bacf2e291d1c2ae150b6200ea2ea4e841b119a7e7c28b {"gasLimit":56804,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 09:18:48 [09:18:48.476] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added fee asset handler 0xb4ff23c4b1e2bc7c86090d4fbda21a457ee6727f as minter on fee asset in 0xc451aae80a23ef806a4bacf2e291d1c2ae150b6200ea2ea4e841b119a7e7c28b 09:18:48 [09:18:48.477] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 09:18:48 [09:18:48.507] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x1faf8bcc8977c90fecabc48f92ddae8dbb0acd71a8ae2fde378732b4f5280dfb {"gasLimit":2434549,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 09:18:48 [09:18:48.508] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xD8C49C848A06990E1B1Ad8DF26dbc5725b657aCA in tx 0x1faf8bcc8977c90fecabc48f92ddae8dbb0acd71a8ae2fde378732b4f5280dfb. 09:18:48 [09:18:48.508] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed StakingAssetHandler at 0xd8c49c848a06990e1b1ad8df26dbc5725b657aca 09:18:48 [09:18:48.539] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x79eec47a96882b804264d6c66ccded4e9ed9ee94a3f9212268001418f61c01b6 {"gasLimit":56804,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 09:18:48 [09:18:48.539] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added staking asset handler 0xd8c49c848a06990e1b1ad8df26dbc5725b657aca as minter on staking asset in 0x79eec47a96882b804264d6c66ccded4e9ed9ee94a3f9212268001418f61c01b6 09:18:48 [09:18:48.539] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for deployments to complete 09:18:48 [09:18:48.540] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 9 transactions to be mined... 09:18:48 [09:18:48.584] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 09:18:48 [09:18:48.598] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed shared contracts 09:18:48 [09:18:48.630] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x3a452c44942037f215b905f38ac51163490a9b231c6bd08b7e958ae2dd00642b {"gasLimit":84837,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 09:18:48 [09:18:48.630] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Funded reward distributor with 10000000000000000000000000 fee asset in 0x3a452c44942037f215b905f38ac51163490a9b231c6bd08b7e958ae2dd00642b 09:18:48 [09:18:48.635] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 09:18:48 [09:18:48.657] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x6732a13052b668b6ed53c2db691f949dc5751b43ca937a6796aab9388f3cb12a {"gasLimit":154658,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 09:18:48 [09:18:48.658] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x277E22B0C9698d7f2A1cD7C6d857511617587309 in tx 0x6732a13052b668b6ed53c2db691f949dc5751b43ca937a6796aab9388f3cb12a. 09:18:48 [09:18:48.658] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup will use the mock verifier at 0x277e22b0c9698d7f2a1cd7c6d857511617587309 09:18:48 [09:18:48.658] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup config args {"aztecSlotDuration":16,"aztecEpochDuration":4,"targetCommitteeSize":0,"aztecProofSubmissionEpochs":1,"slashingQuorum":6,"slashingRoundSize":10,"manaTarget":10000000000,"entryQueueFlushSizeMin":48,"entryQueueFlushSizeQuotient":2,"provingCostPerMana":100,"rewardConfig":{"sequencerBps":5000,"increment":200000,"maxScore":5000000,"a":5000,"k":1000000,"minimum":100000,"rewardDistributor":"0x4a51916a6b10a43f6565042be5b6b69d8d613f64"}} 09:18:48 [09:18:48.659] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 09:18:48 [09:18:48.675] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x41f1a97b4169402d8ffffe2c1e10e4208f2cbb77f013e5d13b610e6af83d24f5 {"gasLimit":86992,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 09:18:48 [09:18:48.676] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x8036677644039d4E4b3C48DADc5de700c64ACe8f in tx 0x41f1a97b4169402d8ffffe2c1e10e4208f2cbb77f013e5d13b610e6af83d24f5. 09:18:48 [09:18:48.676] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 09:18:48 [09:18:48.723] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xe6ea7e3b8ed4d00f0a2db44996d4a8f19a743b75ae4885d46a4ce4cd6559eaf1 {"gasLimit":5125076,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 09:18:48 [09:18:48.724] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x76836C865645796c7eE9068efbDed634783a00AF in tx 0xe6ea7e3b8ed4d00f0a2db44996d4a8f19a743b75ae4885d46a4ce4cd6559eaf1. 09:18:48 [09:18:48.725] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 09:18:48 [09:18:48.759] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xb61d555a7dec6e9c985806cddb053e8d13705025eb222f14584644dbba2f1668 {"gasLimit":2891348,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 09:18:48 [09:18:48.759] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x48Bc5abFAa35F60Aec77dC10a45DA59e057BEF17 in tx 0xb61d555a7dec6e9c985806cddb053e8d13705025eb222f14584644dbba2f1668. 09:18:48 [09:18:48.760] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Awaiting for linked libraries to be deployed 09:18:48 [09:18:48.769] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 09:18:48 [09:18:48.838] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x035700af559103af975c44b4147db9904709bc3f7c04c86447eda755a880a7cd {"gasLimit":11292829,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 09:18:48 [09:18:48.839] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x238B28FD473A035d549ac8C05c48F62b71D95E09 in tx 0x035700af559103af975c44b4147db9904709bc3f7c04c86447eda755a880a7cd. 09:18:48 [09:18:48.839] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Rollup at 0x238b28fd473a035d549ac8c05c48f62b71d95e09 {"aztecSlotDuration":16,"aztecEpochDuration":4,"targetCommitteeSize":0,"aztecProofSubmissionEpochs":1,"slashingQuorum":6,"slashingRoundSize":10,"manaTarget":10000000000,"entryQueueFlushSizeMin":48,"entryQueueFlushSizeQuotient":2,"provingCostPerMana":100,"rewardConfig":{"sequencerBps":5000,"increment":200000,"maxScore":5000000,"a":5000,"k":1000000,"minimum":100000,"rewardDistributor":"0x4a51916a6b10a43f6565042be5b6b69d8d613f64"}} 09:18:48 [09:18:48.839] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 11 transactions to be mined... 09:18:48 [09:18:48.867] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 09:18:48 [09:18:48.868] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof All core contracts have been deployed 09:18:48 [09:18:48.868] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 09:18:48 [09:18:48.889] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x53fbbe7a89e36c3f324639fd5cf68548de239599bafeb20b5bc9241defe0b456 {"gasLimit":1056482,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 09:18:48 [09:18:48.889] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x7C800D855370b8d9b736D4a334c99dA369F33ADA in tx 0x53fbbe7a89e36c3f324639fd5cf68548de239599bafeb20b5bc9241defe0b456. 09:18:48 [09:18:48.889] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed SlashFactory at 0x7c800d855370b8d9b736d4a334c99da369f33ada 09:18:48 [09:18:48.940] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xde8f4f0e98674d50ffd16702d12313c65c3b25928451f797de9a9e232952a598 {"gasLimit":117006,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 09:18:48 [09:18:48.941] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Adding rollup 0x238b28fd473a035d549ac8c05c48f62b71d95e09 to registry 0x3c709afec1aceae522c13145005de788a3cc65c8 in tx 0xde8f4f0e98674d50ffd16702d12313c65c3b25928451f797de9a9e232952a598 09:18:48 [09:18:48.960] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xb4fc46a1717c0c18999a6e4f799b790a747c99d181a4f30fe65105b2d7abde22 {"gasLimit":109478,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 09:18:48 [09:18:48.960] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Adding rollup 0x238b28fd473a035d549ac8c05c48f62b71d95e09 to GSE 0x6f26a1916df432654607f9c75b764e535e65cf3e in tx 0xb4fc46a1717c0c18999a6e4f799b790a747c99d181a4f30fe65105b2d7abde22 09:18:48 [09:18:48.965] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 12 transactions to be mined... 09:18:49 [09:18:49.003] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 09:18:49 [09:18:49.010] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup deployed 09:18:49 [09:18:49.010] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for rollup and slash factory to be deployed 09:18:49 [09:18:49.011] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 12 transactions to be mined... 09:18:49 [09:18:49.043] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 09:18:49 [09:18:49.044] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof All transactions for L1 deployment have been mined 09:18:49 [09:18:49.066] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Aztec L1 contracts initialized {"registryAddress":"0x3c709afec1aceae522c13145005de788a3cc65c8","governanceAddress":"0xa49a3d51a71916f87d60f0e919fb66e4b933b4df","governanceProposerAddress":"0xede9b34af448f9261efea2dafb2364866b09e01a","rollupAddress":"0x238b28fd473a035d549ac8c05c48f62b71d95e09","inboxAddress":"0x67741349158060347f9b5c3e4d9d81768f81a8c1","outboxAddress":"0x125dbf9956c14815fbf38af1ed7cc91ed11406b5","feeJuicePortalAddress":"0xd96cc6c2369924c2e4b8fdbb56bb6a9107f74afb","feeJuiceAddress":"0xb8999345da8041f1da51ac5179b1f055a560f397","stakingAssetAddress":"0xbb9e13665cfb3d531f288a11e7312b6b91c59292","rewardDistributorAddress":"0x4a51916a6b10a43f6565042be5b6b69d8d613f64","gseAddress":"0x6f26a1916df432654607f9c75b764e535e65cf3e","coinIssuerAddress":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266"} 09:18:49 [09:18:49.067] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Handing over to governance 09:18:49 [09:18:49.072] WARN: ethereum:cheat_codes Set L1 automine to false 09:18:49 [09:18:49.073] WARN: ethereum:cheat_codes Set L1 interval mining to 8 seconds 09:18:49 [09:18:49.076] WARN: foundation:test-date-provider Time set to 2025-06-24T09:21:52.000Z {"offset":182924,"timeMs":1750756912000} 09:18:49 [09:18:49.081] INFO: aztecjs:utils:watcher Watcher not started because not auto mining 09:18:49 [09:18:49.082] INFO: telemetry:client Using NoopTelemetryClient 09:18:49 [09:18:49.085] INFO: kv-store:lmdb-v2:blob-sink Creating blob-sink data store at directory /tmp/a9ea606550889e7d/blob-sink with map size 134217728 KB (LMDB v2) 09:18:49 [09:18:49.091] INFO: kv-store:lmdb-v2:blob-sink Starting data store with maxReaders 16 09:18:49 [09:18:49.103] INFO: blob-sink:server Server is running on http://localhost:38075 09:18:49 [09:18:49.103] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating and synching an aztec node... 09:18:49 [09:18:49.107] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Using native ACVM binary at ../../noir/noir-repo/target/release/acvm with working directory /tmp/3d36632b/acvm 09:18:49 [09:18:49.108] INFO: node:blob-sink:client Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:38075"} 09:18:49 [09:18:49.154] VERBOSE: node:MAIN-aztec-node Snapshot sync is disabled. No snapshots URL provided. 09:18:49 [09:18:49.155] INFO: archiver:lmdb Creating archiver data store at directory /tmp/a9ea606550889e7d/archiver with map size 134217728 KB (LMDB v2) 09:18:49 [09:18:49.156] INFO: archiver:lmdb Starting data store with maxReaders 16 09:18:50 [09:18:50.036] INFO: node:blob-sink:client Testing configured blob sources {"blobSinkUrl":"http://localhost:38075"} 09:18:50 [09:18:50.053] INFO: node:blob-sink:client Blob sink is reachable {"blobSinkUrl":"http://localhost:38075"} 09:18:50 [09:18:50.054] WARN: node:blob-sink:client No L1 consensus host urls configured 09:18:50 [09:18:50.054] WARN: node:blob-sink:client No archive client configured 09:18:50 [09:18:50.057] INFO: archiver Starting archiver sync to rollup contract 0x238b28fd473a035d549ac8c05c48f62b71d95e09 from L1 block 22 to current L1 block 25 with hash 0x52606e2a8a156a216c738464381c309c854eb7fb109ab73b1a49418956e1b5d4 {"blocksSynchedTo":22,"messagesSynchedTo":{"l1BlockHash":"0xdd4e757710cb2322e08abacc23370580e1c580e6283eeb03048a4872082527b1","l1BlockNumber":22}} 09:18:50 [09:18:50.075] INFO: archiver Initial archiver sync to L1 block 25 complete. {"l1BlockNumber":25,"syncPoint":{"blocksSynchedTo":25},"latest":{"number":0},"proven":{"number":0},"finalized":{"number":0}} 09:18:50 [09:18:50.087] INFO: world-state:database Creating world state data store at directory /tmp/a9ea606550889e7d/world_state with map sizes {"archiveTreeMapSizeKb":134217728,"nullifierTreeMapSizeKb":134217728,"noteHashTreeMapSizeKb":134217728,"messageTreeMapSizeKb":134217728,"publicDataTreeMapSizeKb":134217728} and 2 threads. 09:18:50 [09:18:50.127] INFO: world_state Created world state synchroniser with block history of 2 09:18:50 [09:18:50.127] WARN: node:MAIN-aztec-node Aztec node is accepting fake proofs 09:18:50 [09:18:50.127] INFO: bb-prover:queued_ivc_verifier Starting QueuedIVCVerifier with 8 concurrent verifiers 09:18:50 [09:18:50.144] INFO: p2p:lmdb-v2 Creating p2p data store at directory /tmp/a9ea606550889e7d/p2p with map size 134217728 KB (LMDB v2) 09:18:50 [09:18:50.147] INFO: p2p:lmdb-v2 Starting data store with maxReaders 16 09:18:50 [09:18:50.148] INFO: p2p-archive:lmdb-v2 Creating p2p-archive data store at directory /tmp/a9ea606550889e7d/p2p-archive with map size 134217728 KB (LMDB v2) 09:18:50 [09:18:50.149] INFO: p2p-archive:lmdb-v2 Starting data store with maxReaders 16 09:18:50 [09:18:50.150] INFO: p2p-peer:lmdb-v2 Creating p2p-peers data store at directory /tmp/a9ea606550889e7d/p2p-peers with map size 134217728 KB (LMDB v2) 09:18:50 [09:18:50.151] INFO: p2p-peer:lmdb-v2 Starting data store with maxReaders 16 09:18:50 [09:18:50.153] INFO: p2p:tx_pool Setting maximum tx mempool size {"maxTxPoolSize":100000000} 09:18:50 [09:18:50.153] VERBOSE: p2p P2P is disabled. Using dummy P2P service. 09:18:50 [09:18:50.157] VERBOSE: world-state:block_stream Starting L2 block stream {"proven":false,"pollIntervalMS":50} 09:18:50 [09:18:50.157] INFO: world_state Started world state synchronizer from block 1 09:18:50 [09:18:50.159] VERBOSE: world-state:block_stream Starting sync from block number 0 09:18:50 [09:18:50.161] INFO: p2p Starting p2p client from block 0 with empty mempools 09:18:50 [09:18:50.161] VERBOSE: p2p:l2-block-stream Starting L2 block stream {"batchSize":20,"pollIntervalMS":100,"startingBlock":0} 09:18:50 [09:18:50.543] INFO: epoch-prune-watcher EpochPruneWatcher initialized 09:18:50 [09:18:50.605] VERBOSE: validator Initialized validator with addresses: 0x4d59dabf02a8e69e8273001098488da83431cdf0 09:18:50 [09:18:50.606] VERBOSE: node:MAIN-aztec-node All Aztec Node subsystems synced 09:18:50 [09:18:50.621] VERBOSE: p2p:l2-block-stream Starting sync from block number 0 09:18:50 [09:18:50.624] INFO: slasher Starting Slasher client... 09:18:50 [09:18:50.650] INFO: validator Started validator with addresses: 0x4d59dabf02a8e69e8273001098488da83431cdf0 09:18:50 [09:18:50.651] VERBOSE: validator Validators 0x4d59dabf02a8e69e8273001098488da83431cdf0 are not on the validator committee for epoch 0 09:18:50 [09:18:50.651] INFO: sequencer Sequencer config set {"transactionPollingIntervalMS":500,"maxTxsPerBlock":32,"minTxsPerBlock":0,"maxL2BlockGas":10000000000,"publishTxsWithProposals":false,"maxDABlockGas":10000000000,"acvmWorkingDirectory":"/tmp/3d36632b/acvm","acvmBinaryPath":"../../noir/noir-repo/target/release/acvm","maxBlockSizeInBytes":1048576,"governanceProposerPayload":"0x0000000000000000000000000000000000000000","maxL1TxInclusionTimeIntoSlot":8,"enforceTimeTable":false} 09:18:50 [09:18:50.652] VERBOSE: sequencer Sequencer timetable updated {"enforceTimeTable":false} 09:18:50 [09:18:50.654] INFO: sequencer Sequencer started with address 0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266 09:18:50 [09:18:50.654] VERBOSE: node:MAIN-aztec-node Sequencer started 09:18:50 [09:18:50.655] INFO: node:MAIN-aztec-node Aztec Node version: 0.87.6 09:18:50 [09:18:50.655] INFO: node:MAIN-aztec-node Aztec Node started on chain 0x7a69 {"registryAddress":"0x3c709afec1aceae522c13145005de788a3cc65c8","governanceAddress":"0xa49a3d51a71916f87d60f0e919fb66e4b933b4df","governanceProposerAddress":"0xede9b34af448f9261efea2dafb2364866b09e01a","rollupAddress":"0x238b28fd473a035d549ac8c05c48f62b71d95e09","inboxAddress":"0x67741349158060347f9b5c3e4d9d81768f81a8c1","outboxAddress":"0x125dbf9956c14815fbf38af1ed7cc91ed11406b5","feeJuicePortalAddress":"0xd96cc6c2369924c2e4b8fdbb56bb6a9107f74afb","feeJuiceAddress":"0xb8999345da8041f1da51ac5179b1f055a560f397","stakingAssetAddress":"0xbb9e13665cfb3d531f288a11e7312b6b91c59292","rewardDistributorAddress":"0x4a51916a6b10a43f6565042be5b6b69d8d613f64","gseAddress":"0x6f26a1916df432654607f9c75b764e535e65cf3e","coinIssuerAddress":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","slashFactoryAddress":"0x7c800d855370b8d9b736d4a334c99da369f33ada","feeAssetHandlerAddress":"0xb4ff23c4b1e2bc7c86090d4fbda21a457ee6727f","stakingAssetHandlerAddress":"0xd8c49c848a06990e1b1ad8df26dbc5725b657aca","zkPassportVerifierAddress":"0xee9f10f38319eae2730dba28fb09081db806c5e5"} 09:18:50 [09:18:50.662] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating and syncing a simulated prover node... 09:18:50 [09:18:50.753] INFO: blob-sink:client:prover-node Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:38075"} 09:18:50 [09:18:50.765] INFO: archiver:lmdb:prover-node Creating archiver data store at directory /tmp/a9ea606550889e7d/ad0dc9c1acbcdd35/archiver with map size 134217728 KB (LMDB v2) 09:18:50 [09:18:50.783] VERBOSE: sequencer Preparing proposal for block 1 at slot 2 {"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750756920,"version":2818537067},"chainTipArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","blockNumber":1,"slot":2} 09:18:50 [09:18:50.785] INFO: archiver:lmdb:prover-node Starting data store with maxReaders 16 09:18:50 [09:18:50.940] VERBOSE: block-builder Building block 1 for slot 2 {"slot":2,"slotStart":"2025-06-24T09:22:00.000Z","now":"2025-06-24T09:21:53.864Z","blockNumber":1,"msgCount":0,"initialStateReference":{"l1ToL2MessageTree":"0x2e33ee2008411c04b99c24b313513d097a0d21a5040b6193d1f978b8226892d6","noteHashTree":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTree":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTree":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9"},"initialArchiveRoot":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}} 09:18:51 [09:18:51.122] INFO: simulator:public-processor:prover-node Processed 0 successful txs and 0 failed txs in 0.0035679589999999734s {"duration":0.0035679589999999734,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 09:18:51 [09:18:51.275] INFO: sequencer Built block 1 for slot 2 with 0 txs and 0 messages. 0 mana/s {"blockHash":"0x2d45391f22d30becef6ce17a91bc600504d04cac09be91a17af528256c9150b6","globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750756920,"version":2818537067},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":351.3114340000011,"publicProcessDuration":4.691150999999081,"rollupCircuitsDuration":337.11810799999876,"txCount":0,"blockNumber":1,"blockTimestamp":1750756920,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 09:18:51 [09:18:51.281] VERBOSE: sequencer Attesting committee is empty 09:18:51 [09:18:51.302] INFO: blob-sink:client:prover-node Testing configured blob sources {"blobSinkUrl":"http://localhost:38075"} 09:18:51 [09:18:51.308] INFO: blob-sink:client:prover-node Blob sink is reachable {"blobSinkUrl":"http://localhost:38075"} 09:18:51 [09:18:51.308] WARN: blob-sink:client:prover-node No L1 consensus host urls configured 09:18:51 [09:18:51.308] WARN: blob-sink:client:prover-node No archive client configured 09:18:51 [09:18:51.315] INFO: archiver:prover-node Starting archiver sync to rollup contract 0x238b28fd473a035d549ac8c05c48f62b71d95e09 from L1 block 22 to current L1 block 25 with hash 0x52606e2a8a156a216c738464381c309c854eb7fb109ab73b1a49418956e1b5d4 {"blocksSynchedTo":22,"messagesSynchedTo":{"l1BlockHash":"0xdd4e757710cb2322e08abacc23370580e1c580e6283eeb03048a4872082527b1","l1BlockNumber":22}} 09:18:51 [09:18:51.393] INFO: archiver:prover-node Initial archiver sync to L1 block 25 complete. {"l1BlockNumber":25,"syncPoint":{"blocksSynchedTo":25},"latest":{"number":0},"proven":{"number":0},"finalized":{"number":0}} 09:18:51 [09:18:51.396] INFO: prover-node:blob-sink:client:prover-node Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:38075"} 09:18:51 [09:18:51.397] VERBOSE: prover-node:prover-node Snapshot sync is disabled. No snapshots URL provided. 09:18:51 [09:18:51.400] VERBOSE: prover-node:prover-node Created archiver and synced to block 0 09:18:51 [09:18:51.442] INFO: world-state:database:prover-node Creating world state data store at directory /tmp/a9ea606550889e7d/ad0dc9c1acbcdd35/world_state with map sizes {"archiveTreeMapSizeKb":134217728,"nullifierTreeMapSizeKb":134217728,"noteHashTreeMapSizeKb":134217728,"messageTreeMapSizeKb":134217728,"publicDataTreeMapSizeKb":134217728} and 2 threads. 09:18:51 [09:18:51.474] INFO: world_state:prover-node Created world state synchroniser with block history of 2 09:18:51 [09:18:51.476] VERBOSE: world-state:block_stream:prover-node Starting L2 block stream {"proven":false,"pollIntervalMS":50} 09:18:51 [09:18:51.477] INFO: world_state:prover-node Started world state synchronizer from block 1 09:18:51 [09:18:51.479] VERBOSE: world-state:block_stream:prover-node Starting sync from block number 0 09:18:51 [09:18:51.479] WARN: prover-client:proving-broker-database:prover-node Found invalid epoch directory /tmp/a9ea606550889e7d/ad0dc9c1acbcdd35/archiver when loading epoch databases, ignoring 09:18:51 [09:18:51.479] WARN: prover-client:proving-broker-database:prover-node Found invalid epoch directory /tmp/a9ea606550889e7d/ad0dc9c1acbcdd35/world_state when loading epoch databases, ignoring 09:18:51 [09:18:51.481] INFO: prover-client:proving-broker:prover-node Proving Broker started 09:18:51 [09:18:51.502] INFO: prover-node:prover-coordination:prover-node Using prover coordination via aztec node 09:18:51 [09:18:51.504] INFO: e2e:e2e_epochs:epochs_upload_failed_proof:prover-node Created and synced prover node {"publisherAddress":"0x3C44CdDdB6a900fa2b585dd299e03d12FA4293BC"} 09:18:51 [09:18:51.504] INFO: prover-node:epoch-monitor:prover-node Started EpochMonitor {"pollingIntervalMs":200} 09:18:51 [09:18:51.509] INFO: prover-node:prover-node Started Prover Node with prover id 0x0000000000000000000000000000000000000000000000000000000000000001 {"proverNodePollingIntervalMs":200,"proverNodeMaxPendingJobs":10,"proverNodeMaxParallelBlocksPerEpoch":32,"txGatheringIntervalMs":1000,"txGatheringBatchSize":10,"txGatheringMaxParallelRequestsPerNode":100,"proverNodeFailedEpochStore":"file:///tmp/failed-proofs-rtfdY8","dataDirectory":"/tmp/a9ea606550889e7d/ad0dc9c1acbcdd35","l1ChainId":31337,"rollupVersion":2818537067} 09:18:51 [09:18:51.510] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating a pxe... 09:18:51 [09:18:51.516] INFO: pxe:data:lmdb Creating pxe_data data store at directory /tmp/933946dcac9dadfe/pxe_data with map size 134217728 KB (LMDB v2) 09:18:51 [09:18:51.523] INFO: pxe:data:lmdb Starting data store with maxReaders 16 09:18:52 [09:18:52.237] VERBOSE: pxe:service Registered protocol contracts in pxe {"AuthRegistry":"0x0000000000000000000000000000000000000000000000000000000000000001","ContractInstanceDeployer":"0x0000000000000000000000000000000000000000000000000000000000000002","ContractClassRegisterer":"0x0000000000000000000000000000000000000000000000000000000000000003","MultiCallEntrypoint":"0x0000000000000000000000000000000000000000000000000000000000000004","FeeJuice":"0x0000000000000000000000000000000000000000000000000000000000000005","Router":"0x0000000000000000000000000000000000000000000000000000000000000006"} 09:18:52 [09:18:52.238] INFO: pxe:service Started PXE connected to chain 31337 version 2818537067 09:18:52 [09:18:52.257] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L2 genesis at L1 block 22 (timestamp 1750756888) 09:18:52 [09:18:52.258] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting until L1 timestamp 1750756952 is reached as the start of epoch 1 09:18:52 [09:18:52.487] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 25 mined at 09:21:52 with new L2 block 0 for epoch 0 with proof up to L2 block 0 for epoch 0 {"l1Timestamp":1750756912,"l1BlockNumber":25,"l2SlotNumber":1,"l2BlockNumber":0,"l2ProvenBlockNumber":0,"totalL2Messages":0} 09:18:54 [09:18:54.924] VERBOSE: ethereum:tx_delayer Sent tx immediately 0x226d621c353e400fdda746132f17c0d02eacd3f3e74b55864c4781ae06107372 09:18:54 [09:18:54.924] VERBOSE: node:MAIN-aztec-node Sent L1 transaction 0x226d621c353e400fdda746132f17c0d02eacd3f3e74b55864c4781ae06107372 {"gasLimit":470455,"maxFeePerGas":"500","maxPriorityFeePerGas":"500","maxFeePerBlobGas":"0.000000001"} 09:18:57 [09:18:57.128] INFO: sequencer:publisher Bundled [propose] transaction [succeeded] 09:18:57 [09:18:57.130] VERBOSE: sequencer:publisher Published L2 block to L1 rollup contract {"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0x226d621c353e400fdda746132f17c0d02eacd3f3e74b55864c4781ae06107372","calldataSize":1220,"calldataGas":8828,"txCount":0,"blockNumber":1,"blockTimestamp":1750756920,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 09:18:57 [09:18:57.131] VERBOSE: node:blob-sink:client Sending 1 blobs to blob sink 09:18:57 [09:18:57.164] INFO: blob-sink:server Received blob sidecar for block 0x02a92f42563384d64fdf66279ab0e7cc01e1459d0093c6d4f5b0667b1b3a9102 09:18:57 [09:18:57.176] INFO: blob-sink:server Blob sidecar stored successfully for block 0x02a92f42563384d64fdf66279ab0e7cc01e1459d0093c6d4f5b0667b1b3a9102 09:18:57 [09:18:57.272] INFO: archiver Downloaded L2 block 1 {"blockHash":"0x2d45391f22d30becef6ce17a91bc600504d04cac09be91a17af528256c9150b6","blockNumber":1,"txCount":0,"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750756920,"version":2818537067},"archiveRoot":"0x12b685b35f59219839311c0fea851e8785c6dc0cf5d7fba1556451bcde5b04b9","archiveNextLeafIndex":2} 09:18:57 [09:18:57.319] INFO: archiver:prover-node Downloaded L2 block 1 {"blockHash":"0x2d45391f22d30becef6ce17a91bc600504d04cac09be91a17af528256c9150b6","blockNumber":1,"txCount":0,"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750756920,"version":2818537067},"archiveRoot":"0x12b685b35f59219839311c0fea851e8785c6dc0cf5d7fba1556451bcde5b04b9","archiveNextLeafIndex":2} 09:18:57 [09:18:57.328] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 26 mined at 09:22:00 with new L2 block 1 for epoch 0 {"l1Timestamp":1750756920,"l1BlockNumber":26,"l2SlotNumber":2,"l2BlockNumber":1,"l2ProvenBlockNumber":0,"totalL2Messages":0} 09:18:57 [09:18:57.332] VERBOSE: p2p Synched to latest block 1 09:18:57 [09:18:57.341] INFO: world_state World state updated with L2 block 1 {"eventName":"l2-block-handled","duration":6.996444999997038,"unfinalisedBlockNumber":1,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":1,"blockTimestamp":1750756920,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 09:18:57 [09:18:57.385] INFO: world_state:prover-node World state updated with L2 block 1 {"eventName":"l2-block-handled","duration":9.226237999999285,"unfinalisedBlockNumber":1,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":1,"blockTimestamp":1750756920,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 09:18:57 [09:18:57.515] VERBOSE: prover-node:prover-node Fetching 0 tx hashes for block number 1 from coordination 09:18:57 [09:18:57.516] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 09:19:05 [09:19:05.118] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 27 mined at 09:22:08 {"l1Timestamp":1750756928,"l1BlockNumber":27,"l2SlotNumber":2,"l2BlockNumber":1,"l2ProvenBlockNumber":0,"totalL2Messages":0} 09:19:05 [09:19:05.405] VERBOSE: sequencer Preparing proposal for block 2 at slot 3 {"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750756936,"version":2818537067},"chainTipArchive":"0x12b685b35f59219839311c0fea851e8785c6dc0cf5d7fba1556451bcde5b04b9","blockNumber":2,"slot":3} 09:19:05 [09:19:05.453] VERBOSE: block-builder Building block 2 for slot 3 {"slot":3,"slotStart":"2025-06-24T09:22:16.000Z","now":"2025-06-24T09:22:08.377Z","blockNumber":2,"msgCount":0,"initialStateReference":{"l1ToL2MessageTree":"0x2e33ee2008411c04b99c24b313513d097a0d21a5040b6193d1f978b8226892d6","noteHashTree":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTree":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTree":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9"},"initialArchiveRoot":"0x12b685b35f59219839311c0fea851e8785c6dc0cf5d7fba1556451bcde5b04b9","opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}} 09:19:05 [09:19:05.457] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.00034046899999884775s {"duration":0.00034046899999884775,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 09:19:05 [09:19:05.532] INFO: sequencer Built block 2 for slot 3 with 0 txs and 0 messages. 0 mana/s {"blockHash":"0x25e5c9b02e7ecb024ce0ad801d96c946e7253b64764ebabe3d68caa9f22fecc4","globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750756936,"version":2818537067},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":91.58401500000036,"publicProcessDuration":0.8871750000034808,"rollupCircuitsDuration":80.28024800000276,"txCount":0,"blockNumber":2,"blockTimestamp":1750756936,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 09:19:05 [09:19:05.546] VERBOSE: sequencer Attesting committee is empty 09:19:05 [09:19:05.655] VERBOSE: ethereum:tx_delayer Sent tx immediately 0xa9b417f3b2fbd423b276194c430ba021ff76d5f4eb2f01860e64bae1204b3a40 09:19:05 [09:19:05.655] VERBOSE: node:MAIN-aztec-node Sent L1 transaction 0xa9b417f3b2fbd423b276194c430ba021ff76d5f4eb2f01860e64bae1204b3a40 {"gasLimit":391098,"maxFeePerGas":"1.266215001","maxPriorityFeePerGas":"1.2","maxFeePerBlobGas":"0.000000001"} 09:19:13 [09:19:13.164] WARN: archiver Failed to reach L2 block 2 at 27 (latest is 1). Rolling back last synched L1 block number to 26. {"latestLocalL2BlockNumber":1,"latestLocalL2BlockArchive":"0x12b685b35f59219839311c0fea851e8785c6dc0cf5d7fba1556451bcde5b04b9","blocksSynchedTo":26,"currentL1BlockNumber":27,"provenBlockNumber":0,"provenArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","pendingBlockNumber":2,"pendingArchive":"0x17f2cad296b63872d9f2190c10c97430b08315339e7986fcb437928fe3412287"} 09:19:13 [09:19:13.256] INFO: sequencer:publisher Bundled [propose] transaction [succeeded] 09:19:13 [09:19:13.265] VERBOSE: sequencer:publisher Published L2 block to L1 rollup contract {"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0xa9b417f3b2fbd423b276194c430ba021ff76d5f4eb2f01860e64bae1204b3a40","calldataSize":1220,"calldataGas":8828,"txCount":0,"blockNumber":2,"blockTimestamp":1750756936,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 09:19:13 [09:19:13.266] VERBOSE: node:blob-sink:client Sending 1 blobs to blob sink 09:19:13 [09:19:13.309] INFO: blob-sink:server Received blob sidecar for block 0xac810d699da88d963fa5f09f95a02034de1a030d3206316ac9357efcfba127b5 09:19:13 [09:19:13.321] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 28 mined at 09:22:16 with new L2 block 2 for epoch 0 {"l1Timestamp":1750756936,"l1BlockNumber":28,"l2SlotNumber":3,"l2BlockNumber":2,"l2ProvenBlockNumber":0,"totalL2Messages":0} 09:19:13 [09:19:13.322] INFO: blob-sink:server Blob sidecar stored successfully for block 0xac810d699da88d963fa5f09f95a02034de1a030d3206316ac9357efcfba127b5 09:19:13 [09:19:13.398] INFO: archiver:prover-node Downloaded L2 block 2 {"blockHash":"0x25e5c9b02e7ecb024ce0ad801d96c946e7253b64764ebabe3d68caa9f22fecc4","blockNumber":2,"txCount":0,"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750756936,"version":2818537067},"archiveRoot":"0x17f2cad296b63872d9f2190c10c97430b08315339e7986fcb437928fe3412287","archiveNextLeafIndex":3} 09:19:13 [09:19:13.466] INFO: archiver Downloaded L2 block 2 {"blockHash":"0x25e5c9b02e7ecb024ce0ad801d96c946e7253b64764ebabe3d68caa9f22fecc4","blockNumber":2,"txCount":0,"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750756936,"version":2818537067},"archiveRoot":"0x17f2cad296b63872d9f2190c10c97430b08315339e7986fcb437928fe3412287","archiveNextLeafIndex":3} 09:19:13 [09:19:13.476] INFO: world_state:prover-node World state updated with L2 block 2 {"eventName":"l2-block-handled","duration":6.89838299999974,"unfinalisedBlockNumber":2,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":2,"blockTimestamp":1750756936,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 09:19:13 [09:19:13.541] INFO: world_state World state updated with L2 block 2 {"eventName":"l2-block-handled","duration":9.412303999997675,"unfinalisedBlockNumber":2,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":2,"blockTimestamp":1750756936,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 09:19:13 [09:19:13.554] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 09:19:13 [09:19:13.554] VERBOSE: prover-node:prover-node Gathered all 0 txs for epoch 0 {"epochNumber":0} 09:19:13 [09:19:13.557] VERBOSE: prover-node:prover-node Gathered all 0 messages for epoch 0 {"epochNumber":0} 09:19:13 [09:19:13.557] VERBOSE: prover-node:prover-node Gathered previous block header 0 for epoch 0 09:19:13 [09:19:13.557] VERBOSE: prover-node:prover-node Creating proving job for epoch 0 for block range 1 to 2 09:19:13 [09:19:13.560] INFO: prover-node:epoch-proving-job Starting epoch 0 proving job with blocks 1 to 2 {"fromBlock":1,"toBlock":2,"epochSizeBlocks":2,"epochNumber":0,"uuid":"7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b"} 09:19:13 [09:19:13.580] INFO: prover-client:orchestrator Starting epoch 0 with 2 blocks 09:19:13 [09:19:13.581] VERBOSE: prover-client:broker-circuit-prover-facade Starting BrokerCircuitProverFacade 09:19:13 [09:19:13.582] VERBOSE: prover-node:epoch-proving-job Starting processing block 1 {"number":1,"blockHash":"0x2d45391f22d30becef6ce17a91bc600504d04cac09be91a17af528256c9150b6","lastArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x00000000000000000000000000000000000000000000000000000000a7ff766b","blockNumber":1,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 09:19:13 [09:19:13.583] INFO: prover-client:orchestrator Starting block 1 for slot 2 09:19:13 [09:19:13.584] VERBOSE: prover-node:epoch-proving-job Starting processing block 2 {"number":2,"blockHash":"0x25e5c9b02e7ecb024ce0ad801d96c946e7253b64764ebabe3d68caa9f22fecc4","lastArchive":"0x12b685b35f59219839311c0fea851e8785c6dc0cf5d7fba1556451bcde5b04b9","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x00000000000000000000000000000000000000000000000000000000a7ff766b","blockNumber":2,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000003","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 09:19:13 [09:19:13.584] INFO: prover-client:orchestrator Starting block 2 for slot 3 09:19:13 [09:19:13.613] VERBOSE: prover-node:prover-node Fetching 0 tx hashes for block number 2 from coordination 09:19:13 [09:19:13.613] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 09:19:13 [09:19:13.624] VERBOSE: p2p Synched to latest block 2 09:19:13 [09:19:13.629] INFO: prover-client:proving-broker:prover-node New proving job id=0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5 epochNumber=0 {"provingJobId":"0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5"} 09:19:13 [09:19:13.630] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5","provingJobType":"BASE_PARITY"} 09:19:13 [09:19:13.630] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5","provingJobType":"BASE_PARITY"} 09:19:13 [09:19:13.630] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5","provingJobType":"BASE_PARITY"} 09:19:13 [09:19:13.635] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000020320000003266615s {"duration":0.000020320000003266615,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 09:19:13 [09:19:13.635] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 09:19:13 [09:19:13.636] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 1 {"blockNumber":1,"blockHash":"0x2d45391f22d30becef6ce17a91bc600504d04cac09be91a17af528256c9150b6","uuid":"7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b"} 09:19:13 [09:19:13.636] VERBOSE: prover-client:orchestrator Block 1 completed. Assembling header. 09:19:13 [09:19:13.643] VERBOSE: prover-client:orchestrator Updating archive tree with block 1 header 0x2d45391f22d30becef6ce17a91bc600504d04cac09be91a17af528256c9150b6 09:19:13 [09:19:13.650] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5","provingJobType":"BASE_PARITY"} 09:19:13 [09:19:13.650] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5","provingJobType":"BASE_PARITY"} 09:19:13 [09:19:13.651] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5","provingJobType":"BASE_PARITY"} 09:19:13 [09:19:13.651] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5","provingJobType":"BASE_PARITY"} 09:19:13 [09:19:13.652] VERBOSE: prover-client:orchestrator Orchestrator finalised block 1 09:19:13 [09:19:13.679] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000023601000000780913s {"duration":0.000023601000000780913,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 09:19:13 [09:19:13.679] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 09:19:13 [09:19:13.685] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 2 {"blockNumber":2,"blockHash":"0x25e5c9b02e7ecb024ce0ad801d96c946e7253b64764ebabe3d68caa9f22fecc4","uuid":"7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b"} 09:19:13 [09:19:13.685] VERBOSE: prover-client:orchestrator Block 2 completed. Assembling header. 09:19:13 [09:19:13.689] INFO: prover-client:proving-broker-database:prover-node Creating broker database for epoch 0 at /tmp/a9ea606550889e7d/ad0dc9c1acbcdd35/0 with map size 134217728 09:19:13 [09:19:13.709] VERBOSE: prover-client:orchestrator Updating archive tree with block 2 header 0x25e5c9b02e7ecb024ce0ad801d96c946e7253b64764ebabe3d68caa9f22fecc4 09:19:13 [09:19:13.715] VERBOSE: prover-client:orchestrator Orchestrator finalised block 2 09:19:13 [09:19:13.741] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:19:13 [09:19:13.748] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5 type=BASE_PARITY epochNumber=0 {"provingJobId":"0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5","provingJobType":"BASE_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...","status":"not-found","numOutstandingJobs":1} 09:19:13 [09:19:13.817] INFO: prover-client:proving-agent:prover-node Starting job id=0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5 type=BASE_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input... 09:19:13 [09:19:13.833] INFO: prover-client:proving-agent:job-controller-575287b0 Job controller started jobId=0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5 {"jobId":"0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5"} 09:19:13 [09:19:13.991] INFO: prover-client:proving-agent:prover-node Job id=0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5 type=BASE_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22resul... 09:19:13 [09:19:13.992] INFO: prover-client:proving-broker:prover-node Proving job complete id=0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5 type=BASE_PARITY totalAttempts=1 {"provingJobId":"0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5"} 09:19:14 [09:19:14.583] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 09:19:14 [09:19:14.585] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5 type=BASE_PARITY 09:19:14 [09:19:14.586] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 09:19:14 [09:19:14.616] INFO: prover-client:proving-broker:prover-node New proving job id=0:ROOT_PARITY:e811e7ef2af8d2ea051872b4690cf1c849702f5df90d06b3f53a70a23d93fee4 epochNumber=0 {"provingJobId":"0:ROOT_PARITY:e811e7ef2af8d2ea051872b4690cf1c849702f5df90d06b3f53a70a23d93fee4"} 09:19:14 [09:19:14.625] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:ROOT_PARITY:e811e7ef2af8d2ea051872b4690cf1c849702f5df90d06b3f53a70a23d93fee4 type=ROOT_PARITY {"provingJobId":"0:ROOT_PARITY:e811e7ef2af8d2ea051872b4690cf1c849702f5df90d06b3f53a70a23d93fee4","provingJobType":"ROOT_PARITY"} 09:19:14 [09:19:14.670] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_PARITY:e811e7ef2af8d2ea051872b4690cf1c849702f5df90d06b3f53a70a23d93fee4 type=ROOT_PARITY epochNumber=0 {"provingJobId":"0:ROOT_PARITY:e811e7ef2af8d2ea051872b4690cf1c849702f5df90d06b3f53a70a23d93fee4","provingJobType":"ROOT_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu...","status":"not-found","numOutstandingJobs":1} 09:19:14 [09:19:14.739] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Triggering error on finaliseEpoch 09:19:14 [09:19:14.747] ERROR: prover-node:epoch-proving-job Error running epoch 0 prover job: Error: Fake error while proving epoch 09:19:14 at ServerEpochProver.epochProver.finaliseEpoch (/home/aztec-dev/aztec-packages/yarn-project/end-to-end/src/e2e_epochs/epochs_upload_failed_proof.test.ts:60:15) 09:19:14 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:142:64) 09:19:14 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) {"uuid":"7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b","epochNumber":0} 09:19:14 [09:19:14.747] VERBOSE: prover-client:broker-circuit-prover-facade Stopping BrokerCircuitProverFacade 09:19:14 [09:19:14.749] ERROR: prover-client:broker-circuit-prover-facade Job errored with 'Broker facade stopped' id=0:ROOT_PARITY:e811e7ef2af8d2ea051872b4690cf1c849702f5df90d06b3f53a70a23d93fee4 type=ROOT_PARITY: { 09:19:14 provingJobId: '0:ROOT_PARITY:e811e7ef2af8d2ea051872b4690cf1c849702f5df90d06b3f53a70a23d93fee4', 09:19:14 provingJobType: 'ROOT_PARITY' 09:19:14 } 09:19:14 [09:19:14.749] INFO: prover-client:proving-broker:prover-node Cancelling job id=0:ROOT_PARITY:e811e7ef2af8d2ea051872b4690cf1c849702f5df90d06b3f53a70a23d93fee4 {"provingJobId":"0:ROOT_PARITY:e811e7ef2af8d2ea051872b4690cf1c849702f5df90d06b3f53a70a23d93fee4"} 09:19:14 [09:19:14.750] WARN: prover-client:proving-broker:prover-node Proving job id=0:ROOT_PARITY:e811e7ef2af8d2ea051872b4690cf1c849702f5df90d06b3f53a70a23d93fee4 type=ROOT_PARITY not in the in-progress set {"provingJobId":"0:ROOT_PARITY:e811e7ef2af8d2ea051872b4690cf1c849702f5df90d06b3f53a70a23d93fee4"} 09:19:14 [09:19:14.750] INFO: prover-client:proving-broker:prover-node Marking proving job as failed id=0:ROOT_PARITY:e811e7ef2af8d2ea051872b4690cf1c849702f5df90d06b3f53a70a23d93fee4 type=ROOT_PARITY totalAttempts=1 err=Aborted {"provingJobId":"0:ROOT_PARITY:e811e7ef2af8d2ea051872b4690cf1c849702f5df90d06b3f53a70a23d93fee4"} 09:19:14 [09:19:14.751] ERROR: prover-client:orchestrator Error thrown when proving job: Error: Broker facade stopped 09:19:14 at BrokerCircuitProverFacade.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/proving_broker/broker_prover_facade.js:142:31) 09:19:14 at ServerEpochProver.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/prover-client/server-epoch-prover.js:31:9) 09:19:14 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:183:13) 09:19:14 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) 09:19:14 [09:19:14.751] ERROR: prover-client:orchestrator Error thrown when proving job: Error: Broker facade stopped 09:19:14 at BrokerCircuitProverFacade.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/proving_broker/broker_prover_facade.js:142:31) 09:19:14 at ServerEpochProver.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/prover-client/server-epoch-prover.js:31:9) 09:19:14 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:183:13) 09:19:14 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) 09:19:14 [09:19:14.752] ERROR: prover-node:prover-node Job for 0 exited with state failed: { 09:19:14 id: '7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b', 09:19:14 epochNumber: 0n, 09:19:14 state: 'failed' 09:19:14 } 09:19:14 [09:19:14.752] WARN: prover-node:prover-node Uploading epoch proof failure for 0 to file:///tmp/failed-proofs-rtfdY8 {"epochNumber":0,"jobId":"7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b","location":"file:///tmp/failed-proofs-rtfdY8"} 09:19:14 [09:19:14.754] INFO: stdlib:file-store Creating local file file store at /tmp/failed-proofs-rtfdY8 09:19:14 [09:19:14.760] INFO: prover-node:prover-node Pausing archiver and world state sync to start snapshot upload 09:19:14 [09:19:14.768] INFO: archiver:prover-node Stopped. 09:19:14 [09:19:14.769] INFO: world_state:prover-node Stopped sync 09:19:14 [09:19:14.769] INFO: prover-node:prover-node Creating backups of lmdb environments to /tmp/a9ea606550889e7d/ad0dc9c1acbcdd35/epoch-proof-data-OgK9xZ 09:19:14 [09:19:14.789] INFO: prover-node:prover-node Data stores backed up to /tmp/a9ea606550889e7d/ad0dc9c1acbcdd35/epoch-proof-data-OgK9xZ {"paths":{"l1-to-l2-message-tree":"/tmp/a9ea606550889e7d/ad0dc9c1acbcdd35/epoch-proof-data-OgK9xZ/world-state/L1ToL2MessageTree/data.mdb","archive-tree":"/tmp/a9ea606550889e7d/ad0dc9c1acbcdd35/epoch-proof-data-OgK9xZ/world-state/ArchiveTree/data.mdb","public-data-tree":"/tmp/a9ea606550889e7d/ad0dc9c1acbcdd35/epoch-proof-data-OgK9xZ/world-state/PublicDataTree/data.mdb","note-hash-tree":"/tmp/a9ea606550889e7d/ad0dc9c1acbcdd35/epoch-proof-data-OgK9xZ/world-state/NoteHashTree/data.mdb","nullifier-tree":"/tmp/a9ea606550889e7d/ad0dc9c1acbcdd35/epoch-proof-data-OgK9xZ/world-state/NullifierTree/data.mdb","archiver":"/tmp/a9ea606550889e7d/ad0dc9c1acbcdd35/epoch-proof-data-OgK9xZ/archiver/data.mdb"}} 09:19:14 [09:19:14.790] INFO: prover-node:prover-node Resuming archiver and world state sync 09:19:14 [09:19:14.790] VERBOSE: world-state:block_stream:prover-node Starting L2 block stream {"proven":false,"pollIntervalMS":50} 09:19:14 [09:19:14.791] INFO: world_state:prover-node Resumed sync 09:19:14 [09:19:14.791] INFO: archiver:prover-node Restarting archiver 09:19:14 [09:19:14.874] WARN: prover-node:prover-node Uploaded epoch 0 proof failure data to file:///tmp/failed-proofs-rtfdY8/aztec-31337-2818537067-0x238b28fd473a035d549ac8c05c48f62b71d95e09/0-20250624091914-7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b {"epochNumber":0,"location":"file:///tmp/failed-proofs-rtfdY8","basePath":"aztec-31337-2818537067-0x238b28fd473a035d549ac8c05c48f62b71d95e09/0-20250624091914-7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b","metadataUrl":"file:///tmp/failed-proofs-rtfdY8/aztec-31337-2818537067-0x238b28fd473a035d549ac8c05c48f62b71d95e09/0-20250624091914-7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b/metadata.json","dataUrl":"file:///tmp/failed-proofs-rtfdY8/aztec-31337-2818537067-0x238b28fd473a035d549ac8c05c48f62b71d95e09/0-20250624091914-7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b/data.bin","metadata":{"l1BlockNumber":28,"l2BlockHash":"0x25e5c9b02e7ecb024ce0ad801d96c946e7253b64764ebabe3d68caa9f22fecc4","l2BlockNumber":2,"schemaVersions":{"archiver":3,"worldState":2},"timestamp":1750756754799,"dataUrls":{"l1-to-l2-message-tree":"file:///tmp/failed-proofs-rtfdY8/aztec-31337-2818537067-0x238b28fd473a035d549ac8c05c48f62b71d95e09/0-20250624091914-7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b/l1-to-l2-message-tree.db","archive-tree":"file:///tmp/failed-proofs-rtfdY8/aztec-31337-2818537067-0x238b28fd473a035d549ac8c05c48f62b71d95e09/0-20250624091914-7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b/archive-tree.db","public-data-tree":"file:///tmp/failed-proofs-rtfdY8/aztec-31337-2818537067-0x238b28fd473a035d549ac8c05c48f62b71d95e09/0-20250624091914-7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-rtfdY8/aztec-31337-2818537067-0x238b28fd473a035d549ac8c05c48f62b71d95e09/0-20250624091914-7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b/note-hash-tree.db","nullifier-tree":"file:///tmp/failed-proofs-rtfdY8/aztec-31337-2818537067-0x238b28fd473a035d549ac8c05c48f62b71d95e09/0-20250624091914-7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b/nullifier-tree.db","archiver":"file:///tmp/failed-proofs-rtfdY8/aztec-31337-2818537067-0x238b28fd473a035d549ac8c05c48f62b71d95e09/0-20250624091914-7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b/archiver.db"}},"jobId":"7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b"} 09:19:14 [09:19:14.875] INFO: prover-node:prover-node Cleaning up backup dir /tmp/a9ea606550889e7d/ad0dc9c1acbcdd35/epoch-proof-data-OgK9xZ 09:19:21 [09:19:21.092] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 29 mined at 09:22:24 {"l1Timestamp":1750756944,"l1BlockNumber":29,"l2SlotNumber":3,"l2BlockNumber":2,"l2ProvenBlockNumber":0,"totalL2Messages":0} 09:19:21 [09:19:21.139] INFO: prover-node:prover-node Stopping ProverNode 09:19:21 [09:19:21.139] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 09:19:21 [09:19:21.140] INFO: archiver:prover-node Stopped. 09:19:21 [09:19:21.143] INFO: world_state:prover-node Stopped world state synchronizer 09:19:21 [09:19:21.144] INFO: prover-node:prover-node Stopped ProverNode 09:19:21 [09:19:21.144] INFO: node:MAIN-aztec-node Stopping Aztec Node 09:19:21 [09:19:21.555] VERBOSE: sequencer Preparing proposal for block 3 at slot 4 {"globalVariables":{"blockNumber":3,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":4,"timestamp":1750756952,"version":2818537067},"chainTipArchive":"0x17f2cad296b63872d9f2190c10c97430b08315339e7986fcb437928fe3412287","blockNumber":3,"slot":4} 09:19:21 [09:19:21.592] VERBOSE: block-builder Building block 3 for slot 4 {"slot":4,"slotStart":"2025-06-24T09:22:32.000Z","now":"2025-06-24T09:22:24.516Z","blockNumber":3,"msgCount":0,"initialStateReference":{"l1ToL2MessageTree":"0x2e33ee2008411c04b99c24b313513d097a0d21a5040b6193d1f978b8226892d6","noteHashTree":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTree":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTree":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9"},"initialArchiveRoot":"0x17f2cad296b63872d9f2190c10c97430b08315339e7986fcb437928fe3412287","opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}} 09:19:21 [09:19:21.597] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.00045073299999785375s {"duration":0.00045073299999785375,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 09:19:21 [09:19:21.622] INFO: sequencer Built block 3 for slot 4 with 0 txs and 0 messages. 0 mana/s {"blockHash":"0x20515d64603565df2eea1ee482f35c9e489453b9240a4535a4d968b244f13e82","globalVariables":{"blockNumber":3,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":4,"timestamp":1750756952,"version":2818537067},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":47.077391999999236,"publicProcessDuration":0.8506239999987883,"rollupCircuitsDuration":30.82344500000181,"txCount":0,"blockNumber":3,"blockTimestamp":1750756952,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 09:19:21 [09:19:21.624] VERBOSE: sequencer Attesting committee is empty 09:19:21 [09:19:21.715] VERBOSE: ethereum:tx_delayer Sent tx immediately 0x63470a8633f32b030374577821d2cbbc4c7a52d168352b75b497a17713914e48 09:19:21 [09:19:21.716] VERBOSE: node:MAIN-aztec-node Sent L1 transaction 0x63470a8633f32b030374577821d2cbbc4c7a52d168352b75b497a17713914e48 {"gasLimit":464655,"maxFeePerGas":"1.250823812","maxPriorityFeePerGas":"1.2","maxFeePerBlobGas":"0.000000001"} 09:19:23 [09:19:23.146] INFO: slasher Slasher client stopped. 09:19:29 [09:19:29.130] INFO: sequencer:publisher Bundled [propose] transaction [succeeded] 09:19:29 [09:19:29.131] VERBOSE: sequencer:publisher Published L2 block to L1 rollup contract {"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0x63470a8633f32b030374577821d2cbbc4c7a52d168352b75b497a17713914e48","calldataSize":1220,"calldataGas":8828,"txCount":0,"blockNumber":3,"blockTimestamp":1750756952,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 09:19:29 [09:19:29.131] VERBOSE: node:blob-sink:client Sending 1 blobs to blob sink 09:19:29 [09:19:29.136] INFO: sequencer Stopped sequencer 09:19:29 [09:19:29.136] INFO: p2p P2P client stopped 09:19:29 [09:19:29.146] INFO: blob-sink:server Received blob sidecar for block 0x9b4d091466d871eab867bc25121e999e6778b5154978265e15358a6ca8734670 09:19:29 [09:19:29.147] INFO: world_state Stopped world state synchronizer 09:19:29 [09:19:29.150] INFO: blob-sink:server Blob sidecar stored successfully for block 0x9b4d091466d871eab867bc25121e999e6778b5154978265e15358a6ca8734670 09:19:29 [09:19:29.181] INFO: archiver Downloaded L2 block 3 {"blockHash":"0x20515d64603565df2eea1ee482f35c9e489453b9240a4535a4d968b244f13e82","blockNumber":3,"txCount":0,"globalVariables":{"blockNumber":3,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":4,"timestamp":1750756952,"version":2818537067},"archiveRoot":"0x2da97c88ed20c22480ab3ca466eafd7afa6ab0994e2da3684219c46855ebe389","archiveNextLeafIndex":4} 09:19:29 [09:19:29.186] INFO: archiver Stopped. 09:19:29 [09:19:29.186] INFO: node:MAIN-aztec-node Stopped Aztec Node 09:19:29 [09:19:29.188] INFO: node:MAIN-aztec-node Stopping Aztec Node 09:19:31 [09:19:31.189] INFO: slasher Slasher client stopped. 09:19:31 [09:19:31.190] WARN: validator Running promise was not started 09:19:31 [09:19:31.190] WARN: sequencer Running promise was not started 09:19:31 [09:19:31.190] INFO: sequencer Stopped sequencer 09:19:31 [09:19:31.191] WARN: p2p:l2-block-stream Running promise was not started 09:19:31 [09:19:31.191] INFO: p2p P2P client stopped 09:19:31 [09:19:31.191] WARN: world-state:block_stream Running promise was not started 09:19:31 [09:19:31.191] INFO: world_state Stopped world state synchronizer 09:19:31 [09:19:31.191] WARN: archiver Running promise was not started 09:19:31 [09:19:31.191] INFO: archiver Stopped. 09:19:31 [09:19:31.191] INFO: node:MAIN-aztec-node Stopped Aztec Node 09:19:31 [09:19:31.192] INFO: prover-node:prover-node Stopping ProverNode 09:19:31 [09:19:31.192] WARN: prover-node:prover-node Running promise was not started 09:19:31 [09:19:31.192] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 09:19:31 [09:19:31.192] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 09:19:31 [09:19:31.192] WARN: archiver:prover-node Running promise was not started 09:19:31 [09:19:31.192] INFO: archiver:prover-node Stopped. 09:19:31 [09:19:31.193] WARN: world-state:block_stream:prover-node Running promise was not started 09:19:31 [09:19:31.193] INFO: world_state:prover-node Stopped world state synchronizer 09:19:31 [09:19:31.193] INFO: prover-node:prover-node Stopped ProverNode 09:19:31 [09:19:31.212] INFO: blob-sink:server Stopping blob sink 09:19:31 [09:19:31.213] INFO: blob-sink:server Blob sink stopped 09:19:31 [09:19:31.222] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data and state {"uploadPath":"/tmp/failed-proofs-rtfdY8","rerunDataDir":"/tmp/rerun-data-C5aJg0","rerunDownloadPath":"/tmp/rerun-download-ZFdovG/data.bin"} 09:19:31 [09:19:31.222] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data from file:///tmp/failed-proofs-rtfdY8/aztec-31337-2818537067-0x238b28fd473a035d549ac8c05c48f62b71d95e09/0-20250624091914-7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b 09:19:31 [09:19:31.223] INFO: stdlib:file-store Creating local file file store at /tmp/failed-proofs-rtfdY8/aztec-31337-2818537067-0x238b28fd473a035d549ac8c05c48f62b71d95e09/0-20250624091914-7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b 09:19:31 [09:19:31.228] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading state snapshot from file:///tmp/failed-proofs-rtfdY8/aztec-31337-2818537067-0x238b28fd473a035d549ac8c05c48f62b71d95e09/0-20250624091914-7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b to local data directory {"metadata":{"l2BlockNumber":2,"l2BlockHash":"0x25e5c9b02e7ecb024ce0ad801d96c946e7253b64764ebabe3d68caa9f22fecc4","l1BlockNumber":28,"l1ChainId":31337,"rollupVersion":2818537067,"rollupAddress":"0x238b28fd473a035d549ac8c05c48f62b71d95e09"},"dataUrls":{"archiver":"file:///tmp/failed-proofs-rtfdY8/aztec-31337-2818537067-0x238b28fd473a035d549ac8c05c48f62b71d95e09/0-20250624091914-7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-rtfdY8/aztec-31337-2818537067-0x238b28fd473a035d549ac8c05c48f62b71d95e09/0-20250624091914-7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-rtfdY8/aztec-31337-2818537067-0x238b28fd473a035d549ac8c05c48f62b71d95e09/0-20250624091914-7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-rtfdY8/aztec-31337-2818537067-0x238b28fd473a035d549ac8c05c48f62b71d95e09/0-20250624091914-7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-rtfdY8/aztec-31337-2818537067-0x238b28fd473a035d549ac8c05c48f62b71d95e09/0-20250624091914-7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-rtfdY8/aztec-31337-2818537067-0x238b28fd473a035d549ac8c05c48f62b71d95e09/0-20250624091914-7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b/l1-to-l2-message-tree.db"}} 09:19:31 [09:19:31.228] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Creating local file file store at /tmp/failed-proofs-rtfdY8/aztec-31337-2818537067-0x238b28fd473a035d549ac8c05c48f62b71d95e09/0-20250624091914-7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b 09:19:31 [09:19:31.229] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading snapshot to /tmp/rerun-data-C5aJg0/download-WW5ijZ {"snapshot":{"dataUrls":{"archiver":"file:///tmp/failed-proofs-rtfdY8/aztec-31337-2818537067-0x238b28fd473a035d549ac8c05c48f62b71d95e09/0-20250624091914-7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-rtfdY8/aztec-31337-2818537067-0x238b28fd473a035d549ac8c05c48f62b71d95e09/0-20250624091914-7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-rtfdY8/aztec-31337-2818537067-0x238b28fd473a035d549ac8c05c48f62b71d95e09/0-20250624091914-7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-rtfdY8/aztec-31337-2818537067-0x238b28fd473a035d549ac8c05c48f62b71d95e09/0-20250624091914-7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-rtfdY8/aztec-31337-2818537067-0x238b28fd473a035d549ac8c05c48f62b71d95e09/0-20250624091914-7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-rtfdY8/aztec-31337-2818537067-0x238b28fd473a035d549ac8c05c48f62b71d95e09/0-20250624091914-7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b/l1-to-l2-message-tree.db"}},"downloadPaths":{"archiver":"/tmp/rerun-data-C5aJg0/download-WW5ijZ/archiver.db","nullifier-tree":"/tmp/rerun-data-C5aJg0/download-WW5ijZ/nullifier-tree.db","public-data-tree":"/tmp/rerun-data-C5aJg0/download-WW5ijZ/public-data-tree.db","note-hash-tree":"/tmp/rerun-data-C5aJg0/download-WW5ijZ/note-hash-tree.db","archive-tree":"/tmp/rerun-data-C5aJg0/download-WW5ijZ/archive-tree.db","l1-to-l2-message-tree":"/tmp/rerun-data-C5aJg0/download-WW5ijZ/l1-to-l2-message-tree.db"}} 09:19:31 [09:19:31.233] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Snapshot downloaded at /tmp/rerun-data-C5aJg0/download-WW5ijZ {"snapshot":{"dataUrls":{"archiver":"file:///tmp/failed-proofs-rtfdY8/aztec-31337-2818537067-0x238b28fd473a035d549ac8c05c48f62b71d95e09/0-20250624091914-7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-rtfdY8/aztec-31337-2818537067-0x238b28fd473a035d549ac8c05c48f62b71d95e09/0-20250624091914-7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-rtfdY8/aztec-31337-2818537067-0x238b28fd473a035d549ac8c05c48f62b71d95e09/0-20250624091914-7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-rtfdY8/aztec-31337-2818537067-0x238b28fd473a035d549ac8c05c48f62b71d95e09/0-20250624091914-7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-rtfdY8/aztec-31337-2818537067-0x238b28fd473a035d549ac8c05c48f62b71d95e09/0-20250624091914-7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-rtfdY8/aztec-31337-2818537067-0x238b28fd473a035d549ac8c05c48f62b71d95e09/0-20250624091914-7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b/l1-to-l2-message-tree.db"}},"downloadPaths":{"archiver":"/tmp/rerun-data-C5aJg0/download-WW5ijZ/archiver.db","nullifier-tree":"/tmp/rerun-data-C5aJg0/download-WW5ijZ/nullifier-tree.db","public-data-tree":"/tmp/rerun-data-C5aJg0/download-WW5ijZ/public-data-tree.db","note-hash-tree":"/tmp/rerun-data-C5aJg0/download-WW5ijZ/note-hash-tree.db","archive-tree":"/tmp/rerun-data-C5aJg0/download-WW5ijZ/archive-tree.db","l1-to-l2-message-tree":"/tmp/rerun-data-C5aJg0/download-WW5ijZ/l1-to-l2-message-tree.db"}} 09:19:31 [09:19:31.235] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Archiver database set up from snapshot {"path":"/tmp/rerun-data-C5aJg0/archiver","dbVersion":3,"rollupAddress":"0x238b28fd473a035d549ac8c05c48f62b71d95e09"} 09:19:31 [09:19:31.236] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database l1-to-l2-message-tree set up from snapshot {"path":"/tmp/rerun-data-C5aJg0/world_state/L1ToL2MessageTree","dbVersion":2,"rollupAddress":"0x238b28fd473a035d549ac8c05c48f62b71d95e09"} 09:19:31 [09:19:31.237] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database archive-tree set up from snapshot {"path":"/tmp/rerun-data-C5aJg0/world_state/ArchiveTree","dbVersion":2,"rollupAddress":"0x238b28fd473a035d549ac8c05c48f62b71d95e09"} 09:19:31 [09:19:31.238] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database public-data-tree set up from snapshot {"path":"/tmp/rerun-data-C5aJg0/world_state/PublicDataTree","dbVersion":2,"rollupAddress":"0x238b28fd473a035d549ac8c05c48f62b71d95e09"} 09:19:31 [09:19:31.239] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database note-hash-tree set up from snapshot {"path":"/tmp/rerun-data-C5aJg0/world_state/NoteHashTree","dbVersion":2,"rollupAddress":"0x238b28fd473a035d549ac8c05c48f62b71d95e09"} 09:19:31 [09:19:31.239] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database nullifier-tree set up from snapshot {"path":"/tmp/rerun-data-C5aJg0/world_state/NullifierTree","dbVersion":2,"rollupAddress":"0x238b28fd473a035d549ac8c05c48f62b71d95e09"} 09:19:31 [09:19:31.240] INFO: e2e:e2e_epochs:epochs_upload_failed_proof P2P database cleared {"path":"/tmp/rerun-data-C5aJg0/p2p"} 09:19:31 [09:19:31.241] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data from file:///tmp/failed-proofs-rtfdY8/aztec-31337-2818537067-0x238b28fd473a035d549ac8c05c48f62b71d95e09/0-20250624091914-7b877f9f-6dd5-4ba4-90b7-e8dde9d42a6b/data.bin to /tmp/rerun-download-ZFdovG/data.bin 09:19:31 [09:19:31.244] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Epoch proving job data for epoch 0 downloaded successfully 09:19:31 [09:19:31.245] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Rerunning proving job from /tmp/rerun-download-ZFdovG/data.bin 09:19:31 [09:19:31.246] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Using native ACVM binary at ../../noir/noir-repo/target/release/acvm with working directory /tmp/f5bf41ff/acvm 09:19:31 [09:19:31.250] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Loaded proving job data for epoch 0 09:19:31 [09:19:31.260] INFO: world-state:database Creating world state data store at directory /tmp/rerun-data-C5aJg0/world_state with map sizes {"archiveTreeMapSizeKb":1048576,"nullifierTreeMapSizeKb":1048576,"noteHashTreeMapSizeKb":1048576,"messageTreeMapSizeKb":1048576,"publicDataTreeMapSizeKb":1048576} and 2 threads. 09:19:31 [09:19:31.287] INFO: archiver:lmdb Creating archiver data store at directory /tmp/rerun-data-C5aJg0/archiver with map size 1048576 KB (LMDB v2) 09:19:31 [09:19:31.291] INFO: archiver:lmdb Starting data store with maxReaders 16 09:19:31 [09:19:31.295] WARN: prover-client:proving-broker-database Found invalid epoch directory /tmp/rerun-data-C5aJg0/archiver when loading epoch databases, ignoring 09:19:31 [09:19:31.295] WARN: prover-client:proving-broker-database Found invalid epoch directory /tmp/rerun-data-C5aJg0/world_state when loading epoch databases, ignoring 09:19:31 [09:19:31.296] INFO: prover-client:proving-broker Proving Broker started 09:19:31 [09:19:31.297] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Rerunning epoch proving job for epoch 0 09:19:31 [09:19:31.297] INFO: prover-node:epoch-proving-job Starting epoch 0 proving job with blocks 1 to 2 {"fromBlock":1,"toBlock":2,"epochSizeBlocks":2,"epochNumber":0,"uuid":"1d4aafd0-13f4-4254-b348-e68e2168a0a1"} 09:19:31 [09:19:31.322] INFO: prover-client:orchestrator Starting epoch 0 with 2 blocks 09:19:31 [09:19:31.322] VERBOSE: prover-client:broker-circuit-prover-facade Starting BrokerCircuitProverFacade 09:19:31 [09:19:31.325] VERBOSE: prover-node:epoch-proving-job Starting processing block 1 {"number":1,"blockHash":"0x2d45391f22d30becef6ce17a91bc600504d04cac09be91a17af528256c9150b6","lastArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"1d4aafd0-13f4-4254-b348-e68e2168a0a1","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x00000000000000000000000000000000000000000000000000000000a7ff766b","blockNumber":1,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 09:19:31 [09:19:31.325] INFO: prover-client:orchestrator Starting block 1 for slot 2 09:19:31 [09:19:31.326] VERBOSE: prover-node:epoch-proving-job Starting processing block 2 {"number":2,"blockHash":"0x25e5c9b02e7ecb024ce0ad801d96c946e7253b64764ebabe3d68caa9f22fecc4","lastArchive":"0x12b685b35f59219839311c0fea851e8785c6dc0cf5d7fba1556451bcde5b04b9","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"1d4aafd0-13f4-4254-b348-e68e2168a0a1","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x00000000000000000000000000000000000000000000000000000000a7ff766b","blockNumber":2,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000003","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 09:19:31 [09:19:31.326] INFO: prover-client:orchestrator Starting block 2 for slot 3 09:19:31 [09:19:31.343] INFO: prover-client:proving-broker New proving job id=0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5 epochNumber=0 {"provingJobId":"0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5"} 09:19:31 [09:19:31.344] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5","provingJobType":"BASE_PARITY"} 09:19:31 [09:19:31.344] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5","provingJobType":"BASE_PARITY"} 09:19:31 [09:19:31.345] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5","provingJobType":"BASE_PARITY"} 09:19:31 [09:19:31.349] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000025021000001288486s {"duration":0.000025021000001288486,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 09:19:31 [09:19:31.349] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 09:19:31 [09:19:31.350] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5","provingJobType":"BASE_PARITY"} 09:19:31 [09:19:31.350] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5","provingJobType":"BASE_PARITY"} 09:19:31 [09:19:31.350] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5","provingJobType":"BASE_PARITY"} 09:19:31 [09:19:31.351] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5","provingJobType":"BASE_PARITY"} 09:19:31 [09:19:31.351] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 1 {"blockNumber":1,"blockHash":"0x2d45391f22d30becef6ce17a91bc600504d04cac09be91a17af528256c9150b6","uuid":"1d4aafd0-13f4-4254-b348-e68e2168a0a1"} 09:19:31 [09:19:31.351] VERBOSE: prover-client:orchestrator Block 1 completed. Assembling header. 09:19:31 [09:19:31.356] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000016179999998712446s {"duration":0.000016179999998712446,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 09:19:31 [09:19:31.356] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 09:19:31 [09:19:31.356] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 2 {"blockNumber":2,"blockHash":"0x25e5c9b02e7ecb024ce0ad801d96c946e7253b64764ebabe3d68caa9f22fecc4","uuid":"1d4aafd0-13f4-4254-b348-e68e2168a0a1"} 09:19:31 [09:19:31.357] VERBOSE: prover-client:orchestrator Block 2 completed. Assembling header. 09:19:31 [09:19:31.363] VERBOSE: prover-client:orchestrator Updating archive tree with block 1 header 0x2d45391f22d30becef6ce17a91bc600504d04cac09be91a17af528256c9150b6 09:19:31 [09:19:31.370] VERBOSE: prover-client:orchestrator Updating archive tree with block 2 header 0x25e5c9b02e7ecb024ce0ad801d96c946e7253b64764ebabe3d68caa9f22fecc4 09:19:31 [09:19:31.373] VERBOSE: prover-client:orchestrator Orchestrator finalised block 1 09:19:31 [09:19:31.384] VERBOSE: prover-client:orchestrator Orchestrator finalised block 2 09:19:31 [09:19:31.401] INFO: prover-client:proving-broker-database Creating broker database for epoch 0 at /tmp/rerun-data-C5aJg0/0 with map size 1048576 09:19:31 [09:19:31.412] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:19:31 [09:19:31.417] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5 type=BASE_PARITY epochNumber=0 {"provingJobId":"0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5","provingJobType":"BASE_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...","status":"not-found","numOutstandingJobs":1} 09:19:31 [09:19:31.503] INFO: prover-client:proving-agent Starting job id=0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5 type=BASE_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input... 09:19:31 [09:19:31.504] INFO: prover-client:proving-agent:job-controller-0ea06b1b Job controller started jobId=0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5 {"jobId":"0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5"} 09:19:31 [09:19:31.591] INFO: prover-client:proving-agent Job id=0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5 type=BASE_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22resul... 09:19:31 [09:19:31.592] INFO: prover-client:proving-broker Proving job complete id=0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5 type=BASE_PARITY totalAttempts=1 {"provingJobId":"0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5"} 09:19:32 [09:19:32.324] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 09:19:32 [09:19:32.325] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:BASE_PARITY:44a5893e3d3815f5ec12b8973b6ef9402ccc296d8ce4c37a35fa66a9731330c5 type=BASE_PARITY 09:19:32 [09:19:32.326] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 09:19:32 [09:19:32.338] INFO: prover-client:proving-broker New proving job id=0:ROOT_PARITY:e811e7ef2af8d2ea051872b4690cf1c849702f5df90d06b3f53a70a23d93fee4 epochNumber=0 {"provingJobId":"0:ROOT_PARITY:e811e7ef2af8d2ea051872b4690cf1c849702f5df90d06b3f53a70a23d93fee4"} 09:19:32 [09:19:32.345] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:ROOT_PARITY:e811e7ef2af8d2ea051872b4690cf1c849702f5df90d06b3f53a70a23d93fee4 type=ROOT_PARITY {"provingJobId":"0:ROOT_PARITY:e811e7ef2af8d2ea051872b4690cf1c849702f5df90d06b3f53a70a23d93fee4","provingJobType":"ROOT_PARITY"} 09:19:32 [09:19:32.391] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_PARITY:e811e7ef2af8d2ea051872b4690cf1c849702f5df90d06b3f53a70a23d93fee4 type=ROOT_PARITY epochNumber=0 {"provingJobId":"0:ROOT_PARITY:e811e7ef2af8d2ea051872b4690cf1c849702f5df90d06b3f53a70a23d93fee4","provingJobType":"ROOT_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu...","status":"not-found","numOutstandingJobs":1} 09:19:32 [09:19:32.411] INFO: prover-client:proving-agent Starting job id=0:ROOT_PARITY:e811e7ef2af8d2ea051872b4690cf1c849702f5df90d06b3f53a70a23d93fee4 type=ROOT_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu... 09:19:32 [09:19:32.437] INFO: prover-client:proving-agent:job-controller-b2411c5b Job controller started jobId=0:ROOT_PARITY:e811e7ef2af8d2ea051872b4690cf1c849702f5df90d06b3f53a70a23d93fee4 {"jobId":"0:ROOT_PARITY:e811e7ef2af8d2ea051872b4690cf1c849702f5df90d06b3f53a70a23d93fee4"} 09:19:32 [09:19:32.559] INFO: prover-client:proving-agent Job id=0:ROOT_PARITY:e811e7ef2af8d2ea051872b4690cf1c849702f5df90d06b3f53a70a23d93fee4 type=ROOT_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22resu... 09:19:32 [09:19:32.560] INFO: prover-client:proving-broker Proving job complete id=0:ROOT_PARITY:e811e7ef2af8d2ea051872b4690cf1c849702f5df90d06b3f53a70a23d93fee4 type=ROOT_PARITY totalAttempts=1 {"provingJobId":"0:ROOT_PARITY:e811e7ef2af8d2ea051872b4690cf1c849702f5df90d06b3f53a70a23d93fee4"} 09:19:33 [09:19:33.327] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 09:19:33 [09:19:33.328] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:ROOT_PARITY:e811e7ef2af8d2ea051872b4690cf1c849702f5df90d06b3f53a70a23d93fee4 type=ROOT_PARITY 09:19:33 [09:19:33.329] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 09:19:33 [09:19:33.345] INFO: prover-client:proving-broker New proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:4dedf402160cfbdf2d4bfa047375d11f2f24b782af1949fae52ccb713baa5a51 epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:4dedf402160cfbdf2d4bfa047375d11f2f24b782af1949fae52ccb713baa5a51"} 09:19:33 [09:19:33.349] INFO: prover-client:proving-broker New proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:9ce1cd57defe383b5c451907eea36ac0cf9641b364b2456bdbeb478bd8852b4b epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:9ce1cd57defe383b5c451907eea36ac0cf9641b364b2456bdbeb478bd8852b4b"} 09:19:33 [09:19:33.397] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:EMPTY_BLOCK_ROOT_ROLLUP:4dedf402160cfbdf2d4bfa047375d11f2f24b782af1949fae52ccb713baa5a51 type=EMPTY_BLOCK_ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:4dedf402160cfbdf2d4bfa047375d11f2f24b782af1949fae52ccb713baa5a51","provingJobType":"EMPTY_BLOCK_ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input...","status":"not-found","numOutstandingJobs":2} 09:19:33 [09:19:33.398] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:EMPTY_BLOCK_ROOT_ROLLUP:9ce1cd57defe383b5c451907eea36ac0cf9641b364b2456bdbeb478bd8852b4b type=EMPTY_BLOCK_ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:9ce1cd57defe383b5c451907eea36ac0cf9641b364b2456bdbeb478bd8852b4b","provingJobType":"EMPTY_BLOCK_ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input...","status":"not-found","numOutstandingJobs":2} 09:19:33 [09:19:33.417] INFO: prover-client:proving-agent Starting job id=0:EMPTY_BLOCK_ROOT_ROLLUP:4dedf402160cfbdf2d4bfa047375d11f2f24b782af1949fae52ccb713baa5a51 type=EMPTY_BLOCK_ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input... 09:19:33 [09:19:33.426] INFO: prover-client:proving-agent:job-controller-38a330ac Job controller started jobId=0:EMPTY_BLOCK_ROOT_ROLLUP:4dedf402160cfbdf2d4bfa047375d11f2f24b782af1949fae52ccb713baa5a51 {"jobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:4dedf402160cfbdf2d4bfa047375d11f2f24b782af1949fae52ccb713baa5a51"} 09:19:33 [09:19:33.473] INFO: prover-client:proving-agent Starting job id=0:EMPTY_BLOCK_ROOT_ROLLUP:9ce1cd57defe383b5c451907eea36ac0cf9641b364b2456bdbeb478bd8852b4b type=EMPTY_BLOCK_ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input... 09:19:33 [09:19:33.483] INFO: prover-client:proving-agent:job-controller-17775d13 Job controller started jobId=0:EMPTY_BLOCK_ROOT_ROLLUP:9ce1cd57defe383b5c451907eea36ac0cf9641b364b2456bdbeb478bd8852b4b {"jobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:9ce1cd57defe383b5c451907eea36ac0cf9641b364b2456bdbeb478bd8852b4b"} 09:19:34 [09:19:34.776] INFO: prover-client:proving-agent Job id=0:EMPTY_BLOCK_ROOT_ROLLUP:4dedf402160cfbdf2d4bfa047375d11f2f24b782af1949fae52ccb713baa5a51 type=EMPTY_BLOCK_ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22resul... 09:19:34 [09:19:34.777] INFO: prover-client:proving-broker Proving job complete id=0:EMPTY_BLOCK_ROOT_ROLLUP:4dedf402160cfbdf2d4bfa047375d11f2f24b782af1949fae52ccb713baa5a51 type=EMPTY_BLOCK_ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:4dedf402160cfbdf2d4bfa047375d11f2f24b782af1949fae52ccb713baa5a51"} 09:19:35 [09:19:35.608] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 2, total jobs ready: 1 09:19:35 [09:19:35.617] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:4dedf402160cfbdf2d4bfa047375d11f2f24b782af1949fae52ccb713baa5a51 type=EMPTY_BLOCK_ROOT_ROLLUP 09:19:35 [09:19:35.618] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 09:19:37 [09:19:37.000] INFO: prover-client:proving-agent Job id=0:EMPTY_BLOCK_ROOT_ROLLUP:9ce1cd57defe383b5c451907eea36ac0cf9641b364b2456bdbeb478bd8852b4b type=EMPTY_BLOCK_ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22resul... 09:19:37 [09:19:37.000] INFO: prover-client:proving-broker Proving job complete id=0:EMPTY_BLOCK_ROOT_ROLLUP:9ce1cd57defe383b5c451907eea36ac0cf9641b364b2456bdbeb478bd8852b4b type=EMPTY_BLOCK_ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:9ce1cd57defe383b5c451907eea36ac0cf9641b364b2456bdbeb478bd8852b4b"} 09:19:37 [09:19:37.620] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 09:19:37 [09:19:37.622] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:9ce1cd57defe383b5c451907eea36ac0cf9641b364b2456bdbeb478bd8852b4b type=EMPTY_BLOCK_ROOT_ROLLUP 09:19:37 [09:19:37.623] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 09:19:37 [09:19:37.638] INFO: prover-client:proving-broker New proving job id=0:ROOT_ROLLUP:77a1b044c8036e3dda7adccb66847170b811ed9f69903142af7208d776eefc7d epochNumber=0 {"provingJobId":"0:ROOT_ROLLUP:77a1b044c8036e3dda7adccb66847170b811ed9f69903142af7208d776eefc7d"} 09:19:37 [09:19:37.690] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_ROLLUP:77a1b044c8036e3dda7adccb66847170b811ed9f69903142af7208d776eefc7d type=ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:ROOT_ROLLUP:77a1b044c8036e3dda7adccb66847170b811ed9f69903142af7208d776eefc7d","provingJobType":"ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22input...","status":"not-found","numOutstandingJobs":1} 09:19:37 [09:19:37.699] INFO: prover-client:proving-agent Starting job id=0:ROOT_ROLLUP:77a1b044c8036e3dda7adccb66847170b811ed9f69903142af7208d776eefc7d type=ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22input... 09:19:37 [09:19:37.716] INFO: prover-client:proving-agent:job-controller-7a9820fe Job controller started jobId=0:ROOT_ROLLUP:77a1b044c8036e3dda7adccb66847170b811ed9f69903142af7208d776eefc7d {"jobId":"0:ROOT_ROLLUP:77a1b044c8036e3dda7adccb66847170b811ed9f69903142af7208d776eefc7d"} 09:19:37 [09:19:37.862] INFO: prover-client:proving-agent Job id=0:ROOT_ROLLUP:77a1b044c8036e3dda7adccb66847170b811ed9f69903142af7208d776eefc7d type=ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22resul... 09:19:37 [09:19:37.862] INFO: prover-client:proving-broker Proving job complete id=0:ROOT_ROLLUP:77a1b044c8036e3dda7adccb66847170b811ed9f69903142af7208d776eefc7d type=ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:ROOT_ROLLUP:77a1b044c8036e3dda7adccb66847170b811ed9f69903142af7208d776eefc7d"} 09:19:38 [09:19:38.625] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 09:19:38 [09:19:38.627] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:ROOT_ROLLUP:77a1b044c8036e3dda7adccb66847170b811ed9f69903142af7208d776eefc7d type=ROOT_ROLLUP 09:19:38 [09:19:38.628] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 09:19:38 [09:19:38.630] VERBOSE: prover-client:orchestrator Orchestrator completed root rollup for epoch 0 09:19:38 [09:19:38.633] INFO: prover-node:epoch-proving-job Finalised proof for epoch 0 {"epochNumber":0,"uuid":"1d4aafd0-13f4-4254-b348-e68e2168a0a1","duration":7335.340615000001} 09:19:38 [09:19:38.634] INFO: prover-node:epoch-proving-job Submitted proof for epoch 0 (blocks 1 to 2) {"epochNumber":0,"uuid":"1d4aafd0-13f4-4254-b348-e68e2168a0a1"} 09:19:38 [09:19:38.634] VERBOSE: prover-client:broker-circuit-prover-facade Stopping BrokerCircuitProverFacade 09:19:38 [09:19:38.634] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Completed job for epoch 0 with status completed 09:19:38 [09:19:38.634] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Test succeeded 09:19:38 [09:19:38.635] INFO: prover-node:prover-node Stopping ProverNode 09:19:38 [09:19:38.636] WARN: prover-node:prover-node Running promise was not started 09:19:38 [09:19:38.636] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 09:19:38 [09:19:38.636] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 09:19:38 [09:19:38.636] WARN: archiver:prover-node Running promise was not started 09:19:38 [09:19:38.636] INFO: archiver:prover-node Stopped. 09:19:38 [09:19:38.637] WARN: world-state:block_stream:prover-node Running promise was not started 09:19:38 [09:19:38.637] INFO: world_state:prover-node Stopped world state synchronizer 09:19:38 [09:19:38.637] INFO: prover-node:prover-node Stopped ProverNode 09:19:38 [09:19:38.637] INFO: node:MAIN-aztec-node Stopping Aztec Node 09:19:40 [09:19:40.638] INFO: slasher Slasher client stopped. 09:19:40 [09:19:40.639] WARN: validator Running promise was not started 09:19:40 [09:19:40.641] WARN: sequencer Running promise was not started 09:19:40 [09:19:40.641] INFO: sequencer Stopped sequencer 09:19:40 [09:19:40.641] WARN: p2p:l2-block-stream Running promise was not started 09:19:40 [09:19:40.641] INFO: p2p P2P client stopped 09:19:40 [09:19:40.641] WARN: world-state:block_stream Running promise was not started 09:19:40 [09:19:40.641] INFO: world_state Stopped world state synchronizer 09:19:40 [09:19:40.642] WARN: archiver Running promise was not started 09:19:40 [09:19:40.642] INFO: archiver Stopped. 09:19:40 [09:19:40.642] INFO: node:MAIN-aztec-node Stopped Aztec Node 09:19:40 [09:19:40.644] INFO: node:MAIN-aztec-node Stopping Aztec Node 09:19:42 [09:19:42.645] INFO: slasher Slasher client stopped. 09:19:42 [09:19:42.645] WARN: validator Running promise was not started 09:19:42 [09:19:42.646] WARN: sequencer Running promise was not started 09:19:42 [09:19:42.646] INFO: sequencer Stopped sequencer 09:19:42 [09:19:42.646] WARN: p2p:l2-block-stream Running promise was not started 09:19:42 [09:19:42.646] INFO: p2p P2P client stopped 09:19:42 [09:19:42.647] WARN: world-state:block_stream Running promise was not started 09:19:42 [09:19:42.647] INFO: world_state Stopped world state synchronizer 09:19:42 [09:19:42.647] WARN: archiver Running promise was not started 09:19:42 [09:19:42.647] INFO: archiver Stopped. 09:19:42 [09:19:42.647] INFO: node:MAIN-aztec-node Stopped Aztec Node 09:19:42 [09:19:42.648] INFO: prover-node:prover-node Stopping ProverNode 09:19:42 [09:19:42.648] WARN: prover-node:prover-node Running promise was not started 09:19:42 [09:19:42.648] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 09:19:42 [09:19:42.648] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 09:19:42 [09:19:42.649] WARN: archiver:prover-node Running promise was not started 09:19:42 [09:19:42.649] INFO: archiver:prover-node Stopped. 09:19:42 [09:19:42.649] WARN: world-state:block_stream:prover-node Running promise was not started 09:19:42 [09:19:42.649] INFO: world_state:prover-node Stopped world state synchronizer 09:19:42 [09:19:42.651] INFO: prover-node:prover-node Stopped ProverNode 09:19:42 [09:19:42.653] INFO: blob-sink:server Stopping blob sink 09:19:42 [09:19:42.653] INFO: blob-sink:server Blob sink already stopped 09:19:42 PASS src/e2e_epochs/epochs_upload_failed_proof.test.ts 09:19:42 e2e_epochs/epochs_upload_failed_proof 09:19:42 uploads failed proving job state and re-runs it on a fresh instance (55050 ms) 09:19:42 09:19:42 Test Suites: 1 passed, 1 total 09:19:42 Tests: 1 passed, 1 total 09:19:42 Snapshots: 0 total 09:19:42 Time: 63.071 s 09:19:42 Ran all test suites matching src/e2e_epochs/epochs_upload_failed_proof.test.ts. 09:19:42 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?