ACI ·

Parent Log: http://ci.aztec-labs.com/2a913f9c1a30a1e1 Command: 13dd8684e4e32fd7:ISOLATE=1:NAME=e2e_epochs/epochs_upload_failed_proof yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_upload_failed_proof.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/1c9ca312bfdace816082212846900a49694e1e50 Env: REF_NAME=gh-readonly-queue/next/pr-15182-af094bce13530e078c78de9f3264280e6693d533 CURRENT_VERSION=0.87.6 CI_FULL=1 Date: Tue Jun 24 08:51:28 UTC 2025 System: ARCH=amd64 CPUS=128 MEM=493Gi HOSTNAME=pr-15182_amd64_x4-full Resources: CPU_LIST=0-127 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_476a42720cde10eb_next 08:51:28 +++ id -u 08:51:28 +++ id -g 08:51:28 ++ docker run -d --name e2e_epochs_epochs_upload_failed_proof --net=none --cpuset-cpus=0-127 --cpus=2 --memory=8g --user 1000:1000 -v/home/aztec-dev:/home/aztec-dev --mount type=tmpfs,target=/tmp,tmpfs-size=1g --workdir /home/aztec-dev/aztec-packages -e HOME -e VERBOSE -e GIT_CONFIG_GLOBAL=/home/aztec-dev/aztec-packages/build-images/src/home/.gitconfig -e FORCE_COLOR=true -e CPUS -e MEM aztecprotocol/build:3.0 /bin/bash -c 'timeout -v 600s bash -c '\''yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_upload_failed_proof.test.ts'\''' 08:51:29 + cid=150e3728896b1c3056000ab0ad920f9c4be7a465d3b2180f06fe91d7761d8d68 08:51:29 + set +x 08:51:30 {"level":25,"time":1750755090366,"pid":12,"hostname":"150e3728896b","module":"logger","msg":"Logger initialized with level verbose"} 08:51:38 [08:51:38.725] INFO: e2e:epochs_upload_failed_proof Running test: e2e_epochs/epochs_upload_failed_proof uploads failed proving job state and re-runs it on a fresh instance 08:51:38 [08:51:38.899] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Logging metrics to log/e2e_epochs_epochs_upload_failed_proof.jsonl 08:51:39 [08:51:39.202] WARN: ethereum:cheat_codes Set L1 automine to true 08:51:39 [08:51:39.236] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Sent 0.1 ETH to deployer {"deployer":"0x05f32b3cc3888453ff71b01135b34ff8e41263f2","value":100000000000000000} 08:51:39 [08:51:39.250] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Sent 0.1 ETH to deployer {"deployer":"0x05f32b3cc3888453ff71b01135b34ff8e41263f2","value":100000000000000000} 08:51:39 [08:51:39.260] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Multicall3 08:51:39 [08:51:39.262] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Calling anvil_setBlockTimestampInterval with params: [8] 08:51:39 [08:51:39.264] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Set block interval to 8 08:51:39 [08:51:39.264] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contracts from 0xf39Fd6e51aad88F6F4ce6aB8827279cffFb92266 08:51:39 [08:51:39.266] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 08:51:39 [08:51:39.314] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x8166bb789c828e492198babef9becf8ac44628f059d48e6f68114a9ae2ade6ec {"gasLimit":867658,"maxFeePerGas":"120.351651125","maxPriorityFeePerGas":"118.94979"} 08:51:39 [08:51:39.314] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xB8999345dA8041f1Da51ac5179B1F055A560f397 in tx 0x8166bb789c828e492198babef9becf8ac44628f059d48e6f68114a9ae2ade6ec. 08:51:39 [08:51:39.316] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Fee Asset at 0xb8999345da8041f1da51ac5179b1f055a560f397 08:51:39 [08:51:39.316] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 08:51:39 [08:51:39.344] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x07d928293fb6819e2a8abf9d0b32b04560f633065cf07cefb5dcf9ca71af1db2 {"gasLimit":867644,"maxFeePerGas":"143.976575211","maxPriorityFeePerGas":"142.739748"} 08:51:39 [08:51:39.344] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xBb9e13665Cfb3d531F288a11E7312b6b91C59292 in tx 0x07d928293fb6819e2a8abf9d0b32b04560f633065cf07cefb5dcf9ca71af1db2. 08:51:39 [08:51:39.345] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Staking Asset at 0xbb9e13665cfb3d531f288a11e7312b6b91c59292 08:51:39 [08:51:39.346] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 08:51:39 [08:51:39.375] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xd90adcaa1621a861dd7b09565f9dc422367574ea376355a4c91cd87ed3fbfeba {"gasLimit":3252094,"maxFeePerGas":"172.377275728","maxPriorityFeePerGas":"171.2876976"} 08:51:39 [08:51:39.375] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x6f26a1916Df432654607f9c75b764e535e65cf3e in tx 0xd90adcaa1621a861dd7b09565f9dc422367574ea376355a4c91cd87ed3fbfeba. 08:51:39 [08:51:39.376] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed GSE at 0x6f26a1916df432654607f9c75b764e535e65cf3e 08:51:39 [08:51:39.377] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 08:51:39 [08:51:39.410] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xc6bb96b972383aade82d230cb0c861a0362867228d18483a86f9e4a83b780d2d {"gasLimit":1081864,"maxFeePerGas":"206.505096634","maxPriorityFeePerGas":"205.54523712"} 08:51:39 [08:51:39.411] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x3C709AFec1acEaE522c13145005De788a3CC65c8 in tx 0xc6bb96b972383aade82d230cb0c861a0362867228d18483a86f9e4a83b780d2d. 08:51:39 [08:51:39.412] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Registry at 0x3c709afec1aceae522c13145005de788a3cc65c8 08:51:39 [08:51:39.412] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 08:51:39 [08:51:39.450] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xf8dde39eb44898986f540429eb4a3f0eeec377763a24054290d85bb8101ac8e4 {"gasLimit":2232036,"maxFeePerGas":"247.515532347","maxPriorityFeePerGas":"246.654284544"} 08:51:39 [08:51:39.451] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xEDE9b34af448F9261efea2DafB2364866b09E01A in tx 0xf8dde39eb44898986f540429eb4a3f0eeec377763a24054290d85bb8101ac8e4. 08:51:39 [08:51:39.452] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed GovernanceProposer at 0xede9b34af448f9261efea2dafb2364866b09e01a 08:51:39 [08:51:39.452] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 08:51:39 [08:51:39.488] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xaf7178913b5905e53367fb0465133faf75227c51bf46428c817f48a06700bb71 {"gasLimit":3092007,"maxFeePerGas":"296.745116241","maxPriorityFeePerGas":"295.985141452"} 08:51:39 [08:51:39.489] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xa49A3d51a71916F87d60f0e919Fb66E4b933b4df in tx 0xaf7178913b5905e53367fb0465133faf75227c51bf46428c817f48a06700bb71. 08:51:39 [08:51:39.490] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Governance at 0xa49a3d51a71916f87d60f0e919fb66e4b933b4df 08:51:39 [08:51:39.520] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x12d6424d782ad27b9fe44dec1624cf29720992859e74e4ee26f6a49bf5e682cc {"gasLimit":100000,"maxFeePerGas":"355.858763396","maxPriorityFeePerGas":"355.182169742"} 08:51:39 [08:51:39.521] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Set governance on GSE in 0x12d6424d782ad27b9fe44dec1624cf29720992859e74e4ee26f6a49bf5e682cc 08:51:39 [08:51:39.521] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 08:51:39 [08:51:39.544] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x593e4091a1e08f47177928f9a458263f67a911112187ec79e9a4bc019be7546f {"gasLimit":397405,"maxFeePerGas":"426.824946124","maxPriorityFeePerGas":"426.21860369"} 08:51:39 [08:51:39.544] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x705baA0D3bF675F9B7F169fd5FEA260c436Cd50c in tx 0x593e4091a1e08f47177928f9a458263f67a911112187ec79e9a4bc019be7546f. 08:51:39 [08:51:39.545] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed CoinIssuer at 0x705baa0d3bf675f9b7f169fd5fea260c436cd50c 08:51:39 [08:51:39.545] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for deployments to complete 08:51:39 [08:51:39.545] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 7 transactions to be mined... 08:51:39 [08:51:39.599] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 08:51:39 [08:51:39.609] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x5d6132645b455679b93fe6fc019047a89d80cbc5fb7cbc890344c07a449854fc {"gasLimit":100000,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 08:51:39 [08:51:39.610] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added coin issuer 0x705baa0d3bf675f9b7f169fd5fea260c436cd50c as minter on fee asset in 0x5d6132645b455679b93fe6fc019047a89d80cbc5fb7cbc890344c07a449854fc 08:51:39 [08:51:39.627] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xd01ce626c7c7ee3a243b24780a9fd0dc5184345d6bec4ec1cc5aafc15402dc62 {"gasLimit":56661,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 08:51:39 [08:51:39.630] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 08:51:39 [08:51:39.648] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x100b31bd1e3992df58985c26db7e5351f01cbb7b9c2e961c411c57733fb6cfa5 {"gasLimit":344517,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 08:51:39 [08:51:39.648] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xB4fF23c4B1E2Bc7C86090d4FBDa21A457ee6727F in tx 0x100b31bd1e3992df58985c26db7e5351f01cbb7b9c2e961c411c57733fb6cfa5. 08:51:39 [08:51:39.649] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed FeeAssetHandler at 0xb4ff23c4b1e2bc7c86090d4fbda21a457ee6727f 08:51:39 [08:51:39.669] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xc451aae80a23ef806a4bacf2e291d1c2ae150b6200ea2ea4e841b119a7e7c28b {"gasLimit":56804,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 08:51:39 [08:51:39.670] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added fee asset handler 0xb4ff23c4b1e2bc7c86090d4fbda21a457ee6727f as minter on fee asset in 0xc451aae80a23ef806a4bacf2e291d1c2ae150b6200ea2ea4e841b119a7e7c28b 08:51:39 [08:51:39.671] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 08:51:39 [08:51:39.708] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x1faf8bcc8977c90fecabc48f92ddae8dbb0acd71a8ae2fde378732b4f5280dfb {"gasLimit":2434549,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 08:51:39 [08:51:39.712] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xD8C49C848A06990E1B1Ad8DF26dbc5725b657aCA in tx 0x1faf8bcc8977c90fecabc48f92ddae8dbb0acd71a8ae2fde378732b4f5280dfb. 08:51:39 [08:51:39.713] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed StakingAssetHandler at 0xd8c49c848a06990e1b1ad8df26dbc5725b657aca 08:51:39 [08:51:39.736] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x79eec47a96882b804264d6c66ccded4e9ed9ee94a3f9212268001418f61c01b6 {"gasLimit":56804,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 08:51:39 [08:51:39.737] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added staking asset handler 0xd8c49c848a06990e1b1ad8df26dbc5725b657aca as minter on staking asset in 0x79eec47a96882b804264d6c66ccded4e9ed9ee94a3f9212268001418f61c01b6 08:51:39 [08:51:39.737] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for deployments to complete 08:51:39 [08:51:39.737] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 9 transactions to be mined... 08:51:39 [08:51:39.770] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 08:51:39 [08:51:39.787] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed shared contracts 08:51:39 [08:51:39.819] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x3a452c44942037f215b905f38ac51163490a9b231c6bd08b7e958ae2dd00642b {"gasLimit":84837,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 08:51:39 [08:51:39.819] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Funded reward distributor with 10000000000000000000000000 fee asset in 0x3a452c44942037f215b905f38ac51163490a9b231c6bd08b7e958ae2dd00642b 08:51:39 [08:51:39.826] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 08:51:39 [08:51:39.844] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x6732a13052b668b6ed53c2db691f949dc5751b43ca937a6796aab9388f3cb12a {"gasLimit":154658,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 08:51:39 [08:51:39.845] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x277E22B0C9698d7f2A1cD7C6d857511617587309 in tx 0x6732a13052b668b6ed53c2db691f949dc5751b43ca937a6796aab9388f3cb12a. 08:51:39 [08:51:39.845] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup will use the mock verifier at 0x277e22b0c9698d7f2a1cd7c6d857511617587309 08:51:39 [08:51:39.846] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup config args {"aztecSlotDuration":16,"aztecEpochDuration":4,"targetCommitteeSize":0,"aztecProofSubmissionEpochs":1,"slashingQuorum":6,"slashingRoundSize":10,"manaTarget":10000000000,"entryQueueFlushSizeMin":48,"entryQueueFlushSizeQuotient":2,"provingCostPerMana":100,"rewardConfig":{"sequencerBps":5000,"increment":200000,"maxScore":5000000,"a":5000,"k":1000000,"minimum":100000,"rewardDistributor":"0x4a51916a6b10a43f6565042be5b6b69d8d613f64"}} 08:51:39 [08:51:39.846] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 08:51:39 [08:51:39.865] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x41f1a97b4169402d8ffffe2c1e10e4208f2cbb77f013e5d13b610e6af83d24f5 {"gasLimit":86992,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 08:51:39 [08:51:39.865] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x8036677644039d4E4b3C48DADc5de700c64ACe8f in tx 0x41f1a97b4169402d8ffffe2c1e10e4208f2cbb77f013e5d13b610e6af83d24f5. 08:51:39 [08:51:39.866] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 08:51:39 [08:51:39.913] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xe6ea7e3b8ed4d00f0a2db44996d4a8f19a743b75ae4885d46a4ce4cd6559eaf1 {"gasLimit":5125076,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 08:51:39 [08:51:39.914] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x76836C865645796c7eE9068efbDed634783a00AF in tx 0xe6ea7e3b8ed4d00f0a2db44996d4a8f19a743b75ae4885d46a4ce4cd6559eaf1. 08:51:39 [08:51:39.914] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 08:51:39 [08:51:39.962] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xb61d555a7dec6e9c985806cddb053e8d13705025eb222f14584644dbba2f1668 {"gasLimit":2891348,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 08:51:39 [08:51:39.963] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x48Bc5abFAa35F60Aec77dC10a45DA59e057BEF17 in tx 0xb61d555a7dec6e9c985806cddb053e8d13705025eb222f14584644dbba2f1668. 08:51:39 [08:51:39.964] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Awaiting for linked libraries to be deployed 08:51:39 [08:51:39.981] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 08:51:40 [08:51:40.049] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xb81201452611ce4fe464879341aa06e94b656c51f73517f6be905b84b3c470c7 {"gasLimit":11292829,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 08:51:40 [08:51:40.050] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xF4Bd81ec49Cd3f3486044A08459c4A23a778c850 in tx 0xb81201452611ce4fe464879341aa06e94b656c51f73517f6be905b84b3c470c7. 08:51:40 [08:51:40.051] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Rollup at 0xf4bd81ec49cd3f3486044a08459c4a23a778c850 {"aztecSlotDuration":16,"aztecEpochDuration":4,"targetCommitteeSize":0,"aztecProofSubmissionEpochs":1,"slashingQuorum":6,"slashingRoundSize":10,"manaTarget":10000000000,"entryQueueFlushSizeMin":48,"entryQueueFlushSizeQuotient":2,"provingCostPerMana":100,"rewardConfig":{"sequencerBps":5000,"increment":200000,"maxScore":5000000,"a":5000,"k":1000000,"minimum":100000,"rewardDistributor":"0x4a51916a6b10a43f6565042be5b6b69d8d613f64"}} 08:51:40 [08:51:40.051] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 11 transactions to be mined... 08:51:40 [08:51:40.093] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 08:51:40 [08:51:40.093] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof All core contracts have been deployed 08:51:40 [08:51:40.093] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 08:51:40 [08:51:40.118] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x300ecfcacf2d62308da99014e7d32e5cc99f6d0876386b723048f2f8cca173f2 {"gasLimit":1056482,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 08:51:40 [08:51:40.119] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xDd1d5D7719fc2112DC7E6d06287eCD355B4208a1 in tx 0x300ecfcacf2d62308da99014e7d32e5cc99f6d0876386b723048f2f8cca173f2. 08:51:40 [08:51:40.120] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed SlashFactory at 0xdd1d5d7719fc2112dc7e6d06287ecd355b4208a1 08:51:40 [08:51:40.157] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xb61f5fe3efefeb786e875b02bc2489dca56d6fbe720f3948ac63e08f800ea2b7 {"gasLimit":117006,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 08:51:40 [08:51:40.157] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Adding rollup 0xf4bd81ec49cd3f3486044a08459c4a23a778c850 to registry 0x3c709afec1aceae522c13145005de788a3cc65c8 in tx 0xb61f5fe3efefeb786e875b02bc2489dca56d6fbe720f3948ac63e08f800ea2b7 08:51:40 [08:51:40.176] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x3df8c5b8b001e2430e50f8fec901f49583b2f766fdd855e79f9c668937696e29 {"gasLimit":109478,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"} 08:51:40 [08:51:40.177] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Adding rollup 0xf4bd81ec49cd3f3486044a08459c4a23a778c850 to GSE 0x6f26a1916df432654607f9c75b764e535e65cf3e in tx 0x3df8c5b8b001e2430e50f8fec901f49583b2f766fdd855e79f9c668937696e29 08:51:40 [08:51:40.185] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 12 transactions to be mined... 08:51:40 [08:51:40.232] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 08:51:40 [08:51:40.244] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup deployed 08:51:40 [08:51:40.244] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for rollup and slash factory to be deployed 08:51:40 [08:51:40.245] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 12 transactions to be mined... 08:51:40 [08:51:40.285] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 08:51:40 [08:51:40.286] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof All transactions for L1 deployment have been mined 08:51:40 [08:51:40.314] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Aztec L1 contracts initialized {"registryAddress":"0x3c709afec1aceae522c13145005de788a3cc65c8","governanceAddress":"0xa49a3d51a71916f87d60f0e919fb66e4b933b4df","governanceProposerAddress":"0xede9b34af448f9261efea2dafb2364866b09e01a","rollupAddress":"0xf4bd81ec49cd3f3486044a08459c4a23a778c850","inboxAddress":"0x059129504d8dbc4535bc96ed8cfe7408f7cd28a8","outboxAddress":"0xad69a73f303d97324bbdbce0b350037c541528b3","feeJuicePortalAddress":"0xe834377c89a9933e74e9ef32f30c1a9830458418","feeJuiceAddress":"0xb8999345da8041f1da51ac5179b1f055a560f397","stakingAssetAddress":"0xbb9e13665cfb3d531f288a11e7312b6b91c59292","rewardDistributorAddress":"0x4a51916a6b10a43f6565042be5b6b69d8d613f64","gseAddress":"0x6f26a1916df432654607f9c75b764e535e65cf3e","coinIssuerAddress":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266"} 08:51:40 [08:51:40.314] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Handing over to governance 08:51:40 [08:51:40.321] WARN: ethereum:cheat_codes Set L1 automine to false 08:51:40 [08:51:40.322] WARN: ethereum:cheat_codes Set L1 interval mining to 8 seconds 08:51:40 [08:51:40.325] WARN: foundation:test-date-provider Time set to 2025-06-24T08:54:43.000Z {"offset":182675,"timeMs":1750755283000} 08:51:40 [08:51:40.332] INFO: aztecjs:utils:watcher Watcher not started because not auto mining 08:51:40 [08:51:40.333] INFO: telemetry:client Using NoopTelemetryClient 08:51:40 [08:51:40.336] INFO: kv-store:lmdb-v2:blob-sink Creating blob-sink data store at directory /tmp/d7ea4d2700fad48b/blob-sink with map size 134217728 KB (LMDB v2) 08:51:40 [08:51:40.349] INFO: kv-store:lmdb-v2:blob-sink Starting data store with maxReaders 16 08:51:40 [08:51:40.363] INFO: blob-sink:server Server is running on http://localhost:42493 08:51:40 [08:51:40.364] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating and synching an aztec node... 08:51:40 [08:51:40.377] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Using native ACVM binary at ../../noir/noir-repo/target/release/acvm with working directory /tmp/2eaa62a6/acvm 08:51:40 [08:51:40.380] INFO: node:blob-sink:client Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:42493"} 08:51:40 [08:51:40.424] VERBOSE: node:MAIN-aztec-node Snapshot sync is disabled. No snapshots URL provided. 08:51:40 [08:51:40.428] INFO: archiver:lmdb Creating archiver data store at directory /tmp/d7ea4d2700fad48b/archiver with map size 134217728 KB (LMDB v2) 08:51:40 [08:51:40.431] INFO: archiver:lmdb Starting data store with maxReaders 16 08:51:41 [08:51:41.448] INFO: node:blob-sink:client Testing configured blob sources {"blobSinkUrl":"http://localhost:42493"} 08:51:41 [08:51:41.475] INFO: node:blob-sink:client Blob sink is reachable {"blobSinkUrl":"http://localhost:42493"} 08:51:41 [08:51:41.475] WARN: node:blob-sink:client No L1 consensus host urls configured 08:51:41 [08:51:41.476] WARN: node:blob-sink:client No archive client configured 08:51:41 [08:51:41.479] INFO: archiver Starting archiver sync to rollup contract 0xf4bd81ec49cd3f3486044a08459c4a23a778c850 from L1 block 22 to current L1 block 25 with hash 0x2949c9886709b6ba2b13a37e22b68208c433cc791d68428af06e51d3b56a9368 {"blocksSynchedTo":22,"messagesSynchedTo":{"l1BlockHash":"0xa7a024b7247446f88df0916f052f39331e2838c419d6a7f1b7ee86811abe29cf","l1BlockNumber":22}} 08:51:41 [08:51:41.512] INFO: archiver Initial archiver sync to L1 block 25 complete. {"l1BlockNumber":25,"syncPoint":{"blocksSynchedTo":25},"latest":{"number":0},"proven":{"number":0},"finalized":{"number":0}} 08:51:41 [08:51:41.521] INFO: world-state:database Creating world state data store at directory /tmp/d7ea4d2700fad48b/world_state with map sizes {"archiveTreeMapSizeKb":134217728,"nullifierTreeMapSizeKb":134217728,"noteHashTreeMapSizeKb":134217728,"messageTreeMapSizeKb":134217728,"publicDataTreeMapSizeKb":134217728} and 2 threads. 08:51:41 [08:51:41.571] INFO: world_state Created world state synchroniser with block history of 2 08:51:41 [08:51:41.571] WARN: node:MAIN-aztec-node Aztec node is accepting fake proofs 08:51:41 [08:51:41.572] INFO: bb-prover:queued_ivc_verifier Starting QueuedIVCVerifier with 8 concurrent verifiers 08:51:41 [08:51:41.606] INFO: p2p:lmdb-v2 Creating p2p data store at directory /tmp/d7ea4d2700fad48b/p2p with map size 134217728 KB (LMDB v2) 08:51:41 [08:51:41.611] INFO: p2p:lmdb-v2 Starting data store with maxReaders 16 08:51:41 [08:51:41.615] INFO: p2p-archive:lmdb-v2 Creating p2p-archive data store at directory /tmp/d7ea4d2700fad48b/p2p-archive with map size 134217728 KB (LMDB v2) 08:51:41 [08:51:41.616] INFO: p2p-archive:lmdb-v2 Starting data store with maxReaders 16 08:51:41 [08:51:41.617] INFO: p2p-peer:lmdb-v2 Creating p2p-peers data store at directory /tmp/d7ea4d2700fad48b/p2p-peers with map size 134217728 KB (LMDB v2) 08:51:41 [08:51:41.618] INFO: p2p-peer:lmdb-v2 Starting data store with maxReaders 16 08:51:41 [08:51:41.620] INFO: p2p:tx_pool Setting maximum tx mempool size {"maxTxPoolSize":100000000} 08:51:41 [08:51:41.620] VERBOSE: p2p P2P is disabled. Using dummy P2P service. 08:51:41 [08:51:41.624] VERBOSE: world-state:block_stream Starting L2 block stream {"proven":false,"pollIntervalMS":50} 08:51:41 [08:51:41.625] INFO: world_state Started world state synchronizer from block 1 08:51:41 [08:51:41.628] VERBOSE: world-state:block_stream Starting sync from block number 0 08:51:41 [08:51:41.632] INFO: p2p Starting p2p client from block 0 with empty mempools 08:51:41 [08:51:41.632] VERBOSE: p2p:l2-block-stream Starting L2 block stream {"batchSize":20,"pollIntervalMS":100,"startingBlock":0} 08:51:42 [08:51:42.054] INFO: epoch-prune-watcher EpochPruneWatcher initialized 08:51:42 [08:51:42.116] VERBOSE: validator Initialized validator with addresses: 0x0d2d057454023bf035fb4144e6f5b5922b721bd5 08:51:42 [08:51:42.116] VERBOSE: node:MAIN-aztec-node All Aztec Node subsystems synced 08:51:42 [08:51:42.130] INFO: slasher Starting Slasher client... 08:51:42 [08:51:42.140] VERBOSE: p2p:l2-block-stream Starting sync from block number 0 08:51:42 [08:51:42.155] INFO: validator Started validator with addresses: 0x0d2d057454023bf035fb4144e6f5b5922b721bd5 08:51:42 [08:51:42.156] VERBOSE: validator Validators 0x0d2d057454023bf035fb4144e6f5b5922b721bd5 are not on the validator committee for epoch 0 08:51:42 [08:51:42.156] INFO: sequencer Sequencer config set {"transactionPollingIntervalMS":500,"maxTxsPerBlock":32,"minTxsPerBlock":0,"maxL2BlockGas":10000000000,"publishTxsWithProposals":false,"maxDABlockGas":10000000000,"acvmWorkingDirectory":"/tmp/2eaa62a6/acvm","acvmBinaryPath":"../../noir/noir-repo/target/release/acvm","maxBlockSizeInBytes":1048576,"governanceProposerPayload":"0x0000000000000000000000000000000000000000","maxL1TxInclusionTimeIntoSlot":8,"enforceTimeTable":false} 08:51:42 [08:51:42.157] VERBOSE: sequencer Sequencer timetable updated {"enforceTimeTable":false} 08:51:42 [08:51:42.159] INFO: sequencer Sequencer started with address 0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266 08:51:42 [08:51:42.160] VERBOSE: node:MAIN-aztec-node Sequencer started 08:51:42 [08:51:42.161] INFO: node:MAIN-aztec-node Aztec Node version: 0.87.6 08:51:42 [08:51:42.161] INFO: node:MAIN-aztec-node Aztec Node started on chain 0x7a69 {"registryAddress":"0x3c709afec1aceae522c13145005de788a3cc65c8","governanceAddress":"0xa49a3d51a71916f87d60f0e919fb66e4b933b4df","governanceProposerAddress":"0xede9b34af448f9261efea2dafb2364866b09e01a","rollupAddress":"0xf4bd81ec49cd3f3486044a08459c4a23a778c850","inboxAddress":"0x059129504d8dbc4535bc96ed8cfe7408f7cd28a8","outboxAddress":"0xad69a73f303d97324bbdbce0b350037c541528b3","feeJuicePortalAddress":"0xe834377c89a9933e74e9ef32f30c1a9830458418","feeJuiceAddress":"0xb8999345da8041f1da51ac5179b1f055a560f397","stakingAssetAddress":"0xbb9e13665cfb3d531f288a11e7312b6b91c59292","rewardDistributorAddress":"0x4a51916a6b10a43f6565042be5b6b69d8d613f64","gseAddress":"0x6f26a1916df432654607f9c75b764e535e65cf3e","coinIssuerAddress":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","slashFactoryAddress":"0xdd1d5d7719fc2112dc7e6d06287ecd355b4208a1","feeAssetHandlerAddress":"0xb4ff23c4b1e2bc7c86090d4fbda21a457ee6727f","stakingAssetHandlerAddress":"0xd8c49c848a06990e1b1ad8df26dbc5725b657aca","zkPassportVerifierAddress":"0xee9f10f38319eae2730dba28fb09081db806c5e5"} 08:51:42 [08:51:42.162] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating and syncing a simulated prover node... 08:51:42 [08:51:42.232] INFO: blob-sink:client:prover-node Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:42493"} 08:51:42 [08:51:42.242] INFO: archiver:lmdb:prover-node Creating archiver data store at directory /tmp/d7ea4d2700fad48b/700f42d803fb63f3/archiver with map size 134217728 KB (LMDB v2) 08:51:42 [08:51:42.258] INFO: archiver:lmdb:prover-node Starting data store with maxReaders 16 08:51:42 [08:51:42.324] VERBOSE: sequencer Preparing proposal for block 1 at slot 2 {"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750755291,"version":585319288},"chainTipArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","blockNumber":1,"slot":2} 08:51:42 [08:51:42.657] VERBOSE: block-builder Building block 1 for slot 2 {"slot":2,"slotStart":"2025-06-24T08:54:51.000Z","now":"2025-06-24T08:54:45.332Z","blockNumber":1,"msgCount":0,"initialStateReference":{"l1ToL2MessageTree":"0x2e33ee2008411c04b99c24b313513d097a0d21a5040b6193d1f978b8226892d6","noteHashTree":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTree":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTree":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9"},"initialArchiveRoot":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}} 08:51:42 [08:51:42.712] INFO: simulator:public-processor:prover-node Processed 0 successful txs and 0 failed txs in 0.048941334999999524s {"duration":0.048941334999999524,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 08:51:42 [08:51:42.802] INFO: blob-sink:client:prover-node Testing configured blob sources {"blobSinkUrl":"http://localhost:42493"} 08:51:42 [08:51:42.805] INFO: blob-sink:client:prover-node Blob sink is reachable {"blobSinkUrl":"http://localhost:42493"} 08:51:42 [08:51:42.805] WARN: blob-sink:client:prover-node No L1 consensus host urls configured 08:51:42 [08:51:42.806] WARN: blob-sink:client:prover-node No archive client configured 08:51:42 [08:51:42.807] INFO: sequencer Built block 1 for slot 2 with 0 txs and 0 messages. 0 mana/s {"blockHash":"0x2764b65e73dc21975fb06d05b21443f7691ed742789f694b182d728309198d38","globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750755291,"version":585319288},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":197.38332000000082,"publicProcessDuration":50.35719099999915,"rollupCircuitsDuration":185.374154000001,"txCount":0,"blockNumber":1,"blockTimestamp":1750755291,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 08:51:42 [08:51:42.814] INFO: archiver:prover-node Starting archiver sync to rollup contract 0xf4bd81ec49cd3f3486044a08459c4a23a778c850 from L1 block 22 to current L1 block 25 with hash 0x2949c9886709b6ba2b13a37e22b68208c433cc791d68428af06e51d3b56a9368 {"blocksSynchedTo":22,"messagesSynchedTo":{"l1BlockHash":"0xa7a024b7247446f88df0916f052f39331e2838c419d6a7f1b7ee86811abe29cf","l1BlockNumber":22}} 08:51:42 [08:51:42.816] VERBOSE: sequencer Attesting committee is empty 08:51:42 [08:51:42.895] INFO: archiver:prover-node Initial archiver sync to L1 block 25 complete. {"l1BlockNumber":25,"syncPoint":{"blocksSynchedTo":25},"latest":{"number":0},"proven":{"number":0},"finalized":{"number":0}} 08:51:42 [08:51:42.898] INFO: prover-node:blob-sink:client:prover-node Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:42493"} 08:51:42 [08:51:42.899] VERBOSE: prover-node:prover-node Snapshot sync is disabled. No snapshots URL provided. 08:51:42 [08:51:42.900] VERBOSE: prover-node:prover-node Created archiver and synced to block 0 08:51:42 [08:51:42.961] INFO: world-state:database:prover-node Creating world state data store at directory /tmp/d7ea4d2700fad48b/700f42d803fb63f3/world_state with map sizes {"archiveTreeMapSizeKb":134217728,"nullifierTreeMapSizeKb":134217728,"noteHashTreeMapSizeKb":134217728,"messageTreeMapSizeKb":134217728,"publicDataTreeMapSizeKb":134217728} and 2 threads. 08:51:43 [08:51:43.009] INFO: world_state:prover-node Created world state synchroniser with block history of 2 08:51:43 [08:51:43.012] VERBOSE: world-state:block_stream:prover-node Starting L2 block stream {"proven":false,"pollIntervalMS":50} 08:51:43 [08:51:43.013] INFO: world_state:prover-node Started world state synchronizer from block 1 08:51:43 [08:51:43.040] VERBOSE: world-state:block_stream:prover-node Starting sync from block number 0 08:51:43 [08:51:43.041] WARN: prover-client:proving-broker-database:prover-node Found invalid epoch directory /tmp/d7ea4d2700fad48b/700f42d803fb63f3/archiver when loading epoch databases, ignoring 08:51:43 [08:51:43.041] WARN: prover-client:proving-broker-database:prover-node Found invalid epoch directory /tmp/d7ea4d2700fad48b/700f42d803fb63f3/world_state when loading epoch databases, ignoring 08:51:43 [08:51:43.043] INFO: prover-client:proving-broker:prover-node Proving Broker started 08:51:43 [08:51:43.070] INFO: prover-node:prover-coordination:prover-node Using prover coordination via aztec node 08:51:43 [08:51:43.073] INFO: e2e:e2e_epochs:epochs_upload_failed_proof:prover-node Created and synced prover node {"publisherAddress":"0x3C44CdDdB6a900fa2b585dd299e03d12FA4293BC"} 08:51:43 [08:51:43.074] INFO: prover-node:epoch-monitor:prover-node Started EpochMonitor {"pollingIntervalMs":200} 08:51:43 [08:51:43.078] INFO: prover-node:prover-node Started Prover Node with prover id 0x0000000000000000000000000000000000000000000000000000000000000001 {"proverNodePollingIntervalMs":200,"proverNodeMaxPendingJobs":10,"proverNodeMaxParallelBlocksPerEpoch":32,"txGatheringIntervalMs":1000,"txGatheringBatchSize":10,"txGatheringMaxParallelRequestsPerNode":100,"proverNodeFailedEpochStore":"file:///tmp/failed-proofs-2td0FS","dataDirectory":"/tmp/d7ea4d2700fad48b/700f42d803fb63f3","l1ChainId":31337,"rollupVersion":585319288} 08:51:43 [08:51:43.079] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating a pxe... 08:51:43 [08:51:43.085] INFO: pxe:data:lmdb Creating pxe_data data store at directory /tmp/af66878449865fa1/pxe_data with map size 134217728 KB (LMDB v2) 08:51:43 [08:51:43.092] INFO: pxe:data:lmdb Starting data store with maxReaders 16 08:51:43 [08:51:43.621] VERBOSE: pxe:service Registered protocol contracts in pxe {"AuthRegistry":"0x0000000000000000000000000000000000000000000000000000000000000001","ContractInstanceDeployer":"0x0000000000000000000000000000000000000000000000000000000000000002","ContractClassRegisterer":"0x0000000000000000000000000000000000000000000000000000000000000003","MultiCallEntrypoint":"0x0000000000000000000000000000000000000000000000000000000000000004","FeeJuice":"0x0000000000000000000000000000000000000000000000000000000000000005","Router":"0x0000000000000000000000000000000000000000000000000000000000000006"} 08:51:43 [08:51:43.622] INFO: pxe:service Started PXE connected to chain 31337 version 585319288 08:51:43 [08:51:43.640] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L2 genesis at L1 block 22 (timestamp 1750755259) 08:51:43 [08:51:43.642] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting until L1 timestamp 1750755323 is reached as the start of epoch 1 08:51:43 [08:51:43.850] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 25 mined at 08:54:43 with new L2 block 0 for epoch 0 with proof up to L2 block 0 for epoch 0 {"l1Timestamp":1750755283,"l1BlockNumber":25,"l2SlotNumber":1,"l2BlockNumber":0,"l2ProvenBlockNumber":0,"totalL2Messages":0} 08:51:46 [08:51:46.494] VERBOSE: ethereum:tx_delayer Sent tx immediately 0x798710918737400b34762e15e2b4c0084aec2a83ecba296783412f9670e5c05b 08:51:46 [08:51:46.496] VERBOSE: node:MAIN-aztec-node Sent L1 transaction 0x798710918737400b34762e15e2b4c0084aec2a83ecba296783412f9670e5c05b {"gasLimit":470455,"maxFeePerGas":"500","maxPriorityFeePerGas":"500","maxFeePerBlobGas":"0.000000001"} 08:51:48 [08:51:48.374] INFO: sequencer:publisher Bundled [propose] transaction [succeeded] 08:51:48 [08:51:48.377] VERBOSE: sequencer:publisher Published L2 block to L1 rollup contract {"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0x798710918737400b34762e15e2b4c0084aec2a83ecba296783412f9670e5c05b","calldataSize":1220,"calldataGas":8828,"txCount":0,"blockNumber":1,"blockTimestamp":1750755291,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 08:51:48 [08:51:48.379] VERBOSE: node:blob-sink:client Sending 1 blobs to blob sink 08:51:48 [08:51:48.445] INFO: blob-sink:server Received blob sidecar for block 0xedc599956da2084fb3b822f330960f8f6e612b520eb9a271e4ed48f46d509d16 08:51:48 [08:51:48.462] INFO: blob-sink:server Blob sidecar stored successfully for block 0xedc599956da2084fb3b822f330960f8f6e612b520eb9a271e4ed48f46d509d16 08:51:48 [08:51:48.552] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 26 mined at 08:54:51 with new L2 block 1 for epoch 0 {"l1Timestamp":1750755291,"l1BlockNumber":26,"l2SlotNumber":2,"l2BlockNumber":1,"l2ProvenBlockNumber":0,"totalL2Messages":0} 08:51:48 [08:51:48.579] INFO: archiver:prover-node Downloaded L2 block 1 {"blockHash":"0x2764b65e73dc21975fb06d05b21443f7691ed742789f694b182d728309198d38","blockNumber":1,"txCount":0,"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750755291,"version":585319288},"archiveRoot":"0x15e23ae220a6cc61399d453d0e95cec2615934092595be7c4f950318efa275c6","archiveNextLeafIndex":2} 08:51:48 [08:51:48.626] INFO: archiver Downloaded L2 block 1 {"blockHash":"0x2764b65e73dc21975fb06d05b21443f7691ed742789f694b182d728309198d38","blockNumber":1,"txCount":0,"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750755291,"version":585319288},"archiveRoot":"0x15e23ae220a6cc61399d453d0e95cec2615934092595be7c4f950318efa275c6","archiveNextLeafIndex":2} 08:51:48 [08:51:48.641] INFO: world_state:prover-node World state updated with L2 block 1 {"eventName":"l2-block-handled","duration":7.278430000002118,"unfinalisedBlockNumber":1,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":1,"blockTimestamp":1750755291,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 08:51:48 [08:51:48.650] INFO: world_state World state updated with L2 block 1 {"eventName":"l2-block-handled","duration":5.467464999997901,"unfinalisedBlockNumber":1,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":1,"blockTimestamp":1750755291,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 08:51:48 [08:51:48.722] VERBOSE: p2p Synched to latest block 1 08:51:49 [08:51:49.092] VERBOSE: prover-node:prover-node Fetching 0 tx hashes for block number 1 from coordination 08:51:49 [08:51:49.093] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 08:51:56 [08:51:56.528] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 27 mined at 08:54:59 {"l1Timestamp":1750755299,"l1BlockNumber":27,"l2SlotNumber":2,"l2BlockNumber":1,"l2ProvenBlockNumber":0,"totalL2Messages":0} 08:51:56 [08:51:56.724] VERBOSE: sequencer Preparing proposal for block 2 at slot 3 {"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750755307,"version":585319288},"chainTipArchive":"0x15e23ae220a6cc61399d453d0e95cec2615934092595be7c4f950318efa275c6","blockNumber":2,"slot":3} 08:51:56 [08:51:56.751] VERBOSE: block-builder Building block 2 for slot 3 {"slot":3,"slotStart":"2025-06-24T08:55:07.000Z","now":"2025-06-24T08:54:59.426Z","blockNumber":2,"msgCount":0,"initialStateReference":{"l1ToL2MessageTree":"0x2e33ee2008411c04b99c24b313513d097a0d21a5040b6193d1f978b8226892d6","noteHashTree":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTree":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTree":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9"},"initialArchiveRoot":"0x15e23ae220a6cc61399d453d0e95cec2615934092595be7c4f950318efa275c6","opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}} 08:51:56 [08:51:56.755] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000375119000000268s {"duration":0.000375119000000268,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 08:51:56 [08:51:56.809] INFO: sequencer Built block 2 for slot 3 with 0 txs and 0 messages. 0 mana/s {"blockHash":"0x261851fcd4d4764ef40c557e4ac00afc650710df05934b3f343fbe6fb4f1e1bd","globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750755307,"version":585319288},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":71.1251599999996,"publicProcessDuration":0.8845220000002882,"rollupCircuitsDuration":63.823019000003114,"txCount":0,"blockNumber":2,"blockTimestamp":1750755307,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 08:51:56 [08:51:56.822] VERBOSE: sequencer Attesting committee is empty 08:51:56 [08:51:56.981] VERBOSE: ethereum:tx_delayer Sent tx immediately 0x036a7e80ad42568e939f3ef48c90cb8f13760e9ea1f6ed1630bfdd6e4b10699d 08:51:56 [08:51:56.981] VERBOSE: node:MAIN-aztec-node Sent L1 transaction 0x036a7e80ad42568e939f3ef48c90cb8f13760e9ea1f6ed1630bfdd6e4b10699d {"gasLimit":391098,"maxFeePerGas":"1.266215001","maxPriorityFeePerGas":"1.2","maxFeePerBlobGas":"0.000000001"} 08:52:04 [08:52:04.361] INFO: sequencer:publisher Bundled [propose] transaction [succeeded] 08:52:04 [08:52:04.365] VERBOSE: sequencer:publisher Published L2 block to L1 rollup contract {"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0x036a7e80ad42568e939f3ef48c90cb8f13760e9ea1f6ed1630bfdd6e4b10699d","calldataSize":1220,"calldataGas":8828,"txCount":0,"blockNumber":2,"blockTimestamp":1750755307,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 08:52:04 [08:52:04.366] VERBOSE: node:blob-sink:client Sending 1 blobs to blob sink 08:52:04 [08:52:04.382] INFO: blob-sink:server Received blob sidecar for block 0x2b11ffa95c9d2957d4b3554188c4d224bc5805ddb1efd68592e183e39d393e4c 08:52:04 [08:52:04.412] INFO: blob-sink:server Blob sidecar stored successfully for block 0x2b11ffa95c9d2957d4b3554188c4d224bc5805ddb1efd68592e183e39d393e4c 08:52:04 [08:52:04.425] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 28 mined at 08:55:07 with new L2 block 2 for epoch 0 {"l1Timestamp":1750755307,"l1BlockNumber":28,"l2SlotNumber":3,"l2BlockNumber":2,"l2ProvenBlockNumber":0,"totalL2Messages":0} 08:52:04 [08:52:04.521] INFO: archiver:prover-node Downloaded L2 block 2 {"blockHash":"0x261851fcd4d4764ef40c557e4ac00afc650710df05934b3f343fbe6fb4f1e1bd","blockNumber":2,"txCount":0,"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750755307,"version":585319288},"archiveRoot":"0x1b74c0807e82b9d82f400b3050e1cba8c7d7f33767599dadae42a18c18fe6858","archiveNextLeafIndex":3} 08:52:04 [08:52:04.631] INFO: archiver Downloaded L2 block 2 {"blockHash":"0x261851fcd4d4764ef40c557e4ac00afc650710df05934b3f343fbe6fb4f1e1bd","blockNumber":2,"txCount":0,"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750755307,"version":585319288},"archiveRoot":"0x1b74c0807e82b9d82f400b3050e1cba8c7d7f33767599dadae42a18c18fe6858","archiveNextLeafIndex":3} 08:52:04 [08:52:04.647] INFO: world_state:prover-node World state updated with L2 block 2 {"eventName":"l2-block-handled","duration":8.420719000001554,"unfinalisedBlockNumber":2,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":2,"blockTimestamp":1750755307,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 08:52:04 [08:52:04.649] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 08:52:04 [08:52:04.649] VERBOSE: prover-node:prover-node Gathered all 0 txs for epoch 0 {"epochNumber":0} 08:52:04 [08:52:04.650] VERBOSE: prover-node:prover-node Gathered all 0 messages for epoch 0 {"epochNumber":0} 08:52:04 [08:52:04.650] VERBOSE: prover-node:prover-node Gathered previous block header 0 for epoch 0 08:52:04 [08:52:04.651] VERBOSE: prover-node:prover-node Creating proving job for epoch 0 for block range 1 to 2 08:52:04 [08:52:04.654] INFO: prover-node:epoch-proving-job Starting epoch 0 proving job with blocks 1 to 2 {"fromBlock":1,"toBlock":2,"epochSizeBlocks":2,"epochNumber":0,"uuid":"d08c73be-b14e-4ac4-a068-8b0b84ac96d6"} 08:52:04 [08:52:04.685] INFO: prover-client:orchestrator Starting epoch 0 with 2 blocks 08:52:04 [08:52:04.686] VERBOSE: prover-client:broker-circuit-prover-facade Starting BrokerCircuitProverFacade 08:52:04 [08:52:04.688] VERBOSE: prover-node:epoch-proving-job Starting processing block 1 {"number":1,"blockHash":"0x2764b65e73dc21975fb06d05b21443f7691ed742789f694b182d728309198d38","lastArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"d08c73be-b14e-4ac4-a068-8b0b84ac96d6","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x0000000000000000000000000000000000000000000000000000000022e34378","blockNumber":1,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 08:52:04 [08:52:04.689] INFO: prover-client:orchestrator Starting block 1 for slot 2 08:52:04 [08:52:04.690] VERBOSE: prover-node:epoch-proving-job Starting processing block 2 {"number":2,"blockHash":"0x261851fcd4d4764ef40c557e4ac00afc650710df05934b3f343fbe6fb4f1e1bd","lastArchive":"0x15e23ae220a6cc61399d453d0e95cec2615934092595be7c4f950318efa275c6","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"d08c73be-b14e-4ac4-a068-8b0b84ac96d6","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x0000000000000000000000000000000000000000000000000000000022e34378","blockNumber":2,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000003","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 08:52:04 [08:52:04.690] INFO: prover-client:orchestrator Starting block 2 for slot 3 08:52:04 [08:52:04.720] VERBOSE: p2p Synched to latest block 2 08:52:04 [08:52:04.724] INFO: world_state World state updated with L2 block 2 {"eventName":"l2-block-handled","duration":8.132722000002104,"unfinalisedBlockNumber":2,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":2,"blockTimestamp":1750755307,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 08:52:04 [08:52:04.730] INFO: prover-client:proving-broker:prover-node New proving job id=0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03 epochNumber=0 {"provingJobId":"0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03"} 08:52:04 [08:52:04.731] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03","provingJobType":"BASE_PARITY"} 08:52:04 [08:52:04.732] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03","provingJobType":"BASE_PARITY"} 08:52:04 [08:52:04.732] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03","provingJobType":"BASE_PARITY"} 08:52:04 [08:52:04.737] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03","provingJobType":"BASE_PARITY"} 08:52:04 [08:52:04.737] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03","provingJobType":"BASE_PARITY"} 08:52:04 [08:52:04.737] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03","provingJobType":"BASE_PARITY"} 08:52:04 [08:52:04.738] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03","provingJobType":"BASE_PARITY"} 08:52:04 [08:52:04.740] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000027361000000382772s {"duration":0.000027361000000382772,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 08:52:04 [08:52:04.741] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 08:52:04 [08:52:04.742] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 1 {"blockNumber":1,"blockHash":"0x2764b65e73dc21975fb06d05b21443f7691ed742789f694b182d728309198d38","uuid":"d08c73be-b14e-4ac4-a068-8b0b84ac96d6"} 08:52:04 [08:52:04.743] VERBOSE: prover-client:orchestrator Block 1 completed. Assembling header. 08:52:04 [08:52:04.745] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000019400000004679895s {"duration":0.000019400000004679895,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 08:52:04 [08:52:04.745] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 08:52:04 [08:52:04.746] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 2 {"blockNumber":2,"blockHash":"0x261851fcd4d4764ef40c557e4ac00afc650710df05934b3f343fbe6fb4f1e1bd","uuid":"d08c73be-b14e-4ac4-a068-8b0b84ac96d6"} 08:52:04 [08:52:04.746] VERBOSE: prover-client:orchestrator Block 2 completed. Assembling header. 08:52:04 [08:52:04.755] VERBOSE: prover-client:orchestrator Updating archive tree with block 1 header 0x2764b65e73dc21975fb06d05b21443f7691ed742789f694b182d728309198d38 08:52:04 [08:52:04.763] VERBOSE: prover-client:orchestrator Updating archive tree with block 2 header 0x261851fcd4d4764ef40c557e4ac00afc650710df05934b3f343fbe6fb4f1e1bd 08:52:04 [08:52:04.768] VERBOSE: prover-client:orchestrator Orchestrator finalised block 1 08:52:04 [08:52:04.786] INFO: prover-client:proving-broker-database:prover-node Creating broker database for epoch 0 at /tmp/d7ea4d2700fad48b/700f42d803fb63f3/0 with map size 134217728 08:52:04 [08:52:04.788] VERBOSE: prover-client:orchestrator Orchestrator finalised block 2 08:52:04 [08:52:04.838] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:52:04 [08:52:04.846] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03 type=BASE_PARITY epochNumber=0 {"provingJobId":"0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03","provingJobType":"BASE_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...","status":"not-found","numOutstandingJobs":1} 08:52:04 [08:52:04.929] INFO: prover-client:proving-agent:prover-node Starting job id=0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03 type=BASE_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input... 08:52:04 [08:52:04.949] INFO: prover-client:proving-agent:job-controller-fdfe14c9 Job controller started jobId=0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03 {"jobId":"0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03"} 08:52:05 [08:52:05.164] INFO: prover-client:proving-agent:prover-node Job id=0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03 type=BASE_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22resul... 08:52:05 [08:52:05.164] INFO: prover-client:proving-broker:prover-node Proving job complete id=0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03 type=BASE_PARITY totalAttempts=1 {"provingJobId":"0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03"} 08:52:05 [08:52:05.186] VERBOSE: prover-node:prover-node Fetching 0 tx hashes for block number 2 from coordination 08:52:05 [08:52:05.186] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 08:52:05 [08:52:05.689] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 08:52:05 [08:52:05.691] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03 type=BASE_PARITY 08:52:05 [08:52:05.692] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 08:52:05 [08:52:05.710] INFO: prover-client:proving-broker:prover-node New proving job id=0:ROOT_PARITY:25b61da8dfd90a9c0b5ccef05da00d684c7973ec20ed394649c29eb42bb60e30 epochNumber=0 {"provingJobId":"0:ROOT_PARITY:25b61da8dfd90a9c0b5ccef05da00d684c7973ec20ed394649c29eb42bb60e30"} 08:52:05 [08:52:05.728] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:ROOT_PARITY:25b61da8dfd90a9c0b5ccef05da00d684c7973ec20ed394649c29eb42bb60e30 type=ROOT_PARITY {"provingJobId":"0:ROOT_PARITY:25b61da8dfd90a9c0b5ccef05da00d684c7973ec20ed394649c29eb42bb60e30","provingJobType":"ROOT_PARITY"} 08:52:05 [08:52:05.768] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_PARITY:25b61da8dfd90a9c0b5ccef05da00d684c7973ec20ed394649c29eb42bb60e30 type=ROOT_PARITY epochNumber=0 {"provingJobId":"0:ROOT_PARITY:25b61da8dfd90a9c0b5ccef05da00d684c7973ec20ed394649c29eb42bb60e30","provingJobType":"ROOT_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu...","status":"not-found","numOutstandingJobs":1} 08:52:05 [08:52:05.811] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Triggering error on finaliseEpoch 08:52:05 [08:52:05.821] ERROR: prover-node:epoch-proving-job Error running epoch 0 prover job: Error: Fake error while proving epoch 08:52:05 at ServerEpochProver.epochProver.finaliseEpoch (/home/aztec-dev/aztec-packages/yarn-project/end-to-end/src/e2e_epochs/epochs_upload_failed_proof.test.ts:60:15) 08:52:05 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:142:64) 08:52:05 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) {"uuid":"d08c73be-b14e-4ac4-a068-8b0b84ac96d6","epochNumber":0} 08:52:05 [08:52:05.822] VERBOSE: prover-client:broker-circuit-prover-facade Stopping BrokerCircuitProverFacade 08:52:05 [08:52:05.823] ERROR: prover-client:broker-circuit-prover-facade Job errored with 'Broker facade stopped' id=0:ROOT_PARITY:25b61da8dfd90a9c0b5ccef05da00d684c7973ec20ed394649c29eb42bb60e30 type=ROOT_PARITY: { 08:52:05 provingJobId: '0:ROOT_PARITY:25b61da8dfd90a9c0b5ccef05da00d684c7973ec20ed394649c29eb42bb60e30', 08:52:05 provingJobType: 'ROOT_PARITY' 08:52:05 } 08:52:05 [08:52:05.824] INFO: prover-client:proving-broker:prover-node Cancelling job id=0:ROOT_PARITY:25b61da8dfd90a9c0b5ccef05da00d684c7973ec20ed394649c29eb42bb60e30 {"provingJobId":"0:ROOT_PARITY:25b61da8dfd90a9c0b5ccef05da00d684c7973ec20ed394649c29eb42bb60e30"} 08:52:05 [08:52:05.824] WARN: prover-client:proving-broker:prover-node Proving job id=0:ROOT_PARITY:25b61da8dfd90a9c0b5ccef05da00d684c7973ec20ed394649c29eb42bb60e30 type=ROOT_PARITY not in the in-progress set {"provingJobId":"0:ROOT_PARITY:25b61da8dfd90a9c0b5ccef05da00d684c7973ec20ed394649c29eb42bb60e30"} 08:52:05 [08:52:05.824] INFO: prover-client:proving-broker:prover-node Marking proving job as failed id=0:ROOT_PARITY:25b61da8dfd90a9c0b5ccef05da00d684c7973ec20ed394649c29eb42bb60e30 type=ROOT_PARITY totalAttempts=1 err=Aborted {"provingJobId":"0:ROOT_PARITY:25b61da8dfd90a9c0b5ccef05da00d684c7973ec20ed394649c29eb42bb60e30"} 08:52:05 [08:52:05.826] ERROR: prover-client:orchestrator Error thrown when proving job: Error: Broker facade stopped 08:52:05 at BrokerCircuitProverFacade.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/proving_broker/broker_prover_facade.js:142:31) 08:52:05 at ServerEpochProver.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/prover-client/server-epoch-prover.js:31:9) 08:52:05 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:183:13) 08:52:05 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) 08:52:05 [08:52:05.826] ERROR: prover-client:orchestrator Error thrown when proving job: Error: Broker facade stopped 08:52:05 at BrokerCircuitProverFacade.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/proving_broker/broker_prover_facade.js:142:31) 08:52:05 at ServerEpochProver.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/prover-client/server-epoch-prover.js:31:9) 08:52:05 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:183:13) 08:52:05 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) 08:52:05 [08:52:05.827] ERROR: prover-node:prover-node Job for 0 exited with state failed: { 08:52:05 id: 'd08c73be-b14e-4ac4-a068-8b0b84ac96d6', 08:52:05 epochNumber: 0n, 08:52:05 state: 'failed' 08:52:05 } 08:52:05 [08:52:05.827] WARN: prover-node:prover-node Uploading epoch proof failure for 0 to file:///tmp/failed-proofs-2td0FS {"epochNumber":0,"jobId":"d08c73be-b14e-4ac4-a068-8b0b84ac96d6","location":"file:///tmp/failed-proofs-2td0FS"} 08:52:05 [08:52:05.835] INFO: stdlib:file-store Creating local file file store at /tmp/failed-proofs-2td0FS 08:52:05 [08:52:05.843] INFO: prover-node:prover-node Pausing archiver and world state sync to start snapshot upload 08:52:05 [08:52:05.847] INFO: archiver:prover-node Stopped. 08:52:05 [08:52:05.847] INFO: world_state:prover-node Stopped sync 08:52:05 [08:52:05.848] INFO: prover-node:prover-node Creating backups of lmdb environments to /tmp/d7ea4d2700fad48b/700f42d803fb63f3/epoch-proof-data-xYKkoI 08:52:05 [08:52:05.853] INFO: prover-node:prover-node Data stores backed up to /tmp/d7ea4d2700fad48b/700f42d803fb63f3/epoch-proof-data-xYKkoI {"paths":{"l1-to-l2-message-tree":"/tmp/d7ea4d2700fad48b/700f42d803fb63f3/epoch-proof-data-xYKkoI/world-state/L1ToL2MessageTree/data.mdb","archive-tree":"/tmp/d7ea4d2700fad48b/700f42d803fb63f3/epoch-proof-data-xYKkoI/world-state/ArchiveTree/data.mdb","public-data-tree":"/tmp/d7ea4d2700fad48b/700f42d803fb63f3/epoch-proof-data-xYKkoI/world-state/PublicDataTree/data.mdb","note-hash-tree":"/tmp/d7ea4d2700fad48b/700f42d803fb63f3/epoch-proof-data-xYKkoI/world-state/NoteHashTree/data.mdb","nullifier-tree":"/tmp/d7ea4d2700fad48b/700f42d803fb63f3/epoch-proof-data-xYKkoI/world-state/NullifierTree/data.mdb","archiver":"/tmp/d7ea4d2700fad48b/700f42d803fb63f3/epoch-proof-data-xYKkoI/archiver/data.mdb"}} 08:52:05 [08:52:05.854] INFO: prover-node:prover-node Resuming archiver and world state sync 08:52:05 [08:52:05.854] VERBOSE: world-state:block_stream:prover-node Starting L2 block stream {"proven":false,"pollIntervalMS":50} 08:52:05 [08:52:05.855] INFO: world_state:prover-node Resumed sync 08:52:05 [08:52:05.856] INFO: archiver:prover-node Restarting archiver 08:52:05 [08:52:05.889] WARN: prover-node:prover-node Uploaded epoch 0 proof failure data to file:///tmp/failed-proofs-2td0FS/aztec-31337-585319288-0xf4bd81ec49cd3f3486044a08459c4a23a778c850/0-20250624085205-d08c73be-b14e-4ac4-a068-8b0b84ac96d6 {"epochNumber":0,"location":"file:///tmp/failed-proofs-2td0FS","basePath":"aztec-31337-585319288-0xf4bd81ec49cd3f3486044a08459c4a23a778c850/0-20250624085205-d08c73be-b14e-4ac4-a068-8b0b84ac96d6","metadataUrl":"file:///tmp/failed-proofs-2td0FS/aztec-31337-585319288-0xf4bd81ec49cd3f3486044a08459c4a23a778c850/0-20250624085205-d08c73be-b14e-4ac4-a068-8b0b84ac96d6/metadata.json","dataUrl":"file:///tmp/failed-proofs-2td0FS/aztec-31337-585319288-0xf4bd81ec49cd3f3486044a08459c4a23a778c850/0-20250624085205-d08c73be-b14e-4ac4-a068-8b0b84ac96d6/data.bin","metadata":{"l1BlockNumber":28,"l2BlockHash":"0x261851fcd4d4764ef40c557e4ac00afc650710df05934b3f343fbe6fb4f1e1bd","l2BlockNumber":2,"schemaVersions":{"archiver":3,"worldState":2},"timestamp":1750755125857,"dataUrls":{"l1-to-l2-message-tree":"file:///tmp/failed-proofs-2td0FS/aztec-31337-585319288-0xf4bd81ec49cd3f3486044a08459c4a23a778c850/0-20250624085205-d08c73be-b14e-4ac4-a068-8b0b84ac96d6/l1-to-l2-message-tree.db","archive-tree":"file:///tmp/failed-proofs-2td0FS/aztec-31337-585319288-0xf4bd81ec49cd3f3486044a08459c4a23a778c850/0-20250624085205-d08c73be-b14e-4ac4-a068-8b0b84ac96d6/archive-tree.db","public-data-tree":"file:///tmp/failed-proofs-2td0FS/aztec-31337-585319288-0xf4bd81ec49cd3f3486044a08459c4a23a778c850/0-20250624085205-d08c73be-b14e-4ac4-a068-8b0b84ac96d6/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-2td0FS/aztec-31337-585319288-0xf4bd81ec49cd3f3486044a08459c4a23a778c850/0-20250624085205-d08c73be-b14e-4ac4-a068-8b0b84ac96d6/note-hash-tree.db","nullifier-tree":"file:///tmp/failed-proofs-2td0FS/aztec-31337-585319288-0xf4bd81ec49cd3f3486044a08459c4a23a778c850/0-20250624085205-d08c73be-b14e-4ac4-a068-8b0b84ac96d6/nullifier-tree.db","archiver":"file:///tmp/failed-proofs-2td0FS/aztec-31337-585319288-0xf4bd81ec49cd3f3486044a08459c4a23a778c850/0-20250624085205-d08c73be-b14e-4ac4-a068-8b0b84ac96d6/archiver.db"}},"jobId":"d08c73be-b14e-4ac4-a068-8b0b84ac96d6"} 08:52:05 [08:52:05.889] INFO: prover-node:prover-node Cleaning up backup dir /tmp/d7ea4d2700fad48b/700f42d803fb63f3/epoch-proof-data-xYKkoI 08:52:12 [08:52:12.360] INFO: prover-node:prover-node Stopping ProverNode 08:52:12 [08:52:12.361] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 08:52:12 [08:52:12.361] INFO: archiver:prover-node Stopped. 08:52:12 [08:52:12.367] INFO: world_state:prover-node Stopped world state synchronizer 08:52:12 [08:52:12.368] INFO: prover-node:prover-node Stopped ProverNode 08:52:12 [08:52:12.368] INFO: node:MAIN-aztec-node Stopping Aztec Node 08:52:12 [08:52:12.607] VERBOSE: sequencer Preparing proposal for block 3 at slot 4 {"globalVariables":{"blockNumber":3,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":4,"timestamp":1750755323,"version":585319288},"chainTipArchive":"0x1b74c0807e82b9d82f400b3050e1cba8c7d7f33767599dadae42a18c18fe6858","blockNumber":3,"slot":4} 08:52:12 [08:52:12.641] VERBOSE: block-builder Building block 3 for slot 4 {"slot":4,"slotStart":"2025-06-24T08:55:23.000Z","now":"2025-06-24T08:55:15.316Z","blockNumber":3,"msgCount":0,"initialStateReference":{"l1ToL2MessageTree":"0x2e33ee2008411c04b99c24b313513d097a0d21a5040b6193d1f978b8226892d6","noteHashTree":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTree":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTree":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9"},"initialArchiveRoot":"0x1b74c0807e82b9d82f400b3050e1cba8c7d7f33767599dadae42a18c18fe6858","opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}} 08:52:12 [08:52:12.645] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.0004468510000006063s {"duration":0.0004468510000006063,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 08:52:12 [08:52:12.671] INFO: sequencer Built block 3 for slot 4 with 0 txs and 0 messages. 0 mana/s {"blockHash":"0x1813ac19990743354637cfc665c4d58b3dc15ba3326e8f8202b7ea4d29893673","globalVariables":{"blockNumber":3,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":4,"timestamp":1750755323,"version":585319288},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":41.21716100000049,"publicProcessDuration":1.1244490000026417,"rollupCircuitsDuration":31.582219000003533,"txCount":0,"blockNumber":3,"blockTimestamp":1750755323,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 08:52:12 [08:52:12.674] VERBOSE: sequencer Attesting committee is empty 08:52:12 [08:52:12.783] VERBOSE: ethereum:tx_delayer Sent tx immediately 0x1f47cb7ccfcf0c95a95802812ca1f1d8ee5794a6fcd675f809bb85313b4f3ef3 08:52:12 [08:52:12.783] VERBOSE: node:MAIN-aztec-node Sent L1 transaction 0x1f47cb7ccfcf0c95a95802812ca1f1d8ee5794a6fcd675f809bb85313b4f3ef3 {"gasLimit":464655,"maxFeePerGas":"1.250823812","maxPriorityFeePerGas":"1.2","maxFeePerBlobGas":"0.000000001"} 08:52:14 [08:52:14.371] INFO: slasher Slasher client stopped. 08:52:20 [08:52:20.390] INFO: sequencer:publisher Bundled [propose] transaction [succeeded] 08:52:20 [08:52:20.391] VERBOSE: sequencer:publisher Published L2 block to L1 rollup contract {"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0x1f47cb7ccfcf0c95a95802812ca1f1d8ee5794a6fcd675f809bb85313b4f3ef3","calldataSize":1220,"calldataGas":8828,"txCount":0,"blockNumber":3,"blockTimestamp":1750755323,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 08:52:20 [08:52:20.392] VERBOSE: node:blob-sink:client Sending 1 blobs to blob sink 08:52:20 [08:52:20.397] WARN: node:blob-sink:client Unable to get blob sidecar for 0xb82be0f29d7841b8fb717e2d13f63b449aa7fc0358c52048d65856dcc5e11147: Not Found (404) {"status":404,"statusText":"Not Found","body":"{\"error\":\"Blob not found\"}"} 08:52:20 [08:52:20.398] WARN: node:blob-sink:client Failed to fetch blobs for 0xb82be0f29d7841b8fb717e2d13f63b449aa7fc0358c52048d65856dcc5e11147 from all blob sources {"blobSinkUrl":"http://localhost:42493"} 08:52:20 [08:52:20.400] INFO: sequencer Stopped sequencer 08:52:20 [08:52:20.403] INFO: blob-sink:server Received blob sidecar for block 0xb82be0f29d7841b8fb717e2d13f63b449aa7fc0358c52048d65856dcc5e11147 08:52:20 [08:52:20.406] INFO: p2p P2P client stopped 08:52:20 [08:52:20.410] INFO: blob-sink:server Blob sidecar stored successfully for block 0xb82be0f29d7841b8fb717e2d13f63b449aa7fc0358c52048d65856dcc5e11147 08:52:20 [08:52:20.413] INFO: world_state Stopped world state synchronizer 08:52:20 [08:52:20.413] INFO: archiver Stopped. 08:52:20 [08:52:20.413] INFO: node:MAIN-aztec-node Stopped Aztec Node 08:52:20 [08:52:20.417] INFO: node:MAIN-aztec-node Stopping Aztec Node 08:52:22 [08:52:22.421] INFO: slasher Slasher client stopped. 08:52:22 [08:52:22.422] WARN: validator Running promise was not started 08:52:22 [08:52:22.422] WARN: sequencer Running promise was not started 08:52:22 [08:52:22.422] INFO: sequencer Stopped sequencer 08:52:22 [08:52:22.423] WARN: p2p:l2-block-stream Running promise was not started 08:52:22 [08:52:22.423] INFO: p2p P2P client stopped 08:52:22 [08:52:22.423] WARN: world-state:block_stream Running promise was not started 08:52:22 [08:52:22.423] INFO: world_state Stopped world state synchronizer 08:52:22 [08:52:22.424] WARN: archiver Running promise was not started 08:52:22 [08:52:22.424] INFO: archiver Stopped. 08:52:22 [08:52:22.424] INFO: node:MAIN-aztec-node Stopped Aztec Node 08:52:22 [08:52:22.424] INFO: prover-node:prover-node Stopping ProverNode 08:52:22 [08:52:22.424] WARN: prover-node:prover-node Running promise was not started 08:52:22 [08:52:22.425] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 08:52:22 [08:52:22.425] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 08:52:22 [08:52:22.425] WARN: archiver:prover-node Running promise was not started 08:52:22 [08:52:22.425] INFO: archiver:prover-node Stopped. 08:52:22 [08:52:22.426] WARN: world-state:block_stream:prover-node Running promise was not started 08:52:22 [08:52:22.426] INFO: world_state:prover-node Stopped world state synchronizer 08:52:22 [08:52:22.426] INFO: prover-node:prover-node Stopped ProverNode 08:52:22 [08:52:22.445] INFO: blob-sink:server Stopping blob sink 08:52:22 [08:52:22.446] INFO: blob-sink:server Blob sink stopped 08:52:22 [08:52:22.451] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data and state {"uploadPath":"/tmp/failed-proofs-2td0FS","rerunDataDir":"/tmp/rerun-data-twIccd","rerunDownloadPath":"/tmp/rerun-download-70D0Bi/data.bin"} 08:52:22 [08:52:22.452] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data from file:///tmp/failed-proofs-2td0FS/aztec-31337-585319288-0xf4bd81ec49cd3f3486044a08459c4a23a778c850/0-20250624085205-d08c73be-b14e-4ac4-a068-8b0b84ac96d6 08:52:22 [08:52:22.453] INFO: stdlib:file-store Creating local file file store at /tmp/failed-proofs-2td0FS/aztec-31337-585319288-0xf4bd81ec49cd3f3486044a08459c4a23a778c850/0-20250624085205-d08c73be-b14e-4ac4-a068-8b0b84ac96d6 08:52:22 [08:52:22.455] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading state snapshot from file:///tmp/failed-proofs-2td0FS/aztec-31337-585319288-0xf4bd81ec49cd3f3486044a08459c4a23a778c850/0-20250624085205-d08c73be-b14e-4ac4-a068-8b0b84ac96d6 to local data directory {"metadata":{"l2BlockNumber":2,"l2BlockHash":"0x261851fcd4d4764ef40c557e4ac00afc650710df05934b3f343fbe6fb4f1e1bd","l1BlockNumber":28,"l1ChainId":31337,"rollupVersion":585319288,"rollupAddress":"0xf4bd81ec49cd3f3486044a08459c4a23a778c850"},"dataUrls":{"archiver":"file:///tmp/failed-proofs-2td0FS/aztec-31337-585319288-0xf4bd81ec49cd3f3486044a08459c4a23a778c850/0-20250624085205-d08c73be-b14e-4ac4-a068-8b0b84ac96d6/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-2td0FS/aztec-31337-585319288-0xf4bd81ec49cd3f3486044a08459c4a23a778c850/0-20250624085205-d08c73be-b14e-4ac4-a068-8b0b84ac96d6/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-2td0FS/aztec-31337-585319288-0xf4bd81ec49cd3f3486044a08459c4a23a778c850/0-20250624085205-d08c73be-b14e-4ac4-a068-8b0b84ac96d6/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-2td0FS/aztec-31337-585319288-0xf4bd81ec49cd3f3486044a08459c4a23a778c850/0-20250624085205-d08c73be-b14e-4ac4-a068-8b0b84ac96d6/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-2td0FS/aztec-31337-585319288-0xf4bd81ec49cd3f3486044a08459c4a23a778c850/0-20250624085205-d08c73be-b14e-4ac4-a068-8b0b84ac96d6/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-2td0FS/aztec-31337-585319288-0xf4bd81ec49cd3f3486044a08459c4a23a778c850/0-20250624085205-d08c73be-b14e-4ac4-a068-8b0b84ac96d6/l1-to-l2-message-tree.db"}} 08:52:22 [08:52:22.456] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Creating local file file store at /tmp/failed-proofs-2td0FS/aztec-31337-585319288-0xf4bd81ec49cd3f3486044a08459c4a23a778c850/0-20250624085205-d08c73be-b14e-4ac4-a068-8b0b84ac96d6 08:52:22 [08:52:22.456] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading snapshot to /tmp/rerun-data-twIccd/download-JpRWjy {"snapshot":{"dataUrls":{"archiver":"file:///tmp/failed-proofs-2td0FS/aztec-31337-585319288-0xf4bd81ec49cd3f3486044a08459c4a23a778c850/0-20250624085205-d08c73be-b14e-4ac4-a068-8b0b84ac96d6/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-2td0FS/aztec-31337-585319288-0xf4bd81ec49cd3f3486044a08459c4a23a778c850/0-20250624085205-d08c73be-b14e-4ac4-a068-8b0b84ac96d6/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-2td0FS/aztec-31337-585319288-0xf4bd81ec49cd3f3486044a08459c4a23a778c850/0-20250624085205-d08c73be-b14e-4ac4-a068-8b0b84ac96d6/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-2td0FS/aztec-31337-585319288-0xf4bd81ec49cd3f3486044a08459c4a23a778c850/0-20250624085205-d08c73be-b14e-4ac4-a068-8b0b84ac96d6/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-2td0FS/aztec-31337-585319288-0xf4bd81ec49cd3f3486044a08459c4a23a778c850/0-20250624085205-d08c73be-b14e-4ac4-a068-8b0b84ac96d6/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-2td0FS/aztec-31337-585319288-0xf4bd81ec49cd3f3486044a08459c4a23a778c850/0-20250624085205-d08c73be-b14e-4ac4-a068-8b0b84ac96d6/l1-to-l2-message-tree.db"}},"downloadPaths":{"archiver":"/tmp/rerun-data-twIccd/download-JpRWjy/archiver.db","nullifier-tree":"/tmp/rerun-data-twIccd/download-JpRWjy/nullifier-tree.db","public-data-tree":"/tmp/rerun-data-twIccd/download-JpRWjy/public-data-tree.db","note-hash-tree":"/tmp/rerun-data-twIccd/download-JpRWjy/note-hash-tree.db","archive-tree":"/tmp/rerun-data-twIccd/download-JpRWjy/archive-tree.db","l1-to-l2-message-tree":"/tmp/rerun-data-twIccd/download-JpRWjy/l1-to-l2-message-tree.db"}} 08:52:22 [08:52:22.464] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Snapshot downloaded at /tmp/rerun-data-twIccd/download-JpRWjy {"snapshot":{"dataUrls":{"archiver":"file:///tmp/failed-proofs-2td0FS/aztec-31337-585319288-0xf4bd81ec49cd3f3486044a08459c4a23a778c850/0-20250624085205-d08c73be-b14e-4ac4-a068-8b0b84ac96d6/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-2td0FS/aztec-31337-585319288-0xf4bd81ec49cd3f3486044a08459c4a23a778c850/0-20250624085205-d08c73be-b14e-4ac4-a068-8b0b84ac96d6/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-2td0FS/aztec-31337-585319288-0xf4bd81ec49cd3f3486044a08459c4a23a778c850/0-20250624085205-d08c73be-b14e-4ac4-a068-8b0b84ac96d6/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-2td0FS/aztec-31337-585319288-0xf4bd81ec49cd3f3486044a08459c4a23a778c850/0-20250624085205-d08c73be-b14e-4ac4-a068-8b0b84ac96d6/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-2td0FS/aztec-31337-585319288-0xf4bd81ec49cd3f3486044a08459c4a23a778c850/0-20250624085205-d08c73be-b14e-4ac4-a068-8b0b84ac96d6/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-2td0FS/aztec-31337-585319288-0xf4bd81ec49cd3f3486044a08459c4a23a778c850/0-20250624085205-d08c73be-b14e-4ac4-a068-8b0b84ac96d6/l1-to-l2-message-tree.db"}},"downloadPaths":{"archiver":"/tmp/rerun-data-twIccd/download-JpRWjy/archiver.db","nullifier-tree":"/tmp/rerun-data-twIccd/download-JpRWjy/nullifier-tree.db","public-data-tree":"/tmp/rerun-data-twIccd/download-JpRWjy/public-data-tree.db","note-hash-tree":"/tmp/rerun-data-twIccd/download-JpRWjy/note-hash-tree.db","archive-tree":"/tmp/rerun-data-twIccd/download-JpRWjy/archive-tree.db","l1-to-l2-message-tree":"/tmp/rerun-data-twIccd/download-JpRWjy/l1-to-l2-message-tree.db"}} 08:52:22 [08:52:22.466] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Archiver database set up from snapshot {"path":"/tmp/rerun-data-twIccd/archiver","dbVersion":3,"rollupAddress":"0xf4bd81ec49cd3f3486044a08459c4a23a778c850"} 08:52:22 [08:52:22.468] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database l1-to-l2-message-tree set up from snapshot {"path":"/tmp/rerun-data-twIccd/world_state/L1ToL2MessageTree","dbVersion":2,"rollupAddress":"0xf4bd81ec49cd3f3486044a08459c4a23a778c850"} 08:52:22 [08:52:22.472] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database archive-tree set up from snapshot {"path":"/tmp/rerun-data-twIccd/world_state/ArchiveTree","dbVersion":2,"rollupAddress":"0xf4bd81ec49cd3f3486044a08459c4a23a778c850"} 08:52:22 [08:52:22.473] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database public-data-tree set up from snapshot {"path":"/tmp/rerun-data-twIccd/world_state/PublicDataTree","dbVersion":2,"rollupAddress":"0xf4bd81ec49cd3f3486044a08459c4a23a778c850"} 08:52:22 [08:52:22.473] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database note-hash-tree set up from snapshot {"path":"/tmp/rerun-data-twIccd/world_state/NoteHashTree","dbVersion":2,"rollupAddress":"0xf4bd81ec49cd3f3486044a08459c4a23a778c850"} 08:52:22 [08:52:22.474] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database nullifier-tree set up from snapshot {"path":"/tmp/rerun-data-twIccd/world_state/NullifierTree","dbVersion":2,"rollupAddress":"0xf4bd81ec49cd3f3486044a08459c4a23a778c850"} 08:52:22 [08:52:22.474] INFO: e2e:e2e_epochs:epochs_upload_failed_proof P2P database cleared {"path":"/tmp/rerun-data-twIccd/p2p"} 08:52:22 [08:52:22.475] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data from file:///tmp/failed-proofs-2td0FS/aztec-31337-585319288-0xf4bd81ec49cd3f3486044a08459c4a23a778c850/0-20250624085205-d08c73be-b14e-4ac4-a068-8b0b84ac96d6/data.bin to /tmp/rerun-download-70D0Bi/data.bin 08:52:22 [08:52:22.476] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Epoch proving job data for epoch 0 downloaded successfully 08:52:22 [08:52:22.477] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Rerunning proving job from /tmp/rerun-download-70D0Bi/data.bin 08:52:22 [08:52:22.479] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Using native ACVM binary at ../../noir/noir-repo/target/release/acvm with working directory /tmp/5d12d883/acvm 08:52:22 [08:52:22.480] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Loaded proving job data for epoch 0 08:52:22 [08:52:22.490] INFO: world-state:database Creating world state data store at directory /tmp/rerun-data-twIccd/world_state with map sizes {"archiveTreeMapSizeKb":1048576,"nullifierTreeMapSizeKb":1048576,"noteHashTreeMapSizeKb":1048576,"messageTreeMapSizeKb":1048576,"publicDataTreeMapSizeKb":1048576} and 2 threads. 08:52:22 [08:52:22.516] INFO: archiver:lmdb Creating archiver data store at directory /tmp/rerun-data-twIccd/archiver with map size 1048576 KB (LMDB v2) 08:52:22 [08:52:22.518] INFO: archiver:lmdb Starting data store with maxReaders 16 08:52:22 [08:52:22.522] WARN: prover-client:proving-broker-database Found invalid epoch directory /tmp/rerun-data-twIccd/archiver when loading epoch databases, ignoring 08:52:22 [08:52:22.523] WARN: prover-client:proving-broker-database Found invalid epoch directory /tmp/rerun-data-twIccd/world_state when loading epoch databases, ignoring 08:52:22 [08:52:22.523] INFO: prover-client:proving-broker Proving Broker started 08:52:22 [08:52:22.524] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Rerunning epoch proving job for epoch 0 08:52:22 [08:52:22.525] INFO: prover-node:epoch-proving-job Starting epoch 0 proving job with blocks 1 to 2 {"fromBlock":1,"toBlock":2,"epochSizeBlocks":2,"epochNumber":0,"uuid":"cbafc41c-4595-4f23-8db3-c8307657b973"} 08:52:22 [08:52:22.549] INFO: prover-client:orchestrator Starting epoch 0 with 2 blocks 08:52:22 [08:52:22.549] VERBOSE: prover-client:broker-circuit-prover-facade Starting BrokerCircuitProverFacade 08:52:22 [08:52:22.551] VERBOSE: prover-node:epoch-proving-job Starting processing block 1 {"number":1,"blockHash":"0x2764b65e73dc21975fb06d05b21443f7691ed742789f694b182d728309198d38","lastArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"cbafc41c-4595-4f23-8db3-c8307657b973","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x0000000000000000000000000000000000000000000000000000000022e34378","blockNumber":1,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 08:52:22 [08:52:22.551] INFO: prover-client:orchestrator Starting block 1 for slot 2 08:52:22 [08:52:22.552] VERBOSE: prover-node:epoch-proving-job Starting processing block 2 {"number":2,"blockHash":"0x261851fcd4d4764ef40c557e4ac00afc650710df05934b3f343fbe6fb4f1e1bd","lastArchive":"0x15e23ae220a6cc61399d453d0e95cec2615934092595be7c4f950318efa275c6","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"cbafc41c-4595-4f23-8db3-c8307657b973","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x0000000000000000000000000000000000000000000000000000000022e34378","blockNumber":2,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000003","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 08:52:22 [08:52:22.552] INFO: prover-client:orchestrator Starting block 2 for slot 3 08:52:22 [08:52:22.572] INFO: prover-client:proving-broker New proving job id=0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03 epochNumber=0 {"provingJobId":"0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03"} 08:52:22 [08:52:22.573] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03","provingJobType":"BASE_PARITY"} 08:52:22 [08:52:22.573] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03","provingJobType":"BASE_PARITY"} 08:52:22 [08:52:22.574] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03","provingJobType":"BASE_PARITY"} 08:52:22 [08:52:22.577] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03","provingJobType":"BASE_PARITY"} 08:52:22 [08:52:22.581] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03","provingJobType":"BASE_PARITY"} 08:52:22 [08:52:22.581] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03","provingJobType":"BASE_PARITY"} 08:52:22 [08:52:22.581] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03","provingJobType":"BASE_PARITY"} 08:52:22 [08:52:22.582] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.00003407000000152038s {"duration":0.00003407000000152038,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 08:52:22 [08:52:22.582] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 08:52:22 [08:52:22.586] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 1 {"blockNumber":1,"blockHash":"0x2764b65e73dc21975fb06d05b21443f7691ed742789f694b182d728309198d38","uuid":"cbafc41c-4595-4f23-8db3-c8307657b973"} 08:52:22 [08:52:22.587] VERBOSE: prover-client:orchestrator Block 1 completed. Assembling header. 08:52:22 [08:52:22.592] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.00002391100000386359s {"duration":0.00002391100000386359,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 08:52:22 [08:52:22.593] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 08:52:22 [08:52:22.593] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 2 {"blockNumber":2,"blockHash":"0x261851fcd4d4764ef40c557e4ac00afc650710df05934b3f343fbe6fb4f1e1bd","uuid":"cbafc41c-4595-4f23-8db3-c8307657b973"} 08:52:22 [08:52:22.594] VERBOSE: prover-client:orchestrator Block 2 completed. Assembling header. 08:52:22 [08:52:22.601] VERBOSE: prover-client:orchestrator Updating archive tree with block 1 header 0x2764b65e73dc21975fb06d05b21443f7691ed742789f694b182d728309198d38 08:52:22 [08:52:22.607] VERBOSE: prover-client:orchestrator Updating archive tree with block 2 header 0x261851fcd4d4764ef40c557e4ac00afc650710df05934b3f343fbe6fb4f1e1bd 08:52:22 [08:52:22.609] VERBOSE: prover-client:orchestrator Orchestrator finalised block 1 08:52:22 [08:52:22.619] VERBOSE: prover-client:orchestrator Orchestrator finalised block 2 08:52:22 [08:52:22.635] INFO: prover-client:proving-broker-database Creating broker database for epoch 0 at /tmp/rerun-data-twIccd/0 with map size 1048576 08:52:22 [08:52:22.639] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:52:22 [08:52:22.642] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03 type=BASE_PARITY epochNumber=0 {"provingJobId":"0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03","provingJobType":"BASE_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...","status":"not-found","numOutstandingJobs":1} 08:52:22 [08:52:22.735] INFO: prover-client:proving-agent Starting job id=0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03 type=BASE_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input... 08:52:22 [08:52:22.737] INFO: prover-client:proving-agent:job-controller-2c1e6919 Job controller started jobId=0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03 {"jobId":"0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03"} 08:52:22 [08:52:22.829] INFO: prover-client:proving-agent Job id=0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03 type=BASE_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22resul... 08:52:22 [08:52:22.829] INFO: prover-client:proving-broker Proving job complete id=0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03 type=BASE_PARITY totalAttempts=1 {"provingJobId":"0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03"} 08:52:23 [08:52:23.549] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 08:52:23 [08:52:23.551] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:BASE_PARITY:e35ca0c930bacb10aff9690df221d59b52fa5611cb59bb2bebb311bdc2253f03 type=BASE_PARITY 08:52:23 [08:52:23.552] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 08:52:23 [08:52:23.565] INFO: prover-client:proving-broker New proving job id=0:ROOT_PARITY:25b61da8dfd90a9c0b5ccef05da00d684c7973ec20ed394649c29eb42bb60e30 epochNumber=0 {"provingJobId":"0:ROOT_PARITY:25b61da8dfd90a9c0b5ccef05da00d684c7973ec20ed394649c29eb42bb60e30"} 08:52:23 [08:52:23.573] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:ROOT_PARITY:25b61da8dfd90a9c0b5ccef05da00d684c7973ec20ed394649c29eb42bb60e30 type=ROOT_PARITY {"provingJobId":"0:ROOT_PARITY:25b61da8dfd90a9c0b5ccef05da00d684c7973ec20ed394649c29eb42bb60e30","provingJobType":"ROOT_PARITY"} 08:52:23 [08:52:23.618] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_PARITY:25b61da8dfd90a9c0b5ccef05da00d684c7973ec20ed394649c29eb42bb60e30 type=ROOT_PARITY epochNumber=0 {"provingJobId":"0:ROOT_PARITY:25b61da8dfd90a9c0b5ccef05da00d684c7973ec20ed394649c29eb42bb60e30","provingJobType":"ROOT_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu...","status":"not-found","numOutstandingJobs":1} 08:52:23 [08:52:23.650] INFO: prover-client:proving-agent Starting job id=0:ROOT_PARITY:25b61da8dfd90a9c0b5ccef05da00d684c7973ec20ed394649c29eb42bb60e30 type=ROOT_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu... 08:52:23 [08:52:23.689] INFO: prover-client:proving-agent:job-controller-53da1677 Job controller started jobId=0:ROOT_PARITY:25b61da8dfd90a9c0b5ccef05da00d684c7973ec20ed394649c29eb42bb60e30 {"jobId":"0:ROOT_PARITY:25b61da8dfd90a9c0b5ccef05da00d684c7973ec20ed394649c29eb42bb60e30"} 08:52:23 [08:52:23.838] INFO: prover-client:proving-agent Job id=0:ROOT_PARITY:25b61da8dfd90a9c0b5ccef05da00d684c7973ec20ed394649c29eb42bb60e30 type=ROOT_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22resu... 08:52:23 [08:52:23.839] INFO: prover-client:proving-broker Proving job complete id=0:ROOT_PARITY:25b61da8dfd90a9c0b5ccef05da00d684c7973ec20ed394649c29eb42bb60e30 type=ROOT_PARITY totalAttempts=1 {"provingJobId":"0:ROOT_PARITY:25b61da8dfd90a9c0b5ccef05da00d684c7973ec20ed394649c29eb42bb60e30"} 08:52:24 [08:52:24.553] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 08:52:24 [08:52:24.555] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:ROOT_PARITY:25b61da8dfd90a9c0b5ccef05da00d684c7973ec20ed394649c29eb42bb60e30 type=ROOT_PARITY 08:52:24 [08:52:24.555] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 08:52:24 [08:52:24.585] INFO: prover-client:proving-broker New proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:b5732217f7230a242d18aceb37211c0bbee0bcc7e78f9addacca77745102ff08 epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:b5732217f7230a242d18aceb37211c0bbee0bcc7e78f9addacca77745102ff08"} 08:52:24 [08:52:24.595] INFO: prover-client:proving-broker New proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:f55d9f9c9edb4f3e02a00a93a8e37b168e04efcb1982d7cf252b9acc77129b97 epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:f55d9f9c9edb4f3e02a00a93a8e37b168e04efcb1982d7cf252b9acc77129b97"} 08:52:24 [08:52:24.642] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:EMPTY_BLOCK_ROOT_ROLLUP:b5732217f7230a242d18aceb37211c0bbee0bcc7e78f9addacca77745102ff08 type=EMPTY_BLOCK_ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:b5732217f7230a242d18aceb37211c0bbee0bcc7e78f9addacca77745102ff08","provingJobType":"EMPTY_BLOCK_ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input...","status":"not-found","numOutstandingJobs":2} 08:52:24 [08:52:24.643] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:EMPTY_BLOCK_ROOT_ROLLUP:f55d9f9c9edb4f3e02a00a93a8e37b168e04efcb1982d7cf252b9acc77129b97 type=EMPTY_BLOCK_ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:f55d9f9c9edb4f3e02a00a93a8e37b168e04efcb1982d7cf252b9acc77129b97","provingJobType":"EMPTY_BLOCK_ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input...","status":"not-found","numOutstandingJobs":2} 08:52:24 [08:52:24.707] INFO: prover-client:proving-agent Starting job id=0:EMPTY_BLOCK_ROOT_ROLLUP:b5732217f7230a242d18aceb37211c0bbee0bcc7e78f9addacca77745102ff08 type=EMPTY_BLOCK_ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input... 08:52:24 [08:52:24.720] INFO: prover-client:proving-agent:job-controller-b9b4f1c5 Job controller started jobId=0:EMPTY_BLOCK_ROOT_ROLLUP:b5732217f7230a242d18aceb37211c0bbee0bcc7e78f9addacca77745102ff08 {"jobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:b5732217f7230a242d18aceb37211c0bbee0bcc7e78f9addacca77745102ff08"} 08:52:24 [08:52:24.724] INFO: prover-client:proving-agent Starting job id=0:EMPTY_BLOCK_ROOT_ROLLUP:f55d9f9c9edb4f3e02a00a93a8e37b168e04efcb1982d7cf252b9acc77129b97 type=EMPTY_BLOCK_ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input... 08:52:24 [08:52:24.732] INFO: prover-client:proving-agent:job-controller-3d076126 Job controller started jobId=0:EMPTY_BLOCK_ROOT_ROLLUP:f55d9f9c9edb4f3e02a00a93a8e37b168e04efcb1982d7cf252b9acc77129b97 {"jobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:f55d9f9c9edb4f3e02a00a93a8e37b168e04efcb1982d7cf252b9acc77129b97"} 08:52:26 [08:52:26.523] INFO: prover-client:proving-agent Job id=0:EMPTY_BLOCK_ROOT_ROLLUP:b5732217f7230a242d18aceb37211c0bbee0bcc7e78f9addacca77745102ff08 type=EMPTY_BLOCK_ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22resul... 08:52:26 [08:52:26.523] INFO: prover-client:proving-broker Proving job complete id=0:EMPTY_BLOCK_ROOT_ROLLUP:b5732217f7230a242d18aceb37211c0bbee0bcc7e78f9addacca77745102ff08 type=EMPTY_BLOCK_ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:b5732217f7230a242d18aceb37211c0bbee0bcc7e78f9addacca77745102ff08"} 08:52:26 [08:52:26.567] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 2, total jobs ready: 1 08:52:26 [08:52:26.570] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:b5732217f7230a242d18aceb37211c0bbee0bcc7e78f9addacca77745102ff08 type=EMPTY_BLOCK_ROOT_ROLLUP 08:52:26 [08:52:26.571] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 08:52:28 [08:52:28.928] INFO: prover-client:proving-agent Job id=0:EMPTY_BLOCK_ROOT_ROLLUP:f55d9f9c9edb4f3e02a00a93a8e37b168e04efcb1982d7cf252b9acc77129b97 type=EMPTY_BLOCK_ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22resul... 08:52:28 [08:52:28.928] INFO: prover-client:proving-broker Proving job complete id=0:EMPTY_BLOCK_ROOT_ROLLUP:f55d9f9c9edb4f3e02a00a93a8e37b168e04efcb1982d7cf252b9acc77129b97 type=EMPTY_BLOCK_ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:f55d9f9c9edb4f3e02a00a93a8e37b168e04efcb1982d7cf252b9acc77129b97"} 08:52:29 [08:52:29.702] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 08:52:29 [08:52:29.704] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:f55d9f9c9edb4f3e02a00a93a8e37b168e04efcb1982d7cf252b9acc77129b97 type=EMPTY_BLOCK_ROOT_ROLLUP 08:52:29 [08:52:29.704] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 08:52:29 [08:52:29.716] INFO: prover-client:proving-broker New proving job id=0:ROOT_ROLLUP:17b2c85e39fca95af8203ba3f2ea765eeec39b32e44c61380038f7280e935e55 epochNumber=0 {"provingJobId":"0:ROOT_ROLLUP:17b2c85e39fca95af8203ba3f2ea765eeec39b32e44c61380038f7280e935e55"} 08:52:29 [08:52:29.769] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_ROLLUP:17b2c85e39fca95af8203ba3f2ea765eeec39b32e44c61380038f7280e935e55 type=ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:ROOT_ROLLUP:17b2c85e39fca95af8203ba3f2ea765eeec39b32e44c61380038f7280e935e55","provingJobType":"ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22input...","status":"not-found","numOutstandingJobs":1} 08:52:29 [08:52:29.793] INFO: prover-client:proving-agent Starting job id=0:ROOT_ROLLUP:17b2c85e39fca95af8203ba3f2ea765eeec39b32e44c61380038f7280e935e55 type=ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22input... 08:52:29 [08:52:29.814] INFO: prover-client:proving-agent:job-controller-41d9d1bb Job controller started jobId=0:ROOT_ROLLUP:17b2c85e39fca95af8203ba3f2ea765eeec39b32e44c61380038f7280e935e55 {"jobId":"0:ROOT_ROLLUP:17b2c85e39fca95af8203ba3f2ea765eeec39b32e44c61380038f7280e935e55"} 08:52:29 [08:52:29.996] INFO: prover-client:proving-agent Job id=0:ROOT_ROLLUP:17b2c85e39fca95af8203ba3f2ea765eeec39b32e44c61380038f7280e935e55 type=ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22resul... 08:52:29 [08:52:29.997] INFO: prover-client:proving-broker Proving job complete id=0:ROOT_ROLLUP:17b2c85e39fca95af8203ba3f2ea765eeec39b32e44c61380038f7280e935e55 type=ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:ROOT_ROLLUP:17b2c85e39fca95af8203ba3f2ea765eeec39b32e44c61380038f7280e935e55"} 08:52:30 [08:52:30.705] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 08:52:30 [08:52:30.716] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:ROOT_ROLLUP:17b2c85e39fca95af8203ba3f2ea765eeec39b32e44c61380038f7280e935e55 type=ROOT_ROLLUP 08:52:30 [08:52:30.716] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 08:52:30 [08:52:30.717] VERBOSE: prover-client:orchestrator Orchestrator completed root rollup for epoch 0 08:52:30 [08:52:30.721] INFO: prover-node:epoch-proving-job Finalised proof for epoch 0 {"epochNumber":0,"uuid":"cbafc41c-4595-4f23-8db3-c8307657b973","duration":8195.625800000002} 08:52:30 [08:52:30.722] INFO: prover-node:epoch-proving-job Submitted proof for epoch 0 (blocks 1 to 2) {"epochNumber":0,"uuid":"cbafc41c-4595-4f23-8db3-c8307657b973"} 08:52:30 [08:52:30.723] VERBOSE: prover-client:broker-circuit-prover-facade Stopping BrokerCircuitProverFacade 08:52:30 [08:52:30.723] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Completed job for epoch 0 with status completed 08:52:30 [08:52:30.723] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Test succeeded 08:52:30 [08:52:30.724] INFO: prover-node:prover-node Stopping ProverNode 08:52:30 [08:52:30.725] WARN: prover-node:prover-node Running promise was not started 08:52:30 [08:52:30.725] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 08:52:30 [08:52:30.725] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 08:52:30 [08:52:30.726] WARN: archiver:prover-node Running promise was not started 08:52:30 [08:52:30.726] INFO: archiver:prover-node Stopped. 08:52:30 [08:52:30.726] WARN: world-state:block_stream:prover-node Running promise was not started 08:52:30 [08:52:30.726] INFO: world_state:prover-node Stopped world state synchronizer 08:52:30 [08:52:30.727] INFO: prover-node:prover-node Stopped ProverNode 08:52:30 [08:52:30.727] INFO: node:MAIN-aztec-node Stopping Aztec Node 08:52:32 [08:52:32.728] INFO: slasher Slasher client stopped. 08:52:32 [08:52:32.730] WARN: validator Running promise was not started 08:52:32 [08:52:32.731] WARN: sequencer Running promise was not started 08:52:32 [08:52:32.731] INFO: sequencer Stopped sequencer 08:52:32 [08:52:32.732] WARN: p2p:l2-block-stream Running promise was not started 08:52:32 [08:52:32.732] INFO: p2p P2P client stopped 08:52:32 [08:52:32.733] WARN: world-state:block_stream Running promise was not started 08:52:32 [08:52:32.733] INFO: world_state Stopped world state synchronizer 08:52:32 [08:52:32.733] WARN: archiver Running promise was not started 08:52:32 [08:52:32.733] INFO: archiver Stopped. 08:52:32 [08:52:32.734] INFO: node:MAIN-aztec-node Stopped Aztec Node 08:52:32 [08:52:32.735] INFO: node:MAIN-aztec-node Stopping Aztec Node 08:52:34 [08:52:34.736] INFO: slasher Slasher client stopped. 08:52:34 [08:52:34.737] WARN: validator Running promise was not started 08:52:34 [08:52:34.737] WARN: sequencer Running promise was not started 08:52:34 [08:52:34.737] INFO: sequencer Stopped sequencer 08:52:34 [08:52:34.738] WARN: p2p:l2-block-stream Running promise was not started 08:52:34 [08:52:34.738] INFO: p2p P2P client stopped 08:52:34 [08:52:34.738] WARN: world-state:block_stream Running promise was not started 08:52:34 [08:52:34.739] INFO: world_state Stopped world state synchronizer 08:52:34 [08:52:34.739] WARN: archiver Running promise was not started 08:52:34 [08:52:34.739] INFO: archiver Stopped. 08:52:34 [08:52:34.739] INFO: node:MAIN-aztec-node Stopped Aztec Node 08:52:34 [08:52:34.740] INFO: prover-node:prover-node Stopping ProverNode 08:52:34 [08:52:34.740] WARN: prover-node:prover-node Running promise was not started 08:52:34 [08:52:34.740] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 08:52:34 [08:52:34.741] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 08:52:34 [08:52:34.741] WARN: archiver:prover-node Running promise was not started 08:52:34 [08:52:34.741] INFO: archiver:prover-node Stopped. 08:52:34 [08:52:34.741] WARN: world-state:block_stream:prover-node Running promise was not started 08:52:34 [08:52:34.741] INFO: world_state:prover-node Stopped world state synchronizer 08:52:34 [08:52:34.742] INFO: prover-node:prover-node Stopped ProverNode 08:52:34 [08:52:34.743] INFO: blob-sink:server Stopping blob sink 08:52:34 [08:52:34.743] INFO: blob-sink:server Blob sink already stopped 08:52:34 PASS src/e2e_epochs/epochs_upload_failed_proof.test.ts 08:52:34 e2e_epochs/epochs_upload_failed_proof 08:52:34 ✓ uploads failed proving job state and re-runs it on a fresh instance (56026 ms) 08:52:34 08:52:34 Test Suites: 1 passed, 1 total 08:52:34 Tests: 1 passed, 1 total 08:52:34 Snapshots: 0 total 08:52:34 Time: 64.766 s 08:52:34 Ran all test suites matching src/e2e_epochs/epochs_upload_failed_proof.test.ts. 08:52:34 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?