Parent Log: http://ci.aztec-labs.com/0c065222b8e9e1ac Command: 3f9f83eed807ea26:ISOLATE=1:NAME=e2e_epochs/epochs_upload_failed_proof yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_upload_failed_proof.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/355a15ab9ebeabff4c5709a97b85bb6c0f1c7b62 Env: REF_NAME=gh-readonly-queue/next/pr-14961-98fbe17330964452777de26d56f0a3ed5633aca1 CURRENT_VERSION=0.87.6 CI_FULL=1 Date: Thu Jun 12 10:24:00 UTC 2025 System: ARCH=amd64 CPUS=128 MEM=493Gi HOSTNAME=pr-14961_amd64_x3-full Resources: CPU_LIST=0-127 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_476a42720cde10eb_next 10:24:00 +++ id -u 10:24:00 +++ id -g 10:24:00 ++ docker run -d --name e2e_epochs_epochs_upload_failed_proof --net=none --cpuset-cpus=0-127 --cpus=2 --memory=8g --user 1000:1000 -v/home/aztec-dev:/home/aztec-dev --mount type=tmpfs,target=/tmp,tmpfs-size=1g --workdir /home/aztec-dev/aztec-packages -e HOME -e VERBOSE -e GIT_CONFIG_GLOBAL=/home/aztec-dev/aztec-packages/build-images/src/home/.gitconfig -e FORCE_COLOR=true -e CPUS -e MEM aztecprotocol/build:3.0 /bin/bash -c 'timeout -v 600s bash -c '\''yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_upload_failed_proof.test.ts'\''' 10:24:01 + cid=78977541fb42be463fa8b73ffe75ac214613094b52e376901f8437aa8a5287cf 10:24:01 + set +x 10:24:02 {"level":25,"time":1749723842190,"pid":13,"hostname":"78977541fb42","module":"logger","msg":"Logger initialized with level verbose"} 10:24:10 [10:24:10.544] INFO: e2e:epochs_upload_failed_proof Running test: e2e_epochs/epochs_upload_failed_proof uploads failed proving job state and re-runs it on a fresh instance 10:24:10 [10:24:10.709] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Logging metrics to log/e2e_epochs_epochs_upload_failed_proof.jsonl 10:24:10 [10:24:10.947] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Calling anvil_setBlockTimestampInterval with params: [8] 10:24:10 [10:24:10.974] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Set block interval to 8 10:24:10 [10:24:10.975] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contracts from 0xf39Fd6e51aad88F6F4ce6aB8827279cffFb92266 10:24:11 [10:24:11.069] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xff8f3047f70ec9e63079d7903c02a47802dc292d5660d2da825ac209bbd9cd89 {"gasLimit":867658,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 10:24:11 [10:24:11.071] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xd8B56421e9b573AE62f2997B7b58858a4413A967 in tx 0xff8f3047f70ec9e63079d7903c02a47802dc292d5660d2da825ac209bbd9cd89. 10:24:11 [10:24:11.073] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Fee Asset at 0xd8b56421e9b573ae62f2997b7b58858a4413a967 10:24:11 [10:24:11.134] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xb8a727e5dcee31d2ee7a6a94b8b01df7952fdc685dfb1b5bb36a0dbda9d08d89 {"gasLimit":867644,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 10:24:11 [10:24:11.135] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x026208feE3F4461826C8838C3569272E8C08E131 in tx 0xb8a727e5dcee31d2ee7a6a94b8b01df7952fdc685dfb1b5bb36a0dbda9d08d89. 10:24:11 [10:24:11.136] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Staking Asset at 0x026208fee3f4461826c8838c3569272e8c08e131 10:24:11 [10:24:11.182] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x84345970a64bc89d244665c6d19bcf62f7a1fb0c5497fd61c66569ea96442f1f {"gasLimit":3118894,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 10:24:11 [10:24:11.183] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xad2120681B02De3e9b8aFd325977CDeDDf15f01C in tx 0x84345970a64bc89d244665c6d19bcf62f7a1fb0c5497fd61c66569ea96442f1f. 10:24:11 [10:24:11.185] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed GSE at 0xad2120681b02de3e9b8afd325977cdeddf15f01c 10:24:11 [10:24:11.235] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x96c1e759b945754976d026659a519c1c5d05a738916e69d742cdec67a5482765 {"gasLimit":1030513,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 10:24:11 [10:24:11.236] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x992D1f24CC5f368188d936cf0b2A111cEE586d4e in tx 0x96c1e759b945754976d026659a519c1c5d05a738916e69d742cdec67a5482765. 10:24:11 [10:24:11.238] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Registry at 0x992d1f24cc5f368188d936cf0b2a111cee586d4e 10:24:11 [10:24:11.285] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x35838f7740ede8daad92b7b8589b59625f0100193e252bc6ce3862a65d23892c {"gasLimit":1998672,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 10:24:11 [10:24:11.285] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xfDB60896B1920A10Fd3AA268A292E51ebD5568A8 in tx 0x35838f7740ede8daad92b7b8589b59625f0100193e252bc6ce3862a65d23892c. 10:24:11 [10:24:11.286] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed GovernanceProposer at 0xfdb60896b1920a10fd3aa268a292e51ebd5568a8 10:24:11 [10:24:11.321] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x4dbcecd47a2081d10a38e4cf385714d92e542e5a44eb5a37a3810c6c6738dc4e {"gasLimit":3092007,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 10:24:11 [10:24:11.322] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x506150CaB49DBC09C8B79D20ac5c79CA28220AEA in tx 0x4dbcecd47a2081d10a38e4cf385714d92e542e5a44eb5a37a3810c6c6738dc4e. 10:24:11 [10:24:11.322] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Governance at 0x506150cab49dbc09c8b79d20ac5c79ca28220aea 10:24:11 [10:24:11.333] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xf2ecc0d2040ae9928a4b186c21f02e611c2904f24b196eed69d646e9333cc00d {"gasLimit":100000,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 10:24:11 [10:24:11.334] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Set governance on GSE in 0xf2ecc0d2040ae9928a4b186c21f02e611c2904f24b196eed69d646e9333cc00d 10:24:11 [10:24:11.367] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x77f9fa97fbbcb04392e88d456c198520b3425518c3d2d4146393099192372448 {"gasLimit":397390,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 10:24:11 [10:24:11.368] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x1649EeAD62C64Db7F63182989C8c41Ab25025C21 in tx 0x77f9fa97fbbcb04392e88d456c198520b3425518c3d2d4146393099192372448. 10:24:11 [10:24:11.369] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed CoinIssuer at 0x1649eead62c64db7f63182989c8c41ab25025c21 10:24:11 [10:24:11.370] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for deployments to complete 10:24:11 [10:24:11.370] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 7 transactions to be mined... 10:24:19 [10:24:19.415] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 10:24:19 [10:24:19.467] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xc033579f2357cfd2f6fa38d1ef9986415f4ed794add3fff64984bc3f1257e970 {"gasLimit":100000,"maxFeePerGas":"3.04180664","maxPriorityFeePerGas":"1.44"} 10:24:19 [10:24:19.471] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added coin issuer 0x1649eead62c64db7f63182989c8c41ab25025c21 as minter on fee asset in 0xc033579f2357cfd2f6fa38d1ef9986415f4ed794add3fff64984bc3f1257e970 10:24:19 [10:24:19.542] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xd6a54e4eed6f07d2b8dcaafbd3883b3558583e43612f444af113d489245a2bb1 {"gasLimit":56661,"maxFeePerGas":"3.04180664","maxPriorityFeePerGas":"1.44"} 10:24:19 [10:24:19.615] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xa67ff7f4001dc5703375e116caba00222d15ec13472e10af8018f62318b463cb {"gasLimit":344517,"maxFeePerGas":"3.04180664","maxPriorityFeePerGas":"1.44"} 10:24:19 [10:24:19.615] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x3607dbAfDe17871E0D6A8f929151C30b83510D39 in tx 0xa67ff7f4001dc5703375e116caba00222d15ec13472e10af8018f62318b463cb. 10:24:19 [10:24:19.621] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed FeeAssetHandler at 0x3607dbafde17871e0d6a8f929151c30b83510d39 10:24:19 [10:24:19.722] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xa32bc1b02f5f02b41626611ec0e0056cad989330fbf908181b5d4f7678377aae {"gasLimit":56804,"maxFeePerGas":"3.04180664","maxPriorityFeePerGas":"1.44"} 10:24:19 [10:24:19.723] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added fee asset handler 0x3607dbafde17871e0d6a8f929151c30b83510d39 as minter on fee asset in 0xa32bc1b02f5f02b41626611ec0e0056cad989330fbf908181b5d4f7678377aae 10:24:19 [10:24:19.765] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xadb884185b00b3cf3fb2aac4753fbbc2bbb58dfbab2a937d61ea0e950d96b91b {"gasLimit":2514669,"maxFeePerGas":"3.04180664","maxPriorityFeePerGas":"1.44"} 10:24:19 [10:24:19.766] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x499C89D6b68cBdcA67C96Bff13Eb5B5a8fDb25a2 in tx 0xadb884185b00b3cf3fb2aac4753fbbc2bbb58dfbab2a937d61ea0e950d96b91b. 10:24:19 [10:24:19.766] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed StakingAssetHandler at 0x499c89d6b68cbdca67c96bff13eb5b5a8fdb25a2 10:24:19 [10:24:19.790] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x2b32bbf996c6d3500330bc3ce74137b03f19074efe8ad0d3e14e6dea009f12e4 {"gasLimit":56804,"maxFeePerGas":"3.04180664","maxPriorityFeePerGas":"1.44"} 10:24:19 [10:24:19.794] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added staking asset handler 0x499c89d6b68cbdca67c96bff13eb5b5a8fdb25a2 as minter on staking asset in 0x2b32bbf996c6d3500330bc3ce74137b03f19074efe8ad0d3e14e6dea009f12e4 10:24:19 [10:24:19.795] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for deployments to complete 10:24:19 [10:24:19.795] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 9 transactions to be mined... 10:24:27 [10:24:27.829] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 10:24:27 [10:24:27.853] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed shared contracts 10:24:27 [10:24:27.894] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x1f3bf003fea3920e27f0ab1b5a7c080b356836c498ba06ccbbb2f38e05cac9a5 {"gasLimit":84823,"maxFeePerGas":"3.2549605","maxPriorityFeePerGas":"1.728"} 10:24:27 [10:24:27.895] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Funded reward distributor with 10000000000000000000000000 fee asset in 0x1f3bf003fea3920e27f0ab1b5a7c080b356836c498ba06ccbbb2f38e05cac9a5 10:24:27 [10:24:27.932] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x8ddfc36dd291a7e69dbb1d1c4b25283f53b9e73f733772b984e1b7cef75ca71d {"gasLimit":154658,"maxFeePerGas":"3.2549605","maxPriorityFeePerGas":"1.728"} 10:24:27 [10:24:27.932] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x277E22B0C9698d7f2A1cD7C6d857511617587309 in tx 0x8ddfc36dd291a7e69dbb1d1c4b25283f53b9e73f733772b984e1b7cef75ca71d. 10:24:27 [10:24:27.933] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup will use the mock verifier at 0x277e22b0c9698d7f2a1cd7c6d857511617587309 10:24:27 [10:24:27.938] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup config args {"aztecSlotDuration":16,"aztecEpochDuration":4,"targetCommitteeSize":48,"aztecProofSubmissionWindow":7,"slashingQuorum":6,"slashingRoundSize":10,"manaTarget":10000000000,"provingCostPerMana":100,"rewardConfig":{"sequencerBps":5000,"increment":200000,"maxScore":5000000,"a":5000,"k":1000000,"minimum":100000}} 10:24:27 [10:24:27.971] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x1244dd983dfa48995970c0afd0fb79b5391ff919edd2ee7939902fc973eec3e1 {"gasLimit":86992,"maxFeePerGas":"3.2549605","maxPriorityFeePerGas":"1.728"} 10:24:27 [10:24:27.972] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xbba8820C80d584aEc2Cb092C3a0bE628aAB41fe3 in tx 0x1244dd983dfa48995970c0afd0fb79b5391ff919edd2ee7939902fc973eec3e1. 10:24:28 [10:24:28.036] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x0785920f3b1808bbb32fbbb9fc7abf594c7e8c615f21bf1b26859927d6d53edc {"gasLimit":6301243,"maxFeePerGas":"3.2549605","maxPriorityFeePerGas":"1.728"} 10:24:28 [10:24:28.037] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x0130CEd3370Af8E822F3D9076177E04F1cA75D3e in tx 0x0785920f3b1808bbb32fbbb9fc7abf594c7e8c615f21bf1b26859927d6d53edc. 10:24:28 [10:24:28.038] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Awaiting for linked libraries to be deployed 10:24:36 [10:24:36.161] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xcb446c06da7708598282d1d5b6a07e8303a0821bd3e65faf6ac5965dd336c000 {"gasLimit":11236180,"maxFeePerGas":"3.44200128","maxPriorityFeePerGas":"2.0736"} 10:24:36 [10:24:36.162] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x16D1D277f9340C50E1c7a9916aB994247a68AF9f in tx 0xcb446c06da7708598282d1d5b6a07e8303a0821bd3e65faf6ac5965dd336c000. 10:24:36 [10:24:36.163] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Rollup at 0x16d1d277f9340c50e1c7a9916ab994247a68af9f {"aztecSlotDuration":16,"aztecEpochDuration":4,"targetCommitteeSize":48,"aztecProofSubmissionWindow":7,"slashingQuorum":6,"slashingRoundSize":10,"manaTarget":10000000000,"provingCostPerMana":100,"rewardConfig":{"sequencerBps":5000,"increment":200000,"maxScore":5000000,"a":5000,"k":1000000,"minimum":100000}} 10:24:36 [10:24:36.164] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 11 transactions to be mined... 10:24:44 [10:24:44.196] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 10:24:44 [10:24:44.197] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof All core contracts have been deployed 10:24:44 [10:24:44.237] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xb7d9a2b3422793e05525e18913ab98eebdd11406fc5f6be8bacf7fdbd19d49bd {"gasLimit":1056496,"maxFeePerGas":"3.747782171","maxPriorityFeePerGas":"2.48832"} 10:24:44 [10:24:44.238] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x02E01398185DCD54AE19eF8481FF736305c90871 in tx 0xb7d9a2b3422793e05525e18913ab98eebdd11406fc5f6be8bacf7fdbd19d49bd. 10:24:44 [10:24:44.239] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed SlashFactory at 0x02e01398185dcd54ae19ef8481ff736305c90871 10:24:44 [10:24:44.297] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x769d0fe3b824c47a1ce39b3f14c965cf421e8d1a98fc7ca6e066c098a83fe7ed {"gasLimit":116846,"maxFeePerGas":"3.747782171","maxPriorityFeePerGas":"2.48832"} 10:24:44 [10:24:44.297] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Adding rollup 0x16d1d277f9340c50e1c7a9916ab994247a68af9f to registry 0x992d1f24cc5f368188d936cf0b2a111cee586d4e in tx 0x769d0fe3b824c47a1ce39b3f14c965cf421e8d1a98fc7ca6e066c098a83fe7ed 10:24:44 [10:24:44.327] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x379d056831f4c196793c09ae0bc40252c1bcc6d01ad683a7e05785ae232b94c4 {"gasLimit":109478,"maxFeePerGas":"3.747782171","maxPriorityFeePerGas":"2.48832"} 10:24:44 [10:24:44.328] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Adding rollup 0x16d1d277f9340c50e1c7a9916ab994247a68af9f to GSE 0xad2120681b02de3e9b8afd325977cdeddf15f01c in tx 0x379d056831f4c196793c09ae0bc40252c1bcc6d01ad683a7e05785ae232b94c4 10:24:52 [10:24:52.339] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 12 transactions to be mined... 10:24:52 [10:24:52.402] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 10:24:52 [10:24:52.408] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup deployed 10:24:52 [10:24:52.408] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for rollup and slash factory to be deployed 10:24:52 [10:24:52.409] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 12 transactions to be mined... 10:24:52 [10:24:52.467] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 10:24:52 [10:24:52.467] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof All transactions for L1 deployment have been mined 10:24:52 [10:24:52.501] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Aztec L1 contracts initialized {"registryAddress":"0x992d1f24cc5f368188d936cf0b2a111cee586d4e","governanceAddress":"0x506150cab49dbc09c8b79d20ac5c79ca28220aea","governanceProposerAddress":"0xfdb60896b1920a10fd3aa268a292e51ebd5568a8","rollupAddress":"0x16d1d277f9340c50e1c7a9916ab994247a68af9f","inboxAddress":"0x421e142dcf1b8b8e2a467dd84e15b0fb9bb89ee2","outboxAddress":"0x00f6b75ca3323d3c1aeab5c3199967fb53eca5cb","feeJuicePortalAddress":"0x96bef22b899e8c881bde3f499300f8e1802aaa6d","feeJuiceAddress":"0xd8b56421e9b573ae62f2997b7b58858a4413a967","stakingAssetAddress":"0x026208fee3f4461826c8838c3569272e8c08e131","rewardDistributorAddress":"0xd462e23c2c8a9b4f83de76004a170d4cebb5d3e1","gseAddress":"0xad2120681b02de3e9b8afd325977cdeddf15f01c","coinIssuerAddress":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266"} 10:24:52 [10:24:52.501] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Handing over to governance 10:24:52 [10:24:52.510] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Calling evm_setNextBlockTimestamp with params: [1749723898] 10:24:52 [10:24:52.518] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Calling hardhat_mine with params: [1] 10:24:52 [10:24:52.527] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Jumped to slot 1 10:24:52 [10:24:52.542] INFO: aztecjs:utils:watcher Watcher not started because not auto mining 10:24:52 [10:24:52.543] INFO: telemetry:client Using NoopTelemetryClient 10:24:52 [10:24:52.546] INFO: kv-store:lmdb-v2:blob-sink Creating blob-sink data store at directory /tmp/5aed7340a89fd652/blob-sink with map size 134217728 KB (LMDB v2) 10:24:52 [10:24:52.551] INFO: kv-store:lmdb-v2:blob-sink Starting data store with maxReaders 16 10:24:52 [10:24:52.567] INFO: blob-sink:server Server is running on http://localhost:35109 10:24:52 [10:24:52.568] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating and synching an aztec node... 10:24:52 [10:24:52.569] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Using native ACVM binary at ../../noir/noir-repo/target/release/acvm with working directory /tmp/80ab6656/acvm 10:24:52 [10:24:52.572] INFO: node:blob-sink:client Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:35109"} 10:24:52 [10:24:52.630] VERBOSE: node Snapshot sync is disabled. No snapshots URL provided. 10:24:52 [10:24:52.631] INFO: archiver:lmdb Creating archiver data store at directory /tmp/5aed7340a89fd652/archiver with map size 134217728 KB (LMDB v2) 10:24:52 [10:24:52.633] INFO: archiver:lmdb Starting data store with maxReaders 16 10:24:53 [10:24:53.612] INFO: node:blob-sink:client Testing configured blob sources {"blobSinkUrl":"http://localhost:35109"} 10:24:53 [10:24:53.637] INFO: node:blob-sink:client Blob sink is reachable {"blobSinkUrl":"http://localhost:35109"} 10:24:53 [10:24:53.638] WARN: node:blob-sink:client No L1 consensus host urls configured 10:24:53 [10:24:53.638] WARN: node:blob-sink:client No archive client configured 10:24:53 [10:24:53.643] INFO: archiver Starting archiver sync to rollup contract 0x16d1d277f9340c50e1c7a9916ab994247a68af9f from L1 block 4 to current L1 block 6 with hash 0x38de4ef16413bbd0b03baaa3e1509cc85f358fef8988134de4a906381360f0d8 {"blocksSynchedTo":4,"messagesSynchedTo":{"l1BlockHash":"0x6f968e6a0d4611a1ceb23b1609833c19d5eb136c95d431b0bd194009e31fbfc6","l1BlockNumber":4}} 10:24:53 [10:24:53.696] INFO: archiver Initial archiver sync to L1 block 6 complete. {"l1BlockNumber":6,"syncPoint":{"blocksSynchedTo":6,"messagesSynchedTo":{"l1BlockHash":"0x38de4ef16413bbd0b03baaa3e1509cc85f358fef8988134de4a906381360f0d8","l1BlockNumber":6}},"latest":{"number":0},"proven":{"number":0},"finalized":{"number":0}} 10:24:53 [10:24:53.713] INFO: world-state:database Creating world state data store at directory /tmp/5aed7340a89fd652/world_state with map sizes {"archiveTreeMapSizeKb":134217728,"nullifierTreeMapSizeKb":134217728,"noteHashTreeMapSizeKb":134217728,"messageTreeMapSizeKb":134217728,"publicDataTreeMapSizeKb":134217728} and 2 threads. 10:24:53 [10:24:53.752] INFO: world_state Created world state synchroniser with block history of 2 10:24:53 [10:24:53.752] WARN: node Aztec node is accepting fake proofs 10:24:53 [10:24:53.766] INFO: p2p:lmdb-v2 Creating p2p data store at directory /tmp/5aed7340a89fd652/p2p with map size 134217728 KB (LMDB v2) 10:24:53 [10:24:53.772] INFO: p2p:lmdb-v2 Starting data store with maxReaders 16 10:24:53 [10:24:53.773] INFO: p2p-archive:lmdb-v2 Creating p2p-archive data store at directory /tmp/5aed7340a89fd652/p2p-archive with map size 134217728 KB (LMDB v2) 10:24:53 [10:24:53.775] INFO: p2p-archive:lmdb-v2 Starting data store with maxReaders 16 10:24:53 [10:24:53.777] INFO: p2p-peer:lmdb-v2 Creating p2p-peers data store at directory /tmp/5aed7340a89fd652/p2p-peers with map size 134217728 KB (LMDB v2) 10:24:53 [10:24:53.780] INFO: p2p-peer:lmdb-v2 Starting data store with maxReaders 16 10:24:53 [10:24:53.782] INFO: p2p:tx_pool Setting maximum tx mempool size {"maxTxPoolSize":100000000} 10:24:53 [10:24:53.783] VERBOSE: p2p P2P is disabled. Using dummy P2P service 10:24:53 [10:24:53.786] VERBOSE: world-state:block_stream Starting L2 block stream {"proven":false,"pollIntervalMS":50} 10:24:53 [10:24:53.786] INFO: world_state Started world state synchronizer from block 1 10:24:53 [10:24:53.789] VERBOSE: world-state:block_stream Starting sync from block number 0 10:24:53 [10:24:53.790] INFO: p2p Starting p2p client from block 0 with empty mempools 10:24:53 [10:24:53.791] VERBOSE: p2p:l2-block-stream Starting L2 block stream {"batchSize":20,"pollIntervalMS":100,"startingBlock":0} 10:24:54 [10:24:54.142] INFO: epoch-prune-watcher EpochPruneWatcher initialized 10:24:54 [10:24:54.187] VERBOSE: validator Initialized validator with addresses: 0x34c84cad87525a32c9175165d1723f9eca88d36b 10:24:54 [10:24:54.188] VERBOSE: node All Aztec Node subsystems synced 10:24:54 [10:24:54.212] INFO: slasher Starting Slasher client... 10:24:54 [10:24:54.225] VERBOSE: p2p:l2-block-stream Starting sync from block number 0 10:24:54 [10:24:54.234] INFO: sequencer-client Deploying forwarder contract 10:24:54 [10:24:54.261] VERBOSE: sequencer-client Sent L1 transaction 0xda888973b4ad2d3d163799c42065a89b2c05bcb621343d65d24f9b27b4d854fa {"gasLimit":323704,"maxFeePerGas":"2.259597543","maxPriorityFeePerGas":"1.2"} 10:24:54 [10:24:54.262] VERBOSE: sequencer-client Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000042 to address 0x0fe4d493871B0C51332De8A330B02BA8172Da4aC in tx 0xda888973b4ad2d3d163799c42065a89b2c05bcb621343d65d24f9b27b4d854fa. 10:25:02 [10:25:02.294] INFO: sequencer-client Forwarder contract deployed at 0x0fe4d493871b0c51332de8a330b02ba8172da4ac 10:25:02 [10:25:02.318] INFO: validator Started validator with addresses: 0x34c84cad87525a32c9175165d1723f9eca88d36b 10:25:02 [10:25:02.319] VERBOSE: validator Validators 0x34c84cad87525a32c9175165d1723f9eca88d36b are not on the validator committee for epoch 0 10:25:02 [10:25:02.320] INFO: sequencer Sequencer config set {"transactionPollingIntervalMS":500,"maxTxsPerBlock":32,"minTxsPerBlock":0,"maxL2BlockGas":10000000000,"publishTxsWithProposals":false,"maxDABlockGas":10000000000,"acvmWorkingDirectory":"/tmp/80ab6656/acvm","acvmBinaryPath":"../../noir/noir-repo/target/release/acvm","maxBlockSizeInBytes":1048576,"governanceProposerPayload":"0x0000000000000000000000000000000000000000","maxL1TxInclusionTimeIntoSlot":8,"enforceTimeTable":false} 10:25:02 [10:25:02.321] VERBOSE: sequencer Sequencer timetable updated {"enforceTimeTable":false} 10:25:02 [10:25:02.326] INFO: sequencer Sequencer started with address 0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266 10:25:02 [10:25:02.327] INFO: node Aztec Node version: 0.87.6 10:25:02 [10:25:02.327] INFO: node Aztec Node started on chain 0x7a69 {"registryAddress":"0x992d1f24cc5f368188d936cf0b2a111cee586d4e","governanceAddress":"0x506150cab49dbc09c8b79d20ac5c79ca28220aea","governanceProposerAddress":"0xfdb60896b1920a10fd3aa268a292e51ebd5568a8","rollupAddress":"0x16d1d277f9340c50e1c7a9916ab994247a68af9f","inboxAddress":"0x421e142dcf1b8b8e2a467dd84e15b0fb9bb89ee2","outboxAddress":"0x00f6b75ca3323d3c1aeab5c3199967fb53eca5cb","feeJuicePortalAddress":"0x96bef22b899e8c881bde3f499300f8e1802aaa6d","feeJuiceAddress":"0xd8b56421e9b573ae62f2997b7b58858a4413a967","stakingAssetAddress":"0x026208fee3f4461826c8838c3569272e8c08e131","rewardDistributorAddress":"0xd462e23c2c8a9b4f83de76004a170d4cebb5d3e1","gseAddress":"0xad2120681b02de3e9b8afd325977cdeddf15f01c","coinIssuerAddress":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","slashFactoryAddress":"0x02e01398185dcd54ae19ef8481ff736305c90871","feeAssetHandlerAddress":"0x3607dbafde17871e0d6a8f929151c30b83510d39","stakingAssetHandlerAddress":"0x499c89d6b68cbdca67c96bff13eb5b5a8fdb25a2","zkPassportVerifierAddress":"0xee9f10f38319eae2730dba28fb09081db806c5e5"} 10:25:02 [10:25:02.329] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating and syncing a simulated prover node... 10:25:02 [10:25:02.452] INFO: blob-sink:client:prover-node Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:35109"} 10:25:02 [10:25:02.460] INFO: archiver:lmdb:prover-node Creating archiver data store at directory /tmp/5aed7340a89fd652/aafe71d72885e67a/archiver with map size 134217728 KB (LMDB v2) 10:25:02 [10:25:02.465] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 10:25:02 [10:25:02.468] INFO: archiver:lmdb:prover-node Starting data store with maxReaders 16 10:25:02 [10:25:02.860] INFO: blob-sink:client:prover-node Testing configured blob sources {"blobSinkUrl":"http://localhost:35109"} 10:25:02 [10:25:02.864] INFO: blob-sink:client:prover-node Blob sink is reachable {"blobSinkUrl":"http://localhost:35109"} 10:25:02 [10:25:02.865] WARN: blob-sink:client:prover-node No L1 consensus host urls configured 10:25:02 [10:25:02.865] WARN: blob-sink:client:prover-node No archive client configured 10:25:02 [10:25:02.876] INFO: archiver:prover-node Starting archiver sync to rollup contract 0x16d1d277f9340c50e1c7a9916ab994247a68af9f from L1 block 4 to current L1 block 7 with hash 0x4c88ed427afb9bfb78464187defcc9e735b7a8251b553224611ff79abb62fa18 {"blocksSynchedTo":4,"messagesSynchedTo":{"l1BlockHash":"0x6f968e6a0d4611a1ceb23b1609833c19d5eb136c95d431b0bd194009e31fbfc6","l1BlockNumber":4}} 10:25:02 [10:25:02.895] INFO: archiver:prover-node Initial archiver sync to L1 block 7 complete. {"l1BlockNumber":7,"syncPoint":{"blocksSynchedTo":7,"messagesSynchedTo":{"l1BlockHash":"0x4c88ed427afb9bfb78464187defcc9e735b7a8251b553224611ff79abb62fa18","l1BlockNumber":7}},"latest":{"number":0},"proven":{"number":0},"finalized":{"number":0}} 10:25:02 [10:25:02.898] INFO: prover-node:blob-sink:client:prover-node Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:35109"} 10:25:02 [10:25:02.898] VERBOSE: prover-node:prover-node Snapshot sync is disabled. No snapshots URL provided. 10:25:02 [10:25:02.900] VERBOSE: prover-node:prover-node Created archiver and synced to block 0 10:25:02 [10:25:02.910] INFO: world-state:database:prover-node Creating world state data store at directory /tmp/5aed7340a89fd652/aafe71d72885e67a/world_state with map sizes {"archiveTreeMapSizeKb":134217728,"nullifierTreeMapSizeKb":134217728,"noteHashTreeMapSizeKb":134217728,"messageTreeMapSizeKb":134217728,"publicDataTreeMapSizeKb":134217728} and 2 threads. 10:25:02 [10:25:02.950] INFO: world_state:prover-node Created world state synchroniser with block history of 2 10:25:02 [10:25:02.952] VERBOSE: world-state:block_stream:prover-node Starting L2 block stream {"proven":false,"pollIntervalMS":50} 10:25:02 [10:25:02.954] INFO: world_state:prover-node Started world state synchronizer from block 1 10:25:02 [10:25:02.960] VERBOSE: world-state:block_stream:prover-node Starting sync from block number 0 10:25:02 [10:25:02.961] WARN: prover-client:proving-broker-database:prover-node Found invalid epoch directory /tmp/5aed7340a89fd652/aafe71d72885e67a/archiver when loading epoch databases, ignoring 10:25:02 [10:25:02.963] WARN: prover-client:proving-broker-database:prover-node Found invalid epoch directory /tmp/5aed7340a89fd652/aafe71d72885e67a/world_state when loading epoch databases, ignoring 10:25:02 [10:25:02.965] INFO: prover-client:proving-broker:prover-node Proving Broker started 10:25:03 [10:25:02.998] INFO: prover-node:prover-coordination:prover-node Using prover coordination via aztec node 10:25:03 [10:25:03.001] INFO: e2e:e2e_epochs:epochs_upload_failed_proof:prover-node Created and synced prover node {"publisherAddress":"0x3C44CdDdB6a900fa2b585dd299e03d12FA4293BC"} 10:25:03 [10:25:03.002] INFO: prover-node:epoch-monitor:prover-node Started EpochMonitor {"pollingIntervalMs":200} 10:25:03 [10:25:03.008] INFO: prover-node:prover-node Started Prover Node with prover id 0x0000000000000000000000000000000000000000000000000000000000000001 {"proverNodePollingIntervalMs":200,"proverNodeMaxPendingJobs":10,"proverNodeMaxParallelBlocksPerEpoch":32,"txGatheringIntervalMs":1000,"txGatheringBatchSize":10,"txGatheringMaxParallelRequestsPerNode":100,"proverNodeFailedEpochStore":"file:///tmp/failed-proofs-NwTzfI","dataDirectory":"/tmp/5aed7340a89fd652/aafe71d72885e67a","l1ChainId":31337,"rollupVersion":1849448694} 10:25:03 [10:25:03.008] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating a pxe... 10:25:03 [10:25:03.024] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 10:25:03 [10:25:03.042] INFO: pxe:data:lmdb Creating pxe_data data store at directory /tmp/bf2a6317b76fe765/pxe_data with map size 134217728 KB (LMDB v2) 10:25:03 [10:25:03.057] INFO: pxe:data:lmdb Starting data store with maxReaders 16 10:25:03 [10:25:03.554] VERBOSE: pxe:service Registered protocol contracts in pxe {"AuthRegistry":"0x0000000000000000000000000000000000000000000000000000000000000001","ContractInstanceDeployer":"0x0000000000000000000000000000000000000000000000000000000000000002","ContractClassRegisterer":"0x0000000000000000000000000000000000000000000000000000000000000003","MultiCallEntrypoint":"0x0000000000000000000000000000000000000000000000000000000000000004","FeeJuice":"0x0000000000000000000000000000000000000000000000000000000000000005","Router":"0x0000000000000000000000000000000000000000000000000000000000000006"} 10:25:03 [10:25:03.555] INFO: pxe:service Started PXE connected to chain 31337 version 1849448694 10:25:03 [10:25:03.568] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L2 genesis at L1 block 4 (timestamp 1749723882) 10:25:03 [10:25:03.569] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting until L1 timestamp 1749723946 is reached as the start of epoch 1 10:25:03 [10:25:03.572] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 10:25:03 [10:25:03.849] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 7 mined at 10:25:06 with new L2 block 0 for epoch 0 with proof up to L2 block 0 for epoch 0 {"l1Timestamp":1749723906,"l1BlockNumber":7,"l2SlotNumber":1,"l2BlockNumber":0,"l2ProvenBlockNumber":0,"totalL2Messages":0} 10:25:04 [10:25:04.118] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 10:25:04 [10:25:04.633] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 10:25:05 [10:25:05.146] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 10:25:05 [10:25:05.663] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 10:25:06 [10:25:06.203] VERBOSE: sequencer Preparing proposal for block 1 at slot 2 {"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1749723914,"version":1849448694},"chainTipArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","blockNumber":1,"slot":2} 10:25:06 [10:25:06.250] VERBOSE: block-builder Building block 1 for slot 2 {"slot":2,"slotStart":"2025-06-12T10:25:14.000Z","now":"2025-06-12T10:25:06.250Z","blockNumber":1,"msgCount":0,"opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}} 10:25:06 [10:25:06.284] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.019077507000001787s {"duration":0.019077507000001787,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 10:25:06 [10:25:06.333] INFO: sequencer Built block 1 for slot 2 with 0 txs and 0 messages. 0 mana/s {"blockHash":"0x302aad9859d5f3a0b5c78321d4041d51d1c3882796329a3edf391daa22949ed4","globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1749723914,"version":1849448694},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":106.54816999999457,"publicProcessDuration":20.903372000000672,"rollupCircuitsDuration":94.79862900000444,"txCount":0,"blockNumber":1,"blockTimestamp":1749723914,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 10:25:06 [10:25:06.343] VERBOSE: sequencer Attesting committee is empty 10:25:06 [10:25:06.825] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 8 mined at 10:25:14 {"l1Timestamp":1749723914,"l1BlockNumber":8,"l2SlotNumber":2,"l2BlockNumber":0,"l2ProvenBlockNumber":0,"totalL2Messages":0} 10:25:09 [10:25:09.525] VERBOSE: ethereum:tx_delayer Sent tx immediately 0xa73211849cfc237e447cf0d9188ed9b75515c0f629dd1e357878e62e65149c69 10:25:09 [10:25:09.526] VERBOSE: node Sent L1 transaction 0xa73211849cfc237e447cf0d9188ed9b75515c0f629dd1e357878e62e65149c69 {"gasLimit":485800,"maxFeePerGas":"2.367147852","maxPriorityFeePerGas":"1.44","maxFeePerBlobGas":"0.000000001"} 10:25:14 [10:25:14.795] INFO: sequencer:publisher Bundled [propose] transaction [succeeded] 10:25:14 [10:25:14.796] VERBOSE: sequencer:publisher Published L2 block to L1 rollup contract {"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0xa73211849cfc237e447cf0d9188ed9b75515c0f629dd1e357878e62e65149c69","calldataSize":1220,"calldataGas":8840,"txCount":0,"blockNumber":1,"blockTimestamp":1749723914,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 10:25:14 [10:25:14.798] VERBOSE: node:blob-sink:client Sending 1 blobs to blob sink 10:25:14 [10:25:14.896] INFO: blob-sink:server Received blob sidecar for block 0x0f9b221f7bca8d6358ca92fe408242b0e68670e5a547bd39973f3bf1d9948571 10:25:14 [10:25:14.930] WARN: blob-sink:client:prover-node Unable to get blob sidecar for 0x0f9b221f7bca8d6358ca92fe408242b0e68670e5a547bd39973f3bf1d9948571: Not Found (404) {"status":404,"statusText":"Not Found","body":"{\"error\":\"Blob not found\"}"} 10:25:14 [10:25:14.931] WARN: blob-sink:client:prover-node Failed to fetch blobs for 0x0f9b221f7bca8d6358ca92fe408242b0e68670e5a547bd39973f3bf1d9948571 from all blob sources {"blobSinkUrl":"http://localhost:35109"} 10:25:14 [10:25:14.945] INFO: blob-sink:server Blob sidecar stored successfully for block 0x0f9b221f7bca8d6358ca92fe408242b0e68670e5a547bd39973f3bf1d9948571 10:25:14 [10:25:14.959] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 9 mined at 10:25:22 with new L2 block 1 for epoch 0 {"l1Timestamp":1749723922,"l1BlockNumber":9,"l2SlotNumber":2,"l2BlockNumber":1,"l2ProvenBlockNumber":0,"totalL2Messages":0} 10:25:14 [10:25:14.998] INFO: archiver Downloaded L2 block 1 {"blockHash":"0x302aad9859d5f3a0b5c78321d4041d51d1c3882796329a3edf391daa22949ed4","blockNumber":1,"txCount":0,"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1749723914,"version":1849448694},"archiveRoot":"0x0b677def024cc3dfff6050f3723285c8787e919997cf8e3d2319a7e4bb2f33f4","archiveNextLeafIndex":2} 10:25:15 [10:25:15.041] VERBOSE: p2p Synched to latest block 1 10:25:15 [10:25:15.082] INFO: archiver:prover-node Downloaded L2 block 1 {"blockHash":"0x302aad9859d5f3a0b5c78321d4041d51d1c3882796329a3edf391daa22949ed4","blockNumber":1,"txCount":0,"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1749723914,"version":1849448694},"archiveRoot":"0x0b677def024cc3dfff6050f3723285c8787e919997cf8e3d2319a7e4bb2f33f4","archiveNextLeafIndex":2} 10:25:15 [10:25:15.092] INFO: world_state World state updated with L2 block 1 {"eventName":"l2-block-handled","duration":12.590236000003642,"unfinalisedBlockNumber":1,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":1,"blockTimestamp":1749723914,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 10:25:15 [10:25:15.140] INFO: world_state:prover-node World state updated with L2 block 1 {"eventName":"l2-block-handled","duration":5.19857600000978,"unfinalisedBlockNumber":1,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":1,"blockTimestamp":1749723914,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 10:25:15 [10:25:15.354] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 10:25:15 [10:25:15.866] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 10:25:16 [10:25:16.085] VERBOSE: prover-node:prover-node Fetching 0 tx hashes for block number 1 from coordination 10:25:16 [10:25:16.086] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 10:25:16 [10:25:16.376] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 10:25:16 [10:25:16.888] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 10:25:17 [10:25:17.411] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 10:25:17 [10:25:17.949] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 10:25:18 [10:25:18.462] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 10:25:18 [10:25:18.984] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 10:25:19 [10:25:19.502] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 10:25:20 [10:25:20.018] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 10:25:20 [10:25:20.532] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 10:25:21 [10:25:21.050] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 10:25:21 [10:25:21.565] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 10:25:22 [10:25:22.082] VERBOSE: sequencer Preparing proposal for block 2 at slot 3 {"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1749723930,"version":1849448694},"chainTipArchive":"0x0b677def024cc3dfff6050f3723285c8787e919997cf8e3d2319a7e4bb2f33f4","blockNumber":2,"slot":3} 10:25:22 [10:25:22.098] VERBOSE: block-builder Building block 2 for slot 3 {"slot":3,"slotStart":"2025-06-12T10:25:30.000Z","now":"2025-06-12T10:25:22.098Z","blockNumber":2,"msgCount":0,"opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}} 10:25:22 [10:25:22.103] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.00040563999999722s {"duration":0.00040563999999722,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 10:25:22 [10:25:22.138] INFO: sequencer Built block 2 for slot 3 with 0 txs and 0 messages. 0 mana/s {"blockHash":"0x27d9aac12c67fce81fcf987108938acd95952e9523eea279f69bfdc4c3369c1a","globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1749723930,"version":1849448694},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":48.995473000002676,"publicProcessDuration":0.979843000008259,"rollupCircuitsDuration":40.86350799999491,"txCount":0,"blockNumber":2,"blockTimestamp":1749723930,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 10:25:22 [10:25:22.141] VERBOSE: sequencer Attesting committee is empty 10:25:22 [10:25:22.286] VERBOSE: ethereum:tx_delayer Sent tx immediately 0x257f07962b0caae9f392eea7f77ebaed8a4315e9a9bfbea7e7768b10e6cddc1f 10:25:22 [10:25:22.286] VERBOSE: node Sent L1 transaction 0x257f07962b0caae9f392eea7f77ebaed8a4315e9a9bfbea7e7768b10e6cddc1f {"gasLimit":414577,"maxFeePerGas":"2.439650389","maxPriorityFeePerGas":"1.728","maxFeePerBlobGas":"0.000000001"} 10:25:22 [10:25:22.737] INFO: sequencer:publisher Bundled [propose] transaction [succeeded] 10:25:22 [10:25:22.738] VERBOSE: sequencer:publisher Published L2 block to L1 rollup contract {"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0x257f07962b0caae9f392eea7f77ebaed8a4315e9a9bfbea7e7768b10e6cddc1f","calldataSize":1220,"calldataGas":8840,"txCount":0,"blockNumber":2,"blockTimestamp":1749723930,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 10:25:22 [10:25:22.739] VERBOSE: node:blob-sink:client Sending 1 blobs to blob sink 10:25:22 [10:25:22.766] INFO: blob-sink:server Received blob sidecar for block 0x53ec679d9d882f0f4a3273882335635d83c16ddcf48adf22b7519e966fd88a8b 10:25:22 [10:25:22.784] INFO: blob-sink:server Blob sidecar stored successfully for block 0x53ec679d9d882f0f4a3273882335635d83c16ddcf48adf22b7519e966fd88a8b 10:25:22 [10:25:22.804] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 10 mined at 10:25:30 with new L2 block 2 for epoch 0 {"l1Timestamp":1749723930,"l1BlockNumber":10,"l2SlotNumber":3,"l2BlockNumber":2,"l2ProvenBlockNumber":0,"totalL2Messages":0} 10:25:22 [10:25:22.879] INFO: archiver:prover-node Downloaded L2 block 2 {"blockHash":"0x27d9aac12c67fce81fcf987108938acd95952e9523eea279f69bfdc4c3369c1a","blockNumber":2,"txCount":0,"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1749723930,"version":1849448694},"archiveRoot":"0x0d7f6d6bd0d74716338e70d896adf83bef7aa1e3b0fbaa201070633bfb091cab","archiveNextLeafIndex":3} 10:25:22 [10:25:22.931] INFO: archiver Downloaded L2 block 2 {"blockHash":"0x27d9aac12c67fce81fcf987108938acd95952e9523eea279f69bfdc4c3369c1a","blockNumber":2,"txCount":0,"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1749723930,"version":1849448694},"archiveRoot":"0x0d7f6d6bd0d74716338e70d896adf83bef7aa1e3b0fbaa201070633bfb091cab","archiveNextLeafIndex":3} 10:25:22 [10:25:22.953] INFO: world_state World state updated with L2 block 2 {"eventName":"l2-block-handled","duration":4.999923999988823,"unfinalisedBlockNumber":2,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":2,"blockTimestamp":1749723930,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 10:25:22 [10:25:22.954] INFO: world_state:prover-node World state updated with L2 block 2 {"eventName":"l2-block-handled","duration":4.966990999993868,"unfinalisedBlockNumber":2,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":2,"blockTimestamp":1749723930,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 10:25:22 [10:25:22.987] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 10:25:22 [10:25:22.988] VERBOSE: prover-node:prover-node Gathered all 0 txs for epoch 0 {"epochNumber":0} 10:25:22 [10:25:22.991] VERBOSE: prover-node:prover-node Gathered all 0 messages for epoch 0 {"epochNumber":0} 10:25:22 [10:25:22.992] VERBOSE: prover-node:prover-node Gathered previous block header 0 for epoch 0 10:25:22 [10:25:22.992] VERBOSE: prover-node:prover-node Creating proving job for epoch 0 for block range 1 to 2 10:25:22 [10:25:22.995] INFO: prover-node:epoch-proving-job Starting epoch 0 proving job with blocks 1 to 2 {"fromBlock":1,"toBlock":2,"epochSizeBlocks":2,"epochNumber":0,"uuid":"e7a1e999-6e67-493f-b433-12c2b7fd80c8"} 10:25:23 [10:25:23.025] INFO: prover-client:orchestrator Starting epoch 0 with 2 blocks 10:25:23 [10:25:23.025] VERBOSE: prover-client:broker-circuit-prover-facade Starting BrokerCircuitProverFacade 10:25:23 [10:25:23.027] VERBOSE: prover-node:epoch-proving-job Starting processing block 1 {"number":1,"blockHash":"0x302aad9859d5f3a0b5c78321d4041d51d1c3882796329a3edf391daa22949ed4","lastArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"e7a1e999-6e67-493f-b433-12c2b7fd80c8","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x000000000000000000000000000000000000000000000000000000006e3c58f6","blockNumber":"0x0000000000000000000000000000000000000000000000000000000000000001","slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 10:25:23 [10:25:23.027] INFO: prover-client:orchestrator Starting block 1 for slot 2 10:25:23 [10:25:23.028] VERBOSE: prover-node:epoch-proving-job Starting processing block 2 {"number":2,"blockHash":"0x27d9aac12c67fce81fcf987108938acd95952e9523eea279f69bfdc4c3369c1a","lastArchive":"0x0b677def024cc3dfff6050f3723285c8787e919997cf8e3d2319a7e4bb2f33f4","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"e7a1e999-6e67-493f-b433-12c2b7fd80c8","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x000000000000000000000000000000000000000000000000000000006e3c58f6","blockNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000003","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 10:25:23 [10:25:23.029] INFO: prover-client:orchestrator Starting block 2 for slot 3 10:25:23 [10:25:23.056] INFO: prover-client:proving-broker:prover-node New proving job id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff epochNumber=0 {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff"} 10:25:23 [10:25:23.056] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff","provingJobType":"BASE_PARITY"} 10:25:23 [10:25:23.057] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff","provingJobType":"BASE_PARITY"} 10:25:23 [10:25:23.057] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff","provingJobType":"BASE_PARITY"} 10:25:23 [10:25:23.057] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff","provingJobType":"BASE_PARITY"} 10:25:23 [10:25:23.058] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff","provingJobType":"BASE_PARITY"} 10:25:23 [10:25:23.058] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff","provingJobType":"BASE_PARITY"} 10:25:23 [10:25:23.058] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff","provingJobType":"BASE_PARITY"} 10:25:23 [10:25:23.060] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.00001892099999531638s {"duration":0.00001892099999531638,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 10:25:23 [10:25:23.060] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 10:25:23 [10:25:23.061] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 1 {"blockNumber":1,"blockHash":"0x302aad9859d5f3a0b5c78321d4041d51d1c3882796329a3edf391daa22949ed4","uuid":"e7a1e999-6e67-493f-b433-12c2b7fd80c8"} 10:25:23 [10:25:23.062] VERBOSE: prover-client:orchestrator Block 1 completed. Assembling header. 10:25:23 [10:25:23.063] VERBOSE: p2p Synched to latest block 2 10:25:23 [10:25:23.069] VERBOSE: prover-client:orchestrator Updating archive tree with block 1 header 0x302aad9859d5f3a0b5c78321d4041d51d1c3882796329a3edf391daa22949ed4 10:25:23 [10:25:23.071] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.00001625100000819657s {"duration":0.00001625100000819657,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 10:25:23 [10:25:23.071] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 10:25:23 [10:25:23.071] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 2 {"blockNumber":2,"blockHash":"0x27d9aac12c67fce81fcf987108938acd95952e9523eea279f69bfdc4c3369c1a","uuid":"e7a1e999-6e67-493f-b433-12c2b7fd80c8"} 10:25:23 [10:25:23.072] VERBOSE: prover-client:orchestrator Block 2 completed. Assembling header. 10:25:23 [10:25:23.076] VERBOSE: prover-client:orchestrator Orchestrator finalised block 1 10:25:23 [10:25:23.092] VERBOSE: prover-client:orchestrator Updating archive tree with block 2 header 0x27d9aac12c67fce81fcf987108938acd95952e9523eea279f69bfdc4c3369c1a 10:25:23 [10:25:23.098] VERBOSE: prover-client:orchestrator Orchestrator finalised block 2 10:25:23 [10:25:23.116] INFO: prover-client:proving-broker-database:prover-node Creating broker database for epoch 0 at /tmp/5aed7340a89fd652/aafe71d72885e67a/0 with map size 134217728 10:25:23 [10:25:23.119] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:25:23 [10:25:23.123] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY epochNumber=0 {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff","provingJobType":"BASE_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...","status":"not-found","numOutstandingJobs":1} 10:25:23 [10:25:23.135] INFO: prover-client:proving-agent:prover-node Starting job id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input... 10:25:23 [10:25:23.147] INFO: prover-client:proving-agent:job-controller-521dbb8d Job controller started jobId=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff {"jobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff"} 10:25:23 [10:25:23.149] VERBOSE: prover-node:prover-node Fetching 0 tx hashes for block number 2 from coordination 10:25:23 [10:25:23.149] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 10:25:23 [10:25:23.253] INFO: prover-client:proving-agent:prover-node Job id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22resul... 10:25:23 [10:25:23.254] INFO: prover-client:proving-broker:prover-node Proving job complete id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY totalAttempts=1 {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff"} 10:25:23 [10:25:23.272] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 10:25:23 error: "Rollup__SlotAlreadyInChain(3, 3)" 10:25:23 [10:25:23.273] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 10:25:23 [10:25:23.799] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 10:25:23 error: "Rollup__SlotAlreadyInChain(3, 3)" 10:25:23 [10:25:23.799] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 10:25:24 [10:25:24.027] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 10:25:24 [10:25:24.033] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY 10:25:24 [10:25:24.034] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 10:25:24 [10:25:24.078] INFO: prover-client:proving-broker:prover-node New proving job id=0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac epochNumber=0 {"provingJobId":"0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac"} 10:25:24 [10:25:24.089] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac type=ROOT_PARITY {"provingJobId":"0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac","provingJobType":"ROOT_PARITY"} 10:25:24 [10:25:24.114] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Triggering error on finaliseEpoch 10:25:24 [10:25:24.122] ERROR: prover-node:epoch-proving-job Error running epoch 0 prover job: Error: Fake error while proving epoch 10:25:24 at ServerEpochProver.epochProver.finaliseEpoch (/home/aztec-dev/aztec-packages/yarn-project/end-to-end/src/e2e_epochs/epochs_upload_failed_proof.test.ts:60:15) 10:25:24 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:142:64) 10:25:24 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) {"uuid":"e7a1e999-6e67-493f-b433-12c2b7fd80c8","epochNumber":0} 10:25:24 [10:25:24.123] VERBOSE: prover-client:broker-circuit-prover-facade Stopping BrokerCircuitProverFacade 10:25:24 [10:25:24.124] ERROR: prover-client:broker-circuit-prover-facade Job errored with 'Broker facade stopped' id=0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac type=ROOT_PARITY: { 10:25:24 provingJobId: '0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac', 10:25:24 provingJobType: 'ROOT_PARITY' 10:25:24 } 10:25:24 [10:25:24.125] ERROR: prover-client:orchestrator Error thrown when proving job: Error: Broker facade stopped 10:25:24 at BrokerCircuitProverFacade.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/proving_broker/broker_prover_facade.js:142:31) 10:25:24 at ServerEpochProver.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/prover-client/server-epoch-prover.js:31:9) 10:25:24 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:183:13) 10:25:24 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) 10:25:24 [10:25:24.125] ERROR: prover-node:prover-node Job for 0 exited with state failed: { 10:25:24 id: 'e7a1e999-6e67-493f-b433-12c2b7fd80c8', 10:25:24 epochNumber: 0n, 10:25:24 state: 'failed' 10:25:24 } 10:25:24 [10:25:24.126] WARN: prover-node:prover-node Uploading epoch proof failure for 0 to file:///tmp/failed-proofs-NwTzfI {"epochNumber":0,"jobId":"e7a1e999-6e67-493f-b433-12c2b7fd80c8","location":"file:///tmp/failed-proofs-NwTzfI"} 10:25:24 [10:25:24.127] INFO: stdlib:file-store Creating local file file store at /tmp/failed-proofs-NwTzfI 10:25:24 [10:25:24.130] INFO: prover-node:prover-node Pausing archiver and world state sync to start snapshot upload 10:25:24 [10:25:24.131] INFO: archiver:prover-node Stopped. 10:25:24 [10:25:24.131] INFO: world_state:prover-node Stopped sync 10:25:24 [10:25:24.131] INFO: prover-node:prover-node Creating backups of lmdb environments to /tmp/5aed7340a89fd652/aafe71d72885e67a/epoch-proof-data-q7HZRe 10:25:24 [10:25:24.138] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac type=ROOT_PARITY epochNumber=0 {"provingJobId":"0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac","provingJobType":"ROOT_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu...","status":"not-found","numOutstandingJobs":0} 10:25:24 [10:25:24.139] ERROR: prover-client:orchestrator Error thrown when proving job: Error: Broker facade stopped 10:25:24 at BrokerCircuitProverFacade.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/proving_broker/broker_prover_facade.js:142:31) 10:25:24 at ServerEpochProver.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/prover-client/server-epoch-prover.js:31:9) 10:25:24 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:183:13) 10:25:24 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) 10:25:24 [10:25:24.143] INFO: prover-node:prover-node Data stores backed up to /tmp/5aed7340a89fd652/aafe71d72885e67a/epoch-proof-data-q7HZRe {"paths":{"l1-to-l2-message-tree":"/tmp/5aed7340a89fd652/aafe71d72885e67a/epoch-proof-data-q7HZRe/world-state/L1ToL2MessageTree/data.mdb","archive-tree":"/tmp/5aed7340a89fd652/aafe71d72885e67a/epoch-proof-data-q7HZRe/world-state/ArchiveTree/data.mdb","public-data-tree":"/tmp/5aed7340a89fd652/aafe71d72885e67a/epoch-proof-data-q7HZRe/world-state/PublicDataTree/data.mdb","note-hash-tree":"/tmp/5aed7340a89fd652/aafe71d72885e67a/epoch-proof-data-q7HZRe/world-state/NoteHashTree/data.mdb","nullifier-tree":"/tmp/5aed7340a89fd652/aafe71d72885e67a/epoch-proof-data-q7HZRe/world-state/NullifierTree/data.mdb","archiver":"/tmp/5aed7340a89fd652/aafe71d72885e67a/epoch-proof-data-q7HZRe/archiver/data.mdb"}} 10:25:24 [10:25:24.143] INFO: prover-node:prover-node Resuming archiver and world state sync 10:25:24 [10:25:24.144] VERBOSE: world-state:block_stream:prover-node Starting L2 block stream {"proven":false,"pollIntervalMS":50} 10:25:24 [10:25:24.144] INFO: world_state:prover-node Resumed sync 10:25:24 [10:25:24.144] INFO: archiver:prover-node Restarting archiver 10:25:24 [10:25:24.166] WARN: prover-node:prover-node Uploaded epoch 0 proof failure data to file:///tmp/failed-proofs-NwTzfI/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612102524-e7a1e999-6e67-493f-b433-12c2b7fd80c8 {"epochNumber":0,"location":"file:///tmp/failed-proofs-NwTzfI","basePath":"aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612102524-e7a1e999-6e67-493f-b433-12c2b7fd80c8","metadataUrl":"file:///tmp/failed-proofs-NwTzfI/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612102524-e7a1e999-6e67-493f-b433-12c2b7fd80c8/metadata.json","dataUrl":"file:///tmp/failed-proofs-NwTzfI/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612102524-e7a1e999-6e67-493f-b433-12c2b7fd80c8/data.bin","metadata":{"l1BlockNumber":10,"l2BlockHash":"0x27d9aac12c67fce81fcf987108938acd95952e9523eea279f69bfdc4c3369c1a","l2BlockNumber":2,"schemaVersions":{"archiver":2,"worldState":1},"timestamp":1749723924145,"dataUrls":{"l1-to-l2-message-tree":"file:///tmp/failed-proofs-NwTzfI/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612102524-e7a1e999-6e67-493f-b433-12c2b7fd80c8/l1-to-l2-message-tree.db","archive-tree":"file:///tmp/failed-proofs-NwTzfI/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612102524-e7a1e999-6e67-493f-b433-12c2b7fd80c8/archive-tree.db","public-data-tree":"file:///tmp/failed-proofs-NwTzfI/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612102524-e7a1e999-6e67-493f-b433-12c2b7fd80c8/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-NwTzfI/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612102524-e7a1e999-6e67-493f-b433-12c2b7fd80c8/note-hash-tree.db","nullifier-tree":"file:///tmp/failed-proofs-NwTzfI/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612102524-e7a1e999-6e67-493f-b433-12c2b7fd80c8/nullifier-tree.db","archiver":"file:///tmp/failed-proofs-NwTzfI/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612102524-e7a1e999-6e67-493f-b433-12c2b7fd80c8/archiver.db"}},"jobId":"e7a1e999-6e67-493f-b433-12c2b7fd80c8"} 10:25:24 [10:25:24.167] INFO: prover-node:prover-node Cleaning up backup dir /tmp/5aed7340a89fd652/aafe71d72885e67a/epoch-proof-data-q7HZRe 10:25:24 [10:25:24.196] INFO: prover-client:proving-agent:prover-node Starting job id=0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac type=ROOT_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu... 10:25:24 [10:25:24.222] INFO: prover-client:proving-agent:job-controller-1bc08c00 Job controller started jobId=0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac {"jobId":"0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac"} 10:25:24 [10:25:24.331] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 10:25:24 error: "Rollup__SlotAlreadyInChain(3, 3)" 10:25:24 [10:25:24.332] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 10:25:24 [10:25:24.428] INFO: prover-client:proving-agent:prover-node Job id=0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac type=ROOT_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22resu... 10:25:24 [10:25:24.428] INFO: prover-client:proving-broker:prover-node Proving job complete id=0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac type=ROOT_PARITY totalAttempts=1 {"provingJobId":"0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac"} 10:25:24 [10:25:24.852] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 10:25:24 error: "Rollup__SlotAlreadyInChain(3, 3)" 10:25:24 [10:25:24.853] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 10:25:25 [10:25:25.364] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 10:25:25 error: "Rollup__SlotAlreadyInChain(3, 3)" 10:25:25 [10:25:25.364] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 10:25:25 [10:25:25.883] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 10:25:25 error: "Rollup__SlotAlreadyInChain(3, 3)" 10:25:25 [10:25:25.883] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 10:25:26 [10:25:26.397] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 10:25:26 error: "Rollup__SlotAlreadyInChain(3, 3)" 10:25:26 [10:25:26.398] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 10:25:26 [10:25:26.910] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 10:25:26 error: "Rollup__SlotAlreadyInChain(3, 3)" 10:25:26 [10:25:26.910] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 10:25:27 [10:25:27.435] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 10:25:27 error: "Rollup__SlotAlreadyInChain(3, 3)" 10:25:27 [10:25:27.435] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 10:25:27 [10:25:27.953] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 10:25:27 error: "Rollup__SlotAlreadyInChain(3, 3)" 10:25:27 [10:25:27.953] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 10:25:28 [10:25:28.467] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 10:25:28 error: "Rollup__SlotAlreadyInChain(3, 3)" 10:25:28 [10:25:28.468] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 10:25:28 [10:25:28.978] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 10:25:28 error: "Rollup__SlotAlreadyInChain(3, 3)" 10:25:28 [10:25:28.978] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 10:25:29 [10:25:29.494] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 10:25:29 error: "Rollup__SlotAlreadyInChain(3, 3)" 10:25:29 [10:25:29.495] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 10:25:30 [10:25:30.025] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 10:25:30 error: "Rollup__SlotAlreadyInChain(3, 3)" 10:25:30 [10:25:30.026] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 10:25:30 [10:25:30.548] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 10:25:30 error: "Rollup__SlotAlreadyInChain(3, 3)" 10:25:30 [10:25:30.548] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 10:25:30 [10:25:30.763] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 11 mined at 10:25:38 {"l1Timestamp":1749723938,"l1BlockNumber":11,"l2SlotNumber":3,"l2BlockNumber":2,"l2ProvenBlockNumber":0,"totalL2Messages":0} 10:25:30 [10:25:30.784] INFO: prover-node:prover-node Stopping ProverNode 10:25:30 [10:25:30.784] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 10:25:30 [10:25:30.784] INFO: archiver:prover-node Stopped. 10:25:30 [10:25:30.786] INFO: world_state:prover-node Stopped world state synchronizer 10:25:30 [10:25:30.787] INFO: prover-node:prover-node Stopped ProverNode 10:25:30 [10:25:30.787] INFO: node Stopping Aztec Node 10:25:31 [10:25:31.059] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 3 but got 4. {"rollup":[4,3],"newBlockNumber":3,"expectedSlot":3} 10:25:31 [10:25:31.570] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 3 but got 4. {"rollup":[4,3],"newBlockNumber":3,"expectedSlot":3} 10:25:32 [10:25:32.084] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 3 but got 4. {"rollup":[4,3],"newBlockNumber":3,"expectedSlot":3} 10:25:32 [10:25:32.595] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 3 but got 4. {"rollup":[4,3],"newBlockNumber":3,"expectedSlot":3} 10:25:32 [10:25:32.788] INFO: slasher Slasher client stopped. 10:25:32 [10:25:32.789] INFO: sequencer Stopped sequencer 10:25:32 [10:25:32.795] INFO: p2p P2P client stopped 10:25:32 [10:25:32.799] INFO: world_state Stopped world state synchronizer 10:25:32 [10:25:32.799] INFO: archiver Stopped. 10:25:32 [10:25:32.799] INFO: node Stopped Aztec Node 10:25:32 [10:25:32.806] INFO: node Stopping Aztec Node 10:25:34 [10:25:34.811] INFO: slasher Slasher client stopped. 10:25:34 [10:25:34.812] WARN: validator Running promise was not started 10:25:34 [10:25:34.812] WARN: sequencer Running promise was not started 10:25:34 [10:25:34.812] INFO: sequencer Stopped sequencer 10:25:34 [10:25:34.812] WARN: p2p:l2-block-stream Running promise was not started 10:25:34 [10:25:34.813] INFO: p2p P2P client stopped 10:25:34 [10:25:34.813] WARN: world-state:block_stream Running promise was not started 10:25:34 [10:25:34.813] INFO: world_state Stopped world state synchronizer 10:25:34 [10:25:34.813] WARN: archiver Running promise was not started 10:25:34 [10:25:34.813] INFO: archiver Stopped. 10:25:34 [10:25:34.813] INFO: node Stopped Aztec Node 10:25:34 [10:25:34.813] INFO: prover-node:prover-node Stopping ProverNode 10:25:34 [10:25:34.814] WARN: prover-node:prover-node Running promise was not started 10:25:34 [10:25:34.814] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 10:25:34 [10:25:34.814] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 10:25:34 [10:25:34.814] WARN: archiver:prover-node Running promise was not started 10:25:34 [10:25:34.814] INFO: archiver:prover-node Stopped. 10:25:34 [10:25:34.814] WARN: world-state:block_stream:prover-node Running promise was not started 10:25:34 [10:25:34.814] INFO: world_state:prover-node Stopped world state synchronizer 10:25:34 [10:25:34.814] INFO: prover-node:prover-node Stopped ProverNode 10:25:34 [10:25:34.829] INFO: blob-sink:server Stopping blob sink 10:25:34 [10:25:34.830] INFO: blob-sink:server Blob sink stopped 10:25:34 [10:25:34.838] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data and state {"uploadPath":"/tmp/failed-proofs-NwTzfI","rerunDataDir":"/tmp/rerun-data-mn9XNx","rerunDownloadPath":"/tmp/rerun-download-Odh1NQ/data.bin"} 10:25:34 [10:25:34.839] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data from file:///tmp/failed-proofs-NwTzfI/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612102524-e7a1e999-6e67-493f-b433-12c2b7fd80c8 10:25:34 [10:25:34.840] INFO: stdlib:file-store Creating local file file store at /tmp/failed-proofs-NwTzfI/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612102524-e7a1e999-6e67-493f-b433-12c2b7fd80c8 10:25:34 [10:25:34.843] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading state snapshot from file:///tmp/failed-proofs-NwTzfI/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612102524-e7a1e999-6e67-493f-b433-12c2b7fd80c8 to local data directory {"metadata":{"l2BlockNumber":2,"l2BlockHash":"0x27d9aac12c67fce81fcf987108938acd95952e9523eea279f69bfdc4c3369c1a","l1BlockNumber":10,"l1ChainId":31337,"rollupVersion":1849448694,"rollupAddress":"0x16d1d277f9340c50e1c7a9916ab994247a68af9f"},"dataUrls":{"archiver":"file:///tmp/failed-proofs-NwTzfI/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612102524-e7a1e999-6e67-493f-b433-12c2b7fd80c8/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-NwTzfI/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612102524-e7a1e999-6e67-493f-b433-12c2b7fd80c8/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-NwTzfI/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612102524-e7a1e999-6e67-493f-b433-12c2b7fd80c8/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-NwTzfI/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612102524-e7a1e999-6e67-493f-b433-12c2b7fd80c8/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-NwTzfI/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612102524-e7a1e999-6e67-493f-b433-12c2b7fd80c8/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-NwTzfI/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612102524-e7a1e999-6e67-493f-b433-12c2b7fd80c8/l1-to-l2-message-tree.db"}} 10:25:34 [10:25:34.844] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Creating local file file store at /tmp/failed-proofs-NwTzfI/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612102524-e7a1e999-6e67-493f-b433-12c2b7fd80c8 10:25:34 [10:25:34.848] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading snapshot to /tmp/rerun-data-mn9XNx/download-2VITb2 {"snapshot":{"dataUrls":{"archiver":"file:///tmp/failed-proofs-NwTzfI/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612102524-e7a1e999-6e67-493f-b433-12c2b7fd80c8/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-NwTzfI/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612102524-e7a1e999-6e67-493f-b433-12c2b7fd80c8/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-NwTzfI/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612102524-e7a1e999-6e67-493f-b433-12c2b7fd80c8/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-NwTzfI/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612102524-e7a1e999-6e67-493f-b433-12c2b7fd80c8/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-NwTzfI/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612102524-e7a1e999-6e67-493f-b433-12c2b7fd80c8/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-NwTzfI/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612102524-e7a1e999-6e67-493f-b433-12c2b7fd80c8/l1-to-l2-message-tree.db"}},"downloadPaths":{"archiver":"/tmp/rerun-data-mn9XNx/download-2VITb2/archiver.db","nullifier-tree":"/tmp/rerun-data-mn9XNx/download-2VITb2/nullifier-tree.db","public-data-tree":"/tmp/rerun-data-mn9XNx/download-2VITb2/public-data-tree.db","note-hash-tree":"/tmp/rerun-data-mn9XNx/download-2VITb2/note-hash-tree.db","archive-tree":"/tmp/rerun-data-mn9XNx/download-2VITb2/archive-tree.db","l1-to-l2-message-tree":"/tmp/rerun-data-mn9XNx/download-2VITb2/l1-to-l2-message-tree.db"}} 10:25:34 [10:25:34.858] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Snapshot downloaded at /tmp/rerun-data-mn9XNx/download-2VITb2 {"snapshot":{"dataUrls":{"archiver":"file:///tmp/failed-proofs-NwTzfI/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612102524-e7a1e999-6e67-493f-b433-12c2b7fd80c8/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-NwTzfI/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612102524-e7a1e999-6e67-493f-b433-12c2b7fd80c8/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-NwTzfI/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612102524-e7a1e999-6e67-493f-b433-12c2b7fd80c8/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-NwTzfI/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612102524-e7a1e999-6e67-493f-b433-12c2b7fd80c8/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-NwTzfI/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612102524-e7a1e999-6e67-493f-b433-12c2b7fd80c8/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-NwTzfI/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612102524-e7a1e999-6e67-493f-b433-12c2b7fd80c8/l1-to-l2-message-tree.db"}},"downloadPaths":{"archiver":"/tmp/rerun-data-mn9XNx/download-2VITb2/archiver.db","nullifier-tree":"/tmp/rerun-data-mn9XNx/download-2VITb2/nullifier-tree.db","public-data-tree":"/tmp/rerun-data-mn9XNx/download-2VITb2/public-data-tree.db","note-hash-tree":"/tmp/rerun-data-mn9XNx/download-2VITb2/note-hash-tree.db","archive-tree":"/tmp/rerun-data-mn9XNx/download-2VITb2/archive-tree.db","l1-to-l2-message-tree":"/tmp/rerun-data-mn9XNx/download-2VITb2/l1-to-l2-message-tree.db"}} 10:25:34 [10:25:34.861] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Archiver database set up from snapshot {"path":"/tmp/rerun-data-mn9XNx/archiver","dbVersion":2,"rollupAddress":"0x16d1d277f9340c50e1c7a9916ab994247a68af9f"} 10:25:34 [10:25:34.867] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database l1-to-l2-message-tree set up from snapshot {"path":"/tmp/rerun-data-mn9XNx/world_state/L1ToL2MessageTree","dbVersion":1,"rollupAddress":"0x16d1d277f9340c50e1c7a9916ab994247a68af9f"} 10:25:34 [10:25:34.868] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database archive-tree set up from snapshot {"path":"/tmp/rerun-data-mn9XNx/world_state/ArchiveTree","dbVersion":1,"rollupAddress":"0x16d1d277f9340c50e1c7a9916ab994247a68af9f"} 10:25:34 [10:25:34.868] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database public-data-tree set up from snapshot {"path":"/tmp/rerun-data-mn9XNx/world_state/PublicDataTree","dbVersion":1,"rollupAddress":"0x16d1d277f9340c50e1c7a9916ab994247a68af9f"} 10:25:34 [10:25:34.868] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database note-hash-tree set up from snapshot {"path":"/tmp/rerun-data-mn9XNx/world_state/NoteHashTree","dbVersion":1,"rollupAddress":"0x16d1d277f9340c50e1c7a9916ab994247a68af9f"} 10:25:34 [10:25:34.869] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database nullifier-tree set up from snapshot {"path":"/tmp/rerun-data-mn9XNx/world_state/NullifierTree","dbVersion":1,"rollupAddress":"0x16d1d277f9340c50e1c7a9916ab994247a68af9f"} 10:25:34 [10:25:34.869] INFO: e2e:e2e_epochs:epochs_upload_failed_proof P2P database cleared {"path":"/tmp/rerun-data-mn9XNx/p2p"} 10:25:34 [10:25:34.869] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data from file:///tmp/failed-proofs-NwTzfI/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612102524-e7a1e999-6e67-493f-b433-12c2b7fd80c8/data.bin to /tmp/rerun-download-Odh1NQ/data.bin 10:25:34 [10:25:34.872] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Epoch proving job data for epoch 0 downloaded successfully 10:25:34 [10:25:34.872] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Rerunning proving job from /tmp/rerun-download-Odh1NQ/data.bin 10:25:34 [10:25:34.873] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Using native ACVM binary at ../../noir/noir-repo/target/release/acvm with working directory /tmp/cbd91053/acvm 10:25:34 [10:25:34.874] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Loaded proving job data for epoch 0 10:25:34 [10:25:34.881] INFO: world-state:database Creating world state data store at directory /tmp/rerun-data-mn9XNx/world_state with map sizes {"archiveTreeMapSizeKb":1048576,"nullifierTreeMapSizeKb":1048576,"noteHashTreeMapSizeKb":1048576,"messageTreeMapSizeKb":1048576,"publicDataTreeMapSizeKb":1048576} and 2 threads. 10:25:34 [10:25:34.914] INFO: archiver:lmdb Creating archiver data store at directory /tmp/rerun-data-mn9XNx/archiver with map size 1048576 KB (LMDB v2) 10:25:34 [10:25:34.916] INFO: archiver:lmdb Starting data store with maxReaders 16 10:25:34 [10:25:34.919] WARN: prover-client:proving-broker-database Found invalid epoch directory /tmp/rerun-data-mn9XNx/archiver when loading epoch databases, ignoring 10:25:34 [10:25:34.919] WARN: prover-client:proving-broker-database Found invalid epoch directory /tmp/rerun-data-mn9XNx/world_state when loading epoch databases, ignoring 10:25:34 [10:25:34.919] INFO: prover-client:proving-broker Proving Broker started 10:25:34 [10:25:34.920] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Rerunning epoch proving job for epoch 0 10:25:34 [10:25:34.920] INFO: prover-node:epoch-proving-job Starting epoch 0 proving job with blocks 1 to 2 {"fromBlock":1,"toBlock":2,"epochSizeBlocks":2,"epochNumber":0,"uuid":"11ae6142-3a15-484d-bb2e-358536c1630e"} 10:25:34 [10:25:34.948] INFO: prover-client:orchestrator Starting epoch 0 with 2 blocks 10:25:34 [10:25:34.948] VERBOSE: prover-client:broker-circuit-prover-facade Starting BrokerCircuitProverFacade 10:25:34 [10:25:34.950] VERBOSE: prover-node:epoch-proving-job Starting processing block 1 {"number":1,"blockHash":"0x302aad9859d5f3a0b5c78321d4041d51d1c3882796329a3edf391daa22949ed4","lastArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"11ae6142-3a15-484d-bb2e-358536c1630e","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x000000000000000000000000000000000000000000000000000000006e3c58f6","blockNumber":"0x0000000000000000000000000000000000000000000000000000000000000001","slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 10:25:34 [10:25:34.951] INFO: prover-client:orchestrator Starting block 1 for slot 2 10:25:34 [10:25:34.951] VERBOSE: prover-node:epoch-proving-job Starting processing block 2 {"number":2,"blockHash":"0x27d9aac12c67fce81fcf987108938acd95952e9523eea279f69bfdc4c3369c1a","lastArchive":"0x0b677def024cc3dfff6050f3723285c8787e919997cf8e3d2319a7e4bb2f33f4","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"11ae6142-3a15-484d-bb2e-358536c1630e","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x000000000000000000000000000000000000000000000000000000006e3c58f6","blockNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000003","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 10:25:34 [10:25:34.951] INFO: prover-client:orchestrator Starting block 2 for slot 3 10:25:34 [10:25:34.989] INFO: prover-client:proving-broker New proving job id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff epochNumber=0 {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff"} 10:25:35 [10:25:34.993] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff","provingJobType":"BASE_PARITY"} 10:25:35 [10:25:34.993] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff","provingJobType":"BASE_PARITY"} 10:25:35 [10:25:34.993] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff","provingJobType":"BASE_PARITY"} 10:25:35 [10:25:34.994] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff","provingJobType":"BASE_PARITY"} 10:25:35 [10:25:34.995] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff","provingJobType":"BASE_PARITY"} 10:25:35 [10:25:34.995] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff","provingJobType":"BASE_PARITY"} 10:25:35 [10:25:34.996] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff","provingJobType":"BASE_PARITY"} 10:25:35 [10:25:34.998] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.00002245099999709055s {"duration":0.00002245099999709055,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 10:25:35 [10:25:34.998] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 10:25:35 [10:25:34.998] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 1 {"blockNumber":1,"blockHash":"0x302aad9859d5f3a0b5c78321d4041d51d1c3882796329a3edf391daa22949ed4","uuid":"11ae6142-3a15-484d-bb2e-358536c1630e"} 10:25:35 [10:25:34.999] VERBOSE: prover-client:orchestrator Block 1 completed. Assembling header. 10:25:35 [10:25:35.006] VERBOSE: prover-client:orchestrator Updating archive tree with block 1 header 0x302aad9859d5f3a0b5c78321d4041d51d1c3882796329a3edf391daa22949ed4 10:25:35 [10:25:35.011] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000018471000003046357s {"duration":0.000018471000003046357,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 10:25:35 [10:25:35.011] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 10:25:35 [10:25:35.012] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 2 {"blockNumber":2,"blockHash":"0x27d9aac12c67fce81fcf987108938acd95952e9523eea279f69bfdc4c3369c1a","uuid":"11ae6142-3a15-484d-bb2e-358536c1630e"} 10:25:35 [10:25:35.012] VERBOSE: prover-client:orchestrator Block 2 completed. Assembling header. 10:25:35 [10:25:35.013] VERBOSE: prover-client:orchestrator Orchestrator finalised block 1 10:25:35 [10:25:35.032] VERBOSE: prover-client:orchestrator Updating archive tree with block 2 header 0x27d9aac12c67fce81fcf987108938acd95952e9523eea279f69bfdc4c3369c1a 10:25:35 [10:25:35.035] VERBOSE: prover-client:orchestrator Orchestrator finalised block 2 10:25:35 [10:25:35.051] INFO: prover-client:proving-broker-database Creating broker database for epoch 0 at /tmp/rerun-data-mn9XNx/0 with map size 1048576 10:25:35 [10:25:35.052] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:25:35 [10:25:35.055] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY epochNumber=0 {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff","provingJobType":"BASE_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...","status":"not-found","numOutstandingJobs":1} 10:25:35 [10:25:35.124] INFO: prover-client:proving-agent Starting job id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input... 10:25:35 [10:25:35.126] INFO: prover-client:proving-agent:job-controller-fe86ece8 Job controller started jobId=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff {"jobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff"} 10:25:35 [10:25:35.217] INFO: prover-client:proving-agent Job id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22resul... 10:25:35 [10:25:35.218] INFO: prover-client:proving-broker Proving job complete id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY totalAttempts=1 {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff"} 10:25:35 [10:25:35.949] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 10:25:35 [10:25:35.952] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY 10:25:35 [10:25:35.952] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 10:25:35 [10:25:35.966] INFO: prover-client:proving-broker New proving job id=0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac epochNumber=0 {"provingJobId":"0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac"} 10:25:35 [10:25:35.974] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac type=ROOT_PARITY {"provingJobId":"0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac","provingJobType":"ROOT_PARITY"} 10:25:36 [10:25:36.022] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac type=ROOT_PARITY epochNumber=0 {"provingJobId":"0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac","provingJobType":"ROOT_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu...","status":"not-found","numOutstandingJobs":1} 10:25:36 [10:25:36.036] INFO: prover-client:proving-agent Starting job id=0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac type=ROOT_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu... 10:25:36 [10:25:36.063] INFO: prover-client:proving-agent:job-controller-ee4d74b9 Job controller started jobId=0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac {"jobId":"0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac"} 10:25:36 [10:25:36.248] INFO: prover-client:proving-agent Job id=0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac type=ROOT_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22resu... 10:25:36 [10:25:36.248] INFO: prover-client:proving-broker Proving job complete id=0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac type=ROOT_PARITY totalAttempts=1 {"provingJobId":"0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac"} 10:25:36 [10:25:36.954] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 10:25:36 [10:25:36.956] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac type=ROOT_PARITY 10:25:36 [10:25:36.956] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 10:25:36 [10:25:36.974] INFO: prover-client:proving-broker New proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:b1e89f5c2c4c63792cc5a2dec4ec7cd53009cbb82c9c6c6daf1c2109720291e1 epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:b1e89f5c2c4c63792cc5a2dec4ec7cd53009cbb82c9c6c6daf1c2109720291e1"} 10:25:36 [10:25:36.979] INFO: prover-client:proving-broker New proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:c1c9b1d12d576a46ba93b75641e68bdd10646b16dac516f953cd07073ae881bb epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:c1c9b1d12d576a46ba93b75641e68bdd10646b16dac516f953cd07073ae881bb"} 10:25:37 [10:25:37.030] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:EMPTY_BLOCK_ROOT_ROLLUP:b1e89f5c2c4c63792cc5a2dec4ec7cd53009cbb82c9c6c6daf1c2109720291e1 type=EMPTY_BLOCK_ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:b1e89f5c2c4c63792cc5a2dec4ec7cd53009cbb82c9c6c6daf1c2109720291e1","provingJobType":"EMPTY_BLOCK_ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input...","status":"not-found","numOutstandingJobs":2} 10:25:37 [10:25:37.030] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:EMPTY_BLOCK_ROOT_ROLLUP:c1c9b1d12d576a46ba93b75641e68bdd10646b16dac516f953cd07073ae881bb type=EMPTY_BLOCK_ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:c1c9b1d12d576a46ba93b75641e68bdd10646b16dac516f953cd07073ae881bb","provingJobType":"EMPTY_BLOCK_ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input...","status":"not-found","numOutstandingJobs":2} 10:25:37 [10:25:37.108] INFO: prover-client:proving-agent Starting job id=0:EMPTY_BLOCK_ROOT_ROLLUP:b1e89f5c2c4c63792cc5a2dec4ec7cd53009cbb82c9c6c6daf1c2109720291e1 type=EMPTY_BLOCK_ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input... 10:25:37 [10:25:37.130] INFO: prover-client:proving-agent:job-controller-da9235aa Job controller started jobId=0:EMPTY_BLOCK_ROOT_ROLLUP:b1e89f5c2c4c63792cc5a2dec4ec7cd53009cbb82c9c6c6daf1c2109720291e1 {"jobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:b1e89f5c2c4c63792cc5a2dec4ec7cd53009cbb82c9c6c6daf1c2109720291e1"} 10:25:37 [10:25:37.134] INFO: prover-client:proving-agent Starting job id=0:EMPTY_BLOCK_ROOT_ROLLUP:c1c9b1d12d576a46ba93b75641e68bdd10646b16dac516f953cd07073ae881bb type=EMPTY_BLOCK_ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input... 10:25:37 [10:25:37.142] INFO: prover-client:proving-agent:job-controller-982e8fc5 Job controller started jobId=0:EMPTY_BLOCK_ROOT_ROLLUP:c1c9b1d12d576a46ba93b75641e68bdd10646b16dac516f953cd07073ae881bb {"jobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:c1c9b1d12d576a46ba93b75641e68bdd10646b16dac516f953cd07073ae881bb"} 10:25:38 [10:25:38.483] INFO: prover-client:proving-agent Job id=0:EMPTY_BLOCK_ROOT_ROLLUP:b1e89f5c2c4c63792cc5a2dec4ec7cd53009cbb82c9c6c6daf1c2109720291e1 type=EMPTY_BLOCK_ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22resul... 10:25:38 [10:25:38.484] INFO: prover-client:proving-broker Proving job complete id=0:EMPTY_BLOCK_ROOT_ROLLUP:b1e89f5c2c4c63792cc5a2dec4ec7cd53009cbb82c9c6c6daf1c2109720291e1 type=EMPTY_BLOCK_ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:b1e89f5c2c4c63792cc5a2dec4ec7cd53009cbb82c9c6c6daf1c2109720291e1"} 10:25:38 [10:25:38.960] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 2, total jobs ready: 1 10:25:38 [10:25:38.963] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:b1e89f5c2c4c63792cc5a2dec4ec7cd53009cbb82c9c6c6daf1c2109720291e1 type=EMPTY_BLOCK_ROOT_ROLLUP 10:25:38 [10:25:38.964] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 10:25:40 [10:25:40.575] INFO: prover-client:proving-agent Job id=0:EMPTY_BLOCK_ROOT_ROLLUP:c1c9b1d12d576a46ba93b75641e68bdd10646b16dac516f953cd07073ae881bb type=EMPTY_BLOCK_ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22resul... 10:25:40 [10:25:40.576] INFO: prover-client:proving-broker Proving job complete id=0:EMPTY_BLOCK_ROOT_ROLLUP:c1c9b1d12d576a46ba93b75641e68bdd10646b16dac516f953cd07073ae881bb type=EMPTY_BLOCK_ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:c1c9b1d12d576a46ba93b75641e68bdd10646b16dac516f953cd07073ae881bb"} 10:25:40 [10:25:40.965] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 10:25:40 [10:25:40.969] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:c1c9b1d12d576a46ba93b75641e68bdd10646b16dac516f953cd07073ae881bb type=EMPTY_BLOCK_ROOT_ROLLUP 10:25:40 [10:25:40.969] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 10:25:40 [10:25:40.981] INFO: prover-client:proving-broker New proving job id=0:ROOT_ROLLUP:2fce5ffd2ea6a1ccefd0214493492dc7d1e934e414c7874393ac76b119cde430 epochNumber=0 {"provingJobId":"0:ROOT_ROLLUP:2fce5ffd2ea6a1ccefd0214493492dc7d1e934e414c7874393ac76b119cde430"} 10:25:41 [10:25:41.034] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_ROLLUP:2fce5ffd2ea6a1ccefd0214493492dc7d1e934e414c7874393ac76b119cde430 type=ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:ROOT_ROLLUP:2fce5ffd2ea6a1ccefd0214493492dc7d1e934e414c7874393ac76b119cde430","provingJobType":"ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22input...","status":"not-found","numOutstandingJobs":1} 10:25:41 [10:25:41.086] INFO: prover-client:proving-agent Starting job id=0:ROOT_ROLLUP:2fce5ffd2ea6a1ccefd0214493492dc7d1e934e414c7874393ac76b119cde430 type=ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22input... 10:25:41 [10:25:41.106] INFO: prover-client:proving-agent:job-controller-292371b6 Job controller started jobId=0:ROOT_ROLLUP:2fce5ffd2ea6a1ccefd0214493492dc7d1e934e414c7874393ac76b119cde430 {"jobId":"0:ROOT_ROLLUP:2fce5ffd2ea6a1ccefd0214493492dc7d1e934e414c7874393ac76b119cde430"} 10:25:41 [10:25:41.231] INFO: prover-client:proving-agent Job id=0:ROOT_ROLLUP:2fce5ffd2ea6a1ccefd0214493492dc7d1e934e414c7874393ac76b119cde430 type=ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22resul... 10:25:41 [10:25:41.232] INFO: prover-client:proving-broker Proving job complete id=0:ROOT_ROLLUP:2fce5ffd2ea6a1ccefd0214493492dc7d1e934e414c7874393ac76b119cde430 type=ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:ROOT_ROLLUP:2fce5ffd2ea6a1ccefd0214493492dc7d1e934e414c7874393ac76b119cde430"} 10:25:41 [10:25:41.970] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 10:25:41 [10:25:41.973] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:ROOT_ROLLUP:2fce5ffd2ea6a1ccefd0214493492dc7d1e934e414c7874393ac76b119cde430 type=ROOT_ROLLUP 10:25:41 [10:25:41.973] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 10:25:41 [10:25:41.974] VERBOSE: prover-client:orchestrator Orchestrator completed root rollup for epoch 0 10:25:41 [10:25:41.977] INFO: prover-node:epoch-proving-job Finalised proof for epoch 0 {"epochNumber":0,"uuid":"11ae6142-3a15-484d-bb2e-358536c1630e","duration":7056.423259000003} 10:25:41 [10:25:41.978] INFO: prover-node:epoch-proving-job Submitted proof for epoch 0 (blocks 1 to 2) {"epochNumber":0,"uuid":"11ae6142-3a15-484d-bb2e-358536c1630e"} 10:25:41 [10:25:41.978] VERBOSE: prover-client:broker-circuit-prover-facade Stopping BrokerCircuitProverFacade 10:25:41 [10:25:41.978] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Completed job for epoch 0 with status completed 10:25:41 [10:25:41.979] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Test succeeded 10:25:41 [10:25:41.979] INFO: prover-node:prover-node Stopping ProverNode 10:25:41 [10:25:41.979] WARN: prover-node:prover-node Running promise was not started 10:25:41 [10:25:41.980] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 10:25:41 [10:25:41.980] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 10:25:41 [10:25:41.980] WARN: archiver:prover-node Running promise was not started 10:25:41 [10:25:41.980] INFO: archiver:prover-node Stopped. 10:25:41 [10:25:41.980] WARN: world-state:block_stream:prover-node Running promise was not started 10:25:41 [10:25:41.980] INFO: world_state:prover-node Stopped world state synchronizer 10:25:41 [10:25:41.980] INFO: prover-node:prover-node Stopped ProverNode 10:25:41 [10:25:41.981] INFO: node Stopping Aztec Node 10:25:43 [10:25:43.981] INFO: slasher Slasher client stopped. 10:25:43 [10:25:43.982] WARN: validator Running promise was not started 10:25:43 [10:25:43.982] WARN: sequencer Running promise was not started 10:25:43 [10:25:43.982] INFO: sequencer Stopped sequencer 10:25:43 [10:25:43.982] WARN: p2p:l2-block-stream Running promise was not started 10:25:43 [10:25:43.982] INFO: p2p P2P client stopped 10:25:43 [10:25:43.982] WARN: world-state:block_stream Running promise was not started 10:25:43 [10:25:43.982] INFO: world_state Stopped world state synchronizer 10:25:43 [10:25:43.982] WARN: archiver Running promise was not started 10:25:43 [10:25:43.982] INFO: archiver Stopped. 10:25:43 [10:25:43.983] INFO: node Stopped Aztec Node 10:25:43 [10:25:43.983] INFO: node Stopping Aztec Node 10:25:45 [10:25:45.984] INFO: slasher Slasher client stopped. 10:25:45 [10:25:45.985] WARN: validator Running promise was not started 10:25:45 [10:25:45.985] WARN: sequencer Running promise was not started 10:25:45 [10:25:45.986] INFO: sequencer Stopped sequencer 10:25:45 [10:25:45.986] WARN: p2p:l2-block-stream Running promise was not started 10:25:45 [10:25:45.986] INFO: p2p P2P client stopped 10:25:45 [10:25:45.986] WARN: world-state:block_stream Running promise was not started 10:25:45 [10:25:45.987] INFO: world_state Stopped world state synchronizer 10:25:45 [10:25:45.987] WARN: archiver Running promise was not started 10:25:45 [10:25:45.987] INFO: archiver Stopped. 10:25:45 [10:25:45.987] INFO: node Stopped Aztec Node 10:25:45 [10:25:45.987] INFO: prover-node:prover-node Stopping ProverNode 10:25:45 [10:25:45.988] WARN: prover-node:prover-node Running promise was not started 10:25:45 [10:25:45.988] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 10:25:45 [10:25:45.988] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 10:25:45 [10:25:45.988] WARN: archiver:prover-node Running promise was not started 10:25:45 [10:25:45.988] INFO: archiver:prover-node Stopped. 10:25:45 [10:25:45.988] WARN: world-state:block_stream:prover-node Running promise was not started 10:25:45 [10:25:45.988] INFO: world_state:prover-node Stopped world state synchronizer 10:25:45 [10:25:45.988] INFO: prover-node:prover-node Stopped ProverNode 10:25:45 [10:25:45.989] INFO: blob-sink:server Stopping blob sink 10:25:45 [10:25:45.989] INFO: blob-sink:server Blob sink already stopped 10:25:46 PASS src/e2e_epochs/epochs_upload_failed_proof.test.ts 10:25:46 e2e_epochs/epochs_upload_failed_proof 10:25:46 ✓ uploads failed proving job state and re-runs it on a fresh instance (95459 ms) 10:25:46 10:25:46 Test Suites: 1 passed, 1 total 10:25:46 Tests: 1 passed, 1 total 10:25:46 Snapshots: 0 total 10:25:46 Time: 104.078 s 10:25:46 Ran all test suites matching /src\/e2e_epochs\/epochs_upload_failed_proof.test.ts/i. 10:25:46 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?