ACI ·

Parent Log: http://ci.aztec-labs.com/b996fe1b8e49e196 Command: 8294f4da4caa3ae7:ISOLATE=1:NAME=e2e_epochs/epochs_upload_failed_proof yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_upload_failed_proof.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/befc8c4c9ab253911288e1ef4bdd56c5ae8eeb9b Env: REF_NAME=gh-readonly-queue/next/pr-14896-1681cb5bd7c7fb85bd5eb6edb329f577b188bc70 CURRENT_VERSION=0.87.6 CI_FULL=0 Date: Wed Jun 11 22:17:10 UTC 2025 System: ARCH=arm64 CPUS=64 MEM=247Gi HOSTNAME=pr-14896_arm64_a1-fast Resources: CPU_LIST=0-63 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_476a42720cde10eb_next 22:17:10 +++ id -u 22:17:10 +++ id -g 22:17:10 ++ docker run -d --name e2e_epochs_epochs_upload_failed_proof --net=none --cpuset-cpus=0-63 --cpus=2 --memory=8g --user 1000:1000 -v/home/aztec-dev:/home/aztec-dev --mount type=tmpfs,target=/tmp,tmpfs-size=1g --workdir /home/aztec-dev/aztec-packages -e HOME -e VERBOSE -e GIT_CONFIG_GLOBAL=/home/aztec-dev/aztec-packages/build-images/src/home/.gitconfig -e FORCE_COLOR=true -e CPUS -e MEM aztecprotocol/build:3.0 /bin/bash -c 'timeout -v 600s bash -c '\''yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_upload_failed_proof.test.ts'\''' 22:17:11 + cid=82bf40b6fd3227ec724544255cf89c227a2467bfabd037ad20e9beb71711fb6a 22:17:11 + set +x 22:17:11 {"level":25,"time":1749680231623,"pid":12,"hostname":"82bf40b6fd32","module":"logger","msg":"Logger initialized with level verbose"} 22:17:16 [22:17:16.398] INFO: e2e:epochs_upload_failed_proof Running test: e2e_epochs/epochs_upload_failed_proof uploads failed proving job state and re-runs it on a fresh instance 22:17:16 [22:17:16.475] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Logging metrics to log/e2e_epochs_epochs_upload_failed_proof.jsonl 22:17:16 [22:17:16.637] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Calling anvil_setBlockTimestampInterval with params: [8] 22:17:16 [22:17:16.660] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Set block interval to 8 22:17:16 [22:17:16.661] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contracts from 0xf39Fd6e51aad88F6F4ce6aB8827279cffFb92266 22:17:16 [22:17:16.739] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xff8f3047f70ec9e63079d7903c02a47802dc292d5660d2da825ac209bbd9cd89 {"gasLimit":867658,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 22:17:16 [22:17:16.740] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xd8B56421e9b573AE62f2997B7b58858a4413A967 in tx 0xff8f3047f70ec9e63079d7903c02a47802dc292d5660d2da825ac209bbd9cd89. 22:17:16 [22:17:16.742] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Fee Asset at 0xd8b56421e9b573ae62f2997b7b58858a4413a967 22:17:16 [22:17:16.783] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xb8a727e5dcee31d2ee7a6a94b8b01df7952fdc685dfb1b5bb36a0dbda9d08d89 {"gasLimit":867644,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 22:17:16 [22:17:16.784] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x026208feE3F4461826C8838C3569272E8C08E131 in tx 0xb8a727e5dcee31d2ee7a6a94b8b01df7952fdc685dfb1b5bb36a0dbda9d08d89. 22:17:16 [22:17:16.785] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Staking Asset at 0x026208fee3f4461826c8838c3569272e8c08e131 22:17:16 [22:17:16.812] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x84345970a64bc89d244665c6d19bcf62f7a1fb0c5497fd61c66569ea96442f1f {"gasLimit":3118894,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 22:17:16 [22:17:16.812] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xad2120681B02De3e9b8aFd325977CDeDDf15f01C in tx 0x84345970a64bc89d244665c6d19bcf62f7a1fb0c5497fd61c66569ea96442f1f. 22:17:16 [22:17:16.813] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed GSE at 0xad2120681b02de3e9b8afd325977cdeddf15f01c 22:17:16 [22:17:16.845] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x96c1e759b945754976d026659a519c1c5d05a738916e69d742cdec67a5482765 {"gasLimit":1030513,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 22:17:16 [22:17:16.845] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x992D1f24CC5f368188d936cf0b2A111cEE586d4e in tx 0x96c1e759b945754976d026659a519c1c5d05a738916e69d742cdec67a5482765. 22:17:16 [22:17:16.846] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Registry at 0x992d1f24cc5f368188d936cf0b2a111cee586d4e 22:17:16 [22:17:16.877] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x35838f7740ede8daad92b7b8589b59625f0100193e252bc6ce3862a65d23892c {"gasLimit":1998672,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 22:17:16 [22:17:16.878] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xfDB60896B1920A10Fd3AA268A292E51ebD5568A8 in tx 0x35838f7740ede8daad92b7b8589b59625f0100193e252bc6ce3862a65d23892c. 22:17:16 [22:17:16.878] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed GovernanceProposer at 0xfdb60896b1920a10fd3aa268a292e51ebd5568a8 22:17:16 [22:17:16.924] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x4dbcecd47a2081d10a38e4cf385714d92e542e5a44eb5a37a3810c6c6738dc4e {"gasLimit":3092007,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 22:17:16 [22:17:16.924] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x506150CaB49DBC09C8B79D20ac5c79CA28220AEA in tx 0x4dbcecd47a2081d10a38e4cf385714d92e542e5a44eb5a37a3810c6c6738dc4e. 22:17:16 [22:17:16.925] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Governance at 0x506150cab49dbc09c8b79d20ac5c79ca28220aea 22:17:16 [22:17:16.936] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xf2ecc0d2040ae9928a4b186c21f02e611c2904f24b196eed69d646e9333cc00d {"gasLimit":100000,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 22:17:16 [22:17:16.937] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Set governance on GSE in 0xf2ecc0d2040ae9928a4b186c21f02e611c2904f24b196eed69d646e9333cc00d 22:17:16 [22:17:16.955] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x77f9fa97fbbcb04392e88d456c198520b3425518c3d2d4146393099192372448 {"gasLimit":397390,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 22:17:16 [22:17:16.956] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x1649EeAD62C64Db7F63182989C8c41Ab25025C21 in tx 0x77f9fa97fbbcb04392e88d456c198520b3425518c3d2d4146393099192372448. 22:17:16 [22:17:16.956] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed CoinIssuer at 0x1649eead62c64db7f63182989c8c41ab25025c21 22:17:16 [22:17:16.957] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for deployments to complete 22:17:16 [22:17:16.958] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 7 transactions to be mined... 22:17:24 [22:17:24.978] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 22:17:24 [22:17:24.990] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xc033579f2357cfd2f6fa38d1ef9986415f4ed794add3fff64984bc3f1257e970 {"gasLimit":100000,"maxFeePerGas":"3.04180664","maxPriorityFeePerGas":"1.44"} 22:17:24 [22:17:24.990] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added coin issuer 0x1649eead62c64db7f63182989c8c41ab25025c21 as minter on fee asset in 0xc033579f2357cfd2f6fa38d1ef9986415f4ed794add3fff64984bc3f1257e970 22:17:25 [22:17:25.016] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xd6a54e4eed6f07d2b8dcaafbd3883b3558583e43612f444af113d489245a2bb1 {"gasLimit":56661,"maxFeePerGas":"3.04180664","maxPriorityFeePerGas":"1.44"} 22:17:25 [22:17:25.040] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xa67ff7f4001dc5703375e116caba00222d15ec13472e10af8018f62318b463cb {"gasLimit":344517,"maxFeePerGas":"3.04180664","maxPriorityFeePerGas":"1.44"} 22:17:25 [22:17:25.040] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x3607dbAfDe17871E0D6A8f929151C30b83510D39 in tx 0xa67ff7f4001dc5703375e116caba00222d15ec13472e10af8018f62318b463cb. 22:17:25 [22:17:25.041] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed FeeAssetHandler at 0x3607dbafde17871e0d6a8f929151c30b83510d39 22:17:25 [22:17:25.102] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xa32bc1b02f5f02b41626611ec0e0056cad989330fbf908181b5d4f7678377aae {"gasLimit":56804,"maxFeePerGas":"3.04180664","maxPriorityFeePerGas":"1.44"} 22:17:25 [22:17:25.102] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added fee asset handler 0x3607dbafde17871e0d6a8f929151c30b83510d39 as minter on fee asset in 0xa32bc1b02f5f02b41626611ec0e0056cad989330fbf908181b5d4f7678377aae 22:17:25 [22:17:25.123] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xadb884185b00b3cf3fb2aac4753fbbc2bbb58dfbab2a937d61ea0e950d96b91b {"gasLimit":2514669,"maxFeePerGas":"3.04180664","maxPriorityFeePerGas":"1.44"} 22:17:25 [22:17:25.123] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x499C89D6b68cBdcA67C96Bff13Eb5B5a8fDb25a2 in tx 0xadb884185b00b3cf3fb2aac4753fbbc2bbb58dfbab2a937d61ea0e950d96b91b. 22:17:25 [22:17:25.124] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed StakingAssetHandler at 0x499c89d6b68cbdca67c96bff13eb5b5a8fdb25a2 22:17:25 [22:17:25.139] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x2b32bbf996c6d3500330bc3ce74137b03f19074efe8ad0d3e14e6dea009f12e4 {"gasLimit":56804,"maxFeePerGas":"3.04180664","maxPriorityFeePerGas":"1.44"} 22:17:25 [22:17:25.140] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added staking asset handler 0x499c89d6b68cbdca67c96bff13eb5b5a8fdb25a2 as minter on staking asset in 0x2b32bbf996c6d3500330bc3ce74137b03f19074efe8ad0d3e14e6dea009f12e4 22:17:25 [22:17:25.140] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for deployments to complete 22:17:25 [22:17:25.140] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 9 transactions to be mined... 22:17:33 [22:17:33.150] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 22:17:33 [22:17:33.162] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed shared contracts 22:17:33 [22:17:33.175] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x1f3bf003fea3920e27f0ab1b5a7c080b356836c498ba06ccbbb2f38e05cac9a5 {"gasLimit":84823,"maxFeePerGas":"3.2549605","maxPriorityFeePerGas":"1.728"} 22:17:33 [22:17:33.176] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Funded reward distributor with 10000000000000000000000000 fee asset in 0x1f3bf003fea3920e27f0ab1b5a7c080b356836c498ba06ccbbb2f38e05cac9a5 22:17:33 [22:17:33.191] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x8ddfc36dd291a7e69dbb1d1c4b25283f53b9e73f733772b984e1b7cef75ca71d {"gasLimit":154658,"maxFeePerGas":"3.2549605","maxPriorityFeePerGas":"1.728"} 22:17:33 [22:17:33.191] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x277E22B0C9698d7f2A1cD7C6d857511617587309 in tx 0x8ddfc36dd291a7e69dbb1d1c4b25283f53b9e73f733772b984e1b7cef75ca71d. 22:17:33 [22:17:33.192] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup will use the mock verifier at 0x277e22b0c9698d7f2a1cd7c6d857511617587309 22:17:33 [22:17:33.192] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup config args {"aztecSlotDuration":16,"aztecEpochDuration":4,"targetCommitteeSize":48,"aztecProofSubmissionWindow":7,"slashingQuorum":6,"slashingRoundSize":10,"manaTarget":10000000000,"provingCostPerMana":100,"rewardConfig":{"sequencerBps":5000,"increment":200000,"maxScore":5000000,"a":5000,"k":1000000,"minimum":100000}} 22:17:33 [22:17:33.207] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x1244dd983dfa48995970c0afd0fb79b5391ff919edd2ee7939902fc973eec3e1 {"gasLimit":86992,"maxFeePerGas":"3.2549605","maxPriorityFeePerGas":"1.728"} 22:17:33 [22:17:33.208] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xbba8820C80d584aEc2Cb092C3a0bE628aAB41fe3 in tx 0x1244dd983dfa48995970c0afd0fb79b5391ff919edd2ee7939902fc973eec3e1. 22:17:33 [22:17:33.284] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x0785920f3b1808bbb32fbbb9fc7abf594c7e8c615f21bf1b26859927d6d53edc {"gasLimit":6301243,"maxFeePerGas":"3.2549605","maxPriorityFeePerGas":"1.728"} 22:17:33 [22:17:33.285] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x0130CEd3370Af8E822F3D9076177E04F1cA75D3e in tx 0x0785920f3b1808bbb32fbbb9fc7abf594c7e8c615f21bf1b26859927d6d53edc. 22:17:33 [22:17:33.286] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Awaiting for linked libraries to be deployed 22:17:41 [22:17:41.392] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xf279175de4e1a4ff8f3ab3ce10cb9b737ac10754e1068f0dd96d1bf962ab2c4d {"gasLimit":11236180,"maxFeePerGas":"3.44200128","maxPriorityFeePerGas":"2.0736"} 22:17:41 [22:17:41.393] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xD31708B4bFCB26bFe24eDE4BefaBBC135d45650F in tx 0xf279175de4e1a4ff8f3ab3ce10cb9b737ac10754e1068f0dd96d1bf962ab2c4d. 22:17:41 [22:17:41.393] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Rollup at 0xd31708b4bfcb26bfe24ede4befabbc135d45650f {"aztecSlotDuration":16,"aztecEpochDuration":4,"targetCommitteeSize":48,"aztecProofSubmissionWindow":7,"slashingQuorum":6,"slashingRoundSize":10,"manaTarget":10000000000,"provingCostPerMana":100,"rewardConfig":{"sequencerBps":5000,"increment":200000,"maxScore":5000000,"a":5000,"k":1000000,"minimum":100000}} 22:17:41 [22:17:41.394] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 11 transactions to be mined... 22:17:49 [22:17:49.404] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 22:17:49 [22:17:49.404] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof All core contracts have been deployed 22:17:49 [22:17:49.422] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x4249ce66fb1918dfff81dd4e0e87ece178b5c461ef1523b054b4ed7c619fc2f2 {"gasLimit":1056496,"maxFeePerGas":"3.747782171","maxPriorityFeePerGas":"2.48832"} 22:17:49 [22:17:49.422] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xE00BE02D54ceD090aE56060867d094Cf4C0ba17A in tx 0x4249ce66fb1918dfff81dd4e0e87ece178b5c461ef1523b054b4ed7c619fc2f2. 22:17:49 [22:17:49.422] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed SlashFactory at 0xe00be02d54ced090ae56060867d094cf4c0ba17a 22:17:49 [22:17:49.445] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x14cc173630feb46aa9703c115d82f5894493eef1eadac205cc1a9996740450b6 {"gasLimit":116846,"maxFeePerGas":"3.747782171","maxPriorityFeePerGas":"2.48832"} 22:17:49 [22:17:49.445] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Adding rollup 0xd31708b4bfcb26bfe24ede4befabbc135d45650f to registry 0x992d1f24cc5f368188d936cf0b2a111cee586d4e in tx 0x14cc173630feb46aa9703c115d82f5894493eef1eadac205cc1a9996740450b6 22:17:49 [22:17:49.461] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x3099162e10d0404a9d0c3157d334e80927bb458c4d23cc03e2d1a5efdb18e47c {"gasLimit":109478,"maxFeePerGas":"3.747782171","maxPriorityFeePerGas":"2.48832"} 22:17:49 [22:17:49.461] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Adding rollup 0xd31708b4bfcb26bfe24ede4befabbc135d45650f to GSE 0xad2120681b02de3e9b8afd325977cdeddf15f01c in tx 0x3099162e10d0404a9d0c3157d334e80927bb458c4d23cc03e2d1a5efdb18e47c 22:17:57 [22:17:57.469] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 12 transactions to be mined... 22:17:57 [22:17:57.504] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 22:17:57 [22:17:57.510] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup deployed 22:17:57 [22:17:57.510] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for rollup and slash factory to be deployed 22:17:57 [22:17:57.510] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 12 transactions to be mined... 22:17:57 [22:17:57.540] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 22:17:57 [22:17:57.541] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof All transactions for L1 deployment have been mined 22:17:57 [22:17:57.559] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Aztec L1 contracts initialized {"registryAddress":"0x992d1f24cc5f368188d936cf0b2a111cee586d4e","governanceAddress":"0x506150cab49dbc09c8b79d20ac5c79ca28220aea","governanceProposerAddress":"0xfdb60896b1920a10fd3aa268a292e51ebd5568a8","rollupAddress":"0xd31708b4bfcb26bfe24ede4befabbc135d45650f","inboxAddress":"0x7aacd9ae08372daf839b702222ce4b3f95fdccd3","outboxAddress":"0x4d2c85295a30c310a5d7654489c365531ee8956c","feeJuicePortalAddress":"0xdac31be6765c2130dbd11c66cc95373715dd1717","feeJuiceAddress":"0xd8b56421e9b573ae62f2997b7b58858a4413a967","stakingAssetAddress":"0x026208fee3f4461826c8838c3569272e8c08e131","rewardDistributorAddress":"0xd462e23c2c8a9b4f83de76004a170d4cebb5d3e1","gseAddress":"0xad2120681b02de3e9b8afd325977cdeddf15f01c","coinIssuerAddress":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266"} 22:17:57 [22:17:57.559] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Handing over to governance 22:17:57 [22:17:57.562] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Calling evm_setNextBlockTimestamp with params: [1749680284] 22:17:57 [22:17:57.563] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Calling hardhat_mine with params: [1] 22:17:57 [22:17:57.566] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Jumped to slot 1 22:17:57 [22:17:57.572] INFO: aztecjs:utils:watcher Watcher not started because not auto mining 22:17:57 [22:17:57.572] INFO: telemetry:client Using NoopTelemetryClient 22:17:57 [22:17:57.574] INFO: kv-store:lmdb-v2:blob-sink Creating blob-sink data store at directory /tmp/2e57abfb462b5791/blob-sink with map size 134217728 KB (LMDB v2) 22:17:57 [22:17:57.577] INFO: kv-store:lmdb-v2:blob-sink Starting data store with maxReaders 16 22:17:57 [22:17:57.584] INFO: blob-sink:server Server is running on http://localhost:36959 22:17:57 [22:17:57.584] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating and synching an aztec node... 22:17:57 [22:17:57.585] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Using native ACVM binary at ../../noir/noir-repo/target/release/acvm with working directory /tmp/7ec89fe9/acvm 22:17:57 [22:17:57.586] INFO: node:blob-sink:client Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:36959"} 22:17:57 [22:17:57.606] VERBOSE: node Snapshot sync is disabled. No snapshots URL provided. 22:17:57 [22:17:57.607] INFO: archiver:lmdb Creating archiver data store at directory /tmp/2e57abfb462b5791/archiver with map size 134217728 KB (LMDB v2) 22:17:57 [22:17:57.608] INFO: archiver:lmdb Starting data store with maxReaders 16 22:17:58 [22:17:58.162] INFO: node:blob-sink:client Testing configured blob sources {"blobSinkUrl":"http://localhost:36959"} 22:17:58 [22:17:58.176] INFO: node:blob-sink:client Blob sink is reachable {"blobSinkUrl":"http://localhost:36959"} 22:17:58 [22:17:58.177] WARN: node:blob-sink:client No L1 consensus host urls configured 22:17:58 [22:17:58.177] WARN: node:blob-sink:client No archive client configured 22:17:58 [22:17:58.179] INFO: archiver Starting archiver sync to rollup contract 0xd31708b4bfcb26bfe24ede4befabbc135d45650f from L1 block 4 to current L1 block 6 with hash 0x457729ac965c2803d60f98874425cff7cc2dcaf1b990001ce2cbd249dc0aaac6 {"blocksSynchedTo":4,"messagesSynchedTo":{"l1BlockHash":"0x25afc3ca66d06e4b754e73173ac4b44e6534fe8b236c18076592595171df6e66","l1BlockNumber":4}} 22:17:58 [22:17:58.193] INFO: archiver Initial archiver sync to L1 block 6 complete. {"l1BlockNumber":6,"syncPoint":{"blocksSynchedTo":6,"messagesSynchedTo":{"l1BlockHash":"0x457729ac965c2803d60f98874425cff7cc2dcaf1b990001ce2cbd249dc0aaac6","l1BlockNumber":6}},"latest":{"number":0},"proven":{"number":0},"finalized":{"number":0}} 22:17:58 [22:17:58.197] INFO: world-state:database Creating world state data store at directory /tmp/2e57abfb462b5791/world_state with map sizes {"archiveTreeMapSizeKb":134217728,"nullifierTreeMapSizeKb":134217728,"noteHashTreeMapSizeKb":134217728,"messageTreeMapSizeKb":134217728,"publicDataTreeMapSizeKb":134217728} and 2 threads. 22:17:58 [22:17:58.220] INFO: world_state Created world state synchroniser with block history of 2 22:17:58 [22:17:58.221] WARN: node Aztec node is accepting fake proofs 22:17:58 [22:17:58.230] INFO: p2p:lmdb-v2 Creating p2p data store at directory /tmp/2e57abfb462b5791/p2p with map size 134217728 KB (LMDB v2) 22:17:58 [22:17:58.231] INFO: p2p:lmdb-v2 Starting data store with maxReaders 16 22:17:58 [22:17:58.232] INFO: p2p-archive:lmdb-v2 Creating p2p-archive data store at directory /tmp/2e57abfb462b5791/p2p-archive with map size 134217728 KB (LMDB v2) 22:17:58 [22:17:58.233] INFO: p2p-archive:lmdb-v2 Starting data store with maxReaders 16 22:17:58 [22:17:58.234] INFO: p2p-peer:lmdb-v2 Creating p2p-peers data store at directory /tmp/2e57abfb462b5791/p2p-peers with map size 134217728 KB (LMDB v2) 22:17:58 [22:17:58.235] INFO: p2p-peer:lmdb-v2 Starting data store with maxReaders 16 22:17:58 [22:17:58.236] INFO: p2p:tx_pool Setting maximum tx mempool size {"maxTxPoolSize":100000000} 22:17:58 [22:17:58.237] VERBOSE: p2p P2P is disabled. Using dummy P2P service 22:17:58 [22:17:58.239] VERBOSE: world-state:block_stream Starting L2 block stream {"proven":false,"pollIntervalMS":50} 22:17:58 [22:17:58.240] INFO: world_state Started world state synchronizer from block 1 22:17:58 [22:17:58.242] VERBOSE: world-state:block_stream Starting sync from block number 0 22:17:58 [22:17:58.243] INFO: p2p Starting p2p client from block 0 with empty mempools 22:17:58 [22:17:58.243] VERBOSE: p2p:l2-block-stream Starting L2 block stream {"batchSize":20,"pollIntervalMS":100,"startingBlock":0} 22:17:58 [22:17:58.477] INFO: epoch-prune-watcher EpochPruneWatcher initialized 22:17:58 [22:17:58.509] VERBOSE: validator Initialized validator with addresses: 0xd044046505c9713ecd37df43814e193afb5fda13 22:17:58 [22:17:58.509] VERBOSE: node All Aztec Node subsystems synced 22:17:58 [22:17:58.518] INFO: slasher Starting Slasher client... 22:17:58 [22:17:58.527] INFO: sequencer-client Deploying forwarder contract 22:17:58 [22:17:58.528] VERBOSE: p2p:l2-block-stream Starting sync from block number 0 22:17:58 [22:17:58.542] VERBOSE: sequencer-client Sent L1 transaction 0xda888973b4ad2d3d163799c42065a89b2c05bcb621343d65d24f9b27b4d854fa {"gasLimit":323704,"maxFeePerGas":"2.259597543","maxPriorityFeePerGas":"1.2"} 22:17:58 [22:17:58.543] VERBOSE: sequencer-client Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000042 to address 0x0fe4d493871B0C51332De8A330B02BA8172Da4aC in tx 0xda888973b4ad2d3d163799c42065a89b2c05bcb621343d65d24f9b27b4d854fa. 22:18:06 [22:18:06.549] INFO: sequencer-client Forwarder contract deployed at 0x0fe4d493871b0c51332de8a330b02ba8172da4ac 22:18:06 [22:18:06.556] INFO: validator Started validator with addresses: 0xd044046505c9713ecd37df43814e193afb5fda13 22:18:06 [22:18:06.556] VERBOSE: validator Validators 0xd044046505c9713ecd37df43814e193afb5fda13 are not on the validator committee for epoch 0 22:18:06 [22:18:06.557] INFO: sequencer Sequencer config set {"transactionPollingIntervalMS":500,"maxTxsPerBlock":32,"minTxsPerBlock":0,"maxL2BlockGas":10000000000,"publishTxsWithProposals":false,"maxDABlockGas":10000000000,"acvmWorkingDirectory":"/tmp/7ec89fe9/acvm","acvmBinaryPath":"../../noir/noir-repo/target/release/acvm","maxBlockSizeInBytes":1048576,"governanceProposerPayload":"0x0000000000000000000000000000000000000000","maxL1TxInclusionTimeIntoSlot":8,"enforceTimeTable":false} 22:18:06 [22:18:06.557] VERBOSE: sequencer Sequencer timetable updated {"enforceTimeTable":false} 22:18:06 [22:18:06.558] INFO: sequencer Sequencer started with address 0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266 22:18:06 [22:18:06.559] INFO: node Aztec Node version: 0.87.6 22:18:06 [22:18:06.559] INFO: node Aztec Node started on chain 0x7a69 {"registryAddress":"0x992d1f24cc5f368188d936cf0b2a111cee586d4e","governanceAddress":"0x506150cab49dbc09c8b79d20ac5c79ca28220aea","governanceProposerAddress":"0xfdb60896b1920a10fd3aa268a292e51ebd5568a8","rollupAddress":"0xd31708b4bfcb26bfe24ede4befabbc135d45650f","inboxAddress":"0x7aacd9ae08372daf839b702222ce4b3f95fdccd3","outboxAddress":"0x4d2c85295a30c310a5d7654489c365531ee8956c","feeJuicePortalAddress":"0xdac31be6765c2130dbd11c66cc95373715dd1717","feeJuiceAddress":"0xd8b56421e9b573ae62f2997b7b58858a4413a967","stakingAssetAddress":"0x026208fee3f4461826c8838c3569272e8c08e131","rewardDistributorAddress":"0xd462e23c2c8a9b4f83de76004a170d4cebb5d3e1","gseAddress":"0xad2120681b02de3e9b8afd325977cdeddf15f01c","coinIssuerAddress":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","slashFactoryAddress":"0xe00be02d54ced090ae56060867d094cf4c0ba17a","feeAssetHandlerAddress":"0x3607dbafde17871e0d6a8f929151c30b83510d39","stakingAssetHandlerAddress":"0x499c89d6b68cbdca67c96bff13eb5b5a8fdb25a2","zkPassportVerifierAddress":"0xee9f10f38319eae2730dba28fb09081db806c5e5"} 22:18:06 [22:18:06.560] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating and syncing a simulated prover node... 22:18:06 [22:18:06.603] INFO: blob-sink:client:prover-node Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:36959"} 22:18:06 [22:18:06.610] INFO: archiver:lmdb:prover-node Creating archiver data store at directory /tmp/2e57abfb462b5791/e7ad73140ceb1b8e/archiver with map size 134217728 KB (LMDB v2) 22:18:06 [22:18:06.613] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 22:18:06 [22:18:06.615] INFO: archiver:lmdb:prover-node Starting data store with maxReaders 16 22:18:06 [22:18:06.858] INFO: blob-sink:client:prover-node Testing configured blob sources {"blobSinkUrl":"http://localhost:36959"} 22:18:06 [22:18:06.861] INFO: blob-sink:client:prover-node Blob sink is reachable {"blobSinkUrl":"http://localhost:36959"} 22:18:06 [22:18:06.861] WARN: blob-sink:client:prover-node No L1 consensus host urls configured 22:18:06 [22:18:06.862] WARN: blob-sink:client:prover-node No archive client configured 22:18:06 [22:18:06.863] INFO: archiver:prover-node Starting archiver sync to rollup contract 0xd31708b4bfcb26bfe24ede4befabbc135d45650f from L1 block 4 to current L1 block 7 with hash 0xe802dbc551495ad2d2a49a0ad0d15706dce5db88a292cb753faae024c0eb9289 {"blocksSynchedTo":4,"messagesSynchedTo":{"l1BlockHash":"0x25afc3ca66d06e4b754e73173ac4b44e6534fe8b236c18076592595171df6e66","l1BlockNumber":4}} 22:18:06 [22:18:06.884] INFO: archiver:prover-node Initial archiver sync to L1 block 7 complete. {"l1BlockNumber":7,"syncPoint":{"blocksSynchedTo":7,"messagesSynchedTo":{"l1BlockHash":"0xe802dbc551495ad2d2a49a0ad0d15706dce5db88a292cb753faae024c0eb9289","l1BlockNumber":7}},"latest":{"number":0},"proven":{"number":0},"finalized":{"number":0}} 22:18:06 [22:18:06.886] INFO: prover-node:blob-sink:client:prover-node Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:36959"} 22:18:06 [22:18:06.887] VERBOSE: prover-node:prover-node Snapshot sync is disabled. No snapshots URL provided. 22:18:06 [22:18:06.888] VERBOSE: prover-node:prover-node Created archiver and synced to block 0 22:18:06 [22:18:06.891] INFO: world-state:database:prover-node Creating world state data store at directory /tmp/2e57abfb462b5791/e7ad73140ceb1b8e/world_state with map sizes {"archiveTreeMapSizeKb":134217728,"nullifierTreeMapSizeKb":134217728,"noteHashTreeMapSizeKb":134217728,"messageTreeMapSizeKb":134217728,"publicDataTreeMapSizeKb":134217728} and 2 threads. 22:18:06 [22:18:06.911] INFO: world_state:prover-node Created world state synchroniser with block history of 2 22:18:06 [22:18:06.912] VERBOSE: world-state:block_stream:prover-node Starting L2 block stream {"proven":false,"pollIntervalMS":50} 22:18:06 [22:18:06.912] INFO: world_state:prover-node Started world state synchronizer from block 1 22:18:06 [22:18:06.914] VERBOSE: world-state:block_stream:prover-node Starting sync from block number 0 22:18:06 [22:18:06.914] WARN: prover-client:proving-broker-database:prover-node Found invalid epoch directory /tmp/2e57abfb462b5791/e7ad73140ceb1b8e/archiver when loading epoch databases, ignoring 22:18:06 [22:18:06.914] WARN: prover-client:proving-broker-database:prover-node Found invalid epoch directory /tmp/2e57abfb462b5791/e7ad73140ceb1b8e/world_state when loading epoch databases, ignoring 22:18:06 [22:18:06.915] INFO: prover-client:proving-broker:prover-node Proving Broker started 22:18:06 [22:18:06.926] INFO: prover-node:prover-coordination:prover-node Using prover coordination via aztec node 22:18:06 [22:18:06.927] INFO: e2e:e2e_epochs:epochs_upload_failed_proof:prover-node Created and synced prover node {"publisherAddress":"0x3C44CdDdB6a900fa2b585dd299e03d12FA4293BC"} 22:18:06 [22:18:06.928] INFO: prover-node:epoch-monitor:prover-node Started EpochMonitor {"pollingIntervalMs":200} 22:18:06 [22:18:06.931] INFO: prover-node:prover-node Started Prover Node with prover id 0x0000000000000000000000000000000000000000000000000000000000000001 {"proverNodePollingIntervalMs":200,"proverNodeMaxPendingJobs":10,"proverNodeMaxParallelBlocksPerEpoch":32,"txGatheringIntervalMs":1000,"txGatheringBatchSize":10,"txGatheringMaxParallelRequestsPerNode":100,"proverNodeFailedEpochStore":"file:///tmp/failed-proofs-o40LdP","dataDirectory":"/tmp/2e57abfb462b5791/e7ad73140ceb1b8e","l1ChainId":31337,"rollupVersion":3013108653} 22:18:06 [22:18:06.932] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating a pxe... 22:18:06 [22:18:06.935] INFO: pxe:data:lmdb Creating pxe_data data store at directory /tmp/ce07d4273c02280b/pxe_data with map size 134217728 KB (LMDB v2) 22:18:06 [22:18:06.937] INFO: pxe:data:lmdb Starting data store with maxReaders 16 22:18:07 [22:18:07.192] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 22:18:07 [22:18:07.194] VERBOSE: pxe:service Registered protocol contracts in pxe {"AuthRegistry":"0x0000000000000000000000000000000000000000000000000000000000000001","ContractInstanceDeployer":"0x0000000000000000000000000000000000000000000000000000000000000002","ContractClassRegisterer":"0x0000000000000000000000000000000000000000000000000000000000000003","MultiCallEntrypoint":"0x0000000000000000000000000000000000000000000000000000000000000004","FeeJuice":"0x0000000000000000000000000000000000000000000000000000000000000005","Router":"0x0000000000000000000000000000000000000000000000000000000000000006"} 22:18:07 [22:18:07.195] INFO: pxe:service Started PXE connected to chain 31337 version 3013108653 22:18:07 [22:18:07.198] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L2 genesis at L1 block 4 (timestamp 1749680268) 22:18:07 [22:18:07.199] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting until L1 timestamp 1749680332 is reached as the start of epoch 1 22:18:07 [22:18:07.422] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 7 mined at 22:18:12 with new L2 block 0 for epoch 0 with proof up to L2 block 0 for epoch 0 {"l1Timestamp":1749680292,"l1BlockNumber":7,"l2SlotNumber":1,"l2BlockNumber":0,"l2ProvenBlockNumber":0,"totalL2Messages":0} 22:18:07 [22:18:07.698] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 22:18:08 [22:18:08.203] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 22:18:08 [22:18:08.708] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 22:18:09 [22:18:09.213] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 22:18:09 [22:18:09.720] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 22:18:10 [22:18:10.228] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 22:18:10 [22:18:10.733] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 22:18:11 [22:18:11.238] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 22:18:11 [22:18:11.746] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 22:18:12 [22:18:12.254] VERBOSE: sequencer Preparing proposal for block 1 at slot 2 {"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1749680300,"version":3013108653},"chainTipArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","blockNumber":1,"slot":2} 22:18:12 [22:18:12.268] VERBOSE: block-builder Building block 1 for slot 2 {"slot":2,"slotStart":"2025-06-11T22:18:20.000Z","now":"2025-06-11T22:18:12.268Z","blockNumber":1,"msgCount":0,"opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}} 22:18:12 [22:18:12.272] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.0004553999999989173s {"duration":0.0004553999999989173,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 22:18:12 [22:18:12.284] INFO: sequencer Built block 1 for slot 2 with 0 txs and 0 messages. 0 mana/s {"blockHash":"0x128b78559c0d55e4ed9a3160d26d189eb28db3aebe4af832aadee96c641629a2","globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1749680300,"version":3013108653},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":23.367647999999463,"publicProcessDuration":1.1566810000003898,"rollupCircuitsDuration":15.88459000000148,"txCount":0,"blockNumber":1,"blockTimestamp":1749680300,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 22:18:12 [22:18:12.287] VERBOSE: sequencer Attesting committee is empty 22:18:12 [22:18:12.610] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 8 mined at 22:18:20 {"l1Timestamp":1749680300,"l1BlockNumber":8,"l2SlotNumber":2,"l2BlockNumber":0,"l2ProvenBlockNumber":0,"totalL2Messages":0} 22:18:14 [22:18:14.879] VERBOSE: ethereum:tx_delayer Sent tx immediately 0x9542d064f8d699619f2839c3ecff4f9ee0b2d849fa8e263e97ea1615cd074628 22:18:14 [22:18:14.880] VERBOSE: node Sent L1 transaction 0x9542d064f8d699619f2839c3ecff4f9ee0b2d849fa8e263e97ea1615cd074628 {"gasLimit":485786,"maxFeePerGas":"2.367147852","maxPriorityFeePerGas":"1.44","maxFeePerBlobGas":"0.000000001"} 22:18:20 [22:18:20.531] INFO: sequencer:publisher Bundled [propose] transaction [succeeded] 22:18:20 [22:18:20.532] VERBOSE: sequencer:publisher Published L2 block to L1 rollup contract {"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0x9542d064f8d699619f2839c3ecff4f9ee0b2d849fa8e263e97ea1615cd074628","calldataSize":1220,"calldataGas":8828,"txCount":0,"blockNumber":1,"blockTimestamp":1749680300,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 22:18:20 [22:18:20.533] VERBOSE: node:blob-sink:client Sending 1 blobs to blob sink 22:18:20 [22:18:20.536] WARN: blob-sink:client:prover-node Unable to get blob sidecar for 0x3453a7d95ecd209fc34d0825e5533097d8547b6bcaf14f02cfea192b0a3fcb0c: Not Found (404) {"status":404,"statusText":"Not Found","body":"{\"error\":\"Blob not found\"}"} 22:18:20 [22:18:20.536] WARN: blob-sink:client:prover-node Failed to fetch blobs for 0x3453a7d95ecd209fc34d0825e5533097d8547b6bcaf14f02cfea192b0a3fcb0c from all blob sources {"blobSinkUrl":"http://localhost:36959"} 22:18:20 [22:18:20.540] WARN: node:blob-sink:client Unable to get blob sidecar for 0x3453a7d95ecd209fc34d0825e5533097d8547b6bcaf14f02cfea192b0a3fcb0c: Not Found (404) {"status":404,"statusText":"Not Found","body":"{\"error\":\"Blob not found\"}"} 22:18:20 [22:18:20.541] WARN: node:blob-sink:client Failed to fetch blobs for 0x3453a7d95ecd209fc34d0825e5533097d8547b6bcaf14f02cfea192b0a3fcb0c from all blob sources {"blobSinkUrl":"http://localhost:36959"} 22:18:20 [22:18:20.550] INFO: blob-sink:server Received blob sidecar for block 0x3453a7d95ecd209fc34d0825e5533097d8547b6bcaf14f02cfea192b0a3fcb0c 22:18:20 [22:18:20.554] INFO: blob-sink:server Blob sidecar stored successfully for block 0x3453a7d95ecd209fc34d0825e5533097d8547b6bcaf14f02cfea192b0a3fcb0c 22:18:20 [22:18:20.643] INFO: archiver:prover-node Downloaded L2 block 1 {"blockHash":"0x128b78559c0d55e4ed9a3160d26d189eb28db3aebe4af832aadee96c641629a2","blockNumber":1,"txCount":0,"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1749680300,"version":3013108653},"archiveRoot":"0x0da3d843d91132b937b470781b18aa6748374e6310b5c2f802ccb75c466dc01e","archiveNextLeafIndex":2} 22:18:20 [22:18:20.670] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 9 mined at 22:18:28 with new L2 block 1 for epoch 0 {"l1Timestamp":1749680308,"l1BlockNumber":9,"l2SlotNumber":2,"l2BlockNumber":1,"l2ProvenBlockNumber":0,"totalL2Messages":0} 22:18:20 [22:18:20.673] INFO: archiver Downloaded L2 block 1 {"blockHash":"0x128b78559c0d55e4ed9a3160d26d189eb28db3aebe4af832aadee96c641629a2","blockNumber":1,"txCount":0,"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1749680300,"version":3013108653},"archiveRoot":"0x0da3d843d91132b937b470781b18aa6748374e6310b5c2f802ccb75c466dc01e","archiveNextLeafIndex":2} 22:18:20 [22:18:20.689] INFO: world_state:prover-node World state updated with L2 block 1 {"eventName":"l2-block-handled","duration":3.0013729999918723,"unfinalisedBlockNumber":1,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":1,"blockTimestamp":1749680300,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 22:18:20 [22:18:20.695] INFO: world_state World state updated with L2 block 1 {"eventName":"l2-block-handled","duration":2.443756000007852,"unfinalisedBlockNumber":1,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":1,"blockTimestamp":1749680300,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 22:18:20 [22:18:20.760] VERBOSE: p2p Synched to latest block 1 22:18:20 [22:18:20.940] VERBOSE: prover-node:prover-node Fetching 0 tx hashes for block number 1 from coordination 22:18:20 [22:18:20.940] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 22:18:21 [22:18:21.044] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 22:18:21 [22:18:21.556] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 22:18:22 [22:18:22.063] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 22:18:22 [22:18:22.569] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 22:18:23 [22:18:23.078] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 22:18:23 [22:18:23.586] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 22:18:24 [22:18:24.094] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 22:18:24 [22:18:24.602] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 22:18:25 [22:18:25.110] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 22:18:25 [22:18:25.619] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 22:18:26 [22:18:26.128] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 22:18:26 [22:18:26.637] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 22:18:27 [22:18:27.144] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 22:18:27 [22:18:27.657] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 22:18:28 [22:18:28.169] VERBOSE: sequencer Preparing proposal for block 2 at slot 3 {"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1749680316,"version":3013108653},"chainTipArchive":"0x0da3d843d91132b937b470781b18aa6748374e6310b5c2f802ccb75c466dc01e","blockNumber":2,"slot":3} 22:18:28 [22:18:28.181] VERBOSE: block-builder Building block 2 for slot 3 {"slot":3,"slotStart":"2025-06-11T22:18:36.000Z","now":"2025-06-11T22:18:28.181Z","blockNumber":2,"msgCount":0,"opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}} 22:18:28 [22:18:28.183] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.00018422500000451691s {"duration":0.00018422500000451691,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 22:18:28 [22:18:28.193] INFO: sequencer Built block 2 for slot 3 with 0 txs and 0 messages. 0 mana/s {"blockHash":"0x2bbe93cd9d355a0e2ddcaae97b9918d69fdd412b7f49130ba6d044d10a466f5e","globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1749680316,"version":3013108653},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":17.19823500000348,"publicProcessDuration":0.5577469999989262,"rollupCircuitsDuration":12.432369000001927,"txCount":0,"blockNumber":2,"blockTimestamp":1749680316,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 22:18:28 [22:18:28.195] VERBOSE: sequencer Attesting committee is empty 22:18:28 [22:18:28.253] VERBOSE: ethereum:tx_delayer Sent tx immediately 0x5cf86222e98e79fd8b23b93177cd5cc934134ce8fbc07ee773f9e7ab41b3e555 22:18:28 [22:18:28.253] VERBOSE: node Sent L1 transaction 0x5cf86222e98e79fd8b23b93177cd5cc934134ce8fbc07ee773f9e7ab41b3e555 {"gasLimit":414548,"maxFeePerGas":"2.439650389","maxPriorityFeePerGas":"1.728","maxFeePerBlobGas":"0.000000001"} 22:18:28 [22:18:28.536] INFO: sequencer:publisher Bundled [propose] transaction [succeeded] 22:18:28 [22:18:28.536] VERBOSE: sequencer:publisher Published L2 block to L1 rollup contract {"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0x5cf86222e98e79fd8b23b93177cd5cc934134ce8fbc07ee773f9e7ab41b3e555","calldataSize":1220,"calldataGas":8816,"txCount":0,"blockNumber":2,"blockTimestamp":1749680316,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 22:18:28 [22:18:28.536] VERBOSE: node:blob-sink:client Sending 1 blobs to blob sink 22:18:28 [22:18:28.551] INFO: blob-sink:server Received blob sidecar for block 0x5cf20ac6660c5245d2fe53e2db6a70cbbcca2702804b628898779c0c16e63f36 22:18:28 [22:18:28.564] INFO: blob-sink:server Blob sidecar stored successfully for block 0x5cf20ac6660c5245d2fe53e2db6a70cbbcca2702804b628898779c0c16e63f36 22:18:28 [22:18:28.604] INFO: archiver Downloaded L2 block 2 {"blockHash":"0x2bbe93cd9d355a0e2ddcaae97b9918d69fdd412b7f49130ba6d044d10a466f5e","blockNumber":2,"txCount":0,"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1749680316,"version":3013108653},"archiveRoot":"0x2ed02748004ee1cd78ed109cd469cb0e2bf1c3ea0bd0f27bcbf25e26609844c7","archiveNextLeafIndex":3} 22:18:28 [22:18:28.606] INFO: archiver:prover-node Downloaded L2 block 2 {"blockHash":"0x2bbe93cd9d355a0e2ddcaae97b9918d69fdd412b7f49130ba6d044d10a466f5e","blockNumber":2,"txCount":0,"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1749680316,"version":3013108653},"archiveRoot":"0x2ed02748004ee1cd78ed109cd469cb0e2bf1c3ea0bd0f27bcbf25e26609844c7","archiveNextLeafIndex":3} 22:18:28 [22:18:28.625] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 10 mined at 22:18:36 with new L2 block 2 for epoch 0 {"l1Timestamp":1749680316,"l1BlockNumber":10,"l2SlotNumber":3,"l2BlockNumber":2,"l2ProvenBlockNumber":0,"totalL2Messages":0} 22:18:28 [22:18:28.658] INFO: world_state World state updated with L2 block 2 {"eventName":"l2-block-handled","duration":2.527331999997841,"unfinalisedBlockNumber":2,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":2,"blockTimestamp":1749680316,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 22:18:28 [22:18:28.659] INFO: world_state:prover-node World state updated with L2 block 2 {"eventName":"l2-block-handled","duration":2.344641000003321,"unfinalisedBlockNumber":2,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":2,"blockTimestamp":1749680316,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 22:18:28 [22:18:28.717] VERBOSE: p2p Synched to latest block 2 22:18:28 [22:18:28.723] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 22:18:28 [22:18:28.724] VERBOSE: prover-node:prover-node Gathered all 0 txs for epoch 0 {"epochNumber":0} 22:18:28 [22:18:28.724] VERBOSE: prover-node:prover-node Gathered all 0 messages for epoch 0 {"epochNumber":0} 22:18:28 [22:18:28.725] VERBOSE: prover-node:prover-node Gathered previous block header 0 for epoch 0 22:18:28 [22:18:28.725] VERBOSE: prover-node:prover-node Creating proving job for epoch 0 for block range 1 to 2 22:18:28 [22:18:28.726] INFO: prover-node:epoch-proving-job Starting epoch 0 proving job with blocks 1 to 2 {"fromBlock":1,"toBlock":2,"epochSizeBlocks":2,"epochNumber":0,"uuid":"5074c38a-c4ff-4175-b247-580a8cf39a5a"} 22:18:28 [22:18:28.741] INFO: prover-client:orchestrator Starting epoch 0 with 2 blocks 22:18:28 [22:18:28.742] VERBOSE: prover-client:broker-circuit-prover-facade Starting BrokerCircuitProverFacade 22:18:28 [22:18:28.743] VERBOSE: prover-node:epoch-proving-job Starting processing block 1 {"number":1,"blockHash":"0x128b78559c0d55e4ed9a3160d26d189eb28db3aebe4af832aadee96c641629a2","lastArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"5074c38a-c4ff-4175-b247-580a8cf39a5a","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x00000000000000000000000000000000000000000000000000000000b39863ad","blockNumber":"0x0000000000000000000000000000000000000000000000000000000000000001","slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 22:18:28 [22:18:28.743] INFO: prover-client:orchestrator Starting block 1 for slot 2 22:18:28 [22:18:28.744] VERBOSE: prover-node:epoch-proving-job Starting processing block 2 {"number":2,"blockHash":"0x2bbe93cd9d355a0e2ddcaae97b9918d69fdd412b7f49130ba6d044d10a466f5e","lastArchive":"0x0da3d843d91132b937b470781b18aa6748374e6310b5c2f802ccb75c466dc01e","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"5074c38a-c4ff-4175-b247-580a8cf39a5a","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x00000000000000000000000000000000000000000000000000000000b39863ad","blockNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000003","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 22:18:28 [22:18:28.744] INFO: prover-client:orchestrator Starting block 2 for slot 3 22:18:28 [22:18:28.753] INFO: prover-client:proving-broker:prover-node New proving job id=0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1 epochNumber=0 {"provingJobId":"0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1"} 22:18:28 [22:18:28.753] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1","provingJobType":"BASE_PARITY"} 22:18:28 [22:18:28.753] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1","provingJobType":"BASE_PARITY"} 22:18:28 [22:18:28.754] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1","provingJobType":"BASE_PARITY"} 22:18:28 [22:18:28.757] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1","provingJobType":"BASE_PARITY"} 22:18:28 [22:18:28.757] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1","provingJobType":"BASE_PARITY"} 22:18:28 [22:18:28.757] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1","provingJobType":"BASE_PARITY"} 22:18:28 [22:18:28.757] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1","provingJobType":"BASE_PARITY"} 22:18:28 [22:18:28.759] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000013605999993160366s {"duration":0.000013605999993160366,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 22:18:28 [22:18:28.759] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 22:18:28 [22:18:28.759] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 1 {"blockNumber":1,"blockHash":"0x128b78559c0d55e4ed9a3160d26d189eb28db3aebe4af832aadee96c641629a2","uuid":"5074c38a-c4ff-4175-b247-580a8cf39a5a"} 22:18:28 [22:18:28.760] VERBOSE: prover-client:orchestrator Block 1 completed. Assembling header. 22:18:28 [22:18:28.765] VERBOSE: prover-client:orchestrator Updating archive tree with block 1 header 0x128b78559c0d55e4ed9a3160d26d189eb28db3aebe4af832aadee96c641629a2 22:18:28 [22:18:28.769] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000012570999999297783s {"duration":0.000012570999999297783,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 22:18:28 [22:18:28.769] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 22:18:28 [22:18:28.772] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 2 {"blockNumber":2,"blockHash":"0x2bbe93cd9d355a0e2ddcaae97b9918d69fdd412b7f49130ba6d044d10a466f5e","uuid":"5074c38a-c4ff-4175-b247-580a8cf39a5a"} 22:18:28 [22:18:28.772] VERBOSE: prover-client:orchestrator Block 2 completed. Assembling header. 22:18:28 [22:18:28.775] VERBOSE: prover-client:orchestrator Orchestrator finalised block 1 22:18:28 [22:18:28.789] VERBOSE: prover-client:orchestrator Updating archive tree with block 2 header 0x2bbe93cd9d355a0e2ddcaae97b9918d69fdd412b7f49130ba6d044d10a466f5e 22:18:28 [22:18:28.791] VERBOSE: prover-client:orchestrator Orchestrator finalised block 2 22:18:28 [22:18:28.803] INFO: prover-client:proving-broker-database:prover-node Creating broker database for epoch 0 at /tmp/2e57abfb462b5791/e7ad73140ceb1b8e/0 with map size 134217728 22:18:28 [22:18:28.804] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:18:28 [22:18:28.807] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1 type=BASE_PARITY epochNumber=0 {"provingJobId":"0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1","provingJobType":"BASE_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...","status":"not-found","numOutstandingJobs":1} 22:18:28 [22:18:28.904] INFO: prover-client:proving-agent:prover-node Starting job id=0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1 type=BASE_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input... 22:18:28 [22:18:28.915] INFO: prover-client:proving-agent:job-controller-e0b25d59 Job controller started jobId=0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1 {"jobId":"0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1"} 22:18:28 [22:18:28.945] VERBOSE: prover-node:prover-node Fetching 0 tx hashes for block number 2 from coordination 22:18:28 [22:18:28.946] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 22:18:28 [22:18:28.979] INFO: prover-client:proving-agent:prover-node Job id=0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1 type=BASE_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22resul... 22:18:28 [22:18:28.980] INFO: prover-client:proving-broker:prover-node Proving job complete id=0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1 type=BASE_PARITY totalAttempts=1 {"provingJobId":"0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1"} 22:18:29 [22:18:29.053] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 22:18:29 error: "Rollup__SlotAlreadyInChain(3, 3)" 22:18:29 [22:18:29.053] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 22:18:29 [22:18:29.562] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 22:18:29 error: "Rollup__SlotAlreadyInChain(3, 3)" 22:18:29 [22:18:29.563] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 22:18:29 [22:18:29.742] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 22:18:29 [22:18:29.744] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1 type=BASE_PARITY 22:18:29 [22:18:29.744] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 22:18:29 [22:18:29.755] INFO: prover-client:proving-broker:prover-node New proving job id=0:ROOT_PARITY:129a026d4e8c9e1eade050caeafcea139c256c3443dcd661155fbc9a914bdfed epochNumber=0 {"provingJobId":"0:ROOT_PARITY:129a026d4e8c9e1eade050caeafcea139c256c3443dcd661155fbc9a914bdfed"} 22:18:29 [22:18:29.761] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:ROOT_PARITY:129a026d4e8c9e1eade050caeafcea139c256c3443dcd661155fbc9a914bdfed type=ROOT_PARITY {"provingJobId":"0:ROOT_PARITY:129a026d4e8c9e1eade050caeafcea139c256c3443dcd661155fbc9a914bdfed","provingJobType":"ROOT_PARITY"} 22:18:29 [22:18:29.803] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Triggering error on finaliseEpoch 22:18:29 [22:18:29.810] ERROR: prover-node:epoch-proving-job Error running epoch 0 prover job: Error: Fake error while proving epoch 22:18:29 at ServerEpochProver.epochProver.finaliseEpoch (/home/aztec-dev/aztec-packages/yarn-project/end-to-end/src/e2e_epochs/epochs_upload_failed_proof.test.ts:60:15) 22:18:29 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:142:64) 22:18:29 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) {"uuid":"5074c38a-c4ff-4175-b247-580a8cf39a5a","epochNumber":0} 22:18:29 [22:18:29.810] VERBOSE: prover-client:broker-circuit-prover-facade Stopping BrokerCircuitProverFacade 22:18:29 [22:18:29.811] ERROR: prover-client:broker-circuit-prover-facade Job errored with 'Broker facade stopped' id=0:ROOT_PARITY:129a026d4e8c9e1eade050caeafcea139c256c3443dcd661155fbc9a914bdfed type=ROOT_PARITY: { 22:18:29 provingJobId: '0:ROOT_PARITY:129a026d4e8c9e1eade050caeafcea139c256c3443dcd661155fbc9a914bdfed', 22:18:29 provingJobType: 'ROOT_PARITY' 22:18:29 } 22:18:29 [22:18:29.812] ERROR: prover-client:orchestrator Error thrown when proving job: Error: Broker facade stopped 22:18:29 at BrokerCircuitProverFacade.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/proving_broker/broker_prover_facade.js:142:31) 22:18:29 at ServerEpochProver.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/prover-client/server-epoch-prover.js:31:9) 22:18:29 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:183:13) 22:18:29 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) 22:18:29 [22:18:29.812] ERROR: prover-node:prover-node Job for 0 exited with state failed: { 22:18:29 id: '5074c38a-c4ff-4175-b247-580a8cf39a5a', 22:18:29 epochNumber: 0n, 22:18:29 state: 'failed' 22:18:29 } 22:18:29 [22:18:29.813] WARN: prover-node:prover-node Uploading epoch proof failure for 0 to file:///tmp/failed-proofs-o40LdP {"epochNumber":0,"jobId":"5074c38a-c4ff-4175-b247-580a8cf39a5a","location":"file:///tmp/failed-proofs-o40LdP"} 22:18:29 [22:18:29.814] INFO: stdlib:file-store Creating local file file store at /tmp/failed-proofs-o40LdP 22:18:29 [22:18:29.815] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_PARITY:129a026d4e8c9e1eade050caeafcea139c256c3443dcd661155fbc9a914bdfed type=ROOT_PARITY epochNumber=0 {"provingJobId":"0:ROOT_PARITY:129a026d4e8c9e1eade050caeafcea139c256c3443dcd661155fbc9a914bdfed","provingJobType":"ROOT_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu...","status":"not-found","numOutstandingJobs":0} 22:18:29 [22:18:29.815] ERROR: prover-client:orchestrator Error thrown when proving job: Error: Broker facade stopped 22:18:29 at BrokerCircuitProverFacade.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/proving_broker/broker_prover_facade.js:142:31) 22:18:29 at ServerEpochProver.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/prover-client/server-epoch-prover.js:31:9) 22:18:29 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:183:13) 22:18:29 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) 22:18:29 [22:18:29.818] INFO: prover-client:proving-agent:prover-node Starting job id=0:ROOT_PARITY:129a026d4e8c9e1eade050caeafcea139c256c3443dcd661155fbc9a914bdfed type=ROOT_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu... 22:18:29 [22:18:29.835] INFO: prover-client:proving-agent:job-controller-007459a4 Job controller started jobId=0:ROOT_PARITY:129a026d4e8c9e1eade050caeafcea139c256c3443dcd661155fbc9a914bdfed {"jobId":"0:ROOT_PARITY:129a026d4e8c9e1eade050caeafcea139c256c3443dcd661155fbc9a914bdfed"} 22:18:29 [22:18:29.836] INFO: prover-node:prover-node Pausing archiver and world state sync to start snapshot upload 22:18:29 [22:18:29.837] INFO: archiver:prover-node Stopped. 22:18:29 [22:18:29.837] INFO: world_state:prover-node Stopped sync 22:18:29 [22:18:29.837] INFO: prover-node:prover-node Creating backups of lmdb environments to /tmp/2e57abfb462b5791/e7ad73140ceb1b8e/epoch-proof-data-R8mbj0 22:18:29 [22:18:29.843] INFO: prover-node:prover-node Data stores backed up to /tmp/2e57abfb462b5791/e7ad73140ceb1b8e/epoch-proof-data-R8mbj0 {"paths":{"l1-to-l2-message-tree":"/tmp/2e57abfb462b5791/e7ad73140ceb1b8e/epoch-proof-data-R8mbj0/world-state/L1ToL2MessageTree/data.mdb","archive-tree":"/tmp/2e57abfb462b5791/e7ad73140ceb1b8e/epoch-proof-data-R8mbj0/world-state/ArchiveTree/data.mdb","public-data-tree":"/tmp/2e57abfb462b5791/e7ad73140ceb1b8e/epoch-proof-data-R8mbj0/world-state/PublicDataTree/data.mdb","note-hash-tree":"/tmp/2e57abfb462b5791/e7ad73140ceb1b8e/epoch-proof-data-R8mbj0/world-state/NoteHashTree/data.mdb","nullifier-tree":"/tmp/2e57abfb462b5791/e7ad73140ceb1b8e/epoch-proof-data-R8mbj0/world-state/NullifierTree/data.mdb","archiver":"/tmp/2e57abfb462b5791/e7ad73140ceb1b8e/epoch-proof-data-R8mbj0/archiver/data.mdb"}} 22:18:29 [22:18:29.843] INFO: prover-node:prover-node Resuming archiver and world state sync 22:18:29 [22:18:29.844] VERBOSE: world-state:block_stream:prover-node Starting L2 block stream {"proven":false,"pollIntervalMS":50} 22:18:29 [22:18:29.844] INFO: world_state:prover-node Resumed sync 22:18:29 [22:18:29.844] INFO: archiver:prover-node Restarting archiver 22:18:29 [22:18:29.862] WARN: prover-node:prover-node Uploaded epoch 0 proof failure data to file:///tmp/failed-proofs-o40LdP/aztec-31337-3013108653-0xd31708b4bfcb26bfe24ede4befabbc135d45650f/0-20250611221829-5074c38a-c4ff-4175-b247-580a8cf39a5a {"epochNumber":0,"location":"file:///tmp/failed-proofs-o40LdP","basePath":"aztec-31337-3013108653-0xd31708b4bfcb26bfe24ede4befabbc135d45650f/0-20250611221829-5074c38a-c4ff-4175-b247-580a8cf39a5a","metadataUrl":"file:///tmp/failed-proofs-o40LdP/aztec-31337-3013108653-0xd31708b4bfcb26bfe24ede4befabbc135d45650f/0-20250611221829-5074c38a-c4ff-4175-b247-580a8cf39a5a/metadata.json","dataUrl":"file:///tmp/failed-proofs-o40LdP/aztec-31337-3013108653-0xd31708b4bfcb26bfe24ede4befabbc135d45650f/0-20250611221829-5074c38a-c4ff-4175-b247-580a8cf39a5a/data.bin","metadata":{"l1BlockNumber":10,"l2BlockHash":"0x2bbe93cd9d355a0e2ddcaae97b9918d69fdd412b7f49130ba6d044d10a466f5e","l2BlockNumber":2,"schemaVersions":{"archiver":2,"worldState":1},"timestamp":1749680309845,"dataUrls":{"l1-to-l2-message-tree":"file:///tmp/failed-proofs-o40LdP/aztec-31337-3013108653-0xd31708b4bfcb26bfe24ede4befabbc135d45650f/0-20250611221829-5074c38a-c4ff-4175-b247-580a8cf39a5a/l1-to-l2-message-tree.db","archive-tree":"file:///tmp/failed-proofs-o40LdP/aztec-31337-3013108653-0xd31708b4bfcb26bfe24ede4befabbc135d45650f/0-20250611221829-5074c38a-c4ff-4175-b247-580a8cf39a5a/archive-tree.db","public-data-tree":"file:///tmp/failed-proofs-o40LdP/aztec-31337-3013108653-0xd31708b4bfcb26bfe24ede4befabbc135d45650f/0-20250611221829-5074c38a-c4ff-4175-b247-580a8cf39a5a/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-o40LdP/aztec-31337-3013108653-0xd31708b4bfcb26bfe24ede4befabbc135d45650f/0-20250611221829-5074c38a-c4ff-4175-b247-580a8cf39a5a/note-hash-tree.db","nullifier-tree":"file:///tmp/failed-proofs-o40LdP/aztec-31337-3013108653-0xd31708b4bfcb26bfe24ede4befabbc135d45650f/0-20250611221829-5074c38a-c4ff-4175-b247-580a8cf39a5a/nullifier-tree.db","archiver":"file:///tmp/failed-proofs-o40LdP/aztec-31337-3013108653-0xd31708b4bfcb26bfe24ede4befabbc135d45650f/0-20250611221829-5074c38a-c4ff-4175-b247-580a8cf39a5a/archiver.db"}},"jobId":"5074c38a-c4ff-4175-b247-580a8cf39a5a"} 22:18:29 [22:18:29.863] INFO: prover-node:prover-node Cleaning up backup dir /tmp/2e57abfb462b5791/e7ad73140ceb1b8e/epoch-proof-data-R8mbj0 22:18:29 [22:18:29.949] INFO: prover-client:proving-agent:prover-node Job id=0:ROOT_PARITY:129a026d4e8c9e1eade050caeafcea139c256c3443dcd661155fbc9a914bdfed type=ROOT_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22resu... 22:18:29 [22:18:29.949] INFO: prover-client:proving-broker:prover-node Proving job complete id=0:ROOT_PARITY:129a026d4e8c9e1eade050caeafcea139c256c3443dcd661155fbc9a914bdfed type=ROOT_PARITY totalAttempts=1 {"provingJobId":"0:ROOT_PARITY:129a026d4e8c9e1eade050caeafcea139c256c3443dcd661155fbc9a914bdfed"} 22:18:30 [22:18:30.071] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 22:18:30 error: "Rollup__SlotAlreadyInChain(3, 3)" 22:18:30 [22:18:30.072] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 22:18:30 [22:18:30.581] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 22:18:30 error: "Rollup__SlotAlreadyInChain(3, 3)" 22:18:30 [22:18:30.581] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 22:18:31 [22:18:31.091] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 22:18:31 error: "Rollup__SlotAlreadyInChain(3, 3)" 22:18:31 [22:18:31.091] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 22:18:31 [22:18:31.601] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 22:18:31 error: "Rollup__SlotAlreadyInChain(3, 3)" 22:18:31 [22:18:31.602] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 22:18:32 [22:18:32.111] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 22:18:32 error: "Rollup__SlotAlreadyInChain(3, 3)" 22:18:32 [22:18:32.111] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 22:18:32 [22:18:32.621] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 22:18:32 error: "Rollup__SlotAlreadyInChain(3, 3)" 22:18:32 [22:18:32.622] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 22:18:33 [22:18:33.130] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 22:18:33 error: "Rollup__SlotAlreadyInChain(3, 3)" 22:18:33 [22:18:33.131] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 22:18:33 [22:18:33.640] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 22:18:33 error: "Rollup__SlotAlreadyInChain(3, 3)" 22:18:33 [22:18:33.640] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 22:18:34 [22:18:34.149] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 22:18:34 error: "Rollup__SlotAlreadyInChain(3, 3)" 22:18:34 [22:18:34.150] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 22:18:34 [22:18:34.657] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 22:18:34 error: "Rollup__SlotAlreadyInChain(3, 3)" 22:18:34 [22:18:34.658] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 22:18:35 [22:18:35.170] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 22:18:35 error: "Rollup__SlotAlreadyInChain(3, 3)" 22:18:35 [22:18:35.171] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 22:18:35 [22:18:35.680] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 22:18:35 error: "Rollup__SlotAlreadyInChain(3, 3)" 22:18:35 [22:18:35.680] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 22:18:36 [22:18:36.189] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 22:18:36 error: "Rollup__SlotAlreadyInChain(3, 3)" 22:18:36 [22:18:36.190] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 22:18:36 [22:18:36.540] INFO: prover-node:prover-node Stopping ProverNode 22:18:36 [22:18:36.540] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 22:18:36 [22:18:36.540] INFO: archiver:prover-node Stopped. 22:18:36 [22:18:36.542] INFO: world_state:prover-node Stopped world state synchronizer 22:18:36 [22:18:36.542] INFO: prover-node:prover-node Stopped ProverNode 22:18:36 [22:18:36.542] INFO: node Stopping Aztec Node 22:18:36 [22:18:36.695] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 3 but got 4. {"rollup":[4,3],"newBlockNumber":3,"expectedSlot":3} 22:18:37 [22:18:37.201] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 3 but got 4. {"rollup":[4,3],"newBlockNumber":3,"expectedSlot":3} 22:18:37 [22:18:37.708] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 3 but got 4. {"rollup":[4,3],"newBlockNumber":3,"expectedSlot":3} 22:18:38 [22:18:38.215] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 3 but got 4. {"rollup":[4,3],"newBlockNumber":3,"expectedSlot":3} 22:18:38 [22:18:38.543] INFO: slasher Slasher client stopped. 22:18:38 [22:18:38.544] INFO: sequencer Stopped sequencer 22:18:38 [22:18:38.544] INFO: p2p P2P client stopped 22:18:38 [22:18:38.546] INFO: world_state Stopped world state synchronizer 22:18:38 [22:18:38.546] INFO: archiver Stopped. 22:18:38 [22:18:38.546] INFO: node Stopped Aztec Node 22:18:38 [22:18:38.547] INFO: node Stopping Aztec Node 22:18:40 [22:18:40.548] INFO: slasher Slasher client stopped. 22:18:40 [22:18:40.548] WARN: validator Running promise was not started 22:18:40 [22:18:40.548] WARN: sequencer Running promise was not started 22:18:40 [22:18:40.549] INFO: sequencer Stopped sequencer 22:18:40 [22:18:40.549] WARN: p2p:l2-block-stream Running promise was not started 22:18:40 [22:18:40.549] INFO: p2p P2P client stopped 22:18:40 [22:18:40.549] WARN: world-state:block_stream Running promise was not started 22:18:40 [22:18:40.549] INFO: world_state Stopped world state synchronizer 22:18:40 [22:18:40.549] WARN: archiver Running promise was not started 22:18:40 [22:18:40.549] INFO: archiver Stopped. 22:18:40 [22:18:40.549] INFO: node Stopped Aztec Node 22:18:40 [22:18:40.550] INFO: prover-node:prover-node Stopping ProverNode 22:18:40 [22:18:40.550] WARN: prover-node:prover-node Running promise was not started 22:18:40 [22:18:40.550] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 22:18:40 [22:18:40.550] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 22:18:40 [22:18:40.550] WARN: archiver:prover-node Running promise was not started 22:18:40 [22:18:40.550] INFO: archiver:prover-node Stopped. 22:18:40 [22:18:40.550] WARN: world-state:block_stream:prover-node Running promise was not started 22:18:40 [22:18:40.550] INFO: world_state:prover-node Stopped world state synchronizer 22:18:40 [22:18:40.550] INFO: prover-node:prover-node Stopped ProverNode 22:18:40 [22:18:40.558] INFO: blob-sink:server Stopping blob sink 22:18:40 [22:18:40.558] INFO: blob-sink:server Blob sink stopped 22:18:40 [22:18:40.561] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data and state {"uploadPath":"/tmp/failed-proofs-o40LdP","rerunDataDir":"/tmp/rerun-data-TUEUPV","rerunDownloadPath":"/tmp/rerun-download-IteIMn/data.bin"} 22:18:40 [22:18:40.562] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data from file:///tmp/failed-proofs-o40LdP/aztec-31337-3013108653-0xd31708b4bfcb26bfe24ede4befabbc135d45650f/0-20250611221829-5074c38a-c4ff-4175-b247-580a8cf39a5a 22:18:40 [22:18:40.562] INFO: stdlib:file-store Creating local file file store at /tmp/failed-proofs-o40LdP/aztec-31337-3013108653-0xd31708b4bfcb26bfe24ede4befabbc135d45650f/0-20250611221829-5074c38a-c4ff-4175-b247-580a8cf39a5a 22:18:40 [22:18:40.563] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading state snapshot from file:///tmp/failed-proofs-o40LdP/aztec-31337-3013108653-0xd31708b4bfcb26bfe24ede4befabbc135d45650f/0-20250611221829-5074c38a-c4ff-4175-b247-580a8cf39a5a to local data directory {"metadata":{"l2BlockNumber":2,"l2BlockHash":"0x2bbe93cd9d355a0e2ddcaae97b9918d69fdd412b7f49130ba6d044d10a466f5e","l1BlockNumber":10,"l1ChainId":31337,"rollupVersion":3013108653,"rollupAddress":"0xd31708b4bfcb26bfe24ede4befabbc135d45650f"},"dataUrls":{"archiver":"file:///tmp/failed-proofs-o40LdP/aztec-31337-3013108653-0xd31708b4bfcb26bfe24ede4befabbc135d45650f/0-20250611221829-5074c38a-c4ff-4175-b247-580a8cf39a5a/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-o40LdP/aztec-31337-3013108653-0xd31708b4bfcb26bfe24ede4befabbc135d45650f/0-20250611221829-5074c38a-c4ff-4175-b247-580a8cf39a5a/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-o40LdP/aztec-31337-3013108653-0xd31708b4bfcb26bfe24ede4befabbc135d45650f/0-20250611221829-5074c38a-c4ff-4175-b247-580a8cf39a5a/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-o40LdP/aztec-31337-3013108653-0xd31708b4bfcb26bfe24ede4befabbc135d45650f/0-20250611221829-5074c38a-c4ff-4175-b247-580a8cf39a5a/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-o40LdP/aztec-31337-3013108653-0xd31708b4bfcb26bfe24ede4befabbc135d45650f/0-20250611221829-5074c38a-c4ff-4175-b247-580a8cf39a5a/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-o40LdP/aztec-31337-3013108653-0xd31708b4bfcb26bfe24ede4befabbc135d45650f/0-20250611221829-5074c38a-c4ff-4175-b247-580a8cf39a5a/l1-to-l2-message-tree.db"}} 22:18:40 [22:18:40.563] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Creating local file file store at /tmp/failed-proofs-o40LdP/aztec-31337-3013108653-0xd31708b4bfcb26bfe24ede4befabbc135d45650f/0-20250611221829-5074c38a-c4ff-4175-b247-580a8cf39a5a 22:18:40 [22:18:40.564] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading snapshot to /tmp/rerun-data-TUEUPV/download-xEYmBK {"snapshot":{"dataUrls":{"archiver":"file:///tmp/failed-proofs-o40LdP/aztec-31337-3013108653-0xd31708b4bfcb26bfe24ede4befabbc135d45650f/0-20250611221829-5074c38a-c4ff-4175-b247-580a8cf39a5a/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-o40LdP/aztec-31337-3013108653-0xd31708b4bfcb26bfe24ede4befabbc135d45650f/0-20250611221829-5074c38a-c4ff-4175-b247-580a8cf39a5a/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-o40LdP/aztec-31337-3013108653-0xd31708b4bfcb26bfe24ede4befabbc135d45650f/0-20250611221829-5074c38a-c4ff-4175-b247-580a8cf39a5a/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-o40LdP/aztec-31337-3013108653-0xd31708b4bfcb26bfe24ede4befabbc135d45650f/0-20250611221829-5074c38a-c4ff-4175-b247-580a8cf39a5a/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-o40LdP/aztec-31337-3013108653-0xd31708b4bfcb26bfe24ede4befabbc135d45650f/0-20250611221829-5074c38a-c4ff-4175-b247-580a8cf39a5a/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-o40LdP/aztec-31337-3013108653-0xd31708b4bfcb26bfe24ede4befabbc135d45650f/0-20250611221829-5074c38a-c4ff-4175-b247-580a8cf39a5a/l1-to-l2-message-tree.db"}},"downloadPaths":{"archiver":"/tmp/rerun-data-TUEUPV/download-xEYmBK/archiver.db","nullifier-tree":"/tmp/rerun-data-TUEUPV/download-xEYmBK/nullifier-tree.db","public-data-tree":"/tmp/rerun-data-TUEUPV/download-xEYmBK/public-data-tree.db","note-hash-tree":"/tmp/rerun-data-TUEUPV/download-xEYmBK/note-hash-tree.db","archive-tree":"/tmp/rerun-data-TUEUPV/download-xEYmBK/archive-tree.db","l1-to-l2-message-tree":"/tmp/rerun-data-TUEUPV/download-xEYmBK/l1-to-l2-message-tree.db"}} 22:18:40 [22:18:40.565] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Snapshot downloaded at /tmp/rerun-data-TUEUPV/download-xEYmBK {"snapshot":{"dataUrls":{"archiver":"file:///tmp/failed-proofs-o40LdP/aztec-31337-3013108653-0xd31708b4bfcb26bfe24ede4befabbc135d45650f/0-20250611221829-5074c38a-c4ff-4175-b247-580a8cf39a5a/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-o40LdP/aztec-31337-3013108653-0xd31708b4bfcb26bfe24ede4befabbc135d45650f/0-20250611221829-5074c38a-c4ff-4175-b247-580a8cf39a5a/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-o40LdP/aztec-31337-3013108653-0xd31708b4bfcb26bfe24ede4befabbc135d45650f/0-20250611221829-5074c38a-c4ff-4175-b247-580a8cf39a5a/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-o40LdP/aztec-31337-3013108653-0xd31708b4bfcb26bfe24ede4befabbc135d45650f/0-20250611221829-5074c38a-c4ff-4175-b247-580a8cf39a5a/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-o40LdP/aztec-31337-3013108653-0xd31708b4bfcb26bfe24ede4befabbc135d45650f/0-20250611221829-5074c38a-c4ff-4175-b247-580a8cf39a5a/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-o40LdP/aztec-31337-3013108653-0xd31708b4bfcb26bfe24ede4befabbc135d45650f/0-20250611221829-5074c38a-c4ff-4175-b247-580a8cf39a5a/l1-to-l2-message-tree.db"}},"downloadPaths":{"archiver":"/tmp/rerun-data-TUEUPV/download-xEYmBK/archiver.db","nullifier-tree":"/tmp/rerun-data-TUEUPV/download-xEYmBK/nullifier-tree.db","public-data-tree":"/tmp/rerun-data-TUEUPV/download-xEYmBK/public-data-tree.db","note-hash-tree":"/tmp/rerun-data-TUEUPV/download-xEYmBK/note-hash-tree.db","archive-tree":"/tmp/rerun-data-TUEUPV/download-xEYmBK/archive-tree.db","l1-to-l2-message-tree":"/tmp/rerun-data-TUEUPV/download-xEYmBK/l1-to-l2-message-tree.db"}} 22:18:40 [22:18:40.566] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Archiver database set up from snapshot {"path":"/tmp/rerun-data-TUEUPV/archiver","dbVersion":2,"rollupAddress":"0xd31708b4bfcb26bfe24ede4befabbc135d45650f"} 22:18:40 [22:18:40.567] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database l1-to-l2-message-tree set up from snapshot {"path":"/tmp/rerun-data-TUEUPV/world_state/L1ToL2MessageTree","dbVersion":1,"rollupAddress":"0xd31708b4bfcb26bfe24ede4befabbc135d45650f"} 22:18:40 [22:18:40.567] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database archive-tree set up from snapshot {"path":"/tmp/rerun-data-TUEUPV/world_state/ArchiveTree","dbVersion":1,"rollupAddress":"0xd31708b4bfcb26bfe24ede4befabbc135d45650f"} 22:18:40 [22:18:40.567] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database public-data-tree set up from snapshot {"path":"/tmp/rerun-data-TUEUPV/world_state/PublicDataTree","dbVersion":1,"rollupAddress":"0xd31708b4bfcb26bfe24ede4befabbc135d45650f"} 22:18:40 [22:18:40.568] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database note-hash-tree set up from snapshot {"path":"/tmp/rerun-data-TUEUPV/world_state/NoteHashTree","dbVersion":1,"rollupAddress":"0xd31708b4bfcb26bfe24ede4befabbc135d45650f"} 22:18:40 [22:18:40.568] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database nullifier-tree set up from snapshot {"path":"/tmp/rerun-data-TUEUPV/world_state/NullifierTree","dbVersion":1,"rollupAddress":"0xd31708b4bfcb26bfe24ede4befabbc135d45650f"} 22:18:40 [22:18:40.568] INFO: e2e:e2e_epochs:epochs_upload_failed_proof P2P database cleared {"path":"/tmp/rerun-data-TUEUPV/p2p"} 22:18:40 [22:18:40.569] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data from file:///tmp/failed-proofs-o40LdP/aztec-31337-3013108653-0xd31708b4bfcb26bfe24ede4befabbc135d45650f/0-20250611221829-5074c38a-c4ff-4175-b247-580a8cf39a5a/data.bin to /tmp/rerun-download-IteIMn/data.bin 22:18:40 [22:18:40.569] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Epoch proving job data for epoch 0 downloaded successfully 22:18:40 [22:18:40.570] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Rerunning proving job from /tmp/rerun-download-IteIMn/data.bin 22:18:40 [22:18:40.570] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Using native ACVM binary at ../../noir/noir-repo/target/release/acvm with working directory /tmp/018c3242/acvm 22:18:40 [22:18:40.571] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Loaded proving job data for epoch 0 22:18:40 [22:18:40.573] INFO: world-state:database Creating world state data store at directory /tmp/rerun-data-TUEUPV/world_state with map sizes {"archiveTreeMapSizeKb":1048576,"nullifierTreeMapSizeKb":1048576,"noteHashTreeMapSizeKb":1048576,"messageTreeMapSizeKb":1048576,"publicDataTreeMapSizeKb":1048576} and 2 threads. 22:18:40 [22:18:40.584] INFO: archiver:lmdb Creating archiver data store at directory /tmp/rerun-data-TUEUPV/archiver with map size 1048576 KB (LMDB v2) 22:18:40 [22:18:40.585] INFO: archiver:lmdb Starting data store with maxReaders 16 22:18:40 [22:18:40.587] WARN: prover-client:proving-broker-database Found invalid epoch directory /tmp/rerun-data-TUEUPV/archiver when loading epoch databases, ignoring 22:18:40 [22:18:40.587] WARN: prover-client:proving-broker-database Found invalid epoch directory /tmp/rerun-data-TUEUPV/world_state when loading epoch databases, ignoring 22:18:40 [22:18:40.587] INFO: prover-client:proving-broker Proving Broker started 22:18:40 [22:18:40.588] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Rerunning epoch proving job for epoch 0 22:18:40 [22:18:40.588] INFO: prover-node:epoch-proving-job Starting epoch 0 proving job with blocks 1 to 2 {"fromBlock":1,"toBlock":2,"epochSizeBlocks":2,"epochNumber":0,"uuid":"bd61ccac-f8d5-4919-bbc8-0d182f84f4c7"} 22:18:40 [22:18:40.602] INFO: prover-client:orchestrator Starting epoch 0 with 2 blocks 22:18:40 [22:18:40.603] VERBOSE: prover-client:broker-circuit-prover-facade Starting BrokerCircuitProverFacade 22:18:40 [22:18:40.604] VERBOSE: prover-node:epoch-proving-job Starting processing block 1 {"number":1,"blockHash":"0x128b78559c0d55e4ed9a3160d26d189eb28db3aebe4af832aadee96c641629a2","lastArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"bd61ccac-f8d5-4919-bbc8-0d182f84f4c7","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x00000000000000000000000000000000000000000000000000000000b39863ad","blockNumber":"0x0000000000000000000000000000000000000000000000000000000000000001","slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 22:18:40 [22:18:40.604] INFO: prover-client:orchestrator Starting block 1 for slot 2 22:18:40 [22:18:40.605] VERBOSE: prover-node:epoch-proving-job Starting processing block 2 {"number":2,"blockHash":"0x2bbe93cd9d355a0e2ddcaae97b9918d69fdd412b7f49130ba6d044d10a466f5e","lastArchive":"0x0da3d843d91132b937b470781b18aa6748374e6310b5c2f802ccb75c466dc01e","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"bd61ccac-f8d5-4919-bbc8-0d182f84f4c7","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x00000000000000000000000000000000000000000000000000000000b39863ad","blockNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000003","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 22:18:40 [22:18:40.605] INFO: prover-client:orchestrator Starting block 2 for slot 3 22:18:40 [22:18:40.612] INFO: prover-client:proving-broker New proving job id=0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1 epochNumber=0 {"provingJobId":"0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1"} 22:18:40 [22:18:40.612] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1","provingJobType":"BASE_PARITY"} 22:18:40 [22:18:40.612] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1","provingJobType":"BASE_PARITY"} 22:18:40 [22:18:40.613] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1","provingJobType":"BASE_PARITY"} 22:18:40 [22:18:40.616] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1","provingJobType":"BASE_PARITY"} 22:18:40 [22:18:40.616] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1","provingJobType":"BASE_PARITY"} 22:18:40 [22:18:40.616] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1","provingJobType":"BASE_PARITY"} 22:18:40 [22:18:40.616] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1","provingJobType":"BASE_PARITY"} 22:18:40 [22:18:40.617] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000012382000000798143s {"duration":0.000012382000000798143,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 22:18:40 [22:18:40.618] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 22:18:40 [22:18:40.618] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 1 {"blockNumber":1,"blockHash":"0x128b78559c0d55e4ed9a3160d26d189eb28db3aebe4af832aadee96c641629a2","uuid":"bd61ccac-f8d5-4919-bbc8-0d182f84f4c7"} 22:18:40 [22:18:40.618] VERBOSE: prover-client:orchestrator Block 1 completed. Assembling header. 22:18:40 [22:18:40.623] VERBOSE: prover-client:orchestrator Updating archive tree with block 1 header 0x128b78559c0d55e4ed9a3160d26d189eb28db3aebe4af832aadee96c641629a2 22:18:40 [22:18:40.624] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000014018000001669861s {"duration":0.000014018000001669861,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 22:18:40 [22:18:40.624] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 22:18:40 [22:18:40.625] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 2 {"blockNumber":2,"blockHash":"0x2bbe93cd9d355a0e2ddcaae97b9918d69fdd412b7f49130ba6d044d10a466f5e","uuid":"bd61ccac-f8d5-4919-bbc8-0d182f84f4c7"} 22:18:40 [22:18:40.625] VERBOSE: prover-client:orchestrator Block 2 completed. Assembling header. 22:18:40 [22:18:40.625] VERBOSE: prover-client:orchestrator Orchestrator finalised block 1 22:18:40 [22:18:40.637] VERBOSE: prover-client:orchestrator Updating archive tree with block 2 header 0x2bbe93cd9d355a0e2ddcaae97b9918d69fdd412b7f49130ba6d044d10a466f5e 22:18:40 [22:18:40.639] VERBOSE: prover-client:orchestrator Orchestrator finalised block 2 22:18:40 [22:18:40.663] INFO: prover-client:proving-broker-database Creating broker database for epoch 0 at /tmp/rerun-data-TUEUPV/0 with map size 1048576 22:18:40 [22:18:40.664] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:18:40 [22:18:40.665] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1 type=BASE_PARITY epochNumber=0 {"provingJobId":"0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1","provingJobType":"BASE_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...","status":"not-found","numOutstandingJobs":1} 22:18:40 [22:18:40.688] INFO: prover-client:proving-agent Starting job id=0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1 type=BASE_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input... 22:18:40 [22:18:40.689] INFO: prover-client:proving-agent:job-controller-e4742c11 Job controller started jobId=0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1 {"jobId":"0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1"} 22:18:40 [22:18:40.736] INFO: prover-client:proving-agent Job id=0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1 type=BASE_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22resul... 22:18:40 [22:18:40.736] INFO: prover-client:proving-broker Proving job complete id=0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1 type=BASE_PARITY totalAttempts=1 {"provingJobId":"0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1"} 22:18:41 [22:18:41.603] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 22:18:41 [22:18:41.604] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:BASE_PARITY:b058842777191ba94c6f884c38f41da8aae49870c6bb0f0664c59b0b54000de1 type=BASE_PARITY 22:18:41 [22:18:41.605] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 22:18:41 [22:18:41.613] INFO: prover-client:proving-broker New proving job id=0:ROOT_PARITY:129a026d4e8c9e1eade050caeafcea139c256c3443dcd661155fbc9a914bdfed epochNumber=0 {"provingJobId":"0:ROOT_PARITY:129a026d4e8c9e1eade050caeafcea139c256c3443dcd661155fbc9a914bdfed"} 22:18:41 [22:18:41.619] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:ROOT_PARITY:129a026d4e8c9e1eade050caeafcea139c256c3443dcd661155fbc9a914bdfed type=ROOT_PARITY {"provingJobId":"0:ROOT_PARITY:129a026d4e8c9e1eade050caeafcea139c256c3443dcd661155fbc9a914bdfed","provingJobType":"ROOT_PARITY"} 22:18:41 [22:18:41.665] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_PARITY:129a026d4e8c9e1eade050caeafcea139c256c3443dcd661155fbc9a914bdfed type=ROOT_PARITY epochNumber=0 {"provingJobId":"0:ROOT_PARITY:129a026d4e8c9e1eade050caeafcea139c256c3443dcd661155fbc9a914bdfed","provingJobType":"ROOT_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu...","status":"not-found","numOutstandingJobs":1} 22:18:41 [22:18:41.692] INFO: prover-client:proving-agent Starting job id=0:ROOT_PARITY:129a026d4e8c9e1eade050caeafcea139c256c3443dcd661155fbc9a914bdfed type=ROOT_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu... 22:18:41 [22:18:41.705] INFO: prover-client:proving-agent:job-controller-7e5f1a6a Job controller started jobId=0:ROOT_PARITY:129a026d4e8c9e1eade050caeafcea139c256c3443dcd661155fbc9a914bdfed {"jobId":"0:ROOT_PARITY:129a026d4e8c9e1eade050caeafcea139c256c3443dcd661155fbc9a914bdfed"} 22:18:41 [22:18:41.802] INFO: prover-client:proving-agent Job id=0:ROOT_PARITY:129a026d4e8c9e1eade050caeafcea139c256c3443dcd661155fbc9a914bdfed type=ROOT_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22resu... 22:18:41 [22:18:41.802] INFO: prover-client:proving-broker Proving job complete id=0:ROOT_PARITY:129a026d4e8c9e1eade050caeafcea139c256c3443dcd661155fbc9a914bdfed type=ROOT_PARITY totalAttempts=1 {"provingJobId":"0:ROOT_PARITY:129a026d4e8c9e1eade050caeafcea139c256c3443dcd661155fbc9a914bdfed"} 22:18:42 [22:18:42.606] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 22:18:42 [22:18:42.607] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:ROOT_PARITY:129a026d4e8c9e1eade050caeafcea139c256c3443dcd661155fbc9a914bdfed type=ROOT_PARITY 22:18:42 [22:18:42.607] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 22:18:42 [22:18:42.619] INFO: prover-client:proving-broker New proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:2895bb7941e417d955b830a0252ea815e5995b0aefc6ee8cd2f22e29ebccdaa6 epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:2895bb7941e417d955b830a0252ea815e5995b0aefc6ee8cd2f22e29ebccdaa6"} 22:18:42 [22:18:42.622] INFO: prover-client:proving-broker New proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:b8ab3220c4ef7be31f2523e3833e34f3c0713d9ae1361d1cff20c9791d738d48 epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:b8ab3220c4ef7be31f2523e3833e34f3c0713d9ae1361d1cff20c9791d738d48"} 22:18:42 [22:18:42.671] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:EMPTY_BLOCK_ROOT_ROLLUP:2895bb7941e417d955b830a0252ea815e5995b0aefc6ee8cd2f22e29ebccdaa6 type=EMPTY_BLOCK_ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:2895bb7941e417d955b830a0252ea815e5995b0aefc6ee8cd2f22e29ebccdaa6","provingJobType":"EMPTY_BLOCK_ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input...","status":"not-found","numOutstandingJobs":2} 22:18:42 [22:18:42.672] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:EMPTY_BLOCK_ROOT_ROLLUP:b8ab3220c4ef7be31f2523e3833e34f3c0713d9ae1361d1cff20c9791d738d48 type=EMPTY_BLOCK_ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:b8ab3220c4ef7be31f2523e3833e34f3c0713d9ae1361d1cff20c9791d738d48","provingJobType":"EMPTY_BLOCK_ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input...","status":"not-found","numOutstandingJobs":2} 22:18:42 [22:18:42.707] INFO: prover-client:proving-agent Starting job id=0:EMPTY_BLOCK_ROOT_ROLLUP:2895bb7941e417d955b830a0252ea815e5995b0aefc6ee8cd2f22e29ebccdaa6 type=EMPTY_BLOCK_ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input... 22:18:42 [22:18:42.714] INFO: prover-client:proving-agent:job-controller-52b95e01 Job controller started jobId=0:EMPTY_BLOCK_ROOT_ROLLUP:2895bb7941e417d955b830a0252ea815e5995b0aefc6ee8cd2f22e29ebccdaa6 {"jobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:2895bb7941e417d955b830a0252ea815e5995b0aefc6ee8cd2f22e29ebccdaa6"} 22:18:42 [22:18:42.757] INFO: prover-client:proving-agent Starting job id=0:EMPTY_BLOCK_ROOT_ROLLUP:b8ab3220c4ef7be31f2523e3833e34f3c0713d9ae1361d1cff20c9791d738d48 type=EMPTY_BLOCK_ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input... 22:18:42 [22:18:42.762] INFO: prover-client:proving-agent:job-controller-5ca22223 Job controller started jobId=0:EMPTY_BLOCK_ROOT_ROLLUP:b8ab3220c4ef7be31f2523e3833e34f3c0713d9ae1361d1cff20c9791d738d48 {"jobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:b8ab3220c4ef7be31f2523e3833e34f3c0713d9ae1361d1cff20c9791d738d48"} 22:18:43 [22:18:43.488] INFO: prover-client:proving-agent Job id=0:EMPTY_BLOCK_ROOT_ROLLUP:2895bb7941e417d955b830a0252ea815e5995b0aefc6ee8cd2f22e29ebccdaa6 type=EMPTY_BLOCK_ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22resul... 22:18:43 [22:18:43.489] INFO: prover-client:proving-broker Proving job complete id=0:EMPTY_BLOCK_ROOT_ROLLUP:2895bb7941e417d955b830a0252ea815e5995b0aefc6ee8cd2f22e29ebccdaa6 type=EMPTY_BLOCK_ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:2895bb7941e417d955b830a0252ea815e5995b0aefc6ee8cd2f22e29ebccdaa6"} 22:18:43 [22:18:43.608] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 2, total jobs ready: 1 22:18:43 [22:18:43.610] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:2895bb7941e417d955b830a0252ea815e5995b0aefc6ee8cd2f22e29ebccdaa6 type=EMPTY_BLOCK_ROOT_ROLLUP 22:18:43 [22:18:43.610] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 22:18:45 [22:18:45.096] INFO: prover-client:proving-agent Job id=0:EMPTY_BLOCK_ROOT_ROLLUP:b8ab3220c4ef7be31f2523e3833e34f3c0713d9ae1361d1cff20c9791d738d48 type=EMPTY_BLOCK_ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22resul... 22:18:45 [22:18:45.096] INFO: prover-client:proving-broker Proving job complete id=0:EMPTY_BLOCK_ROOT_ROLLUP:b8ab3220c4ef7be31f2523e3833e34f3c0713d9ae1361d1cff20c9791d738d48 type=EMPTY_BLOCK_ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:b8ab3220c4ef7be31f2523e3833e34f3c0713d9ae1361d1cff20c9791d738d48"} 22:18:45 [22:18:45.611] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 22:18:45 [22:18:45.612] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:b8ab3220c4ef7be31f2523e3833e34f3c0713d9ae1361d1cff20c9791d738d48 type=EMPTY_BLOCK_ROOT_ROLLUP 22:18:45 [22:18:45.613] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 22:18:45 [22:18:45.621] INFO: prover-client:proving-broker New proving job id=0:ROOT_ROLLUP:57f6123f6fdd491625f98c524b7171893f2debf5e4bea201d3e9f7c4aca9f6e2 epochNumber=0 {"provingJobId":"0:ROOT_ROLLUP:57f6123f6fdd491625f98c524b7171893f2debf5e4bea201d3e9f7c4aca9f6e2"} 22:18:45 [22:18:45.673] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_ROLLUP:57f6123f6fdd491625f98c524b7171893f2debf5e4bea201d3e9f7c4aca9f6e2 type=ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:ROOT_ROLLUP:57f6123f6fdd491625f98c524b7171893f2debf5e4bea201d3e9f7c4aca9f6e2","provingJobType":"ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22input...","status":"not-found","numOutstandingJobs":1} 22:18:45 [22:18:45.700] INFO: prover-client:proving-agent Starting job id=0:ROOT_ROLLUP:57f6123f6fdd491625f98c524b7171893f2debf5e4bea201d3e9f7c4aca9f6e2 type=ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22input... 22:18:45 [22:18:45.712] INFO: prover-client:proving-agent:job-controller-f2b88c70 Job controller started jobId=0:ROOT_ROLLUP:57f6123f6fdd491625f98c524b7171893f2debf5e4bea201d3e9f7c4aca9f6e2 {"jobId":"0:ROOT_ROLLUP:57f6123f6fdd491625f98c524b7171893f2debf5e4bea201d3e9f7c4aca9f6e2"} 22:18:45 [22:18:45.800] INFO: prover-client:proving-agent Job id=0:ROOT_ROLLUP:57f6123f6fdd491625f98c524b7171893f2debf5e4bea201d3e9f7c4aca9f6e2 type=ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22resul... 22:18:45 [22:18:45.800] INFO: prover-client:proving-broker Proving job complete id=0:ROOT_ROLLUP:57f6123f6fdd491625f98c524b7171893f2debf5e4bea201d3e9f7c4aca9f6e2 type=ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:ROOT_ROLLUP:57f6123f6fdd491625f98c524b7171893f2debf5e4bea201d3e9f7c4aca9f6e2"} 22:18:46 [22:18:46.614] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 22:18:46 [22:18:46.615] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:ROOT_ROLLUP:57f6123f6fdd491625f98c524b7171893f2debf5e4bea201d3e9f7c4aca9f6e2 type=ROOT_ROLLUP 22:18:46 [22:18:46.616] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 22:18:46 [22:18:46.616] VERBOSE: prover-client:orchestrator Orchestrator completed root rollup for epoch 0 22:18:46 [22:18:46.618] INFO: prover-node:epoch-proving-job Finalised proof for epoch 0 {"epochNumber":0,"uuid":"bd61ccac-f8d5-4919-bbc8-0d182f84f4c7","duration":6029.970102000007} 22:18:46 [22:18:46.618] INFO: prover-node:epoch-proving-job Submitted proof for epoch 0 (blocks 1 to 2) {"epochNumber":0,"uuid":"bd61ccac-f8d5-4919-bbc8-0d182f84f4c7"} 22:18:46 [22:18:46.619] VERBOSE: prover-client:broker-circuit-prover-facade Stopping BrokerCircuitProverFacade 22:18:46 [22:18:46.619] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Completed job for epoch 0 with status completed 22:18:46 [22:18:46.619] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Test succeeded 22:18:46 [22:18:46.620] INFO: prover-node:prover-node Stopping ProverNode 22:18:46 [22:18:46.620] WARN: prover-node:prover-node Running promise was not started 22:18:46 [22:18:46.620] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 22:18:46 [22:18:46.620] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 22:18:46 [22:18:46.620] WARN: archiver:prover-node Running promise was not started 22:18:46 [22:18:46.620] INFO: archiver:prover-node Stopped. 22:18:46 [22:18:46.620] WARN: world-state:block_stream:prover-node Running promise was not started 22:18:46 [22:18:46.620] INFO: world_state:prover-node Stopped world state synchronizer 22:18:46 [22:18:46.621] INFO: prover-node:prover-node Stopped ProverNode 22:18:46 [22:18:46.621] INFO: node Stopping Aztec Node 22:18:48 [22:18:48.620] INFO: slasher Slasher client stopped. 22:18:48 [22:18:48.621] WARN: validator Running promise was not started 22:18:48 [22:18:48.621] WARN: sequencer Running promise was not started 22:18:48 [22:18:48.621] INFO: sequencer Stopped sequencer 22:18:48 [22:18:48.621] WARN: p2p:l2-block-stream Running promise was not started 22:18:48 [22:18:48.621] INFO: p2p P2P client stopped 22:18:48 [22:18:48.622] WARN: world-state:block_stream Running promise was not started 22:18:48 [22:18:48.622] INFO: world_state Stopped world state synchronizer 22:18:48 [22:18:48.622] WARN: archiver Running promise was not started 22:18:48 [22:18:48.622] INFO: archiver Stopped. 22:18:48 [22:18:48.622] INFO: node Stopped Aztec Node 22:18:48 [22:18:48.622] INFO: node Stopping Aztec Node 22:18:50 [22:18:50.622] INFO: slasher Slasher client stopped. 22:18:50 [22:18:50.623] WARN: validator Running promise was not started 22:18:50 [22:18:50.623] WARN: sequencer Running promise was not started 22:18:50 [22:18:50.623] INFO: sequencer Stopped sequencer 22:18:50 [22:18:50.623] WARN: p2p:l2-block-stream Running promise was not started 22:18:50 [22:18:50.623] INFO: p2p P2P client stopped 22:18:50 [22:18:50.623] WARN: world-state:block_stream Running promise was not started 22:18:50 [22:18:50.623] INFO: world_state Stopped world state synchronizer 22:18:50 [22:18:50.624] WARN: archiver Running promise was not started 22:18:50 [22:18:50.624] INFO: archiver Stopped. 22:18:50 [22:18:50.624] INFO: node Stopped Aztec Node 22:18:50 [22:18:50.624] INFO: prover-node:prover-node Stopping ProverNode 22:18:50 [22:18:50.624] WARN: prover-node:prover-node Running promise was not started 22:18:50 [22:18:50.624] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 22:18:50 [22:18:50.624] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 22:18:50 [22:18:50.624] WARN: archiver:prover-node Running promise was not started 22:18:50 [22:18:50.624] INFO: archiver:prover-node Stopped. 22:18:50 [22:18:50.624] WARN: world-state:block_stream:prover-node Running promise was not started 22:18:50 [22:18:50.625] INFO: world_state:prover-node Stopped world state synchronizer 22:18:50 [22:18:50.625] INFO: prover-node:prover-node Stopped ProverNode 22:18:50 [22:18:50.625] INFO: blob-sink:server Stopping blob sink 22:18:50 [22:18:50.625] INFO: blob-sink:server Blob sink already stopped 22:18:50 PASS src/e2e_epochs/epochs_upload_failed_proof.test.ts 22:18:50 e2e_epochs/epochs_upload_failed_proof 22:18:50 ✓ uploads failed proving job state and re-runs it on a fresh instance (94231 ms) 22:18:50 22:18:50 Test Suites: 1 passed, 1 total 22:18:50 Tests: 1 passed, 1 total 22:18:50 Snapshots: 0 total 22:18:50 Time: 99.18 s 22:18:50 Ran all test suites matching /src\/e2e_epochs\/epochs_upload_failed_proof.test.ts/i. 22:18:50 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?