Parent Log: http://ci.aztec-labs.com/401e5d3e3afe926b Command: 49bbc26acf87c0b5:ISOLATE=1:NAME=e2e_epochs/epochs_upload_failed_proof yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_upload_failed_proof.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/b608f9359219731d3c03407689a4fadaaa5a0d45 Env: REF_NAME=gh-readonly-queue/next/pr-15006-082468f0c1e7e5424b3654b5be0f3560eed7e487 CURRENT_VERSION=0.87.6 CI_FULL=1 Date: Thu Jun 12 13:43:59 UTC 2025 System: ARCH=amd64 CPUS=128 MEM=493Gi HOSTNAME=pr-15006_amd64_x3-full Resources: CPU_LIST=0-127 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_476a42720cde10eb_next 13:43:59 +++ id -u 13:43:59 +++ id -g 13:43:59 ++ docker run -d --name e2e_epochs_epochs_upload_failed_proof --net=none --cpuset-cpus=0-127 --cpus=2 --memory=8g --user 1000:1000 -v/home/aztec-dev:/home/aztec-dev --mount type=tmpfs,target=/tmp,tmpfs-size=1g --workdir /home/aztec-dev/aztec-packages -e HOME -e VERBOSE -e GIT_CONFIG_GLOBAL=/home/aztec-dev/aztec-packages/build-images/src/home/.gitconfig -e FORCE_COLOR=true -e CPUS -e MEM aztecprotocol/build:3.0 /bin/bash -c 'timeout -v 600s bash -c '\''yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_upload_failed_proof.test.ts'\''' 13:43:59 + cid=913cb6f065c32a0d82eb7384622f16eef0c109cfdbbb66c2d89cd5cf8e113dc7 13:43:59 + set +x 13:44:00 {"level":25,"time":1749735840688,"pid":12,"hostname":"913cb6f065c3","module":"logger","msg":"Logger initialized with level verbose"} 13:44:08 [13:44:08.828] INFO: e2e:epochs_upload_failed_proof Running test: e2e_epochs/epochs_upload_failed_proof uploads failed proving job state and re-runs it on a fresh instance 13:44:09 [13:44:09.002] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Logging metrics to log/e2e_epochs_epochs_upload_failed_proof.jsonl 13:44:09 [13:44:09.219] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Calling anvil_setBlockTimestampInterval with params: [8] 13:44:09 [13:44:09.259] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Set block interval to 8 13:44:09 [13:44:09.260] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contracts from 0xf39Fd6e51aad88F6F4ce6aB8827279cffFb92266 13:44:09 [13:44:09.338] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xff8f3047f70ec9e63079d7903c02a47802dc292d5660d2da825ac209bbd9cd89 {"gasLimit":867658,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 13:44:09 [13:44:09.340] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xd8B56421e9b573AE62f2997B7b58858a4413A967 in tx 0xff8f3047f70ec9e63079d7903c02a47802dc292d5660d2da825ac209bbd9cd89. 13:44:09 [13:44:09.343] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Fee Asset at 0xd8b56421e9b573ae62f2997b7b58858a4413a967 13:44:09 [13:44:09.376] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xb8a727e5dcee31d2ee7a6a94b8b01df7952fdc685dfb1b5bb36a0dbda9d08d89 {"gasLimit":867644,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 13:44:09 [13:44:09.377] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x026208feE3F4461826C8838C3569272E8C08E131 in tx 0xb8a727e5dcee31d2ee7a6a94b8b01df7952fdc685dfb1b5bb36a0dbda9d08d89. 13:44:09 [13:44:09.378] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Staking Asset at 0x026208fee3f4461826c8838c3569272e8c08e131 13:44:09 [13:44:09.413] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x84345970a64bc89d244665c6d19bcf62f7a1fb0c5497fd61c66569ea96442f1f {"gasLimit":3118894,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 13:44:09 [13:44:09.413] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xad2120681B02De3e9b8aFd325977CDeDDf15f01C in tx 0x84345970a64bc89d244665c6d19bcf62f7a1fb0c5497fd61c66569ea96442f1f. 13:44:09 [13:44:09.414] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed GSE at 0xad2120681b02de3e9b8afd325977cdeddf15f01c 13:44:09 [13:44:09.448] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x96c1e759b945754976d026659a519c1c5d05a738916e69d742cdec67a5482765 {"gasLimit":1030513,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 13:44:09 [13:44:09.449] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x992D1f24CC5f368188d936cf0b2A111cEE586d4e in tx 0x96c1e759b945754976d026659a519c1c5d05a738916e69d742cdec67a5482765. 13:44:09 [13:44:09.450] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Registry at 0x992d1f24cc5f368188d936cf0b2a111cee586d4e 13:44:09 [13:44:09.484] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x35838f7740ede8daad92b7b8589b59625f0100193e252bc6ce3862a65d23892c {"gasLimit":1998672,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 13:44:09 [13:44:09.485] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xfDB60896B1920A10Fd3AA268A292E51ebD5568A8 in tx 0x35838f7740ede8daad92b7b8589b59625f0100193e252bc6ce3862a65d23892c. 13:44:09 [13:44:09.485] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed GovernanceProposer at 0xfdb60896b1920a10fd3aa268a292e51ebd5568a8 13:44:09 [13:44:09.530] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x4dbcecd47a2081d10a38e4cf385714d92e542e5a44eb5a37a3810c6c6738dc4e {"gasLimit":3092007,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 13:44:09 [13:44:09.530] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x506150CaB49DBC09C8B79D20ac5c79CA28220AEA in tx 0x4dbcecd47a2081d10a38e4cf385714d92e542e5a44eb5a37a3810c6c6738dc4e. 13:44:09 [13:44:09.531] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Governance at 0x506150cab49dbc09c8b79d20ac5c79ca28220aea 13:44:09 [13:44:09.549] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xf2ecc0d2040ae9928a4b186c21f02e611c2904f24b196eed69d646e9333cc00d {"gasLimit":100000,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 13:44:09 [13:44:09.552] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Set governance on GSE in 0xf2ecc0d2040ae9928a4b186c21f02e611c2904f24b196eed69d646e9333cc00d 13:44:09 [13:44:09.583] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x77f9fa97fbbcb04392e88d456c198520b3425518c3d2d4146393099192372448 {"gasLimit":397390,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 13:44:09 [13:44:09.583] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x1649EeAD62C64Db7F63182989C8c41Ab25025C21 in tx 0x77f9fa97fbbcb04392e88d456c198520b3425518c3d2d4146393099192372448. 13:44:09 [13:44:09.584] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed CoinIssuer at 0x1649eead62c64db7f63182989c8c41ab25025c21 13:44:09 [13:44:09.585] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for deployments to complete 13:44:09 [13:44:09.585] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 7 transactions to be mined... 13:44:17 [13:44:17.615] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 13:44:17 [13:44:17.630] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xc033579f2357cfd2f6fa38d1ef9986415f4ed794add3fff64984bc3f1257e970 {"gasLimit":100000,"maxFeePerGas":"3.04180664","maxPriorityFeePerGas":"1.44"} 13:44:17 [13:44:17.630] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added coin issuer 0x1649eead62c64db7f63182989c8c41ab25025c21 as minter on fee asset in 0xc033579f2357cfd2f6fa38d1ef9986415f4ed794add3fff64984bc3f1257e970 13:44:17 [13:44:17.669] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xd6a54e4eed6f07d2b8dcaafbd3883b3558583e43612f444af113d489245a2bb1 {"gasLimit":56661,"maxFeePerGas":"3.04180664","maxPriorityFeePerGas":"1.44"} 13:44:17 [13:44:17.691] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xa67ff7f4001dc5703375e116caba00222d15ec13472e10af8018f62318b463cb {"gasLimit":344517,"maxFeePerGas":"3.04180664","maxPriorityFeePerGas":"1.44"} 13:44:17 [13:44:17.691] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x3607dbAfDe17871E0D6A8f929151C30b83510D39 in tx 0xa67ff7f4001dc5703375e116caba00222d15ec13472e10af8018f62318b463cb. 13:44:17 [13:44:17.692] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed FeeAssetHandler at 0x3607dbafde17871e0d6a8f929151c30b83510d39 13:44:17 [13:44:17.739] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xa32bc1b02f5f02b41626611ec0e0056cad989330fbf908181b5d4f7678377aae {"gasLimit":56804,"maxFeePerGas":"3.04180664","maxPriorityFeePerGas":"1.44"} 13:44:17 [13:44:17.740] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added fee asset handler 0x3607dbafde17871e0d6a8f929151c30b83510d39 as minter on fee asset in 0xa32bc1b02f5f02b41626611ec0e0056cad989330fbf908181b5d4f7678377aae 13:44:17 [13:44:17.836] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xadb884185b00b3cf3fb2aac4753fbbc2bbb58dfbab2a937d61ea0e950d96b91b {"gasLimit":2514669,"maxFeePerGas":"3.04180664","maxPriorityFeePerGas":"1.44"} 13:44:17 [13:44:17.837] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x499C89D6b68cBdcA67C96Bff13Eb5B5a8fDb25a2 in tx 0xadb884185b00b3cf3fb2aac4753fbbc2bbb58dfbab2a937d61ea0e950d96b91b. 13:44:17 [13:44:17.837] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed StakingAssetHandler at 0x499c89d6b68cbdca67c96bff13eb5b5a8fdb25a2 13:44:17 [13:44:17.855] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x2b32bbf996c6d3500330bc3ce74137b03f19074efe8ad0d3e14e6dea009f12e4 {"gasLimit":56804,"maxFeePerGas":"3.04180664","maxPriorityFeePerGas":"1.44"} 13:44:17 [13:44:17.856] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added staking asset handler 0x499c89d6b68cbdca67c96bff13eb5b5a8fdb25a2 as minter on staking asset in 0x2b32bbf996c6d3500330bc3ce74137b03f19074efe8ad0d3e14e6dea009f12e4 13:44:17 [13:44:17.856] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for deployments to complete 13:44:17 [13:44:17.857] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 9 transactions to be mined... 13:44:25 [13:44:25.877] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 13:44:25 [13:44:25.898] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed shared contracts 13:44:25 [13:44:25.918] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x1f3bf003fea3920e27f0ab1b5a7c080b356836c498ba06ccbbb2f38e05cac9a5 {"gasLimit":84823,"maxFeePerGas":"3.2549605","maxPriorityFeePerGas":"1.728"} 13:44:25 [13:44:25.918] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Funded reward distributor with 10000000000000000000000000 fee asset in 0x1f3bf003fea3920e27f0ab1b5a7c080b356836c498ba06ccbbb2f38e05cac9a5 13:44:25 [13:44:25.942] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x8ddfc36dd291a7e69dbb1d1c4b25283f53b9e73f733772b984e1b7cef75ca71d {"gasLimit":154658,"maxFeePerGas":"3.2549605","maxPriorityFeePerGas":"1.728"} 13:44:25 [13:44:25.942] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x277E22B0C9698d7f2A1cD7C6d857511617587309 in tx 0x8ddfc36dd291a7e69dbb1d1c4b25283f53b9e73f733772b984e1b7cef75ca71d. 13:44:25 [13:44:25.945] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup will use the mock verifier at 0x277e22b0c9698d7f2a1cd7c6d857511617587309 13:44:25 [13:44:25.945] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup config args {"aztecSlotDuration":16,"aztecEpochDuration":4,"targetCommitteeSize":48,"aztecProofSubmissionWindow":7,"slashingQuorum":6,"slashingRoundSize":10,"manaTarget":10000000000,"provingCostPerMana":100,"rewardConfig":{"sequencerBps":5000,"increment":200000,"maxScore":5000000,"a":5000,"k":1000000,"minimum":100000}} 13:44:25 [13:44:25.975] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x1244dd983dfa48995970c0afd0fb79b5391ff919edd2ee7939902fc973eec3e1 {"gasLimit":86992,"maxFeePerGas":"3.2549605","maxPriorityFeePerGas":"1.728"} 13:44:25 [13:44:25.975] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xbba8820C80d584aEc2Cb092C3a0bE628aAB41fe3 in tx 0x1244dd983dfa48995970c0afd0fb79b5391ff919edd2ee7939902fc973eec3e1. 13:44:26 [13:44:26.037] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x0785920f3b1808bbb32fbbb9fc7abf594c7e8c615f21bf1b26859927d6d53edc {"gasLimit":6301243,"maxFeePerGas":"3.2549605","maxPriorityFeePerGas":"1.728"} 13:44:26 [13:44:26.038] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x0130CEd3370Af8E822F3D9076177E04F1cA75D3e in tx 0x0785920f3b1808bbb32fbbb9fc7abf594c7e8c615f21bf1b26859927d6d53edc. 13:44:26 [13:44:26.039] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Awaiting for linked libraries to be deployed 13:44:34 [13:44:34.142] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xcb446c06da7708598282d1d5b6a07e8303a0821bd3e65faf6ac5965dd336c000 {"gasLimit":11236180,"maxFeePerGas":"3.44200128","maxPriorityFeePerGas":"2.0736"} 13:44:34 [13:44:34.142] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x16D1D277f9340C50E1c7a9916aB994247a68AF9f in tx 0xcb446c06da7708598282d1d5b6a07e8303a0821bd3e65faf6ac5965dd336c000. 13:44:34 [13:44:34.143] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Rollup at 0x16d1d277f9340c50e1c7a9916ab994247a68af9f {"aztecSlotDuration":16,"aztecEpochDuration":4,"targetCommitteeSize":48,"aztecProofSubmissionWindow":7,"slashingQuorum":6,"slashingRoundSize":10,"manaTarget":10000000000,"provingCostPerMana":100,"rewardConfig":{"sequencerBps":5000,"increment":200000,"maxScore":5000000,"a":5000,"k":1000000,"minimum":100000}} 13:44:34 [13:44:34.143] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 11 transactions to be mined... 13:44:42 [13:44:42.156] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 13:44:42 [13:44:42.156] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof All core contracts have been deployed 13:44:42 [13:44:42.172] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xb7d9a2b3422793e05525e18913ab98eebdd11406fc5f6be8bacf7fdbd19d49bd {"gasLimit":1056496,"maxFeePerGas":"3.747782171","maxPriorityFeePerGas":"2.48832"} 13:44:42 [13:44:42.173] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x02E01398185DCD54AE19eF8481FF736305c90871 in tx 0xb7d9a2b3422793e05525e18913ab98eebdd11406fc5f6be8bacf7fdbd19d49bd. 13:44:42 [13:44:42.173] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed SlashFactory at 0x02e01398185dcd54ae19ef8481ff736305c90871 13:44:42 [13:44:42.211] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x769d0fe3b824c47a1ce39b3f14c965cf421e8d1a98fc7ca6e066c098a83fe7ed {"gasLimit":116846,"maxFeePerGas":"3.747782171","maxPriorityFeePerGas":"2.48832"} 13:44:42 [13:44:42.211] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Adding rollup 0x16d1d277f9340c50e1c7a9916ab994247a68af9f to registry 0x992d1f24cc5f368188d936cf0b2a111cee586d4e in tx 0x769d0fe3b824c47a1ce39b3f14c965cf421e8d1a98fc7ca6e066c098a83fe7ed 13:44:42 [13:44:42.232] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x379d056831f4c196793c09ae0bc40252c1bcc6d01ad683a7e05785ae232b94c4 {"gasLimit":109478,"maxFeePerGas":"3.747782171","maxPriorityFeePerGas":"2.48832"} 13:44:42 [13:44:42.232] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Adding rollup 0x16d1d277f9340c50e1c7a9916ab994247a68af9f to GSE 0xad2120681b02de3e9b8afd325977cdeddf15f01c in tx 0x379d056831f4c196793c09ae0bc40252c1bcc6d01ad683a7e05785ae232b94c4 13:44:50 [13:44:50.260] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 12 transactions to be mined... 13:44:50 [13:44:50.303] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 13:44:50 [13:44:50.308] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup deployed 13:44:50 [13:44:50.309] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for rollup and slash factory to be deployed 13:44:50 [13:44:50.309] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 12 transactions to be mined... 13:44:50 [13:44:50.342] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 13:44:50 [13:44:50.342] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof All transactions for L1 deployment have been mined 13:44:50 [13:44:50.382] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Aztec L1 contracts initialized {"registryAddress":"0x992d1f24cc5f368188d936cf0b2a111cee586d4e","governanceAddress":"0x506150cab49dbc09c8b79d20ac5c79ca28220aea","governanceProposerAddress":"0xfdb60896b1920a10fd3aa268a292e51ebd5568a8","rollupAddress":"0x16d1d277f9340c50e1c7a9916ab994247a68af9f","inboxAddress":"0x421e142dcf1b8b8e2a467dd84e15b0fb9bb89ee2","outboxAddress":"0x00f6b75ca3323d3c1aeab5c3199967fb53eca5cb","feeJuicePortalAddress":"0x96bef22b899e8c881bde3f499300f8e1802aaa6d","feeJuiceAddress":"0xd8b56421e9b573ae62f2997b7b58858a4413a967","stakingAssetAddress":"0x026208fee3f4461826c8838c3569272e8c08e131","rewardDistributorAddress":"0xd462e23c2c8a9b4f83de76004a170d4cebb5d3e1","gseAddress":"0xad2120681b02de3e9b8afd325977cdeddf15f01c","coinIssuerAddress":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266"} 13:44:50 [13:44:50.383] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Handing over to governance 13:44:50 [13:44:50.386] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Calling evm_setNextBlockTimestamp with params: [1749735896] 13:44:50 [13:44:50.388] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Calling hardhat_mine with params: [1] 13:44:50 [13:44:50.390] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Jumped to slot 1 13:44:50 [13:44:50.401] INFO: aztecjs:utils:watcher Watcher not started because not auto mining 13:44:50 [13:44:50.402] INFO: telemetry:client Using NoopTelemetryClient 13:44:50 [13:44:50.406] INFO: kv-store:lmdb-v2:blob-sink Creating blob-sink data store at directory /tmp/598f2f08e2f6b896/blob-sink with map size 134217728 KB (LMDB v2) 13:44:50 [13:44:50.415] INFO: kv-store:lmdb-v2:blob-sink Starting data store with maxReaders 16 13:44:50 [13:44:50.440] INFO: blob-sink:server Server is running on http://localhost:35851 13:44:50 [13:44:50.441] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating and synching an aztec node... 13:44:50 [13:44:50.442] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Using native ACVM binary at ../../noir/noir-repo/target/release/acvm with working directory /tmp/dfecccb4/acvm 13:44:50 [13:44:50.445] INFO: node:blob-sink:client Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:35851"} 13:44:50 [13:44:50.492] VERBOSE: node Snapshot sync is disabled. No snapshots URL provided. 13:44:50 [13:44:50.495] INFO: archiver:lmdb Creating archiver data store at directory /tmp/598f2f08e2f6b896/archiver with map size 134217728 KB (LMDB v2) 13:44:50 [13:44:50.499] INFO: archiver:lmdb Starting data store with maxReaders 16 13:44:51 [13:44:51.514] INFO: node:blob-sink:client Testing configured blob sources {"blobSinkUrl":"http://localhost:35851"} 13:44:51 [13:44:51.539] INFO: node:blob-sink:client Blob sink is reachable {"blobSinkUrl":"http://localhost:35851"} 13:44:51 [13:44:51.540] WARN: node:blob-sink:client No L1 consensus host urls configured 13:44:51 [13:44:51.540] WARN: node:blob-sink:client No archive client configured 13:44:51 [13:44:51.545] INFO: archiver Starting archiver sync to rollup contract 0x16d1d277f9340c50e1c7a9916ab994247a68af9f from L1 block 4 to current L1 block 6 with hash 0x645859e0c2b6b105e5415d75dff52fb43a0c419d0b976a4dcc101b95a06e0c1b {"blocksSynchedTo":4,"messagesSynchedTo":{"l1BlockHash":"0x0c14bbf28d9688d9b121b48ca6e41ef0b0f9ff4ed9682d98c53cff54e36d138f","l1BlockNumber":4}} 13:44:51 [13:44:51.591] INFO: archiver Initial archiver sync to L1 block 6 complete. {"l1BlockNumber":6,"syncPoint":{"blocksSynchedTo":6,"messagesSynchedTo":{"l1BlockHash":"0x645859e0c2b6b105e5415d75dff52fb43a0c419d0b976a4dcc101b95a06e0c1b","l1BlockNumber":6}},"latest":{"number":0},"proven":{"number":0},"finalized":{"number":0}} 13:44:51 [13:44:51.605] INFO: world-state:database Creating world state data store at directory /tmp/598f2f08e2f6b896/world_state with map sizes {"archiveTreeMapSizeKb":134217728,"nullifierTreeMapSizeKb":134217728,"noteHashTreeMapSizeKb":134217728,"messageTreeMapSizeKb":134217728,"publicDataTreeMapSizeKb":134217728} and 2 threads. 13:44:51 [13:44:51.657] INFO: world_state Created world state synchroniser with block history of 2 13:44:51 [13:44:51.657] WARN: node Aztec node is accepting fake proofs 13:44:51 [13:44:51.691] INFO: p2p:lmdb-v2 Creating p2p data store at directory /tmp/598f2f08e2f6b896/p2p with map size 134217728 KB (LMDB v2) 13:44:51 [13:44:51.694] INFO: p2p:lmdb-v2 Starting data store with maxReaders 16 13:44:51 [13:44:51.696] INFO: p2p-archive:lmdb-v2 Creating p2p-archive data store at directory /tmp/598f2f08e2f6b896/p2p-archive with map size 134217728 KB (LMDB v2) 13:44:51 [13:44:51.701] INFO: p2p-archive:lmdb-v2 Starting data store with maxReaders 16 13:44:51 [13:44:51.706] INFO: p2p-peer:lmdb-v2 Creating p2p-peers data store at directory /tmp/598f2f08e2f6b896/p2p-peers with map size 134217728 KB (LMDB v2) 13:44:51 [13:44:51.712] INFO: p2p-peer:lmdb-v2 Starting data store with maxReaders 16 13:44:51 [13:44:51.720] INFO: p2p:tx_pool Setting maximum tx mempool size {"maxTxPoolSize":100000000} 13:44:51 [13:44:51.723] VERBOSE: p2p P2P is disabled. Using dummy P2P service 13:44:51 [13:44:51.736] VERBOSE: world-state:block_stream Starting L2 block stream {"proven":false,"pollIntervalMS":50} 13:44:51 [13:44:51.738] INFO: world_state Started world state synchronizer from block 1 13:44:51 [13:44:51.742] VERBOSE: world-state:block_stream Starting sync from block number 0 13:44:51 [13:44:51.746] INFO: p2p Starting p2p client from block 0 with empty mempools 13:44:51 [13:44:51.746] VERBOSE: p2p:l2-block-stream Starting L2 block stream {"batchSize":20,"pollIntervalMS":100,"startingBlock":0} 13:44:52 [13:44:52.163] INFO: epoch-prune-watcher EpochPruneWatcher initialized 13:44:52 [13:44:52.238] VERBOSE: validator Initialized validator with addresses: 0xd670096e565144291daaa5e16e40cb0a1c6080ea 13:44:52 [13:44:52.238] VERBOSE: node All Aztec Node subsystems synced 13:44:52 [13:44:52.252] INFO: slasher Starting Slasher client... 13:44:52 [13:44:52.261] VERBOSE: p2p:l2-block-stream Starting sync from block number 0 13:44:52 [13:44:52.265] INFO: sequencer-client Deploying forwarder contract 13:44:52 [13:44:52.296] VERBOSE: sequencer-client Sent L1 transaction 0xda888973b4ad2d3d163799c42065a89b2c05bcb621343d65d24f9b27b4d854fa {"gasLimit":323704,"maxFeePerGas":"2.259597543","maxPriorityFeePerGas":"1.2"} 13:44:52 [13:44:52.296] VERBOSE: sequencer-client Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000042 to address 0x0fe4d493871B0C51332De8A330B02BA8172Da4aC in tx 0xda888973b4ad2d3d163799c42065a89b2c05bcb621343d65d24f9b27b4d854fa. 13:45:00 [13:45:00.313] INFO: sequencer-client Forwarder contract deployed at 0x0fe4d493871b0c51332de8a330b02ba8172da4ac 13:45:00 [13:45:00.330] INFO: validator Started validator with addresses: 0xd670096e565144291daaa5e16e40cb0a1c6080ea 13:45:00 [13:45:00.331] VERBOSE: validator Validators 0xd670096e565144291daaa5e16e40cb0a1c6080ea are not on the validator committee for epoch 0 13:45:00 [13:45:00.332] INFO: sequencer Sequencer config set {"transactionPollingIntervalMS":500,"maxTxsPerBlock":32,"minTxsPerBlock":0,"maxL2BlockGas":10000000000,"publishTxsWithProposals":false,"maxDABlockGas":10000000000,"acvmWorkingDirectory":"/tmp/dfecccb4/acvm","acvmBinaryPath":"../../noir/noir-repo/target/release/acvm","maxBlockSizeInBytes":1048576,"governanceProposerPayload":"0x0000000000000000000000000000000000000000","maxL1TxInclusionTimeIntoSlot":8,"enforceTimeTable":false} 13:45:00 [13:45:00.333] VERBOSE: sequencer Sequencer timetable updated {"enforceTimeTable":false} 13:45:00 [13:45:00.335] INFO: sequencer Sequencer started with address 0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266 13:45:00 [13:45:00.337] INFO: node Aztec Node version: 0.87.6 13:45:00 [13:45:00.337] INFO: node Aztec Node started on chain 0x7a69 {"registryAddress":"0x992d1f24cc5f368188d936cf0b2a111cee586d4e","governanceAddress":"0x506150cab49dbc09c8b79d20ac5c79ca28220aea","governanceProposerAddress":"0xfdb60896b1920a10fd3aa268a292e51ebd5568a8","rollupAddress":"0x16d1d277f9340c50e1c7a9916ab994247a68af9f","inboxAddress":"0x421e142dcf1b8b8e2a467dd84e15b0fb9bb89ee2","outboxAddress":"0x00f6b75ca3323d3c1aeab5c3199967fb53eca5cb","feeJuicePortalAddress":"0x96bef22b899e8c881bde3f499300f8e1802aaa6d","feeJuiceAddress":"0xd8b56421e9b573ae62f2997b7b58858a4413a967","stakingAssetAddress":"0x026208fee3f4461826c8838c3569272e8c08e131","rewardDistributorAddress":"0xd462e23c2c8a9b4f83de76004a170d4cebb5d3e1","gseAddress":"0xad2120681b02de3e9b8afd325977cdeddf15f01c","coinIssuerAddress":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","slashFactoryAddress":"0x02e01398185dcd54ae19ef8481ff736305c90871","feeAssetHandlerAddress":"0x3607dbafde17871e0d6a8f929151c30b83510d39","stakingAssetHandlerAddress":"0x499c89d6b68cbdca67c96bff13eb5b5a8fdb25a2","zkPassportVerifierAddress":"0xee9f10f38319eae2730dba28fb09081db806c5e5"} 13:45:00 [13:45:00.340] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating and syncing a simulated prover node... 13:45:00 [13:45:00.414] INFO: blob-sink:client:prover-node Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:35851"} 13:45:00 [13:45:00.423] INFO: archiver:lmdb:prover-node Creating archiver data store at directory /tmp/598f2f08e2f6b896/8e32927321741504/archiver with map size 134217728 KB (LMDB v2) 13:45:00 [13:45:00.427] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 13:45:00 [13:45:00.432] INFO: archiver:lmdb:prover-node Starting data store with maxReaders 16 13:45:00 [13:45:00.840] INFO: blob-sink:client:prover-node Testing configured blob sources {"blobSinkUrl":"http://localhost:35851"} 13:45:00 [13:45:00.844] INFO: blob-sink:client:prover-node Blob sink is reachable {"blobSinkUrl":"http://localhost:35851"} 13:45:00 [13:45:00.845] WARN: blob-sink:client:prover-node No L1 consensus host urls configured 13:45:00 [13:45:00.845] WARN: blob-sink:client:prover-node No archive client configured 13:45:00 [13:45:00.850] INFO: archiver:prover-node Starting archiver sync to rollup contract 0x16d1d277f9340c50e1c7a9916ab994247a68af9f from L1 block 4 to current L1 block 7 with hash 0x1979f278d89da0d5271dea08e13d8cbd251ec102f499320605882b9ed36c3cae {"blocksSynchedTo":4,"messagesSynchedTo":{"l1BlockHash":"0x0c14bbf28d9688d9b121b48ca6e41ef0b0f9ff4ed9682d98c53cff54e36d138f","l1BlockNumber":4}} 13:45:00 [13:45:00.869] INFO: archiver:prover-node Initial archiver sync to L1 block 7 complete. {"l1BlockNumber":7,"syncPoint":{"blocksSynchedTo":7,"messagesSynchedTo":{"l1BlockHash":"0x1979f278d89da0d5271dea08e13d8cbd251ec102f499320605882b9ed36c3cae","l1BlockNumber":7}},"latest":{"number":0},"proven":{"number":0},"finalized":{"number":0}} 13:45:00 [13:45:00.873] INFO: prover-node:blob-sink:client:prover-node Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:35851"} 13:45:00 [13:45:00.873] VERBOSE: prover-node:prover-node Snapshot sync is disabled. No snapshots URL provided. 13:45:00 [13:45:00.875] VERBOSE: prover-node:prover-node Created archiver and synced to block 0 13:45:00 [13:45:00.890] INFO: world-state:database:prover-node Creating world state data store at directory /tmp/598f2f08e2f6b896/8e32927321741504/world_state with map sizes {"archiveTreeMapSizeKb":134217728,"nullifierTreeMapSizeKb":134217728,"noteHashTreeMapSizeKb":134217728,"messageTreeMapSizeKb":134217728,"publicDataTreeMapSizeKb":134217728} and 2 threads. 13:45:00 [13:45:00.918] INFO: world_state:prover-node Created world state synchroniser with block history of 2 13:45:00 [13:45:00.919] VERBOSE: world-state:block_stream:prover-node Starting L2 block stream {"proven":false,"pollIntervalMS":50} 13:45:00 [13:45:00.920] INFO: world_state:prover-node Started world state synchronizer from block 1 13:45:00 [13:45:00.922] VERBOSE: world-state:block_stream:prover-node Starting sync from block number 0 13:45:00 [13:45:00.922] WARN: prover-client:proving-broker-database:prover-node Found invalid epoch directory /tmp/598f2f08e2f6b896/8e32927321741504/archiver when loading epoch databases, ignoring 13:45:00 [13:45:00.922] WARN: prover-client:proving-broker-database:prover-node Found invalid epoch directory /tmp/598f2f08e2f6b896/8e32927321741504/world_state when loading epoch databases, ignoring 13:45:00 [13:45:00.923] INFO: prover-client:proving-broker:prover-node Proving Broker started 13:45:00 [13:45:00.954] INFO: prover-node:prover-coordination:prover-node Using prover coordination via aztec node 13:45:00 [13:45:00.956] INFO: e2e:e2e_epochs:epochs_upload_failed_proof:prover-node Created and synced prover node {"publisherAddress":"0x3C44CdDdB6a900fa2b585dd299e03d12FA4293BC"} 13:45:00 [13:45:00.956] INFO: prover-node:epoch-monitor:prover-node Started EpochMonitor {"pollingIntervalMs":200} 13:45:00 [13:45:00.959] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 13:45:00 [13:45:00.961] INFO: prover-node:prover-node Started Prover Node with prover id 0x0000000000000000000000000000000000000000000000000000000000000001 {"proverNodePollingIntervalMs":200,"proverNodeMaxPendingJobs":10,"proverNodeMaxParallelBlocksPerEpoch":32,"txGatheringIntervalMs":1000,"txGatheringBatchSize":10,"txGatheringMaxParallelRequestsPerNode":100,"proverNodeFailedEpochStore":"file:///tmp/failed-proofs-XTAwKW","dataDirectory":"/tmp/598f2f08e2f6b896/8e32927321741504","l1ChainId":31337,"rollupVersion":1849448694} 13:45:00 [13:45:00.961] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating a pxe... 13:45:00 [13:45:00.964] INFO: pxe:data:lmdb Creating pxe_data data store at directory /tmp/6960d5226712232e/pxe_data with map size 134217728 KB (LMDB v2) 13:45:00 [13:45:00.967] INFO: pxe:data:lmdb Starting data store with maxReaders 16 13:45:01 [13:45:01.413] VERBOSE: pxe:service Registered protocol contracts in pxe {"AuthRegistry":"0x0000000000000000000000000000000000000000000000000000000000000001","ContractInstanceDeployer":"0x0000000000000000000000000000000000000000000000000000000000000002","ContractClassRegisterer":"0x0000000000000000000000000000000000000000000000000000000000000003","MultiCallEntrypoint":"0x0000000000000000000000000000000000000000000000000000000000000004","FeeJuice":"0x0000000000000000000000000000000000000000000000000000000000000005","Router":"0x0000000000000000000000000000000000000000000000000000000000000006"} 13:45:01 [13:45:01.414] INFO: pxe:service Started PXE connected to chain 31337 version 1849448694 13:45:01 [13:45:01.422] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L2 genesis at L1 block 4 (timestamp 1749735880) 13:45:01 [13:45:01.423] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting until L1 timestamp 1749735944 is reached as the start of epoch 1 13:45:01 [13:45:01.482] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 13:45:01 [13:45:01.683] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 7 mined at 13:45:04 with new L2 block 0 for epoch 0 with proof up to L2 block 0 for epoch 0 {"l1Timestamp":1749735904,"l1BlockNumber":7,"l2SlotNumber":1,"l2BlockNumber":0,"l2ProvenBlockNumber":0,"totalL2Messages":0} 13:45:01 [13:45:01.993] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 13:45:02 [13:45:02.519] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 13:45:03 [13:45:03.043] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 13:45:03 [13:45:03.566] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 13:45:04 [13:45:04.084] VERBOSE: sequencer Preparing proposal for block 1 at slot 2 {"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1749735912,"version":1849448694},"chainTipArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","blockNumber":1,"slot":2} 13:45:04 [13:45:04.106] VERBOSE: block-builder Building block 1 for slot 2 {"slot":2,"slotStart":"2025-06-12T13:45:12.000Z","now":"2025-06-12T13:45:04.106Z","blockNumber":1,"msgCount":0,"opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}} 13:45:04 [13:45:04.111] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.0006941630000001169s {"duration":0.0006941630000001169,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 13:45:04 [13:45:04.129] INFO: sequencer Built block 1 for slot 2 with 0 txs and 0 messages. 0 mana/s {"blockHash":"0x06168dbe6f99bd847785b9ea87ffdea24e325aafd63aa3a9b598d14fa382d35b","globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1749735912,"version":1849448694},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":33.3234369999991,"publicProcessDuration":1.743372000004456,"rollupCircuitsDuration":23.348332000001392,"txCount":0,"blockNumber":1,"blockTimestamp":1749735912,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 13:45:04 [13:45:04.134] VERBOSE: sequencer Attesting committee is empty 13:45:05 [13:45:05.069] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 8 mined at 13:45:12 {"l1Timestamp":1749735912,"l1BlockNumber":8,"l2SlotNumber":2,"l2BlockNumber":0,"l2ProvenBlockNumber":0,"totalL2Messages":0} 13:45:07 [13:45:07.384] VERBOSE: ethereum:tx_delayer Sent tx immediately 0x2555d83f877d3a1d903cd8531af2cd79eca48ab1763b0843912e0575744eeaa4 13:45:07 [13:45:07.385] VERBOSE: node Sent L1 transaction 0x2555d83f877d3a1d903cd8531af2cd79eca48ab1763b0843912e0575744eeaa4 {"gasLimit":485800,"maxFeePerGas":"2.367147852","maxPriorityFeePerGas":"1.44","maxFeePerBlobGas":"0.000000001"} 13:45:13 [13:45:13.065] INFO: sequencer:publisher Bundled [propose] transaction [succeeded] 13:45:13 [13:45:13.066] VERBOSE: sequencer:publisher Published L2 block to L1 rollup contract {"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0x2555d83f877d3a1d903cd8531af2cd79eca48ab1763b0843912e0575744eeaa4","calldataSize":1220,"calldataGas":8840,"txCount":0,"blockNumber":1,"blockTimestamp":1749735912,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 13:45:13 [13:45:13.068] VERBOSE: node:blob-sink:client Sending 1 blobs to blob sink 13:45:13 [13:45:13.094] INFO: blob-sink:server Received blob sidecar for block 0x749271f7c6d6f78b48edae22772f5384becc9cd2b07388bb45ee5dc716966f85 13:45:13 [13:45:13.108] INFO: blob-sink:server Blob sidecar stored successfully for block 0x749271f7c6d6f78b48edae22772f5384becc9cd2b07388bb45ee5dc716966f85 13:45:13 [13:45:13.148] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 9 mined at 13:45:20 with new L2 block 1 for epoch 0 {"l1Timestamp":1749735920,"l1BlockNumber":9,"l2SlotNumber":2,"l2BlockNumber":1,"l2ProvenBlockNumber":0,"totalL2Messages":0} 13:45:13 [13:45:13.242] INFO: archiver:prover-node Downloaded L2 block 1 {"blockHash":"0x06168dbe6f99bd847785b9ea87ffdea24e325aafd63aa3a9b598d14fa382d35b","blockNumber":1,"txCount":0,"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1749735912,"version":1849448694},"archiveRoot":"0x11bc6d9587ed2ae44a6cc23757f25f11aa46e01d7a70d6b263f2751e4b9c36f4","archiveNextLeafIndex":2} 13:45:13 [13:45:13.251] INFO: archiver Downloaded L2 block 1 {"blockHash":"0x06168dbe6f99bd847785b9ea87ffdea24e325aafd63aa3a9b598d14fa382d35b","blockNumber":1,"txCount":0,"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1749735912,"version":1849448694},"archiveRoot":"0x11bc6d9587ed2ae44a6cc23757f25f11aa46e01d7a70d6b263f2751e4b9c36f4","archiveNextLeafIndex":2} 13:45:13 [13:45:13.284] INFO: world_state:prover-node World state updated with L2 block 1 {"eventName":"l2-block-handled","duration":7.120372000004863,"unfinalisedBlockNumber":1,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":1,"blockTimestamp":1749735912,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 13:45:13 [13:45:13.312] INFO: world_state World state updated with L2 block 1 {"eventName":"l2-block-handled","duration":4.652946000001975,"unfinalisedBlockNumber":1,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":1,"blockTimestamp":1749735912,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 13:45:13 [13:45:13.374] VERBOSE: p2p Synched to latest block 1 13:45:13 [13:45:13.593] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 13:45:14 [13:45:14.010] VERBOSE: prover-node:prover-node Fetching 0 tx hashes for block number 1 from coordination 13:45:14 [13:45:14.010] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 13:45:14 [13:45:14.107] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 13:45:14 [13:45:14.623] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 13:45:15 [13:45:15.145] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 13:45:15 [13:45:15.657] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 13:45:16 [13:45:16.183] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 13:45:16 [13:45:16.709] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 13:45:17 [13:45:17.222] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 13:45:17 [13:45:17.737] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 13:45:18 [13:45:18.252] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 13:45:18 [13:45:18.764] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 13:45:19 [13:45:19.276] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 13:45:19 [13:45:19.795] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 13:45:20 [13:45:20.326] VERBOSE: sequencer Preparing proposal for block 2 at slot 3 {"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1749735928,"version":1849448694},"chainTipArchive":"0x11bc6d9587ed2ae44a6cc23757f25f11aa46e01d7a70d6b263f2751e4b9c36f4","blockNumber":2,"slot":3} 13:45:20 [13:45:20.341] VERBOSE: block-builder Building block 2 for slot 3 {"slot":3,"slotStart":"2025-06-12T13:45:28.000Z","now":"2025-06-12T13:45:20.341Z","blockNumber":2,"msgCount":0,"opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}} 13:45:20 [13:45:20.348] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.002363914000001387s {"duration":0.002363914000001387,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 13:45:20 [13:45:20.368] INFO: sequencer Built block 2 for slot 3 with 0 txs and 0 messages. 0 mana/s {"blockHash":"0x2b74dff8de77ca3bfaea7c986832c28ff6e9c91850baf23e9d5dfc741c8456f1","globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1749735928,"version":1849448694},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":35.67065100000764,"publicProcessDuration":3.075847000000067,"rollupCircuitsDuration":28.56395799999882,"txCount":0,"blockNumber":2,"blockTimestamp":1749735928,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 13:45:20 [13:45:20.370] VERBOSE: sequencer Attesting committee is empty 13:45:20 [13:45:20.486] VERBOSE: ethereum:tx_delayer Sent tx immediately 0x1d84ab6309166e43f15f5bb94ce58c4643a42474d1a042bfc7132e8fa00ab46d 13:45:20 [13:45:20.487] VERBOSE: node Sent L1 transaction 0x1d84ab6309166e43f15f5bb94ce58c4643a42474d1a042bfc7132e8fa00ab46d {"gasLimit":414577,"maxFeePerGas":"2.439650389","maxPriorityFeePerGas":"1.728","maxFeePerBlobGas":"0.000000001"} 13:45:21 [13:45:21.044] INFO: sequencer:publisher Bundled [propose] transaction [succeeded] 13:45:21 [13:45:21.044] VERBOSE: sequencer:publisher Published L2 block to L1 rollup contract {"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0x1d84ab6309166e43f15f5bb94ce58c4643a42474d1a042bfc7132e8fa00ab46d","calldataSize":1220,"calldataGas":8840,"txCount":0,"blockNumber":2,"blockTimestamp":1749735928,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 13:45:21 [13:45:21.045] VERBOSE: node:blob-sink:client Sending 1 blobs to blob sink 13:45:21 [13:45:21.072] INFO: blob-sink:server Received blob sidecar for block 0x8bafa8d4cd4569b1fd83c5a5d5c6b671218ec1181ff013f94fd379ec181f7f87 13:45:21 [13:45:21.081] INFO: blob-sink:server Blob sidecar stored successfully for block 0x8bafa8d4cd4569b1fd83c5a5d5c6b671218ec1181ff013f94fd379ec181f7f87 13:45:21 [13:45:21.183] INFO: archiver Downloaded L2 block 2 {"blockHash":"0x2b74dff8de77ca3bfaea7c986832c28ff6e9c91850baf23e9d5dfc741c8456f1","blockNumber":2,"txCount":0,"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1749735928,"version":1849448694},"archiveRoot":"0x083b6451b9b0a4f4f33afc0780df65e38661c5d998910a247ef09e2849c3f54e","archiveNextLeafIndex":3} 13:45:21 [13:45:21.197] INFO: archiver:prover-node Downloaded L2 block 2 {"blockHash":"0x2b74dff8de77ca3bfaea7c986832c28ff6e9c91850baf23e9d5dfc741c8456f1","blockNumber":2,"txCount":0,"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1749735928,"version":1849448694},"archiveRoot":"0x083b6451b9b0a4f4f33afc0780df65e38661c5d998910a247ef09e2849c3f54e","archiveNextLeafIndex":3} 13:45:21 [13:45:21.208] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 10 mined at 13:45:28 with new L2 block 2 for epoch 0 {"l1Timestamp":1749735928,"l1BlockNumber":10,"l2SlotNumber":3,"l2BlockNumber":2,"l2ProvenBlockNumber":0,"totalL2Messages":0} 13:45:21 [13:45:21.216] VERBOSE: p2p Synched to latest block 2 13:45:21 [13:45:21.223] INFO: world_state:prover-node World state updated with L2 block 2 {"eventName":"l2-block-handled","duration":5.365259999991395,"unfinalisedBlockNumber":2,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":2,"blockTimestamp":1749735928,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 13:45:21 [13:45:21.224] INFO: world_state World state updated with L2 block 2 {"eventName":"l2-block-handled","duration":5.525002999987919,"unfinalisedBlockNumber":2,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":2,"blockTimestamp":1749735928,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 13:45:21 [13:45:21.407] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 13:45:21 [13:45:21.407] VERBOSE: prover-node:prover-node Gathered all 0 txs for epoch 0 {"epochNumber":0} 13:45:21 [13:45:21.408] VERBOSE: prover-node:prover-node Gathered all 0 messages for epoch 0 {"epochNumber":0} 13:45:21 [13:45:21.408] VERBOSE: prover-node:prover-node Gathered previous block header 0 for epoch 0 13:45:21 [13:45:21.408] VERBOSE: prover-node:prover-node Creating proving job for epoch 0 for block range 1 to 2 13:45:21 [13:45:21.410] INFO: prover-node:epoch-proving-job Starting epoch 0 proving job with blocks 1 to 2 {"fromBlock":1,"toBlock":2,"epochSizeBlocks":2,"epochNumber":0,"uuid":"89a1a84d-2b56-46c3-b092-f534e3e93c0e"} 13:45:21 [13:45:21.428] INFO: prover-client:orchestrator Starting epoch 0 with 2 blocks 13:45:21 [13:45:21.429] VERBOSE: prover-client:broker-circuit-prover-facade Starting BrokerCircuitProverFacade 13:45:21 [13:45:21.430] VERBOSE: prover-node:epoch-proving-job Starting processing block 1 {"number":1,"blockHash":"0x06168dbe6f99bd847785b9ea87ffdea24e325aafd63aa3a9b598d14fa382d35b","lastArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"89a1a84d-2b56-46c3-b092-f534e3e93c0e","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x000000000000000000000000000000000000000000000000000000006e3c58f6","blockNumber":"0x0000000000000000000000000000000000000000000000000000000000000001","slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 13:45:21 [13:45:21.431] INFO: prover-client:orchestrator Starting block 1 for slot 2 13:45:21 [13:45:21.432] VERBOSE: prover-node:epoch-proving-job Starting processing block 2 {"number":2,"blockHash":"0x2b74dff8de77ca3bfaea7c986832c28ff6e9c91850baf23e9d5dfc741c8456f1","lastArchive":"0x11bc6d9587ed2ae44a6cc23757f25f11aa46e01d7a70d6b263f2751e4b9c36f4","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"89a1a84d-2b56-46c3-b092-f534e3e93c0e","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x000000000000000000000000000000000000000000000000000000006e3c58f6","blockNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000003","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 13:45:21 [13:45:21.432] INFO: prover-client:orchestrator Starting block 2 for slot 3 13:45:21 [13:45:21.461] INFO: prover-client:proving-broker:prover-node New proving job id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff epochNumber=0 {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff"} 13:45:21 [13:45:21.462] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff","provingJobType":"BASE_PARITY"} 13:45:21 [13:45:21.462] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff","provingJobType":"BASE_PARITY"} 13:45:21 [13:45:21.462] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff","provingJobType":"BASE_PARITY"} 13:45:21 [13:45:21.463] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff","provingJobType":"BASE_PARITY"} 13:45:21 [13:45:21.464] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff","provingJobType":"BASE_PARITY"} 13:45:21 [13:45:21.464] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff","provingJobType":"BASE_PARITY"} 13:45:21 [13:45:21.464] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff","provingJobType":"BASE_PARITY"} 13:45:21 [13:45:21.465] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.0000196400000131689s {"duration":0.0000196400000131689,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 13:45:21 [13:45:21.466] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 13:45:21 [13:45:21.467] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 1 {"blockNumber":1,"blockHash":"0x06168dbe6f99bd847785b9ea87ffdea24e325aafd63aa3a9b598d14fa382d35b","uuid":"89a1a84d-2b56-46c3-b092-f534e3e93c0e"} 13:45:21 [13:45:21.467] VERBOSE: prover-client:orchestrator Block 1 completed. Assembling header. 13:45:21 [13:45:21.471] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.00002291099999274593s {"duration":0.00002291099999274593,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 13:45:21 [13:45:21.472] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 13:45:21 [13:45:21.473] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 2 {"blockNumber":2,"blockHash":"0x2b74dff8de77ca3bfaea7c986832c28ff6e9c91850baf23e9d5dfc741c8456f1","uuid":"89a1a84d-2b56-46c3-b092-f534e3e93c0e"} 13:45:21 [13:45:21.473] VERBOSE: prover-client:orchestrator Block 2 completed. Assembling header. 13:45:21 [13:45:21.479] VERBOSE: prover-client:orchestrator Updating archive tree with block 1 header 0x06168dbe6f99bd847785b9ea87ffdea24e325aafd63aa3a9b598d14fa382d35b 13:45:21 [13:45:21.486] VERBOSE: prover-client:orchestrator Updating archive tree with block 2 header 0x2b74dff8de77ca3bfaea7c986832c28ff6e9c91850baf23e9d5dfc741c8456f1 13:45:21 [13:45:21.487] VERBOSE: prover-client:orchestrator Orchestrator finalised block 1 13:45:21 [13:45:21.503] VERBOSE: prover-client:orchestrator Orchestrator finalised block 2 13:45:21 [13:45:21.522] INFO: prover-client:proving-broker-database:prover-node Creating broker database for epoch 0 at /tmp/598f2f08e2f6b896/8e32927321741504/0 with map size 134217728 13:45:21 [13:45:21.528] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 13:45:21 [13:45:21.531] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY epochNumber=0 {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff","provingJobType":"BASE_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...","status":"not-found","numOutstandingJobs":1} 13:45:21 [13:45:21.541] INFO: prover-client:proving-agent:prover-node Starting job id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input... 13:45:21 [13:45:21.553] INFO: prover-client:proving-agent:job-controller-c345ab76 Job controller started jobId=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff {"jobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff"} 13:45:21 [13:45:21.626] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 13:45:21 error: "Rollup__SlotAlreadyInChain(3, 3)" 13:45:21 [13:45:21.627] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 13:45:21 [13:45:21.692] INFO: prover-client:proving-agent:prover-node Job id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22resul... 13:45:21 [13:45:21.693] INFO: prover-client:proving-broker:prover-node Proving job complete id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY totalAttempts=1 {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff"} 13:45:22 [13:45:22.034] VERBOSE: prover-node:prover-node Fetching 0 tx hashes for block number 2 from coordination 13:45:22 [13:45:22.035] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 13:45:22 [13:45:22.165] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 13:45:22 error: "Rollup__SlotAlreadyInChain(3, 3)" 13:45:22 [13:45:22.166] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 13:45:22 [13:45:22.430] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 13:45:22 [13:45:22.433] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY 13:45:22 [13:45:22.434] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 13:45:22 [13:45:22.454] INFO: prover-client:proving-broker:prover-node New proving job id=0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac epochNumber=0 {"provingJobId":"0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac"} 13:45:22 [13:45:22.460] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac type=ROOT_PARITY {"provingJobId":"0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac","provingJobType":"ROOT_PARITY"} 13:45:22 [13:45:22.507] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac type=ROOT_PARITY epochNumber=0 {"provingJobId":"0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac","provingJobType":"ROOT_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu...","status":"not-found","numOutstandingJobs":1} 13:45:22 [13:45:22.519] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Triggering error on finaliseEpoch 13:45:22 [13:45:22.528] ERROR: prover-node:epoch-proving-job Error running epoch 0 prover job: Error: Fake error while proving epoch 13:45:22 at ServerEpochProver.epochProver.finaliseEpoch (/home/aztec-dev/aztec-packages/yarn-project/end-to-end/src/e2e_epochs/epochs_upload_failed_proof.test.ts:60:15) 13:45:22 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:142:64) 13:45:22 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) {"uuid":"89a1a84d-2b56-46c3-b092-f534e3e93c0e","epochNumber":0} 13:45:22 [13:45:22.529] VERBOSE: prover-client:broker-circuit-prover-facade Stopping BrokerCircuitProverFacade 13:45:22 [13:45:22.530] ERROR: prover-client:broker-circuit-prover-facade Job errored with 'Broker facade stopped' id=0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac type=ROOT_PARITY: { 13:45:22 provingJobId: '0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac', 13:45:22 provingJobType: 'ROOT_PARITY' 13:45:22 } 13:45:22 [13:45:22.531] INFO: prover-client:proving-broker:prover-node Cancelling job id=0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac {"provingJobId":"0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac"} 13:45:22 [13:45:22.532] WARN: prover-client:proving-broker:prover-node Proving job id=0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac type=ROOT_PARITY not in the in-progress set {"provingJobId":"0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac"} 13:45:22 [13:45:22.532] INFO: prover-client:proving-broker:prover-node Marking proving job as failed id=0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac type=ROOT_PARITY totalAttempts=1 err=Aborted {"provingJobId":"0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac"} 13:45:22 [13:45:22.534] ERROR: prover-client:orchestrator Error thrown when proving job: Error: Broker facade stopped 13:45:22 at BrokerCircuitProverFacade.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/proving_broker/broker_prover_facade.js:142:31) 13:45:22 at ServerEpochProver.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/prover-client/server-epoch-prover.js:31:9) 13:45:22 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:183:13) 13:45:22 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) 13:45:22 [13:45:22.534] ERROR: prover-client:orchestrator Error thrown when proving job: Error: Broker facade stopped 13:45:22 at BrokerCircuitProverFacade.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/proving_broker/broker_prover_facade.js:142:31) 13:45:22 at ServerEpochProver.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/prover-client/server-epoch-prover.js:31:9) 13:45:22 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:183:13) 13:45:22 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) 13:45:22 [13:45:22.535] ERROR: prover-node:prover-node Job for 0 exited with state failed: { 13:45:22 id: '89a1a84d-2b56-46c3-b092-f534e3e93c0e', 13:45:22 epochNumber: 0n, 13:45:22 state: 'failed' 13:45:22 } 13:45:22 [13:45:22.535] WARN: prover-node:prover-node Uploading epoch proof failure for 0 to file:///tmp/failed-proofs-XTAwKW {"epochNumber":0,"jobId":"89a1a84d-2b56-46c3-b092-f534e3e93c0e","location":"file:///tmp/failed-proofs-XTAwKW"} 13:45:22 [13:45:22.537] INFO: stdlib:file-store Creating local file file store at /tmp/failed-proofs-XTAwKW 13:45:22 [13:45:22.547] INFO: prover-node:prover-node Pausing archiver and world state sync to start snapshot upload 13:45:22 [13:45:22.548] INFO: archiver:prover-node Stopped. 13:45:22 [13:45:22.549] INFO: world_state:prover-node Stopped sync 13:45:22 [13:45:22.549] INFO: prover-node:prover-node Creating backups of lmdb environments to /tmp/598f2f08e2f6b896/8e32927321741504/epoch-proof-data-xi7iF7 13:45:22 [13:45:22.556] INFO: prover-node:prover-node Data stores backed up to /tmp/598f2f08e2f6b896/8e32927321741504/epoch-proof-data-xi7iF7 {"paths":{"l1-to-l2-message-tree":"/tmp/598f2f08e2f6b896/8e32927321741504/epoch-proof-data-xi7iF7/world-state/L1ToL2MessageTree/data.mdb","archive-tree":"/tmp/598f2f08e2f6b896/8e32927321741504/epoch-proof-data-xi7iF7/world-state/ArchiveTree/data.mdb","public-data-tree":"/tmp/598f2f08e2f6b896/8e32927321741504/epoch-proof-data-xi7iF7/world-state/PublicDataTree/data.mdb","note-hash-tree":"/tmp/598f2f08e2f6b896/8e32927321741504/epoch-proof-data-xi7iF7/world-state/NoteHashTree/data.mdb","nullifier-tree":"/tmp/598f2f08e2f6b896/8e32927321741504/epoch-proof-data-xi7iF7/world-state/NullifierTree/data.mdb","archiver":"/tmp/598f2f08e2f6b896/8e32927321741504/epoch-proof-data-xi7iF7/archiver/data.mdb"}} 13:45:22 [13:45:22.557] INFO: prover-node:prover-node Resuming archiver and world state sync 13:45:22 [13:45:22.558] VERBOSE: world-state:block_stream:prover-node Starting L2 block stream {"proven":false,"pollIntervalMS":50} 13:45:22 [13:45:22.559] INFO: world_state:prover-node Resumed sync 13:45:22 [13:45:22.559] INFO: archiver:prover-node Restarting archiver 13:45:22 [13:45:22.586] WARN: prover-node:prover-node Uploaded epoch 0 proof failure data to file:///tmp/failed-proofs-XTAwKW/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612134522-89a1a84d-2b56-46c3-b092-f534e3e93c0e {"epochNumber":0,"location":"file:///tmp/failed-proofs-XTAwKW","basePath":"aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612134522-89a1a84d-2b56-46c3-b092-f534e3e93c0e","metadataUrl":"file:///tmp/failed-proofs-XTAwKW/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612134522-89a1a84d-2b56-46c3-b092-f534e3e93c0e/metadata.json","dataUrl":"file:///tmp/failed-proofs-XTAwKW/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612134522-89a1a84d-2b56-46c3-b092-f534e3e93c0e/data.bin","metadata":{"l1BlockNumber":10,"l2BlockHash":"0x2b74dff8de77ca3bfaea7c986832c28ff6e9c91850baf23e9d5dfc741c8456f1","l2BlockNumber":2,"schemaVersions":{"archiver":2,"worldState":1},"timestamp":1749735922560,"dataUrls":{"l1-to-l2-message-tree":"file:///tmp/failed-proofs-XTAwKW/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612134522-89a1a84d-2b56-46c3-b092-f534e3e93c0e/l1-to-l2-message-tree.db","archive-tree":"file:///tmp/failed-proofs-XTAwKW/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612134522-89a1a84d-2b56-46c3-b092-f534e3e93c0e/archive-tree.db","public-data-tree":"file:///tmp/failed-proofs-XTAwKW/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612134522-89a1a84d-2b56-46c3-b092-f534e3e93c0e/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-XTAwKW/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612134522-89a1a84d-2b56-46c3-b092-f534e3e93c0e/note-hash-tree.db","nullifier-tree":"file:///tmp/failed-proofs-XTAwKW/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612134522-89a1a84d-2b56-46c3-b092-f534e3e93c0e/nullifier-tree.db","archiver":"file:///tmp/failed-proofs-XTAwKW/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612134522-89a1a84d-2b56-46c3-b092-f534e3e93c0e/archiver.db"}},"jobId":"89a1a84d-2b56-46c3-b092-f534e3e93c0e"} 13:45:22 [13:45:22.587] INFO: prover-node:prover-node Cleaning up backup dir /tmp/598f2f08e2f6b896/8e32927321741504/epoch-proof-data-xi7iF7 13:45:22 [13:45:22.683] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 13:45:22 error: "Rollup__SlotAlreadyInChain(3, 3)" 13:45:22 [13:45:22.683] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 13:45:23 [13:45:23.205] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 13:45:23 error: "Rollup__SlotAlreadyInChain(3, 3)" 13:45:23 [13:45:23.206] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 13:45:23 [13:45:23.743] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 13:45:23 error: "Rollup__SlotAlreadyInChain(3, 3)" 13:45:23 [13:45:23.743] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 13:45:24 [13:45:24.263] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 13:45:24 error: "Rollup__SlotAlreadyInChain(3, 3)" 13:45:24 [13:45:24.263] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 13:45:24 [13:45:24.773] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 13:45:24 error: "Rollup__SlotAlreadyInChain(3, 3)" 13:45:24 [13:45:24.773] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 13:45:25 [13:45:25.298] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 13:45:25 error: "Rollup__SlotAlreadyInChain(3, 3)" 13:45:25 [13:45:25.299] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 13:45:25 [13:45:25.813] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 13:45:25 error: "Rollup__SlotAlreadyInChain(3, 3)" 13:45:25 [13:45:25.814] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 13:45:26 [13:45:26.331] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 13:45:26 error: "Rollup__SlotAlreadyInChain(3, 3)" 13:45:26 [13:45:26.332] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 13:45:26 [13:45:26.858] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 13:45:26 error: "Rollup__SlotAlreadyInChain(3, 3)" 13:45:26 [13:45:26.859] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 13:45:27 [13:45:27.374] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 13:45:27 error: "Rollup__SlotAlreadyInChain(3, 3)" 13:45:27 [13:45:27.374] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 13:45:27 [13:45:27.888] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 13:45:27 error: "Rollup__SlotAlreadyInChain(3, 3)" 13:45:27 [13:45:27.888] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 13:45:28 [13:45:28.401] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 13:45:28 error: "Rollup__SlotAlreadyInChain(3, 3)" 13:45:28 [13:45:28.401] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 13:45:28 [13:45:28.924] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 13:45:28 error: "Rollup__SlotAlreadyInChain(3, 3)" 13:45:28 [13:45:28.924] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 13:45:29 [13:45:29.097] INFO: prover-node:prover-node Stopping ProverNode 13:45:29 [13:45:29.098] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 13:45:29 [13:45:29.099] INFO: archiver:prover-node Stopped. 13:45:29 [13:45:29.102] INFO: world_state:prover-node Stopped world state synchronizer 13:45:29 [13:45:29.102] INFO: prover-node:prover-node Stopped ProverNode 13:45:29 [13:45:29.103] INFO: node Stopping Aztec Node 13:45:29 [13:45:29.436] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 3 but got 4. {"rollup":[4,3],"newBlockNumber":3,"expectedSlot":3} 13:45:29 [13:45:29.952] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 3 but got 4. {"rollup":[4,3],"newBlockNumber":3,"expectedSlot":3} 13:45:30 [13:45:30.461] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 3 but got 4. {"rollup":[4,3],"newBlockNumber":3,"expectedSlot":3} 13:45:30 [13:45:30.970] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 3 but got 4. {"rollup":[4,3],"newBlockNumber":3,"expectedSlot":3} 13:45:31 [13:45:31.106] INFO: slasher Slasher client stopped. 13:45:31 [13:45:31.109] INFO: sequencer Stopped sequencer 13:45:31 [13:45:31.110] INFO: p2p P2P client stopped 13:45:31 [13:45:31.115] INFO: world_state Stopped world state synchronizer 13:45:31 [13:45:31.115] INFO: archiver Stopped. 13:45:31 [13:45:31.116] INFO: node Stopped Aztec Node 13:45:31 [13:45:31.121] INFO: node Stopping Aztec Node 13:45:33 [13:45:33.122] INFO: slasher Slasher client stopped. 13:45:33 [13:45:33.123] WARN: validator Running promise was not started 13:45:33 [13:45:33.123] WARN: sequencer Running promise was not started 13:45:33 [13:45:33.123] INFO: sequencer Stopped sequencer 13:45:33 [13:45:33.124] WARN: p2p:l2-block-stream Running promise was not started 13:45:33 [13:45:33.124] INFO: p2p P2P client stopped 13:45:33 [13:45:33.124] WARN: world-state:block_stream Running promise was not started 13:45:33 [13:45:33.124] INFO: world_state Stopped world state synchronizer 13:45:33 [13:45:33.124] WARN: archiver Running promise was not started 13:45:33 [13:45:33.124] INFO: archiver Stopped. 13:45:33 [13:45:33.125] INFO: node Stopped Aztec Node 13:45:33 [13:45:33.125] INFO: prover-node:prover-node Stopping ProverNode 13:45:33 [13:45:33.125] WARN: prover-node:prover-node Running promise was not started 13:45:33 [13:45:33.125] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 13:45:33 [13:45:33.125] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 13:45:33 [13:45:33.125] WARN: archiver:prover-node Running promise was not started 13:45:33 [13:45:33.125] INFO: archiver:prover-node Stopped. 13:45:33 [13:45:33.126] WARN: world-state:block_stream:prover-node Running promise was not started 13:45:33 [13:45:33.126] INFO: world_state:prover-node Stopped world state synchronizer 13:45:33 [13:45:33.126] INFO: prover-node:prover-node Stopped ProverNode 13:45:33 [13:45:33.171] INFO: blob-sink:server Stopping blob sink 13:45:33 [13:45:33.172] INFO: blob-sink:server Blob sink stopped 13:45:33 [13:45:33.192] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data and state {"uploadPath":"/tmp/failed-proofs-XTAwKW","rerunDataDir":"/tmp/rerun-data-F5R0f2","rerunDownloadPath":"/tmp/rerun-download-W7RsOH/data.bin"} 13:45:33 [13:45:33.193] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data from file:///tmp/failed-proofs-XTAwKW/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612134522-89a1a84d-2b56-46c3-b092-f534e3e93c0e 13:45:33 [13:45:33.194] INFO: stdlib:file-store Creating local file file store at /tmp/failed-proofs-XTAwKW/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612134522-89a1a84d-2b56-46c3-b092-f534e3e93c0e 13:45:33 [13:45:33.197] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading state snapshot from file:///tmp/failed-proofs-XTAwKW/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612134522-89a1a84d-2b56-46c3-b092-f534e3e93c0e to local data directory {"metadata":{"l2BlockNumber":2,"l2BlockHash":"0x2b74dff8de77ca3bfaea7c986832c28ff6e9c91850baf23e9d5dfc741c8456f1","l1BlockNumber":10,"l1ChainId":31337,"rollupVersion":1849448694,"rollupAddress":"0x16d1d277f9340c50e1c7a9916ab994247a68af9f"},"dataUrls":{"archiver":"file:///tmp/failed-proofs-XTAwKW/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612134522-89a1a84d-2b56-46c3-b092-f534e3e93c0e/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-XTAwKW/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612134522-89a1a84d-2b56-46c3-b092-f534e3e93c0e/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-XTAwKW/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612134522-89a1a84d-2b56-46c3-b092-f534e3e93c0e/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-XTAwKW/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612134522-89a1a84d-2b56-46c3-b092-f534e3e93c0e/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-XTAwKW/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612134522-89a1a84d-2b56-46c3-b092-f534e3e93c0e/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-XTAwKW/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612134522-89a1a84d-2b56-46c3-b092-f534e3e93c0e/l1-to-l2-message-tree.db"}} 13:45:33 [13:45:33.198] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Creating local file file store at /tmp/failed-proofs-XTAwKW/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612134522-89a1a84d-2b56-46c3-b092-f534e3e93c0e 13:45:33 [13:45:33.199] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading snapshot to /tmp/rerun-data-F5R0f2/download-tW7OfT {"snapshot":{"dataUrls":{"archiver":"file:///tmp/failed-proofs-XTAwKW/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612134522-89a1a84d-2b56-46c3-b092-f534e3e93c0e/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-XTAwKW/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612134522-89a1a84d-2b56-46c3-b092-f534e3e93c0e/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-XTAwKW/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612134522-89a1a84d-2b56-46c3-b092-f534e3e93c0e/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-XTAwKW/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612134522-89a1a84d-2b56-46c3-b092-f534e3e93c0e/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-XTAwKW/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612134522-89a1a84d-2b56-46c3-b092-f534e3e93c0e/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-XTAwKW/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612134522-89a1a84d-2b56-46c3-b092-f534e3e93c0e/l1-to-l2-message-tree.db"}},"downloadPaths":{"archiver":"/tmp/rerun-data-F5R0f2/download-tW7OfT/archiver.db","nullifier-tree":"/tmp/rerun-data-F5R0f2/download-tW7OfT/nullifier-tree.db","public-data-tree":"/tmp/rerun-data-F5R0f2/download-tW7OfT/public-data-tree.db","note-hash-tree":"/tmp/rerun-data-F5R0f2/download-tW7OfT/note-hash-tree.db","archive-tree":"/tmp/rerun-data-F5R0f2/download-tW7OfT/archive-tree.db","l1-to-l2-message-tree":"/tmp/rerun-data-F5R0f2/download-tW7OfT/l1-to-l2-message-tree.db"}} 13:45:33 [13:45:33.208] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Snapshot downloaded at /tmp/rerun-data-F5R0f2/download-tW7OfT {"snapshot":{"dataUrls":{"archiver":"file:///tmp/failed-proofs-XTAwKW/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612134522-89a1a84d-2b56-46c3-b092-f534e3e93c0e/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-XTAwKW/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612134522-89a1a84d-2b56-46c3-b092-f534e3e93c0e/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-XTAwKW/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612134522-89a1a84d-2b56-46c3-b092-f534e3e93c0e/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-XTAwKW/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612134522-89a1a84d-2b56-46c3-b092-f534e3e93c0e/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-XTAwKW/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612134522-89a1a84d-2b56-46c3-b092-f534e3e93c0e/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-XTAwKW/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612134522-89a1a84d-2b56-46c3-b092-f534e3e93c0e/l1-to-l2-message-tree.db"}},"downloadPaths":{"archiver":"/tmp/rerun-data-F5R0f2/download-tW7OfT/archiver.db","nullifier-tree":"/tmp/rerun-data-F5R0f2/download-tW7OfT/nullifier-tree.db","public-data-tree":"/tmp/rerun-data-F5R0f2/download-tW7OfT/public-data-tree.db","note-hash-tree":"/tmp/rerun-data-F5R0f2/download-tW7OfT/note-hash-tree.db","archive-tree":"/tmp/rerun-data-F5R0f2/download-tW7OfT/archive-tree.db","l1-to-l2-message-tree":"/tmp/rerun-data-F5R0f2/download-tW7OfT/l1-to-l2-message-tree.db"}} 13:45:33 [13:45:33.215] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Archiver database set up from snapshot {"path":"/tmp/rerun-data-F5R0f2/archiver","dbVersion":2,"rollupAddress":"0x16d1d277f9340c50e1c7a9916ab994247a68af9f"} 13:45:33 [13:45:33.216] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database l1-to-l2-message-tree set up from snapshot {"path":"/tmp/rerun-data-F5R0f2/world_state/L1ToL2MessageTree","dbVersion":1,"rollupAddress":"0x16d1d277f9340c50e1c7a9916ab994247a68af9f"} 13:45:33 [13:45:33.217] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database archive-tree set up from snapshot {"path":"/tmp/rerun-data-F5R0f2/world_state/ArchiveTree","dbVersion":1,"rollupAddress":"0x16d1d277f9340c50e1c7a9916ab994247a68af9f"} 13:45:33 [13:45:33.217] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database public-data-tree set up from snapshot {"path":"/tmp/rerun-data-F5R0f2/world_state/PublicDataTree","dbVersion":1,"rollupAddress":"0x16d1d277f9340c50e1c7a9916ab994247a68af9f"} 13:45:33 [13:45:33.218] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database note-hash-tree set up from snapshot {"path":"/tmp/rerun-data-F5R0f2/world_state/NoteHashTree","dbVersion":1,"rollupAddress":"0x16d1d277f9340c50e1c7a9916ab994247a68af9f"} 13:45:33 [13:45:33.218] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database nullifier-tree set up from snapshot {"path":"/tmp/rerun-data-F5R0f2/world_state/NullifierTree","dbVersion":1,"rollupAddress":"0x16d1d277f9340c50e1c7a9916ab994247a68af9f"} 13:45:33 [13:45:33.218] INFO: e2e:e2e_epochs:epochs_upload_failed_proof P2P database cleared {"path":"/tmp/rerun-data-F5R0f2/p2p"} 13:45:33 [13:45:33.221] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data from file:///tmp/failed-proofs-XTAwKW/aztec-31337-1849448694-0x16d1d277f9340c50e1c7a9916ab994247a68af9f/0-20250612134522-89a1a84d-2b56-46c3-b092-f534e3e93c0e/data.bin to /tmp/rerun-download-W7RsOH/data.bin 13:45:33 [13:45:33.223] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Epoch proving job data for epoch 0 downloaded successfully 13:45:33 [13:45:33.223] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Rerunning proving job from /tmp/rerun-download-W7RsOH/data.bin 13:45:33 [13:45:33.224] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Using native ACVM binary at ../../noir/noir-repo/target/release/acvm with working directory /tmp/f730770c/acvm 13:45:33 [13:45:33.225] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Loaded proving job data for epoch 0 13:45:33 [13:45:33.234] INFO: world-state:database Creating world state data store at directory /tmp/rerun-data-F5R0f2/world_state with map sizes {"archiveTreeMapSizeKb":1048576,"nullifierTreeMapSizeKb":1048576,"noteHashTreeMapSizeKb":1048576,"messageTreeMapSizeKb":1048576,"publicDataTreeMapSizeKb":1048576} and 2 threads. 13:45:33 [13:45:33.270] INFO: archiver:lmdb Creating archiver data store at directory /tmp/rerun-data-F5R0f2/archiver with map size 1048576 KB (LMDB v2) 13:45:33 [13:45:33.272] INFO: archiver:lmdb Starting data store with maxReaders 16 13:45:33 [13:45:33.277] WARN: prover-client:proving-broker-database Found invalid epoch directory /tmp/rerun-data-F5R0f2/archiver when loading epoch databases, ignoring 13:45:33 [13:45:33.277] WARN: prover-client:proving-broker-database Found invalid epoch directory /tmp/rerun-data-F5R0f2/world_state when loading epoch databases, ignoring 13:45:33 [13:45:33.278] INFO: prover-client:proving-broker Proving Broker started 13:45:33 [13:45:33.279] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Rerunning epoch proving job for epoch 0 13:45:33 [13:45:33.279] INFO: prover-node:epoch-proving-job Starting epoch 0 proving job with blocks 1 to 2 {"fromBlock":1,"toBlock":2,"epochSizeBlocks":2,"epochNumber":0,"uuid":"e75c916b-8b80-4cc7-9854-274c379985a4"} 13:45:33 [13:45:33.312] INFO: prover-client:orchestrator Starting epoch 0 with 2 blocks 13:45:33 [13:45:33.312] VERBOSE: prover-client:broker-circuit-prover-facade Starting BrokerCircuitProverFacade 13:45:33 [13:45:33.314] VERBOSE: prover-node:epoch-proving-job Starting processing block 1 {"number":1,"blockHash":"0x06168dbe6f99bd847785b9ea87ffdea24e325aafd63aa3a9b598d14fa382d35b","lastArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"e75c916b-8b80-4cc7-9854-274c379985a4","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x000000000000000000000000000000000000000000000000000000006e3c58f6","blockNumber":"0x0000000000000000000000000000000000000000000000000000000000000001","slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 13:45:33 [13:45:33.314] INFO: prover-client:orchestrator Starting block 1 for slot 2 13:45:33 [13:45:33.315] VERBOSE: prover-node:epoch-proving-job Starting processing block 2 {"number":2,"blockHash":"0x2b74dff8de77ca3bfaea7c986832c28ff6e9c91850baf23e9d5dfc741c8456f1","lastArchive":"0x11bc6d9587ed2ae44a6cc23757f25f11aa46e01d7a70d6b263f2751e4b9c36f4","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"e75c916b-8b80-4cc7-9854-274c379985a4","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x000000000000000000000000000000000000000000000000000000006e3c58f6","blockNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000003","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 13:45:33 [13:45:33.315] INFO: prover-client:orchestrator Starting block 2 for slot 3 13:45:33 [13:45:33.336] INFO: prover-client:proving-broker New proving job id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff epochNumber=0 {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff"} 13:45:33 [13:45:33.337] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff","provingJobType":"BASE_PARITY"} 13:45:33 [13:45:33.337] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff","provingJobType":"BASE_PARITY"} 13:45:33 [13:45:33.338] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff","provingJobType":"BASE_PARITY"} 13:45:33 [13:45:33.339] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff","provingJobType":"BASE_PARITY"} 13:45:33 [13:45:33.339] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff","provingJobType":"BASE_PARITY"} 13:45:33 [13:45:33.339] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff","provingJobType":"BASE_PARITY"} 13:45:33 [13:45:33.340] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff","provingJobType":"BASE_PARITY"} 13:45:33 [13:45:33.350] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.00003657999999995809s {"duration":0.00003657999999995809,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 13:45:33 [13:45:33.351] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 13:45:33 [13:45:33.359] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 1 {"blockNumber":1,"blockHash":"0x06168dbe6f99bd847785b9ea87ffdea24e325aafd63aa3a9b598d14fa382d35b","uuid":"e75c916b-8b80-4cc7-9854-274c379985a4"} 13:45:33 [13:45:33.360] VERBOSE: prover-client:orchestrator Block 1 completed. Assembling header. 13:45:33 [13:45:33.361] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.00001726999999664258s {"duration":0.00001726999999664258,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 13:45:33 [13:45:33.361] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 13:45:33 [13:45:33.361] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 2 {"blockNumber":2,"blockHash":"0x2b74dff8de77ca3bfaea7c986832c28ff6e9c91850baf23e9d5dfc741c8456f1","uuid":"e75c916b-8b80-4cc7-9854-274c379985a4"} 13:45:33 [13:45:33.362] VERBOSE: prover-client:orchestrator Block 2 completed. Assembling header. 13:45:33 [13:45:33.373] VERBOSE: prover-client:orchestrator Updating archive tree with block 1 header 0x06168dbe6f99bd847785b9ea87ffdea24e325aafd63aa3a9b598d14fa382d35b 13:45:33 [13:45:33.383] VERBOSE: prover-client:orchestrator Updating archive tree with block 2 header 0x2b74dff8de77ca3bfaea7c986832c28ff6e9c91850baf23e9d5dfc741c8456f1 13:45:33 [13:45:33.385] VERBOSE: prover-client:orchestrator Orchestrator finalised block 1 13:45:33 [13:45:33.401] INFO: prover-client:proving-broker-database Creating broker database for epoch 0 at /tmp/rerun-data-F5R0f2/0 with map size 1048576 13:45:33 [13:45:33.402] VERBOSE: prover-client:orchestrator Orchestrator finalised block 2 13:45:33 [13:45:33.437] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 13:45:33 [13:45:33.447] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY epochNumber=0 {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff","provingJobType":"BASE_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...","status":"not-found","numOutstandingJobs":1} 13:45:33 [13:45:33.486] INFO: prover-client:proving-agent Starting job id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input... 13:45:33 [13:45:33.487] INFO: prover-client:proving-agent:job-controller-5a82319d Job controller started jobId=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff {"jobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff"} 13:45:33 [13:45:33.615] INFO: prover-client:proving-agent Job id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22resul... 13:45:33 [13:45:33.618] INFO: prover-client:proving-broker Proving job complete id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY totalAttempts=1 {"provingJobId":"0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff"} 13:45:34 [13:45:34.312] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 13:45:34 [13:45:34.314] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:BASE_PARITY:d7bbb975b9e5d8cc9d62127be10f54fe489e3357dac18181bd3c8014e15832ff type=BASE_PARITY 13:45:34 [13:45:34.315] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 13:45:34 [13:45:34.328] INFO: prover-client:proving-broker New proving job id=0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac epochNumber=0 {"provingJobId":"0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac"} 13:45:34 [13:45:34.336] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac type=ROOT_PARITY {"provingJobId":"0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac","provingJobType":"ROOT_PARITY"} 13:45:34 [13:45:34.381] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac type=ROOT_PARITY epochNumber=0 {"provingJobId":"0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac","provingJobType":"ROOT_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu...","status":"not-found","numOutstandingJobs":1} 13:45:34 [13:45:34.441] INFO: prover-client:proving-agent Starting job id=0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac type=ROOT_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu... 13:45:34 [13:45:34.470] INFO: prover-client:proving-agent:job-controller-63f5d2df Job controller started jobId=0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac {"jobId":"0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac"} 13:45:34 [13:45:34.616] INFO: prover-client:proving-agent Job id=0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac type=ROOT_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22resu... 13:45:34 [13:45:34.616] INFO: prover-client:proving-broker Proving job complete id=0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac type=ROOT_PARITY totalAttempts=1 {"provingJobId":"0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac"} 13:45:35 [13:45:35.316] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 13:45:35 [13:45:35.317] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:ROOT_PARITY:b99e517f568f699ebf92ba279240f8990e68cf8eeae0a51e6c495620a7fbbcac type=ROOT_PARITY 13:45:35 [13:45:35.318] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 13:45:35 [13:45:35.338] INFO: prover-client:proving-broker New proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:af953eec2caded4d2ebab19e14aa597535cc127ed5a687985ce70f71d5016ad8 epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:af953eec2caded4d2ebab19e14aa597535cc127ed5a687985ce70f71d5016ad8"} 13:45:35 [13:45:35.342] INFO: prover-client:proving-broker New proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:741eda597084712f73d72b9b9becb235afb61580844dba73c82f3d25ddc0ac16 epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:741eda597084712f73d72b9b9becb235afb61580844dba73c82f3d25ddc0ac16"} 13:45:35 [13:45:35.391] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:EMPTY_BLOCK_ROOT_ROLLUP:af953eec2caded4d2ebab19e14aa597535cc127ed5a687985ce70f71d5016ad8 type=EMPTY_BLOCK_ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:af953eec2caded4d2ebab19e14aa597535cc127ed5a687985ce70f71d5016ad8","provingJobType":"EMPTY_BLOCK_ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input...","status":"not-found","numOutstandingJobs":2} 13:45:35 [13:45:35.392] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:EMPTY_BLOCK_ROOT_ROLLUP:741eda597084712f73d72b9b9becb235afb61580844dba73c82f3d25ddc0ac16 type=EMPTY_BLOCK_ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:741eda597084712f73d72b9b9becb235afb61580844dba73c82f3d25ddc0ac16","provingJobType":"EMPTY_BLOCK_ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input...","status":"not-found","numOutstandingJobs":2} 13:45:35 [13:45:35.480] INFO: prover-client:proving-agent Starting job id=0:EMPTY_BLOCK_ROOT_ROLLUP:af953eec2caded4d2ebab19e14aa597535cc127ed5a687985ce70f71d5016ad8 type=EMPTY_BLOCK_ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input... 13:45:35 [13:45:35.492] INFO: prover-client:proving-agent:job-controller-a0d04346 Job controller started jobId=0:EMPTY_BLOCK_ROOT_ROLLUP:af953eec2caded4d2ebab19e14aa597535cc127ed5a687985ce70f71d5016ad8 {"jobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:af953eec2caded4d2ebab19e14aa597535cc127ed5a687985ce70f71d5016ad8"} 13:45:35 [13:45:35.494] INFO: prover-client:proving-agent Starting job id=0:EMPTY_BLOCK_ROOT_ROLLUP:741eda597084712f73d72b9b9becb235afb61580844dba73c82f3d25ddc0ac16 type=EMPTY_BLOCK_ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input... 13:45:35 [13:45:35.503] INFO: prover-client:proving-agent:job-controller-80c574ba Job controller started jobId=0:EMPTY_BLOCK_ROOT_ROLLUP:741eda597084712f73d72b9b9becb235afb61580844dba73c82f3d25ddc0ac16 {"jobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:741eda597084712f73d72b9b9becb235afb61580844dba73c82f3d25ddc0ac16"} 13:45:36 [13:45:36.658] INFO: prover-client:proving-agent Job id=0:EMPTY_BLOCK_ROOT_ROLLUP:af953eec2caded4d2ebab19e14aa597535cc127ed5a687985ce70f71d5016ad8 type=EMPTY_BLOCK_ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22resul... 13:45:36 [13:45:36.659] INFO: prover-client:proving-broker Proving job complete id=0:EMPTY_BLOCK_ROOT_ROLLUP:af953eec2caded4d2ebab19e14aa597535cc127ed5a687985ce70f71d5016ad8 type=EMPTY_BLOCK_ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:af953eec2caded4d2ebab19e14aa597535cc127ed5a687985ce70f71d5016ad8"} 13:45:37 [13:45:37.330] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 2, total jobs ready: 1 13:45:37 [13:45:37.335] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:af953eec2caded4d2ebab19e14aa597535cc127ed5a687985ce70f71d5016ad8 type=EMPTY_BLOCK_ROOT_ROLLUP 13:45:37 [13:45:37.335] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 13:45:38 [13:45:38.734] INFO: prover-client:proving-agent Job id=0:EMPTY_BLOCK_ROOT_ROLLUP:741eda597084712f73d72b9b9becb235afb61580844dba73c82f3d25ddc0ac16 type=EMPTY_BLOCK_ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22resul... 13:45:38 [13:45:38.735] INFO: prover-client:proving-broker Proving job complete id=0:EMPTY_BLOCK_ROOT_ROLLUP:741eda597084712f73d72b9b9becb235afb61580844dba73c82f3d25ddc0ac16 type=EMPTY_BLOCK_ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:741eda597084712f73d72b9b9becb235afb61580844dba73c82f3d25ddc0ac16"} 13:45:39 [13:45:39.337] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 13:45:39 [13:45:39.340] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:741eda597084712f73d72b9b9becb235afb61580844dba73c82f3d25ddc0ac16 type=EMPTY_BLOCK_ROOT_ROLLUP 13:45:39 [13:45:39.340] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 13:45:39 [13:45:39.354] INFO: prover-client:proving-broker New proving job id=0:ROOT_ROLLUP:979f814f5f4b046daf1d2e3c747048ab5e84bb90e833f8dee80f816d3ba0322b epochNumber=0 {"provingJobId":"0:ROOT_ROLLUP:979f814f5f4b046daf1d2e3c747048ab5e84bb90e833f8dee80f816d3ba0322b"} 13:45:39 [13:45:39.410] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_ROLLUP:979f814f5f4b046daf1d2e3c747048ab5e84bb90e833f8dee80f816d3ba0322b type=ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:ROOT_ROLLUP:979f814f5f4b046daf1d2e3c747048ab5e84bb90e833f8dee80f816d3ba0322b","provingJobType":"ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22input...","status":"not-found","numOutstandingJobs":1} 13:45:39 [13:45:39.460] INFO: prover-client:proving-agent Starting job id=0:ROOT_ROLLUP:979f814f5f4b046daf1d2e3c747048ab5e84bb90e833f8dee80f816d3ba0322b type=ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22input... 13:45:39 [13:45:39.483] INFO: prover-client:proving-agent:job-controller-0a044036 Job controller started jobId=0:ROOT_ROLLUP:979f814f5f4b046daf1d2e3c747048ab5e84bb90e833f8dee80f816d3ba0322b {"jobId":"0:ROOT_ROLLUP:979f814f5f4b046daf1d2e3c747048ab5e84bb90e833f8dee80f816d3ba0322b"} 13:45:39 [13:45:39.603] INFO: prover-client:proving-agent Job id=0:ROOT_ROLLUP:979f814f5f4b046daf1d2e3c747048ab5e84bb90e833f8dee80f816d3ba0322b type=ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22resul... 13:45:39 [13:45:39.603] INFO: prover-client:proving-broker Proving job complete id=0:ROOT_ROLLUP:979f814f5f4b046daf1d2e3c747048ab5e84bb90e833f8dee80f816d3ba0322b type=ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:ROOT_ROLLUP:979f814f5f4b046daf1d2e3c747048ab5e84bb90e833f8dee80f816d3ba0322b"} 13:45:40 [13:45:40.341] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 13:45:40 [13:45:40.347] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:ROOT_ROLLUP:979f814f5f4b046daf1d2e3c747048ab5e84bb90e833f8dee80f816d3ba0322b type=ROOT_ROLLUP 13:45:40 [13:45:40.347] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 13:45:40 [13:45:40.348] VERBOSE: prover-client:orchestrator Orchestrator completed root rollup for epoch 0 13:45:40 [13:45:40.351] INFO: prover-node:epoch-proving-job Finalised proof for epoch 0 {"epochNumber":0,"uuid":"e75c916b-8b80-4cc7-9854-274c379985a4","duration":7071.470071999996} 13:45:40 [13:45:40.351] INFO: prover-node:epoch-proving-job Submitted proof for epoch 0 (blocks 1 to 2) {"epochNumber":0,"uuid":"e75c916b-8b80-4cc7-9854-274c379985a4"} 13:45:40 [13:45:40.352] VERBOSE: prover-client:broker-circuit-prover-facade Stopping BrokerCircuitProverFacade 13:45:40 [13:45:40.352] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Completed job for epoch 0 with status completed 13:45:40 [13:45:40.352] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Test succeeded 13:45:40 [13:45:40.354] INFO: prover-node:prover-node Stopping ProverNode 13:45:40 [13:45:40.355] WARN: prover-node:prover-node Running promise was not started 13:45:40 [13:45:40.355] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 13:45:40 [13:45:40.355] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 13:45:40 [13:45:40.355] WARN: archiver:prover-node Running promise was not started 13:45:40 [13:45:40.355] INFO: archiver:prover-node Stopped. 13:45:40 [13:45:40.355] WARN: world-state:block_stream:prover-node Running promise was not started 13:45:40 [13:45:40.356] INFO: world_state:prover-node Stopped world state synchronizer 13:45:40 [13:45:40.356] INFO: prover-node:prover-node Stopped ProverNode 13:45:40 [13:45:40.356] INFO: node Stopping Aztec Node 13:45:42 [13:45:42.356] INFO: slasher Slasher client stopped. 13:45:42 [13:45:42.357] WARN: validator Running promise was not started 13:45:42 [13:45:42.357] WARN: sequencer Running promise was not started 13:45:42 [13:45:42.357] INFO: sequencer Stopped sequencer 13:45:42 [13:45:42.358] WARN: p2p:l2-block-stream Running promise was not started 13:45:42 [13:45:42.358] INFO: p2p P2P client stopped 13:45:42 [13:45:42.358] WARN: world-state:block_stream Running promise was not started 13:45:42 [13:45:42.358] INFO: world_state Stopped world state synchronizer 13:45:42 [13:45:42.358] WARN: archiver Running promise was not started 13:45:42 [13:45:42.359] INFO: archiver Stopped. 13:45:42 [13:45:42.359] INFO: node Stopped Aztec Node 13:45:42 [13:45:42.363] INFO: node Stopping Aztec Node 13:45:44 [13:45:44.364] INFO: slasher Slasher client stopped. 13:45:44 [13:45:44.365] WARN: validator Running promise was not started 13:45:44 [13:45:44.365] WARN: sequencer Running promise was not started 13:45:44 [13:45:44.365] INFO: sequencer Stopped sequencer 13:45:44 [13:45:44.365] WARN: p2p:l2-block-stream Running promise was not started 13:45:44 [13:45:44.365] INFO: p2p P2P client stopped 13:45:44 [13:45:44.365] WARN: world-state:block_stream Running promise was not started 13:45:44 [13:45:44.365] INFO: world_state Stopped world state synchronizer 13:45:44 [13:45:44.366] WARN: archiver Running promise was not started 13:45:44 [13:45:44.366] INFO: archiver Stopped. 13:45:44 [13:45:44.366] INFO: node Stopped Aztec Node 13:45:44 [13:45:44.366] INFO: prover-node:prover-node Stopping ProverNode 13:45:44 [13:45:44.366] WARN: prover-node:prover-node Running promise was not started 13:45:44 [13:45:44.366] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 13:45:44 [13:45:44.366] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 13:45:44 [13:45:44.366] WARN: archiver:prover-node Running promise was not started 13:45:44 [13:45:44.366] INFO: archiver:prover-node Stopped. 13:45:44 [13:45:44.367] WARN: world-state:block_stream:prover-node Running promise was not started 13:45:44 [13:45:44.367] INFO: world_state:prover-node Stopped world state synchronizer 13:45:44 [13:45:44.367] INFO: prover-node:prover-node Stopped ProverNode 13:45:44 [13:45:44.370] INFO: blob-sink:server Stopping blob sink 13:45:44 [13:45:44.371] INFO: blob-sink:server Blob sink already stopped 13:45:44 PASS src/e2e_epochs/epochs_upload_failed_proof.test.ts 13:45:44 e2e_epochs/epochs_upload_failed_proof 13:45:44 uploads failed proving job state and re-runs it on a fresh instance (95551 ms) 13:45:44 13:45:44 Test Suites: 1 passed, 1 total 13:45:44 Tests: 1 passed, 1 total 13:45:44 Snapshots: 0 total 13:45:44 Time: 103.965 s 13:45:44 Ran all test suites matching /src\/e2e_epochs\/epochs_upload_failed_proof.test.ts/i. 13:45:44 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?