Parent Log: http://ci.aztec-labs.com/d9cbe39da05505e1 Command: f682b45a820409ef:ISOLATE=1:NAME=e2e_epochs/epochs_upload_failed_proof yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_upload_failed_proof.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/c0e766a133071c44b2c0d8fac5df352c6e059df1 Env: REF_NAME=gh-readonly-queue/next/pr-15015-cf8be0f9e81e248048560619de041e90d9d6990a CURRENT_VERSION=0.87.6 CI_FULL=1 Date: Fri Jun 13 07:51:01 UTC 2025 System: ARCH=amd64 CPUS=128 MEM=493Gi HOSTNAME=pr-15015_amd64_x1-full Resources: CPU_LIST=0-127 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_476a42720cde10eb_next 07:51:01 +++ id -u 07:51:01 +++ id -g 07:51:01 ++ docker run -d --name e2e_epochs_epochs_upload_failed_proof --net=none --cpuset-cpus=0-127 --cpus=2 --memory=8g --user 1000:1000 -v/home/aztec-dev:/home/aztec-dev --mount type=tmpfs,target=/tmp,tmpfs-size=1g --workdir /home/aztec-dev/aztec-packages -e HOME -e VERBOSE -e GIT_CONFIG_GLOBAL=/home/aztec-dev/aztec-packages/build-images/src/home/.gitconfig -e FORCE_COLOR=true -e CPUS -e MEM aztecprotocol/build:3.0 /bin/bash -c 'timeout -v 600s bash -c '\''yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_upload_failed_proof.test.ts'\''' 07:51:01 + cid=3425c320d4d7c339cf8e6c9497deabfc7cb4c51c7f322bcaff364f9c50d21dfb 07:51:01 + set +x 07:51:02 {"level":25,"time":1749801062618,"pid":12,"hostname":"3425c320d4d7","module":"logger","msg":"Logger initialized with level verbose"} 07:51:10 [07:51:10.851] INFO: e2e:epochs_upload_failed_proof Running test: e2e_epochs/epochs_upload_failed_proof uploads failed proving job state and re-runs it on a fresh instance 07:51:11 [07:51:10.995] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Logging metrics to log/e2e_epochs_epochs_upload_failed_proof.jsonl 07:51:11 [07:51:11.258] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Calling anvil_setBlockTimestampInterval with params: [8] 07:51:11 [07:51:11.293] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Set block interval to 8 07:51:11 [07:51:11.294] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contracts from 0xf39Fd6e51aad88F6F4ce6aB8827279cffFb92266 07:51:11 [07:51:11.387] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xff8f3047f70ec9e63079d7903c02a47802dc292d5660d2da825ac209bbd9cd89 {"gasLimit":867658,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 07:51:11 [07:51:11.391] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xd8B56421e9b573AE62f2997B7b58858a4413A967 in tx 0xff8f3047f70ec9e63079d7903c02a47802dc292d5660d2da825ac209bbd9cd89. 07:51:11 [07:51:11.394] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Fee Asset at 0xd8b56421e9b573ae62f2997b7b58858a4413a967 07:51:11 [07:51:11.425] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xb8a727e5dcee31d2ee7a6a94b8b01df7952fdc685dfb1b5bb36a0dbda9d08d89 {"gasLimit":867644,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 07:51:11 [07:51:11.427] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x026208feE3F4461826C8838C3569272E8C08E131 in tx 0xb8a727e5dcee31d2ee7a6a94b8b01df7952fdc685dfb1b5bb36a0dbda9d08d89. 07:51:11 [07:51:11.429] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Staking Asset at 0x026208fee3f4461826c8838c3569272e8c08e131 07:51:11 [07:51:11.463] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x84345970a64bc89d244665c6d19bcf62f7a1fb0c5497fd61c66569ea96442f1f {"gasLimit":3118894,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 07:51:11 [07:51:11.464] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xad2120681B02De3e9b8aFd325977CDeDDf15f01C in tx 0x84345970a64bc89d244665c6d19bcf62f7a1fb0c5497fd61c66569ea96442f1f. 07:51:11 [07:51:11.465] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed GSE at 0xad2120681b02de3e9b8afd325977cdeddf15f01c 07:51:11 [07:51:11.494] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x96c1e759b945754976d026659a519c1c5d05a738916e69d742cdec67a5482765 {"gasLimit":1030513,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 07:51:11 [07:51:11.494] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x992D1f24CC5f368188d936cf0b2A111cEE586d4e in tx 0x96c1e759b945754976d026659a519c1c5d05a738916e69d742cdec67a5482765. 07:51:11 [07:51:11.495] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Registry at 0x992d1f24cc5f368188d936cf0b2a111cee586d4e 07:51:11 [07:51:11.541] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x35838f7740ede8daad92b7b8589b59625f0100193e252bc6ce3862a65d23892c {"gasLimit":1998672,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 07:51:11 [07:51:11.543] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xfDB60896B1920A10Fd3AA268A292E51ebD5568A8 in tx 0x35838f7740ede8daad92b7b8589b59625f0100193e252bc6ce3862a65d23892c. 07:51:11 [07:51:11.544] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed GovernanceProposer at 0xfdb60896b1920a10fd3aa268a292e51ebd5568a8 07:51:11 [07:51:11.586] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x4dbcecd47a2081d10a38e4cf385714d92e542e5a44eb5a37a3810c6c6738dc4e {"gasLimit":3092007,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 07:51:11 [07:51:11.587] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x506150CaB49DBC09C8B79D20ac5c79CA28220AEA in tx 0x4dbcecd47a2081d10a38e4cf385714d92e542e5a44eb5a37a3810c6c6738dc4e. 07:51:11 [07:51:11.588] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Governance at 0x506150cab49dbc09c8b79d20ac5c79ca28220aea 07:51:11 [07:51:11.602] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xf2ecc0d2040ae9928a4b186c21f02e611c2904f24b196eed69d646e9333cc00d {"gasLimit":100000,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 07:51:11 [07:51:11.603] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Set governance on GSE in 0xf2ecc0d2040ae9928a4b186c21f02e611c2904f24b196eed69d646e9333cc00d 07:51:11 [07:51:11.648] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x77f9fa97fbbcb04392e88d456c198520b3425518c3d2d4146393099192372448 {"gasLimit":397390,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 07:51:11 [07:51:11.648] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x1649EeAD62C64Db7F63182989C8c41Ab25025C21 in tx 0x77f9fa97fbbcb04392e88d456c198520b3425518c3d2d4146393099192372448. 07:51:11 [07:51:11.649] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed CoinIssuer at 0x1649eead62c64db7f63182989c8c41ab25025c21 07:51:11 [07:51:11.650] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for deployments to complete 07:51:11 [07:51:11.650] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 7 transactions to be mined... 07:51:19 [07:51:19.726] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 07:51:19 [07:51:19.778] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xc033579f2357cfd2f6fa38d1ef9986415f4ed794add3fff64984bc3f1257e970 {"gasLimit":100000,"maxFeePerGas":"3.04180664","maxPriorityFeePerGas":"1.44"} 07:51:19 [07:51:19.779] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added coin issuer 0x1649eead62c64db7f63182989c8c41ab25025c21 as minter on fee asset in 0xc033579f2357cfd2f6fa38d1ef9986415f4ed794add3fff64984bc3f1257e970 07:51:19 [07:51:19.869] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xd6a54e4eed6f07d2b8dcaafbd3883b3558583e43612f444af113d489245a2bb1 {"gasLimit":56661,"maxFeePerGas":"3.04180664","maxPriorityFeePerGas":"1.44"} 07:51:19 [07:51:19.976] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xa67ff7f4001dc5703375e116caba00222d15ec13472e10af8018f62318b463cb {"gasLimit":344517,"maxFeePerGas":"3.04180664","maxPriorityFeePerGas":"1.44"} 07:51:19 [07:51:19.977] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x3607dbAfDe17871E0D6A8f929151C30b83510D39 in tx 0xa67ff7f4001dc5703375e116caba00222d15ec13472e10af8018f62318b463cb. 07:51:19 [07:51:19.978] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed FeeAssetHandler at 0x3607dbafde17871e0d6a8f929151c30b83510d39 07:51:20 [07:51:20.011] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xa32bc1b02f5f02b41626611ec0e0056cad989330fbf908181b5d4f7678377aae {"gasLimit":56804,"maxFeePerGas":"3.04180664","maxPriorityFeePerGas":"1.44"} 07:51:20 [07:51:20.011] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added fee asset handler 0x3607dbafde17871e0d6a8f929151c30b83510d39 as minter on fee asset in 0xa32bc1b02f5f02b41626611ec0e0056cad989330fbf908181b5d4f7678377aae 07:51:20 [07:51:20.050] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xadb884185b00b3cf3fb2aac4753fbbc2bbb58dfbab2a937d61ea0e950d96b91b {"gasLimit":2514669,"maxFeePerGas":"3.04180664","maxPriorityFeePerGas":"1.44"} 07:51:20 [07:51:20.051] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x499C89D6b68cBdcA67C96Bff13Eb5B5a8fDb25a2 in tx 0xadb884185b00b3cf3fb2aac4753fbbc2bbb58dfbab2a937d61ea0e950d96b91b. 07:51:20 [07:51:20.052] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed StakingAssetHandler at 0x499c89d6b68cbdca67c96bff13eb5b5a8fdb25a2 07:51:20 [07:51:20.068] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x2b32bbf996c6d3500330bc3ce74137b03f19074efe8ad0d3e14e6dea009f12e4 {"gasLimit":56804,"maxFeePerGas":"3.04180664","maxPriorityFeePerGas":"1.44"} 07:51:20 [07:51:20.068] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added staking asset handler 0x499c89d6b68cbdca67c96bff13eb5b5a8fdb25a2 as minter on staking asset in 0x2b32bbf996c6d3500330bc3ce74137b03f19074efe8ad0d3e14e6dea009f12e4 07:51:20 [07:51:20.068] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for deployments to complete 07:51:20 [07:51:20.068] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 9 transactions to be mined... 07:51:28 [07:51:28.095] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 07:51:28 [07:51:28.121] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed shared contracts 07:51:28 [07:51:28.172] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x1f3bf003fea3920e27f0ab1b5a7c080b356836c498ba06ccbbb2f38e05cac9a5 {"gasLimit":84823,"maxFeePerGas":"3.2549605","maxPriorityFeePerGas":"1.728"} 07:51:28 [07:51:28.173] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Funded reward distributor with 10000000000000000000000000 fee asset in 0x1f3bf003fea3920e27f0ab1b5a7c080b356836c498ba06ccbbb2f38e05cac9a5 07:51:28 [07:51:28.227] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x8ddfc36dd291a7e69dbb1d1c4b25283f53b9e73f733772b984e1b7cef75ca71d {"gasLimit":154658,"maxFeePerGas":"3.2549605","maxPriorityFeePerGas":"1.728"} 07:51:28 [07:51:28.228] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x277E22B0C9698d7f2A1cD7C6d857511617587309 in tx 0x8ddfc36dd291a7e69dbb1d1c4b25283f53b9e73f733772b984e1b7cef75ca71d. 07:51:28 [07:51:28.229] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup will use the mock verifier at 0x277e22b0c9698d7f2a1cd7c6d857511617587309 07:51:28 [07:51:28.230] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup config args {"aztecSlotDuration":16,"aztecEpochDuration":4,"targetCommitteeSize":48,"aztecProofSubmissionWindow":7,"slashingQuorum":6,"slashingRoundSize":10,"manaTarget":10000000000,"provingCostPerMana":100,"rewardConfig":{"sequencerBps":5000,"increment":200000,"maxScore":5000000,"a":5000,"k":1000000,"minimum":100000}} 07:51:28 [07:51:28.277] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x1244dd983dfa48995970c0afd0fb79b5391ff919edd2ee7939902fc973eec3e1 {"gasLimit":86992,"maxFeePerGas":"3.2549605","maxPriorityFeePerGas":"1.728"} 07:51:28 [07:51:28.281] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xbba8820C80d584aEc2Cb092C3a0bE628aAB41fe3 in tx 0x1244dd983dfa48995970c0afd0fb79b5391ff919edd2ee7939902fc973eec3e1. 07:51:28 [07:51:28.328] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xc613ac3e45b25859ad92f225b053c859a6b60b0ddf525799f26696c2568a98fe {"gasLimit":5159372,"maxFeePerGas":"3.2549605","maxPriorityFeePerGas":"1.728"} 07:51:28 [07:51:28.328] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x95bA1C62f973621Af2A511A8010d3F1aC1062C33 in tx 0xc613ac3e45b25859ad92f225b053c859a6b60b0ddf525799f26696c2568a98fe. 07:51:28 [07:51:28.368] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x605c36a0608e211905ee60f09d2a342acfff4cfa28b000496717a06c835d1381 {"gasLimit":2478502,"maxFeePerGas":"3.2549605","maxPriorityFeePerGas":"1.728"} 07:51:28 [07:51:28.369] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xfF6eB969c88E1ba744A420c6E9a2C9e471dB1811 in tx 0x605c36a0608e211905ee60f09d2a342acfff4cfa28b000496717a06c835d1381. 07:51:28 [07:51:28.370] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Awaiting for linked libraries to be deployed 07:51:36 [07:51:36.505] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xc9ef6f8c7a94e0de2281f50860c31ad14c7c5b427f62214698462b45fe31ad73 {"gasLimit":10676151,"maxFeePerGas":"3.44200128","maxPriorityFeePerGas":"2.0736"} 07:51:36 [07:51:36.506] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xFcF6B62b78a1cae3CE50e9C3c0a4760fa347b430 in tx 0xc9ef6f8c7a94e0de2281f50860c31ad14c7c5b427f62214698462b45fe31ad73. 07:51:36 [07:51:36.506] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Rollup at 0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430 {"aztecSlotDuration":16,"aztecEpochDuration":4,"targetCommitteeSize":48,"aztecProofSubmissionWindow":7,"slashingQuorum":6,"slashingRoundSize":10,"manaTarget":10000000000,"provingCostPerMana":100,"rewardConfig":{"sequencerBps":5000,"increment":200000,"maxScore":5000000,"a":5000,"k":1000000,"minimum":100000}} 07:51:36 [07:51:36.509] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 11 transactions to be mined... 07:51:44 [07:51:44.533] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 07:51:44 [07:51:44.533] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof All core contracts have been deployed 07:51:44 [07:51:44.561] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x9248b4b3b47b341e610e3a46699dafb88d9df1f729791d2014b8ab214dba4de9 {"gasLimit":1056496,"maxFeePerGas":"3.760309518","maxPriorityFeePerGas":"2.48832"} 07:51:44 [07:51:44.562] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x3ACC88cB658DFc72a85B7eBAb545133fE3397087 in tx 0x9248b4b3b47b341e610e3a46699dafb88d9df1f729791d2014b8ab214dba4de9. 07:51:44 [07:51:44.562] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed SlashFactory at 0x3acc88cb658dfc72a85b7ebab545133fe3397087 07:51:44 [07:51:44.614] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x5819a256876ab8581d1fffeb6648985474f940ff2ce98a2e8d3d39a5f50c976b {"gasLimit":116846,"maxFeePerGas":"3.760309518","maxPriorityFeePerGas":"2.48832"} 07:51:44 [07:51:44.614] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Adding rollup 0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430 to registry 0x992d1f24cc5f368188d936cf0b2a111cee586d4e in tx 0x5819a256876ab8581d1fffeb6648985474f940ff2ce98a2e8d3d39a5f50c976b 07:51:44 [07:51:44.645] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xe4ea329536b578e0bc7aafc02e719f3f273130f1ade52d2238c8a02cda978b0c {"gasLimit":109478,"maxFeePerGas":"3.760309518","maxPriorityFeePerGas":"2.48832"} 07:51:44 [07:51:44.646] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Adding rollup 0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430 to GSE 0xad2120681b02de3e9b8afd325977cdeddf15f01c in tx 0xe4ea329536b578e0bc7aafc02e719f3f273130f1ade52d2238c8a02cda978b0c 07:51:52 [07:51:52.665] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 12 transactions to be mined... 07:51:52 [07:51:52.727] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 07:51:52 [07:51:52.740] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup deployed 07:51:52 [07:51:52.740] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for rollup and slash factory to be deployed 07:51:52 [07:51:52.740] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 12 transactions to be mined... 07:51:52 [07:51:52.794] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 07:51:52 [07:51:52.795] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof All transactions for L1 deployment have been mined 07:51:52 [07:51:52.824] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Aztec L1 contracts initialized {"registryAddress":"0x992d1f24cc5f368188d936cf0b2a111cee586d4e","governanceAddress":"0x506150cab49dbc09c8b79d20ac5c79ca28220aea","governanceProposerAddress":"0xfdb60896b1920a10fd3aa268a292e51ebd5568a8","rollupAddress":"0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430","inboxAddress":"0xb6c18a35bdc2ce3055e42679f9d134f3caca8f2f","outboxAddress":"0x8c25caf4cf46666436b838007351f13970f02de9","feeJuicePortalAddress":"0x889f29fd4ad8f9c8472aafb7c5f30b8d8815ce7e","feeJuiceAddress":"0xd8b56421e9b573ae62f2997b7b58858a4413a967","stakingAssetAddress":"0x026208fee3f4461826c8838c3569272e8c08e131","rewardDistributorAddress":"0xd462e23c2c8a9b4f83de76004a170d4cebb5d3e1","gseAddress":"0xad2120681b02de3e9b8afd325977cdeddf15f01c","coinIssuerAddress":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266"} 07:51:52 [07:51:52.824] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Handing over to governance 07:51:52 [07:51:52.829] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Calling evm_setNextBlockTimestamp with params: [1749801118] 07:51:52 [07:51:52.830] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Calling hardhat_mine with params: [1] 07:51:52 [07:51:52.838] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Jumped to slot 1 07:51:52 [07:51:52.852] INFO: aztecjs:utils:watcher Watcher not started because not auto mining 07:51:52 [07:51:52.852] INFO: telemetry:client Using NoopTelemetryClient 07:51:52 [07:51:52.855] INFO: kv-store:lmdb-v2:blob-sink Creating blob-sink data store at directory /tmp/9212dbb40ad644fe/blob-sink with map size 134217728 KB (LMDB v2) 07:51:52 [07:51:52.864] INFO: kv-store:lmdb-v2:blob-sink Starting data store with maxReaders 16 07:51:52 [07:51:52.876] INFO: blob-sink:server Server is running on http://localhost:34087 07:51:52 [07:51:52.877] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating and synching an aztec node... 07:51:52 [07:51:52.880] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Using native ACVM binary at ../../noir/noir-repo/target/release/acvm with working directory /tmp/beacff85/acvm 07:51:52 [07:51:52.890] INFO: node:blob-sink:client Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:34087"} 07:51:52 [07:51:52.948] VERBOSE: node Snapshot sync is disabled. No snapshots URL provided. 07:51:52 [07:51:52.948] INFO: archiver:lmdb Creating archiver data store at directory /tmp/9212dbb40ad644fe/archiver with map size 134217728 KB (LMDB v2) 07:51:52 [07:51:52.950] INFO: archiver:lmdb Starting data store with maxReaders 16 07:51:53 [07:51:53.940] INFO: node:blob-sink:client Testing configured blob sources {"blobSinkUrl":"http://localhost:34087"} 07:51:53 [07:51:53.967] INFO: node:blob-sink:client Blob sink is reachable {"blobSinkUrl":"http://localhost:34087"} 07:51:53 [07:51:53.968] WARN: node:blob-sink:client No L1 consensus host urls configured 07:51:53 [07:51:53.968] WARN: node:blob-sink:client No archive client configured 07:51:53 [07:51:53.972] INFO: archiver Starting archiver sync to rollup contract 0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430 from L1 block 4 to current L1 block 6 with hash 0xa690b68f6c29d60cc49ddd2333c614a549b113b69c6d48b0ffbad3a638e5db87 {"blocksSynchedTo":4,"messagesSynchedTo":{"l1BlockHash":"0x462b54fb4e2053ad645303941121bb247ffcaefd7379a74f7f9dc2dcdb39cb1b","l1BlockNumber":4}} 07:51:54 [07:51:54.003] INFO: archiver Initial archiver sync to L1 block 6 complete. {"l1BlockNumber":6,"syncPoint":{"blocksSynchedTo":6,"messagesSynchedTo":{"l1BlockHash":"0xa690b68f6c29d60cc49ddd2333c614a549b113b69c6d48b0ffbad3a638e5db87","l1BlockNumber":6}},"latest":{"number":0},"proven":{"number":0},"finalized":{"number":0}} 07:51:54 [07:51:54.025] INFO: world-state:database Creating world state data store at directory /tmp/9212dbb40ad644fe/world_state with map sizes {"archiveTreeMapSizeKb":134217728,"nullifierTreeMapSizeKb":134217728,"noteHashTreeMapSizeKb":134217728,"messageTreeMapSizeKb":134217728,"publicDataTreeMapSizeKb":134217728} and 2 threads. 07:51:54 [07:51:54.065] INFO: world_state Created world state synchroniser with block history of 2 07:51:54 [07:51:54.065] WARN: node Aztec node is accepting fake proofs 07:51:54 [07:51:54.078] INFO: p2p:lmdb-v2 Creating p2p data store at directory /tmp/9212dbb40ad644fe/p2p with map size 134217728 KB (LMDB v2) 07:51:54 [07:51:54.080] INFO: p2p:lmdb-v2 Starting data store with maxReaders 16 07:51:54 [07:51:54.083] INFO: p2p-archive:lmdb-v2 Creating p2p-archive data store at directory /tmp/9212dbb40ad644fe/p2p-archive with map size 134217728 KB (LMDB v2) 07:51:54 [07:51:54.085] INFO: p2p-archive:lmdb-v2 Starting data store with maxReaders 16 07:51:54 [07:51:54.087] INFO: p2p-peer:lmdb-v2 Creating p2p-peers data store at directory /tmp/9212dbb40ad644fe/p2p-peers with map size 134217728 KB (LMDB v2) 07:51:54 [07:51:54.088] INFO: p2p-peer:lmdb-v2 Starting data store with maxReaders 16 07:51:54 [07:51:54.090] INFO: p2p:tx_pool Setting maximum tx mempool size {"maxTxPoolSize":100000000} 07:51:54 [07:51:54.091] VERBOSE: p2p P2P is disabled. Using dummy P2P service 07:51:54 [07:51:54.094] VERBOSE: world-state:block_stream Starting L2 block stream {"proven":false,"pollIntervalMS":50} 07:51:54 [07:51:54.095] INFO: world_state Started world state synchronizer from block 1 07:51:54 [07:51:54.097] VERBOSE: world-state:block_stream Starting sync from block number 0 07:51:54 [07:51:54.098] INFO: p2p Starting p2p client from block 0 with empty mempools 07:51:54 [07:51:54.099] VERBOSE: p2p:l2-block-stream Starting L2 block stream {"batchSize":20,"pollIntervalMS":100,"startingBlock":0} 07:51:54 [07:51:54.471] INFO: epoch-prune-watcher EpochPruneWatcher initialized 07:51:54 [07:51:54.515] VERBOSE: validator Initialized validator with addresses: 0x47f502bb841802f9e1012b84bbf04c58e99b290a 07:51:54 [07:51:54.516] VERBOSE: node All Aztec Node subsystems synced 07:51:54 [07:51:54.532] INFO: slasher Starting Slasher client... 07:51:54 [07:51:54.539] VERBOSE: p2p:l2-block-stream Starting sync from block number 0 07:51:54 [07:51:54.542] INFO: sequencer-client Deploying forwarder contract 07:51:54 [07:51:54.567] VERBOSE: sequencer-client Sent L1 transaction 0x3e1ef8d23ca5a131e6a5da8b4a3fb4e426e92bd5eb69ea0c6492670affab3fb2 {"gasLimit":323704,"maxFeePerGas":"2.265827991","maxPriorityFeePerGas":"1.2"} 07:51:54 [07:51:54.567] VERBOSE: sequencer-client Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000042 to address 0x0fe4d493871B0C51332De8A330B02BA8172Da4aC in tx 0x3e1ef8d23ca5a131e6a5da8b4a3fb4e426e92bd5eb69ea0c6492670affab3fb2. 07:52:02 [07:52:02.585] INFO: sequencer-client Forwarder contract deployed at 0x0fe4d493871b0c51332de8a330b02ba8172da4ac 07:52:02 [07:52:02.604] INFO: validator Started validator with addresses: 0x47f502bb841802f9e1012b84bbf04c58e99b290a 07:52:02 [07:52:02.605] VERBOSE: validator Validators 0x47f502bb841802f9e1012b84bbf04c58e99b290a are not on the validator committee for epoch 0 07:52:02 [07:52:02.605] INFO: sequencer Sequencer config set {"transactionPollingIntervalMS":500,"maxTxsPerBlock":32,"minTxsPerBlock":0,"maxL2BlockGas":10000000000,"publishTxsWithProposals":false,"maxDABlockGas":10000000000,"acvmWorkingDirectory":"/tmp/beacff85/acvm","acvmBinaryPath":"../../noir/noir-repo/target/release/acvm","maxBlockSizeInBytes":1048576,"governanceProposerPayload":"0x0000000000000000000000000000000000000000","maxL1TxInclusionTimeIntoSlot":8,"enforceTimeTable":false} 07:52:02 [07:52:02.606] VERBOSE: sequencer Sequencer timetable updated {"enforceTimeTable":false} 07:52:02 [07:52:02.609] INFO: sequencer Sequencer started with address 0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266 07:52:02 [07:52:02.610] INFO: node Aztec Node version: 0.87.6 07:52:02 [07:52:02.611] INFO: node Aztec Node started on chain 0x7a69 {"registryAddress":"0x992d1f24cc5f368188d936cf0b2a111cee586d4e","governanceAddress":"0x506150cab49dbc09c8b79d20ac5c79ca28220aea","governanceProposerAddress":"0xfdb60896b1920a10fd3aa268a292e51ebd5568a8","rollupAddress":"0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430","inboxAddress":"0xb6c18a35bdc2ce3055e42679f9d134f3caca8f2f","outboxAddress":"0x8c25caf4cf46666436b838007351f13970f02de9","feeJuicePortalAddress":"0x889f29fd4ad8f9c8472aafb7c5f30b8d8815ce7e","feeJuiceAddress":"0xd8b56421e9b573ae62f2997b7b58858a4413a967","stakingAssetAddress":"0x026208fee3f4461826c8838c3569272e8c08e131","rewardDistributorAddress":"0xd462e23c2c8a9b4f83de76004a170d4cebb5d3e1","gseAddress":"0xad2120681b02de3e9b8afd325977cdeddf15f01c","coinIssuerAddress":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","slashFactoryAddress":"0x3acc88cb658dfc72a85b7ebab545133fe3397087","feeAssetHandlerAddress":"0x3607dbafde17871e0d6a8f929151c30b83510d39","stakingAssetHandlerAddress":"0x499c89d6b68cbdca67c96bff13eb5b5a8fdb25a2","zkPassportVerifierAddress":"0xee9f10f38319eae2730dba28fb09081db806c5e5"} 07:52:02 [07:52:02.612] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating and syncing a simulated prover node... 07:52:02 [07:52:02.693] INFO: blob-sink:client:prover-node Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:34087"} 07:52:02 [07:52:02.719] INFO: archiver:lmdb:prover-node Creating archiver data store at directory /tmp/9212dbb40ad644fe/3d099d8a2746afd6/archiver with map size 134217728 KB (LMDB v2) 07:52:02 [07:52:02.727] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 07:52:02 [07:52:02.733] INFO: archiver:lmdb:prover-node Starting data store with maxReaders 16 07:52:03 [07:52:03.155] INFO: blob-sink:client:prover-node Testing configured blob sources {"blobSinkUrl":"http://localhost:34087"} 07:52:03 [07:52:03.159] INFO: blob-sink:client:prover-node Blob sink is reachable {"blobSinkUrl":"http://localhost:34087"} 07:52:03 [07:52:03.160] WARN: blob-sink:client:prover-node No L1 consensus host urls configured 07:52:03 [07:52:03.160] WARN: blob-sink:client:prover-node No archive client configured 07:52:03 [07:52:03.167] INFO: archiver:prover-node Starting archiver sync to rollup contract 0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430 from L1 block 4 to current L1 block 7 with hash 0x35a9d99bb9555d05ae5a60301d872e63d63385cdccfb63c265d3343702c70823 {"blocksSynchedTo":4,"messagesSynchedTo":{"l1BlockHash":"0x462b54fb4e2053ad645303941121bb247ffcaefd7379a74f7f9dc2dcdb39cb1b","l1BlockNumber":4}} 07:52:03 [07:52:03.183] INFO: archiver:prover-node Initial archiver sync to L1 block 7 complete. {"l1BlockNumber":7,"syncPoint":{"blocksSynchedTo":7,"messagesSynchedTo":{"l1BlockHash":"0x35a9d99bb9555d05ae5a60301d872e63d63385cdccfb63c265d3343702c70823","l1BlockNumber":7}},"latest":{"number":0},"proven":{"number":0},"finalized":{"number":0}} 07:52:03 [07:52:03.186] INFO: prover-node:blob-sink:client:prover-node Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:34087"} 07:52:03 [07:52:03.186] VERBOSE: prover-node:prover-node Snapshot sync is disabled. No snapshots URL provided. 07:52:03 [07:52:03.188] VERBOSE: prover-node:prover-node Created archiver and synced to block 0 07:52:03 [07:52:03.203] INFO: world-state:database:prover-node Creating world state data store at directory /tmp/9212dbb40ad644fe/3d099d8a2746afd6/world_state with map sizes {"archiveTreeMapSizeKb":134217728,"nullifierTreeMapSizeKb":134217728,"noteHashTreeMapSizeKb":134217728,"messageTreeMapSizeKb":134217728,"publicDataTreeMapSizeKb":134217728} and 2 threads. 07:52:03 [07:52:03.252] INFO: world_state:prover-node Created world state synchroniser with block history of 2 07:52:03 [07:52:03.258] VERBOSE: world-state:block_stream:prover-node Starting L2 block stream {"proven":false,"pollIntervalMS":50} 07:52:03 [07:52:03.261] INFO: world_state:prover-node Started world state synchronizer from block 1 07:52:03 [07:52:03.264] VERBOSE: world-state:block_stream:prover-node Starting sync from block number 0 07:52:03 [07:52:03.265] WARN: prover-client:proving-broker-database:prover-node Found invalid epoch directory /tmp/9212dbb40ad644fe/3d099d8a2746afd6/archiver when loading epoch databases, ignoring 07:52:03 [07:52:03.265] WARN: prover-client:proving-broker-database:prover-node Found invalid epoch directory /tmp/9212dbb40ad644fe/3d099d8a2746afd6/world_state when loading epoch databases, ignoring 07:52:03 [07:52:03.267] INFO: prover-client:proving-broker:prover-node Proving Broker started 07:52:03 [07:52:03.281] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 07:52:03 [07:52:03.294] INFO: prover-node:prover-coordination:prover-node Using prover coordination via aztec node 07:52:03 [07:52:03.297] INFO: e2e:e2e_epochs:epochs_upload_failed_proof:prover-node Created and synced prover node {"publisherAddress":"0x3C44CdDdB6a900fa2b585dd299e03d12FA4293BC"} 07:52:03 [07:52:03.298] INFO: prover-node:epoch-monitor:prover-node Started EpochMonitor {"pollingIntervalMs":200} 07:52:03 [07:52:03.307] INFO: prover-node:prover-node Started Prover Node with prover id 0x0000000000000000000000000000000000000000000000000000000000000001 {"proverNodePollingIntervalMs":200,"proverNodeMaxPendingJobs":10,"proverNodeMaxParallelBlocksPerEpoch":32,"txGatheringIntervalMs":1000,"txGatheringBatchSize":10,"txGatheringMaxParallelRequestsPerNode":100,"proverNodeFailedEpochStore":"file:///tmp/failed-proofs-A9poSY","dataDirectory":"/tmp/9212dbb40ad644fe/3d099d8a2746afd6","l1ChainId":31337,"rollupVersion":3502789751} 07:52:03 [07:52:03.308] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating a pxe... 07:52:03 [07:52:03.324] INFO: pxe:data:lmdb Creating pxe_data data store at directory /tmp/ba9ff2e3e713e279/pxe_data with map size 134217728 KB (LMDB v2) 07:52:03 [07:52:03.327] INFO: pxe:data:lmdb Starting data store with maxReaders 16 07:52:03 [07:52:03.768] VERBOSE: pxe:service Registered protocol contracts in pxe {"AuthRegistry":"0x0000000000000000000000000000000000000000000000000000000000000001","ContractInstanceDeployer":"0x0000000000000000000000000000000000000000000000000000000000000002","ContractClassRegisterer":"0x0000000000000000000000000000000000000000000000000000000000000003","MultiCallEntrypoint":"0x0000000000000000000000000000000000000000000000000000000000000004","FeeJuice":"0x0000000000000000000000000000000000000000000000000000000000000005","Router":"0x0000000000000000000000000000000000000000000000000000000000000006"} 07:52:03 [07:52:03.769] INFO: pxe:service Started PXE connected to chain 31337 version 3502789751 07:52:03 [07:52:03.773] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L2 genesis at L1 block 4 (timestamp 1749801102) 07:52:03 [07:52:03.774] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting until L1 timestamp 1749801166 is reached as the start of epoch 1 07:52:03 [07:52:03.787] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 07:52:04 [07:52:04.037] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 7 mined at 07:52:06 with new L2 block 0 for epoch 0 with proof up to L2 block 0 for epoch 0 {"l1Timestamp":1749801126,"l1BlockNumber":7,"l2SlotNumber":1,"l2BlockNumber":0,"l2ProvenBlockNumber":0,"totalL2Messages":0} 07:52:04 [07:52:04.302] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 07:52:04 [07:52:04.847] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 07:52:05 [07:52:05.360] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 07:52:05 [07:52:05.879] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 07:52:06 [07:52:06.405] VERBOSE: sequencer Preparing proposal for block 1 at slot 2 {"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1749801134,"version":3502789751},"chainTipArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","blockNumber":1,"slot":2} 07:52:06 [07:52:06.428] VERBOSE: block-builder Building block 1 for slot 2 {"slot":2,"slotStart":"2025-06-13T07:52:14.000Z","now":"2025-06-13T07:52:06.428Z","blockNumber":1,"msgCount":0,"opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}} 07:52:06 [07:52:06.433] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.0005706710000013118s {"duration":0.0005706710000013118,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 07:52:06 [07:52:06.460] INFO: sequencer Built block 1 for slot 2 with 0 txs and 0 messages. 0 mana/s {"blockHash":"0x1d096b2b2b223ce5f618816274f4e2a13c8a10c34c3eb25b1df96781ed41c2d9","globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1749801134,"version":3502789751},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":45.48815900000045,"publicProcessDuration":1.6217350000006263,"rollupCircuitsDuration":33.20150100000319,"txCount":0,"blockNumber":1,"blockTimestamp":1749801134,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 07:52:06 [07:52:06.463] VERBOSE: sequencer Attesting committee is empty 07:52:07 [07:52:07.218] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 8 mined at 07:52:14 {"l1Timestamp":1749801134,"l1BlockNumber":8,"l2SlotNumber":2,"l2BlockNumber":0,"l2ProvenBlockNumber":0,"totalL2Messages":0} 07:52:09 [07:52:09.595] VERBOSE: ethereum:tx_delayer Sent tx immediately 0x18c57e2ee0981af46d0603d4d3cb527d9392a1775e989c87e1ec2d0e6aaa0c2f 07:52:09 [07:52:09.596] VERBOSE: node Sent L1 transaction 0x18c57e2ee0981af46d0603d4d3cb527d9392a1775e989c87e1ec2d0e6aaa0c2f {"gasLimit":485524,"maxFeePerGas":"2.37259949","maxPriorityFeePerGas":"1.44","maxFeePerBlobGas":"0.000000001"} 07:52:15 [07:52:15.078] INFO: sequencer:publisher Bundled [propose] transaction [succeeded] 07:52:15 [07:52:15.080] VERBOSE: sequencer:publisher Published L2 block to L1 rollup contract {"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0x18c57e2ee0981af46d0603d4d3cb527d9392a1775e989c87e1ec2d0e6aaa0c2f","calldataSize":1220,"calldataGas":8840,"txCount":0,"blockNumber":1,"blockTimestamp":1749801134,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 07:52:15 [07:52:15.081] VERBOSE: node:blob-sink:client Sending 1 blobs to blob sink 07:52:15 [07:52:15.146] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 9 mined at 07:52:22 with new L2 block 1 for epoch 0 {"l1Timestamp":1749801142,"l1BlockNumber":9,"l2SlotNumber":2,"l2BlockNumber":1,"l2ProvenBlockNumber":0,"totalL2Messages":0} 07:52:15 [07:52:15.165] INFO: blob-sink:server Received blob sidecar for block 0xb659d94b08aec4667e9fcf864299156e94517ffb2520921d0135c457f72cfce4 07:52:15 [07:52:15.190] INFO: blob-sink:server Blob sidecar stored successfully for block 0xb659d94b08aec4667e9fcf864299156e94517ffb2520921d0135c457f72cfce4 07:52:15 [07:52:15.300] INFO: archiver:prover-node Downloaded L2 block 1 {"blockHash":"0x1d096b2b2b223ce5f618816274f4e2a13c8a10c34c3eb25b1df96781ed41c2d9","blockNumber":1,"txCount":0,"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1749801134,"version":3502789751},"archiveRoot":"0x037b82a9c5a1549348147b194ae142bad437cbece0feb12b1016152a3ce33c9d","archiveNextLeafIndex":2} 07:52:15 [07:52:15.317] INFO: archiver Downloaded L2 block 1 {"blockHash":"0x1d096b2b2b223ce5f618816274f4e2a13c8a10c34c3eb25b1df96781ed41c2d9","blockNumber":1,"txCount":0,"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1749801134,"version":3502789751},"archiveRoot":"0x037b82a9c5a1549348147b194ae142bad437cbece0feb12b1016152a3ce33c9d","archiveNextLeafIndex":2} 07:52:15 [07:52:15.332] VERBOSE: prover-node:prover-node Fetching 0 tx hashes for block number 1 from coordination 07:52:15 [07:52:15.334] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 07:52:15 [07:52:15.336] INFO: world_state:prover-node World state updated with L2 block 1 {"eventName":"l2-block-handled","duration":15.98481099998753,"unfinalisedBlockNumber":1,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":1,"blockTimestamp":1749801134,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 07:52:15 [07:52:15.373] INFO: world_state World state updated with L2 block 1 {"eventName":"l2-block-handled","duration":13.63790400000289,"unfinalisedBlockNumber":1,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":1,"blockTimestamp":1749801134,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 07:52:15 [07:52:15.425] VERBOSE: p2p Synched to latest block 1 07:52:15 [07:52:15.613] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 07:52:16 [07:52:16.123] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 07:52:16 [07:52:16.638] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 07:52:17 [07:52:17.187] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 07:52:17 [07:52:17.724] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 07:52:18 [07:52:18.256] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 07:52:18 [07:52:18.775] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 07:52:19 [07:52:19.298] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 07:52:19 [07:52:19.808] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 07:52:20 [07:52:20.330] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 07:52:20 [07:52:20.853] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 07:52:21 [07:52:21.366] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 07:52:21 [07:52:21.892] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 07:52:22 [07:52:22.422] VERBOSE: sequencer Preparing proposal for block 2 at slot 3 {"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1749801150,"version":3502789751},"chainTipArchive":"0x037b82a9c5a1549348147b194ae142bad437cbece0feb12b1016152a3ce33c9d","blockNumber":2,"slot":3} 07:52:22 [07:52:22.448] VERBOSE: block-builder Building block 2 for slot 3 {"slot":3,"slotStart":"2025-06-13T07:52:30.000Z","now":"2025-06-13T07:52:22.447Z","blockNumber":2,"msgCount":0,"opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}} 07:52:22 [07:52:22.456] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.005700096999993548s {"duration":0.005700096999993548,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 07:52:22 [07:52:22.490] INFO: sequencer Built block 2 for slot 3 with 0 txs and 0 messages. 0 mana/s {"blockHash":"0x2eb35b1521af5e6ad5cf96dd4e7c0caa9c4c9fc32a4f5b5c480bc07185c62f08","globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1749801150,"version":3502789751},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":50.96087299998908,"publicProcessDuration":6.435043999998015,"rollupCircuitsDuration":43.44520400000329,"txCount":0,"blockNumber":2,"blockTimestamp":1749801150,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 07:52:22 [07:52:22.501] VERBOSE: sequencer Attesting committee is empty 07:52:22 [07:52:22.643] VERBOSE: ethereum:tx_delayer Sent tx immediately 0xb4097ba5d171c24126bf4bf62338ed875de6db3223eb74c428cdb244d59abb36 07:52:22 [07:52:22.643] VERBOSE: node Sent L1 transaction 0xb4097ba5d171c24126bf4bf62338ed875de6db3223eb74c428cdb244d59abb36 {"gasLimit":414472,"maxFeePerGas":"2.443834904","maxPriorityFeePerGas":"1.728","maxFeePerBlobGas":"0.000000001"} 07:52:23 [07:52:23.008] INFO: sequencer:publisher Bundled [propose] transaction [succeeded] 07:52:23 [07:52:23.008] VERBOSE: sequencer:publisher Published L2 block to L1 rollup contract {"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0xb4097ba5d171c24126bf4bf62338ed875de6db3223eb74c428cdb244d59abb36","calldataSize":1220,"calldataGas":8828,"txCount":0,"blockNumber":2,"blockTimestamp":1749801150,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 07:52:23 [07:52:23.009] VERBOSE: node:blob-sink:client Sending 1 blobs to blob sink 07:52:23 [07:52:23.018] INFO: blob-sink:server Received blob sidecar for block 0x2a06762c6ff193a3b4f9f4632efa54d5cf6af2edae297842d4a832f6ffdaad0e 07:52:23 [07:52:23.038] INFO: blob-sink:server Blob sidecar stored successfully for block 0x2a06762c6ff193a3b4f9f4632efa54d5cf6af2edae297842d4a832f6ffdaad0e 07:52:23 [07:52:23.131] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 10 mined at 07:52:30 with new L2 block 2 for epoch 0 {"l1Timestamp":1749801150,"l1BlockNumber":10,"l2SlotNumber":3,"l2BlockNumber":2,"l2ProvenBlockNumber":0,"totalL2Messages":0} 07:52:23 [07:52:23.183] INFO: archiver:prover-node Downloaded L2 block 2 {"blockHash":"0x2eb35b1521af5e6ad5cf96dd4e7c0caa9c4c9fc32a4f5b5c480bc07185c62f08","blockNumber":2,"txCount":0,"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1749801150,"version":3502789751},"archiveRoot":"0x005d8f7cc318c73920289b7d35edacfdbce90d36e219c8a235e173db2758f0f9","archiveNextLeafIndex":3} 07:52:23 [07:52:23.214] INFO: archiver Downloaded L2 block 2 {"blockHash":"0x2eb35b1521af5e6ad5cf96dd4e7c0caa9c4c9fc32a4f5b5c480bc07185c62f08","blockNumber":2,"txCount":0,"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1749801150,"version":3502789751},"archiveRoot":"0x005d8f7cc318c73920289b7d35edacfdbce90d36e219c8a235e173db2758f0f9","archiveNextLeafIndex":3} 07:52:23 [07:52:23.220] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 07:52:23 [07:52:23.221] VERBOSE: prover-node:prover-node Gathered all 0 txs for epoch 0 {"epochNumber":0} 07:52:23 [07:52:23.222] VERBOSE: prover-node:prover-node Gathered all 0 messages for epoch 0 {"epochNumber":0} 07:52:23 [07:52:23.222] VERBOSE: prover-node:prover-node Gathered previous block header 0 for epoch 0 07:52:23 [07:52:23.222] VERBOSE: prover-node:prover-node Creating proving job for epoch 0 for block range 1 to 2 07:52:23 [07:52:23.240] INFO: world_state:prover-node World state updated with L2 block 2 {"eventName":"l2-block-handled","duration":9.15617800000473,"unfinalisedBlockNumber":2,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":2,"blockTimestamp":1749801150,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 07:52:23 [07:52:23.245] INFO: prover-node:epoch-proving-job Starting epoch 0 proving job with blocks 1 to 2 {"fromBlock":1,"toBlock":2,"epochSizeBlocks":2,"epochNumber":0,"uuid":"d234beba-0cde-47d5-b701-e8c557fd3dff"} 07:52:23 [07:52:23.271] INFO: prover-client:orchestrator Starting epoch 0 with 2 blocks 07:52:23 [07:52:23.272] VERBOSE: prover-client:broker-circuit-prover-facade Starting BrokerCircuitProverFacade 07:52:23 [07:52:23.273] VERBOSE: prover-node:epoch-proving-job Starting processing block 1 {"number":1,"blockHash":"0x1d096b2b2b223ce5f618816274f4e2a13c8a10c34c3eb25b1df96781ed41c2d9","lastArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"d234beba-0cde-47d5-b701-e8c557fd3dff","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x00000000000000000000000000000000000000000000000000000000d0c85477","blockNumber":1,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 07:52:23 [07:52:23.274] INFO: prover-client:orchestrator Starting block 1 for slot 2 07:52:23 [07:52:23.274] VERBOSE: prover-node:epoch-proving-job Starting processing block 2 {"number":2,"blockHash":"0x2eb35b1521af5e6ad5cf96dd4e7c0caa9c4c9fc32a4f5b5c480bc07185c62f08","lastArchive":"0x037b82a9c5a1549348147b194ae142bad437cbece0feb12b1016152a3ce33c9d","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"d234beba-0cde-47d5-b701-e8c557fd3dff","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x00000000000000000000000000000000000000000000000000000000d0c85477","blockNumber":2,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000003","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 07:52:23 [07:52:23.275] INFO: prover-client:orchestrator Starting block 2 for slot 3 07:52:23 [07:52:23.277] INFO: world_state World state updated with L2 block 2 {"eventName":"l2-block-handled","duration":47.50740199998836,"unfinalisedBlockNumber":2,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":2,"blockTimestamp":1749801150,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 07:52:23 [07:52:23.296] INFO: prover-client:proving-broker:prover-node New proving job id=0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0 epochNumber=0 {"provingJobId":"0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0"} 07:52:23 [07:52:23.297] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0","provingJobType":"BASE_PARITY"} 07:52:23 [07:52:23.297] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0","provingJobType":"BASE_PARITY"} 07:52:23 [07:52:23.297] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0","provingJobType":"BASE_PARITY"} 07:52:23 [07:52:23.300] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.00001999200000136625s {"duration":0.00001999200000136625,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 07:52:23 [07:52:23.301] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 07:52:23 [07:52:23.301] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 1 {"blockNumber":1,"blockHash":"0x1d096b2b2b223ce5f618816274f4e2a13c8a10c34c3eb25b1df96781ed41c2d9","uuid":"d234beba-0cde-47d5-b701-e8c557fd3dff"} 07:52:23 [07:52:23.302] VERBOSE: prover-client:orchestrator Block 1 completed. Assembling header. 07:52:23 [07:52:23.303] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0","provingJobType":"BASE_PARITY"} 07:52:23 [07:52:23.303] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0","provingJobType":"BASE_PARITY"} 07:52:23 [07:52:23.304] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0","provingJobType":"BASE_PARITY"} 07:52:23 [07:52:23.304] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0","provingJobType":"BASE_PARITY"} 07:52:23 [07:52:23.308] VERBOSE: prover-client:orchestrator Updating archive tree with block 1 header 0x1d096b2b2b223ce5f618816274f4e2a13c8a10c34c3eb25b1df96781ed41c2d9 07:52:23 [07:52:23.310] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000016961000001174397s {"duration":0.000016961000001174397,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 07:52:23 [07:52:23.310] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 07:52:23 [07:52:23.311] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 2 {"blockNumber":2,"blockHash":"0x2eb35b1521af5e6ad5cf96dd4e7c0caa9c4c9fc32a4f5b5c480bc07185c62f08","uuid":"d234beba-0cde-47d5-b701-e8c557fd3dff"} 07:52:23 [07:52:23.311] VERBOSE: prover-client:orchestrator Block 2 completed. Assembling header. 07:52:23 [07:52:23.313] VERBOSE: prover-client:orchestrator Orchestrator finalised block 1 07:52:23 [07:52:23.334] VERBOSE: prover-client:orchestrator Updating archive tree with block 2 header 0x2eb35b1521af5e6ad5cf96dd4e7c0caa9c4c9fc32a4f5b5c480bc07185c62f08 07:52:23 [07:52:23.354] VERBOSE: p2p Synched to latest block 2 07:52:23 [07:52:23.355] VERBOSE: prover-client:orchestrator Orchestrator finalised block 2 07:52:23 [07:52:23.373] INFO: prover-client:proving-broker-database:prover-node Creating broker database for epoch 0 at /tmp/9212dbb40ad644fe/3d099d8a2746afd6/0 with map size 134217728 07:52:23 [07:52:23.376] VERBOSE: prover-node:prover-node Fetching 0 tx hashes for block number 2 from coordination 07:52:23 [07:52:23.376] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 07:52:23 [07:52:23.382] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 07:52:23 [07:52:23.386] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0 type=BASE_PARITY epochNumber=0 {"provingJobId":"0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0","provingJobType":"BASE_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...","status":"not-found","numOutstandingJobs":1} 07:52:23 [07:52:23.390] INFO: prover-client:proving-agent:prover-node Starting job id=0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0 type=BASE_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input... 07:52:23 [07:52:23.407] INFO: prover-client:proving-agent:job-controller-7c9cdf99 Job controller started jobId=0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0 {"jobId":"0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0"} 07:52:23 [07:52:23.554] INFO: prover-client:proving-agent:prover-node Job id=0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0 type=BASE_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22resul... 07:52:23 [07:52:23.555] INFO: prover-client:proving-broker:prover-node Proving job complete id=0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0 type=BASE_PARITY totalAttempts=1 {"provingJobId":"0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0"} 07:52:23 [07:52:23.587] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 07:52:23 error: "Rollup__SlotAlreadyInChain(3, 3)" 07:52:23 [07:52:23.588] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 07:52:24 [07:52:24.114] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 07:52:24 error: "Rollup__SlotAlreadyInChain(3, 3)" 07:52:24 [07:52:24.115] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 07:52:24 [07:52:24.274] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 07:52:24 [07:52:24.277] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0 type=BASE_PARITY 07:52:24 [07:52:24.277] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 07:52:24 [07:52:24.296] INFO: prover-client:proving-broker:prover-node New proving job id=0:ROOT_PARITY:753b88c434bc5c1cd43db6666d5a6ee2f974b934cbe54f7ec092b6b28a3a99a5 epochNumber=0 {"provingJobId":"0:ROOT_PARITY:753b88c434bc5c1cd43db6666d5a6ee2f974b934cbe54f7ec092b6b28a3a99a5"} 07:52:24 [07:52:24.305] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:ROOT_PARITY:753b88c434bc5c1cd43db6666d5a6ee2f974b934cbe54f7ec092b6b28a3a99a5 type=ROOT_PARITY {"provingJobId":"0:ROOT_PARITY:753b88c434bc5c1cd43db6666d5a6ee2f974b934cbe54f7ec092b6b28a3a99a5","provingJobType":"ROOT_PARITY"} 07:52:24 [07:52:24.349] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_PARITY:753b88c434bc5c1cd43db6666d5a6ee2f974b934cbe54f7ec092b6b28a3a99a5 type=ROOT_PARITY epochNumber=0 {"provingJobId":"0:ROOT_PARITY:753b88c434bc5c1cd43db6666d5a6ee2f974b934cbe54f7ec092b6b28a3a99a5","provingJobType":"ROOT_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu...","status":"not-found","numOutstandingJobs":1} 07:52:24 [07:52:24.372] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Triggering error on finaliseEpoch 07:52:24 [07:52:24.383] ERROR: prover-node:epoch-proving-job Error running epoch 0 prover job: Error: Fake error while proving epoch 07:52:24 at ServerEpochProver.epochProver.finaliseEpoch (/home/aztec-dev/aztec-packages/yarn-project/end-to-end/src/e2e_epochs/epochs_upload_failed_proof.test.ts:60:15) 07:52:24 at runNextTicks (node:internal/process/task_queues:65:5) 07:52:24 at processTimers (node:internal/timers:520:9) 07:52:24 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:142:64) 07:52:24 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) {"uuid":"d234beba-0cde-47d5-b701-e8c557fd3dff","epochNumber":0} 07:52:24 [07:52:24.383] VERBOSE: prover-client:broker-circuit-prover-facade Stopping BrokerCircuitProverFacade 07:52:24 [07:52:24.385] ERROR: prover-client:broker-circuit-prover-facade Job errored with 'Broker facade stopped' id=0:ROOT_PARITY:753b88c434bc5c1cd43db6666d5a6ee2f974b934cbe54f7ec092b6b28a3a99a5 type=ROOT_PARITY: { 07:52:24 provingJobId: '0:ROOT_PARITY:753b88c434bc5c1cd43db6666d5a6ee2f974b934cbe54f7ec092b6b28a3a99a5', 07:52:24 provingJobType: 'ROOT_PARITY' 07:52:24 } 07:52:24 [07:52:24.385] INFO: prover-client:proving-broker:prover-node Cancelling job id=0:ROOT_PARITY:753b88c434bc5c1cd43db6666d5a6ee2f974b934cbe54f7ec092b6b28a3a99a5 {"provingJobId":"0:ROOT_PARITY:753b88c434bc5c1cd43db6666d5a6ee2f974b934cbe54f7ec092b6b28a3a99a5"} 07:52:24 [07:52:24.386] WARN: prover-client:proving-broker:prover-node Proving job id=0:ROOT_PARITY:753b88c434bc5c1cd43db6666d5a6ee2f974b934cbe54f7ec092b6b28a3a99a5 type=ROOT_PARITY not in the in-progress set {"provingJobId":"0:ROOT_PARITY:753b88c434bc5c1cd43db6666d5a6ee2f974b934cbe54f7ec092b6b28a3a99a5"} 07:52:24 [07:52:24.386] INFO: prover-client:proving-broker:prover-node Marking proving job as failed id=0:ROOT_PARITY:753b88c434bc5c1cd43db6666d5a6ee2f974b934cbe54f7ec092b6b28a3a99a5 type=ROOT_PARITY totalAttempts=1 err=Aborted {"provingJobId":"0:ROOT_PARITY:753b88c434bc5c1cd43db6666d5a6ee2f974b934cbe54f7ec092b6b28a3a99a5"} 07:52:24 [07:52:24.387] ERROR: prover-client:orchestrator Error thrown when proving job: Error: Broker facade stopped 07:52:24 at BrokerCircuitProverFacade.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/proving_broker/broker_prover_facade.js:142:31) 07:52:24 at runNextTicks (node:internal/process/task_queues:65:5) 07:52:24 at processTimers (node:internal/timers:520:9) 07:52:24 at ServerEpochProver.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/prover-client/server-epoch-prover.js:31:9) 07:52:24 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:183:13) 07:52:24 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) 07:52:24 [07:52:24.388] ERROR: prover-client:orchestrator Error thrown when proving job: Error: Broker facade stopped 07:52:24 at BrokerCircuitProverFacade.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/proving_broker/broker_prover_facade.js:142:31) 07:52:24 at runNextTicks (node:internal/process/task_queues:65:5) 07:52:24 at processTimers (node:internal/timers:520:9) 07:52:24 at ServerEpochProver.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/prover-client/server-epoch-prover.js:31:9) 07:52:24 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:183:13) 07:52:24 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) 07:52:24 [07:52:24.388] ERROR: prover-node:prover-node Job for 0 exited with state failed: { 07:52:24 id: 'd234beba-0cde-47d5-b701-e8c557fd3dff', 07:52:24 epochNumber: 0n, 07:52:24 state: 'failed' 07:52:24 } 07:52:24 [07:52:24.389] WARN: prover-node:prover-node Uploading epoch proof failure for 0 to file:///tmp/failed-proofs-A9poSY {"epochNumber":0,"jobId":"d234beba-0cde-47d5-b701-e8c557fd3dff","location":"file:///tmp/failed-proofs-A9poSY"} 07:52:24 [07:52:24.390] INFO: stdlib:file-store Creating local file file store at /tmp/failed-proofs-A9poSY 07:52:24 [07:52:24.393] INFO: prover-node:prover-node Pausing archiver and world state sync to start snapshot upload 07:52:24 [07:52:24.393] INFO: archiver:prover-node Stopped. 07:52:24 [07:52:24.394] INFO: world_state:prover-node Stopped sync 07:52:24 [07:52:24.394] INFO: prover-node:prover-node Creating backups of lmdb environments to /tmp/9212dbb40ad644fe/3d099d8a2746afd6/epoch-proof-data-6OZOI2 07:52:24 [07:52:24.398] INFO: prover-node:prover-node Data stores backed up to /tmp/9212dbb40ad644fe/3d099d8a2746afd6/epoch-proof-data-6OZOI2 {"paths":{"l1-to-l2-message-tree":"/tmp/9212dbb40ad644fe/3d099d8a2746afd6/epoch-proof-data-6OZOI2/world-state/L1ToL2MessageTree/data.mdb","archive-tree":"/tmp/9212dbb40ad644fe/3d099d8a2746afd6/epoch-proof-data-6OZOI2/world-state/ArchiveTree/data.mdb","public-data-tree":"/tmp/9212dbb40ad644fe/3d099d8a2746afd6/epoch-proof-data-6OZOI2/world-state/PublicDataTree/data.mdb","note-hash-tree":"/tmp/9212dbb40ad644fe/3d099d8a2746afd6/epoch-proof-data-6OZOI2/world-state/NoteHashTree/data.mdb","nullifier-tree":"/tmp/9212dbb40ad644fe/3d099d8a2746afd6/epoch-proof-data-6OZOI2/world-state/NullifierTree/data.mdb","archiver":"/tmp/9212dbb40ad644fe/3d099d8a2746afd6/epoch-proof-data-6OZOI2/archiver/data.mdb"}} 07:52:24 [07:52:24.399] INFO: prover-node:prover-node Resuming archiver and world state sync 07:52:24 [07:52:24.399] VERBOSE: world-state:block_stream:prover-node Starting L2 block stream {"proven":false,"pollIntervalMS":50} 07:52:24 [07:52:24.399] INFO: world_state:prover-node Resumed sync 07:52:24 [07:52:24.400] INFO: archiver:prover-node Restarting archiver 07:52:24 [07:52:24.409] WARN: prover-node:prover-node Uploaded epoch 0 proof failure data to file:///tmp/failed-proofs-A9poSY/aztec-31337-3502789751-0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430/0-20250613075224-d234beba-0cde-47d5-b701-e8c557fd3dff {"epochNumber":0,"location":"file:///tmp/failed-proofs-A9poSY","basePath":"aztec-31337-3502789751-0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430/0-20250613075224-d234beba-0cde-47d5-b701-e8c557fd3dff","metadataUrl":"file:///tmp/failed-proofs-A9poSY/aztec-31337-3502789751-0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430/0-20250613075224-d234beba-0cde-47d5-b701-e8c557fd3dff/metadata.json","dataUrl":"file:///tmp/failed-proofs-A9poSY/aztec-31337-3502789751-0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430/0-20250613075224-d234beba-0cde-47d5-b701-e8c557fd3dff/data.bin","metadata":{"l1BlockNumber":10,"l2BlockHash":"0x2eb35b1521af5e6ad5cf96dd4e7c0caa9c4c9fc32a4f5b5c480bc07185c62f08","l2BlockNumber":2,"schemaVersions":{"archiver":2,"worldState":1},"timestamp":1749801144401,"dataUrls":{"l1-to-l2-message-tree":"file:///tmp/failed-proofs-A9poSY/aztec-31337-3502789751-0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430/0-20250613075224-d234beba-0cde-47d5-b701-e8c557fd3dff/l1-to-l2-message-tree.db","archive-tree":"file:///tmp/failed-proofs-A9poSY/aztec-31337-3502789751-0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430/0-20250613075224-d234beba-0cde-47d5-b701-e8c557fd3dff/archive-tree.db","public-data-tree":"file:///tmp/failed-proofs-A9poSY/aztec-31337-3502789751-0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430/0-20250613075224-d234beba-0cde-47d5-b701-e8c557fd3dff/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-A9poSY/aztec-31337-3502789751-0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430/0-20250613075224-d234beba-0cde-47d5-b701-e8c557fd3dff/note-hash-tree.db","nullifier-tree":"file:///tmp/failed-proofs-A9poSY/aztec-31337-3502789751-0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430/0-20250613075224-d234beba-0cde-47d5-b701-e8c557fd3dff/nullifier-tree.db","archiver":"file:///tmp/failed-proofs-A9poSY/aztec-31337-3502789751-0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430/0-20250613075224-d234beba-0cde-47d5-b701-e8c557fd3dff/archiver.db"}},"jobId":"d234beba-0cde-47d5-b701-e8c557fd3dff"} 07:52:24 [07:52:24.410] INFO: prover-node:prover-node Cleaning up backup dir /tmp/9212dbb40ad644fe/3d099d8a2746afd6/epoch-proof-data-6OZOI2 07:52:24 [07:52:24.645] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 07:52:24 error: "Rollup__SlotAlreadyInChain(3, 3)" 07:52:24 [07:52:24.646] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 07:52:25 [07:52:25.165] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 07:52:25 error: "Rollup__SlotAlreadyInChain(3, 3)" 07:52:25 [07:52:25.166] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 07:52:25 [07:52:25.693] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 07:52:25 error: "Rollup__SlotAlreadyInChain(3, 3)" 07:52:25 [07:52:25.693] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 07:52:26 [07:52:26.216] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 07:52:26 error: "Rollup__SlotAlreadyInChain(3, 3)" 07:52:26 [07:52:26.216] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 07:52:26 [07:52:26.745] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 07:52:26 error: "Rollup__SlotAlreadyInChain(3, 3)" 07:52:26 [07:52:26.745] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 07:52:27 [07:52:27.280] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 07:52:27 error: "Rollup__SlotAlreadyInChain(3, 3)" 07:52:27 [07:52:27.280] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 07:52:27 [07:52:27.795] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 07:52:27 error: "Rollup__SlotAlreadyInChain(3, 3)" 07:52:27 [07:52:27.795] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 07:52:28 [07:52:28.309] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 07:52:28 error: "Rollup__SlotAlreadyInChain(3, 3)" 07:52:28 [07:52:28.310] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 07:52:28 [07:52:28.824] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 07:52:28 error: "Rollup__SlotAlreadyInChain(3, 3)" 07:52:28 [07:52:28.824] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 07:52:29 [07:52:29.338] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 07:52:29 error: "Rollup__SlotAlreadyInChain(3, 3)" 07:52:29 [07:52:29.339] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 07:52:29 [07:52:29.866] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 07:52:29 error: "Rollup__SlotAlreadyInChain(3, 3)" 07:52:29 [07:52:29.866] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 07:52:30 [07:52:30.386] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 07:52:30 error: "Rollup__SlotAlreadyInChain(3, 3)" 07:52:30 [07:52:30.386] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 07:52:30 [07:52:30.901] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 07:52:30 error: "Rollup__SlotAlreadyInChain(3, 3)" 07:52:30 [07:52:30.901] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 07:52:31 [07:52:31.017] INFO: prover-node:prover-node Stopping ProverNode 07:52:31 [07:52:31.018] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 07:52:31 [07:52:31.018] INFO: archiver:prover-node Stopped. 07:52:31 [07:52:31.023] INFO: world_state:prover-node Stopped world state synchronizer 07:52:31 [07:52:31.024] INFO: prover-node:prover-node Stopped ProverNode 07:52:31 [07:52:31.024] INFO: node Stopping Aztec Node 07:52:31 [07:52:31.426] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 3 but got 4. {"rollup":[4,3],"newBlockNumber":3,"expectedSlot":3} 07:52:31 [07:52:31.936] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 3 but got 4. {"rollup":[4,3],"newBlockNumber":3,"expectedSlot":3} 07:52:32 [07:52:32.450] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 3 but got 4. {"rollup":[4,3],"newBlockNumber":3,"expectedSlot":3} 07:52:32 [07:52:32.977] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 3 but got 4. {"rollup":[4,3],"newBlockNumber":3,"expectedSlot":3} 07:52:33 [07:52:33.027] INFO: slasher Slasher client stopped. 07:52:33 [07:52:33.029] INFO: sequencer Stopped sequencer 07:52:33 [07:52:33.030] INFO: p2p P2P client stopped 07:52:33 [07:52:33.032] INFO: world_state Stopped world state synchronizer 07:52:33 [07:52:33.032] INFO: archiver Stopped. 07:52:33 [07:52:33.033] INFO: node Stopped Aztec Node 07:52:33 [07:52:33.044] INFO: node Stopping Aztec Node 07:52:35 [07:52:35.045] INFO: slasher Slasher client stopped. 07:52:35 [07:52:35.045] WARN: validator Running promise was not started 07:52:35 [07:52:35.045] WARN: sequencer Running promise was not started 07:52:35 [07:52:35.045] INFO: sequencer Stopped sequencer 07:52:35 [07:52:35.046] WARN: p2p:l2-block-stream Running promise was not started 07:52:35 [07:52:35.046] INFO: p2p P2P client stopped 07:52:35 [07:52:35.046] WARN: world-state:block_stream Running promise was not started 07:52:35 [07:52:35.046] INFO: world_state Stopped world state synchronizer 07:52:35 [07:52:35.046] WARN: archiver Running promise was not started 07:52:35 [07:52:35.046] INFO: archiver Stopped. 07:52:35 [07:52:35.047] INFO: node Stopped Aztec Node 07:52:35 [07:52:35.047] INFO: prover-node:prover-node Stopping ProverNode 07:52:35 [07:52:35.047] WARN: prover-node:prover-node Running promise was not started 07:52:35 [07:52:35.047] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 07:52:35 [07:52:35.047] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 07:52:35 [07:52:35.047] WARN: archiver:prover-node Running promise was not started 07:52:35 [07:52:35.047] INFO: archiver:prover-node Stopped. 07:52:35 [07:52:35.047] WARN: world-state:block_stream:prover-node Running promise was not started 07:52:35 [07:52:35.048] INFO: world_state:prover-node Stopped world state synchronizer 07:52:35 [07:52:35.048] INFO: prover-node:prover-node Stopped ProverNode 07:52:35 [07:52:35.065] INFO: blob-sink:server Stopping blob sink 07:52:35 [07:52:35.066] INFO: blob-sink:server Blob sink stopped 07:52:35 [07:52:35.075] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data and state {"uploadPath":"/tmp/failed-proofs-A9poSY","rerunDataDir":"/tmp/rerun-data-p4HvYx","rerunDownloadPath":"/tmp/rerun-download-zahp3Z/data.bin"} 07:52:35 [07:52:35.076] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data from file:///tmp/failed-proofs-A9poSY/aztec-31337-3502789751-0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430/0-20250613075224-d234beba-0cde-47d5-b701-e8c557fd3dff 07:52:35 [07:52:35.077] INFO: stdlib:file-store Creating local file file store at /tmp/failed-proofs-A9poSY/aztec-31337-3502789751-0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430/0-20250613075224-d234beba-0cde-47d5-b701-e8c557fd3dff 07:52:35 [07:52:35.079] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading state snapshot from file:///tmp/failed-proofs-A9poSY/aztec-31337-3502789751-0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430/0-20250613075224-d234beba-0cde-47d5-b701-e8c557fd3dff to local data directory {"metadata":{"l2BlockNumber":2,"l2BlockHash":"0x2eb35b1521af5e6ad5cf96dd4e7c0caa9c4c9fc32a4f5b5c480bc07185c62f08","l1BlockNumber":10,"l1ChainId":31337,"rollupVersion":3502789751,"rollupAddress":"0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430"},"dataUrls":{"archiver":"file:///tmp/failed-proofs-A9poSY/aztec-31337-3502789751-0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430/0-20250613075224-d234beba-0cde-47d5-b701-e8c557fd3dff/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-A9poSY/aztec-31337-3502789751-0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430/0-20250613075224-d234beba-0cde-47d5-b701-e8c557fd3dff/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-A9poSY/aztec-31337-3502789751-0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430/0-20250613075224-d234beba-0cde-47d5-b701-e8c557fd3dff/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-A9poSY/aztec-31337-3502789751-0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430/0-20250613075224-d234beba-0cde-47d5-b701-e8c557fd3dff/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-A9poSY/aztec-31337-3502789751-0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430/0-20250613075224-d234beba-0cde-47d5-b701-e8c557fd3dff/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-A9poSY/aztec-31337-3502789751-0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430/0-20250613075224-d234beba-0cde-47d5-b701-e8c557fd3dff/l1-to-l2-message-tree.db"}} 07:52:35 [07:52:35.080] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Creating local file file store at /tmp/failed-proofs-A9poSY/aztec-31337-3502789751-0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430/0-20250613075224-d234beba-0cde-47d5-b701-e8c557fd3dff 07:52:35 [07:52:35.081] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading snapshot to /tmp/rerun-data-p4HvYx/download-OcDW42 {"snapshot":{"dataUrls":{"archiver":"file:///tmp/failed-proofs-A9poSY/aztec-31337-3502789751-0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430/0-20250613075224-d234beba-0cde-47d5-b701-e8c557fd3dff/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-A9poSY/aztec-31337-3502789751-0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430/0-20250613075224-d234beba-0cde-47d5-b701-e8c557fd3dff/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-A9poSY/aztec-31337-3502789751-0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430/0-20250613075224-d234beba-0cde-47d5-b701-e8c557fd3dff/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-A9poSY/aztec-31337-3502789751-0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430/0-20250613075224-d234beba-0cde-47d5-b701-e8c557fd3dff/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-A9poSY/aztec-31337-3502789751-0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430/0-20250613075224-d234beba-0cde-47d5-b701-e8c557fd3dff/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-A9poSY/aztec-31337-3502789751-0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430/0-20250613075224-d234beba-0cde-47d5-b701-e8c557fd3dff/l1-to-l2-message-tree.db"}},"downloadPaths":{"archiver":"/tmp/rerun-data-p4HvYx/download-OcDW42/archiver.db","nullifier-tree":"/tmp/rerun-data-p4HvYx/download-OcDW42/nullifier-tree.db","public-data-tree":"/tmp/rerun-data-p4HvYx/download-OcDW42/public-data-tree.db","note-hash-tree":"/tmp/rerun-data-p4HvYx/download-OcDW42/note-hash-tree.db","archive-tree":"/tmp/rerun-data-p4HvYx/download-OcDW42/archive-tree.db","l1-to-l2-message-tree":"/tmp/rerun-data-p4HvYx/download-OcDW42/l1-to-l2-message-tree.db"}} 07:52:35 [07:52:35.089] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Snapshot downloaded at /tmp/rerun-data-p4HvYx/download-OcDW42 {"snapshot":{"dataUrls":{"archiver":"file:///tmp/failed-proofs-A9poSY/aztec-31337-3502789751-0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430/0-20250613075224-d234beba-0cde-47d5-b701-e8c557fd3dff/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-A9poSY/aztec-31337-3502789751-0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430/0-20250613075224-d234beba-0cde-47d5-b701-e8c557fd3dff/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-A9poSY/aztec-31337-3502789751-0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430/0-20250613075224-d234beba-0cde-47d5-b701-e8c557fd3dff/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-A9poSY/aztec-31337-3502789751-0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430/0-20250613075224-d234beba-0cde-47d5-b701-e8c557fd3dff/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-A9poSY/aztec-31337-3502789751-0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430/0-20250613075224-d234beba-0cde-47d5-b701-e8c557fd3dff/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-A9poSY/aztec-31337-3502789751-0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430/0-20250613075224-d234beba-0cde-47d5-b701-e8c557fd3dff/l1-to-l2-message-tree.db"}},"downloadPaths":{"archiver":"/tmp/rerun-data-p4HvYx/download-OcDW42/archiver.db","nullifier-tree":"/tmp/rerun-data-p4HvYx/download-OcDW42/nullifier-tree.db","public-data-tree":"/tmp/rerun-data-p4HvYx/download-OcDW42/public-data-tree.db","note-hash-tree":"/tmp/rerun-data-p4HvYx/download-OcDW42/note-hash-tree.db","archive-tree":"/tmp/rerun-data-p4HvYx/download-OcDW42/archive-tree.db","l1-to-l2-message-tree":"/tmp/rerun-data-p4HvYx/download-OcDW42/l1-to-l2-message-tree.db"}} 07:52:35 [07:52:35.091] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Archiver database set up from snapshot {"path":"/tmp/rerun-data-p4HvYx/archiver","dbVersion":2,"rollupAddress":"0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430"} 07:52:35 [07:52:35.095] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database l1-to-l2-message-tree set up from snapshot {"path":"/tmp/rerun-data-p4HvYx/world_state/L1ToL2MessageTree","dbVersion":1,"rollupAddress":"0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430"} 07:52:35 [07:52:35.097] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database archive-tree set up from snapshot {"path":"/tmp/rerun-data-p4HvYx/world_state/ArchiveTree","dbVersion":1,"rollupAddress":"0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430"} 07:52:35 [07:52:35.098] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database public-data-tree set up from snapshot {"path":"/tmp/rerun-data-p4HvYx/world_state/PublicDataTree","dbVersion":1,"rollupAddress":"0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430"} 07:52:35 [07:52:35.099] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database note-hash-tree set up from snapshot {"path":"/tmp/rerun-data-p4HvYx/world_state/NoteHashTree","dbVersion":1,"rollupAddress":"0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430"} 07:52:35 [07:52:35.099] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database nullifier-tree set up from snapshot {"path":"/tmp/rerun-data-p4HvYx/world_state/NullifierTree","dbVersion":1,"rollupAddress":"0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430"} 07:52:35 [07:52:35.099] INFO: e2e:e2e_epochs:epochs_upload_failed_proof P2P database cleared {"path":"/tmp/rerun-data-p4HvYx/p2p"} 07:52:35 [07:52:35.100] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data from file:///tmp/failed-proofs-A9poSY/aztec-31337-3502789751-0xfcf6b62b78a1cae3ce50e9c3c0a4760fa347b430/0-20250613075224-d234beba-0cde-47d5-b701-e8c557fd3dff/data.bin to /tmp/rerun-download-zahp3Z/data.bin 07:52:35 [07:52:35.104] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Epoch proving job data for epoch 0 downloaded successfully 07:52:35 [07:52:35.104] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Rerunning proving job from /tmp/rerun-download-zahp3Z/data.bin 07:52:35 [07:52:35.106] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Using native ACVM binary at ../../noir/noir-repo/target/release/acvm with working directory /tmp/9a01cd28/acvm 07:52:35 [07:52:35.108] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Loaded proving job data for epoch 0 07:52:35 [07:52:35.122] INFO: world-state:database Creating world state data store at directory /tmp/rerun-data-p4HvYx/world_state with map sizes {"archiveTreeMapSizeKb":1048576,"nullifierTreeMapSizeKb":1048576,"noteHashTreeMapSizeKb":1048576,"messageTreeMapSizeKb":1048576,"publicDataTreeMapSizeKb":1048576} and 2 threads. 07:52:35 [07:52:35.164] INFO: archiver:lmdb Creating archiver data store at directory /tmp/rerun-data-p4HvYx/archiver with map size 1048576 KB (LMDB v2) 07:52:35 [07:52:35.177] INFO: archiver:lmdb Starting data store with maxReaders 16 07:52:35 [07:52:35.183] WARN: prover-client:proving-broker-database Found invalid epoch directory /tmp/rerun-data-p4HvYx/archiver when loading epoch databases, ignoring 07:52:35 [07:52:35.184] WARN: prover-client:proving-broker-database Found invalid epoch directory /tmp/rerun-data-p4HvYx/world_state when loading epoch databases, ignoring 07:52:35 [07:52:35.184] INFO: prover-client:proving-broker Proving Broker started 07:52:35 [07:52:35.185] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Rerunning epoch proving job for epoch 0 07:52:35 [07:52:35.185] INFO: prover-node:epoch-proving-job Starting epoch 0 proving job with blocks 1 to 2 {"fromBlock":1,"toBlock":2,"epochSizeBlocks":2,"epochNumber":0,"uuid":"76a088b9-37df-48be-8eab-e3e308cb18dd"} 07:52:35 [07:52:35.207] INFO: prover-client:orchestrator Starting epoch 0 with 2 blocks 07:52:35 [07:52:35.207] VERBOSE: prover-client:broker-circuit-prover-facade Starting BrokerCircuitProverFacade 07:52:35 [07:52:35.209] VERBOSE: prover-node:epoch-proving-job Starting processing block 1 {"number":1,"blockHash":"0x1d096b2b2b223ce5f618816274f4e2a13c8a10c34c3eb25b1df96781ed41c2d9","lastArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"76a088b9-37df-48be-8eab-e3e308cb18dd","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x00000000000000000000000000000000000000000000000000000000d0c85477","blockNumber":1,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 07:52:35 [07:52:35.209] INFO: prover-client:orchestrator Starting block 1 for slot 2 07:52:35 [07:52:35.210] VERBOSE: prover-node:epoch-proving-job Starting processing block 2 {"number":2,"blockHash":"0x2eb35b1521af5e6ad5cf96dd4e7c0caa9c4c9fc32a4f5b5c480bc07185c62f08","lastArchive":"0x037b82a9c5a1549348147b194ae142bad437cbece0feb12b1016152a3ce33c9d","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"76a088b9-37df-48be-8eab-e3e308cb18dd","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x00000000000000000000000000000000000000000000000000000000d0c85477","blockNumber":2,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000003","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 07:52:35 [07:52:35.210] INFO: prover-client:orchestrator Starting block 2 for slot 3 07:52:35 [07:52:35.221] INFO: prover-client:proving-broker New proving job id=0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0 epochNumber=0 {"provingJobId":"0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0"} 07:52:35 [07:52:35.222] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0","provingJobType":"BASE_PARITY"} 07:52:35 [07:52:35.222] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0","provingJobType":"BASE_PARITY"} 07:52:35 [07:52:35.222] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0","provingJobType":"BASE_PARITY"} 07:52:35 [07:52:35.225] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000019220999995013698s {"duration":0.000019220999995013698,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 07:52:35 [07:52:35.226] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 07:52:35 [07:52:35.226] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 1 {"blockNumber":1,"blockHash":"0x1d096b2b2b223ce5f618816274f4e2a13c8a10c34c3eb25b1df96781ed41c2d9","uuid":"76a088b9-37df-48be-8eab-e3e308cb18dd"} 07:52:35 [07:52:35.226] VERBOSE: prover-client:orchestrator Block 1 completed. Assembling header. 07:52:35 [07:52:35.238] VERBOSE: prover-client:orchestrator Updating archive tree with block 1 header 0x1d096b2b2b223ce5f618816274f4e2a13c8a10c34c3eb25b1df96781ed41c2d9 07:52:35 [07:52:35.244] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0","provingJobType":"BASE_PARITY"} 07:52:35 [07:52:35.249] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0","provingJobType":"BASE_PARITY"} 07:52:35 [07:52:35.249] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0","provingJobType":"BASE_PARITY"} 07:52:35 [07:52:35.250] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0","provingJobType":"BASE_PARITY"} 07:52:35 [07:52:35.251] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000020541999998386017s {"duration":0.000020541999998386017,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 07:52:35 [07:52:35.251] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 07:52:35 [07:52:35.251] VERBOSE: prover-client:orchestrator Orchestrator finalised block 1 07:52:35 [07:52:35.263] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 2 {"blockNumber":2,"blockHash":"0x2eb35b1521af5e6ad5cf96dd4e7c0caa9c4c9fc32a4f5b5c480bc07185c62f08","uuid":"76a088b9-37df-48be-8eab-e3e308cb18dd"} 07:52:35 [07:52:35.263] VERBOSE: prover-client:orchestrator Block 2 completed. Assembling header. 07:52:35 [07:52:35.273] INFO: prover-client:proving-broker-database Creating broker database for epoch 0 at /tmp/rerun-data-p4HvYx/0 with map size 1048576 07:52:35 [07:52:35.278] VERBOSE: prover-client:orchestrator Updating archive tree with block 2 header 0x2eb35b1521af5e6ad5cf96dd4e7c0caa9c4c9fc32a4f5b5c480bc07185c62f08 07:52:35 [07:52:35.280] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 07:52:35 [07:52:35.286] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0 type=BASE_PARITY epochNumber=0 {"provingJobId":"0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0","provingJobType":"BASE_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...","status":"not-found","numOutstandingJobs":1} 07:52:35 [07:52:35.286] VERBOSE: prover-client:orchestrator Orchestrator finalised block 2 07:52:35 [07:52:35.386] INFO: prover-client:proving-agent Starting job id=0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0 type=BASE_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input... 07:52:35 [07:52:35.387] INFO: prover-client:proving-agent:job-controller-da2209c3 Job controller started jobId=0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0 {"jobId":"0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0"} 07:52:35 [07:52:35.488] INFO: prover-client:proving-agent Job id=0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0 type=BASE_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22resul... 07:52:35 [07:52:35.489] INFO: prover-client:proving-broker Proving job complete id=0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0 type=BASE_PARITY totalAttempts=1 {"provingJobId":"0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0"} 07:52:36 [07:52:36.207] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 07:52:36 [07:52:36.209] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:BASE_PARITY:e492da201f5ca9b34a8763416a663d15adb10393e53cc47eded5a2769d3a63a0 type=BASE_PARITY 07:52:36 [07:52:36.209] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 07:52:36 [07:52:36.228] INFO: prover-client:proving-broker New proving job id=0:ROOT_PARITY:753b88c434bc5c1cd43db6666d5a6ee2f974b934cbe54f7ec092b6b28a3a99a5 epochNumber=0 {"provingJobId":"0:ROOT_PARITY:753b88c434bc5c1cd43db6666d5a6ee2f974b934cbe54f7ec092b6b28a3a99a5"} 07:52:36 [07:52:36.233] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:ROOT_PARITY:753b88c434bc5c1cd43db6666d5a6ee2f974b934cbe54f7ec092b6b28a3a99a5 type=ROOT_PARITY {"provingJobId":"0:ROOT_PARITY:753b88c434bc5c1cd43db6666d5a6ee2f974b934cbe54f7ec092b6b28a3a99a5","provingJobType":"ROOT_PARITY"} 07:52:36 [07:52:36.283] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_PARITY:753b88c434bc5c1cd43db6666d5a6ee2f974b934cbe54f7ec092b6b28a3a99a5 type=ROOT_PARITY epochNumber=0 {"provingJobId":"0:ROOT_PARITY:753b88c434bc5c1cd43db6666d5a6ee2f974b934cbe54f7ec092b6b28a3a99a5","provingJobType":"ROOT_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu...","status":"not-found","numOutstandingJobs":1} 07:52:36 [07:52:36.300] INFO: prover-client:proving-agent Starting job id=0:ROOT_PARITY:753b88c434bc5c1cd43db6666d5a6ee2f974b934cbe54f7ec092b6b28a3a99a5 type=ROOT_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu... 07:52:36 [07:52:36.326] INFO: prover-client:proving-agent:job-controller-3b1bd8e0 Job controller started jobId=0:ROOT_PARITY:753b88c434bc5c1cd43db6666d5a6ee2f974b934cbe54f7ec092b6b28a3a99a5 {"jobId":"0:ROOT_PARITY:753b88c434bc5c1cd43db6666d5a6ee2f974b934cbe54f7ec092b6b28a3a99a5"} 07:52:36 [07:52:36.473] INFO: prover-client:proving-agent Job id=0:ROOT_PARITY:753b88c434bc5c1cd43db6666d5a6ee2f974b934cbe54f7ec092b6b28a3a99a5 type=ROOT_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22resu... 07:52:36 [07:52:36.474] INFO: prover-client:proving-broker Proving job complete id=0:ROOT_PARITY:753b88c434bc5c1cd43db6666d5a6ee2f974b934cbe54f7ec092b6b28a3a99a5 type=ROOT_PARITY totalAttempts=1 {"provingJobId":"0:ROOT_PARITY:753b88c434bc5c1cd43db6666d5a6ee2f974b934cbe54f7ec092b6b28a3a99a5"} 07:52:37 [07:52:37.210] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 07:52:37 [07:52:37.214] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:ROOT_PARITY:753b88c434bc5c1cd43db6666d5a6ee2f974b934cbe54f7ec092b6b28a3a99a5 type=ROOT_PARITY 07:52:37 [07:52:37.215] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 07:52:37 [07:52:37.226] INFO: prover-client:proving-broker New proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:ab98c9347edeb7ad546ef87b8aecab4c05597ebc20e57afdf67ff79b7e34c2ca epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:ab98c9347edeb7ad546ef87b8aecab4c05597ebc20e57afdf67ff79b7e34c2ca"} 07:52:37 [07:52:37.230] INFO: prover-client:proving-broker New proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:422dc13da85bd3f440416e84dcb3da64c8c8f3529b738c4bccb057957ef14e5a epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:422dc13da85bd3f440416e84dcb3da64c8c8f3529b738c4bccb057957ef14e5a"} 07:52:37 [07:52:37.281] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:EMPTY_BLOCK_ROOT_ROLLUP:ab98c9347edeb7ad546ef87b8aecab4c05597ebc20e57afdf67ff79b7e34c2ca type=EMPTY_BLOCK_ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:ab98c9347edeb7ad546ef87b8aecab4c05597ebc20e57afdf67ff79b7e34c2ca","provingJobType":"EMPTY_BLOCK_ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input...","status":"not-found","numOutstandingJobs":2} 07:52:37 [07:52:37.282] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:EMPTY_BLOCK_ROOT_ROLLUP:422dc13da85bd3f440416e84dcb3da64c8c8f3529b738c4bccb057957ef14e5a type=EMPTY_BLOCK_ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:422dc13da85bd3f440416e84dcb3da64c8c8f3529b738c4bccb057957ef14e5a","provingJobType":"EMPTY_BLOCK_ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input...","status":"not-found","numOutstandingJobs":2} 07:52:37 [07:52:37.333] INFO: prover-client:proving-agent Starting job id=0:EMPTY_BLOCK_ROOT_ROLLUP:ab98c9347edeb7ad546ef87b8aecab4c05597ebc20e57afdf67ff79b7e34c2ca type=EMPTY_BLOCK_ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input... 07:52:37 [07:52:37.344] INFO: prover-client:proving-agent:job-controller-ac1232ce Job controller started jobId=0:EMPTY_BLOCK_ROOT_ROLLUP:ab98c9347edeb7ad546ef87b8aecab4c05597ebc20e57afdf67ff79b7e34c2ca {"jobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:ab98c9347edeb7ad546ef87b8aecab4c05597ebc20e57afdf67ff79b7e34c2ca"} 07:52:37 [07:52:37.383] INFO: prover-client:proving-agent Starting job id=0:EMPTY_BLOCK_ROOT_ROLLUP:422dc13da85bd3f440416e84dcb3da64c8c8f3529b738c4bccb057957ef14e5a type=EMPTY_BLOCK_ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input... 07:52:37 [07:52:37.400] INFO: prover-client:proving-agent:job-controller-e5786a59 Job controller started jobId=0:EMPTY_BLOCK_ROOT_ROLLUP:422dc13da85bd3f440416e84dcb3da64c8c8f3529b738c4bccb057957ef14e5a {"jobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:422dc13da85bd3f440416e84dcb3da64c8c8f3529b738c4bccb057957ef14e5a"} 07:52:38 [07:52:38.878] INFO: prover-client:proving-agent Job id=0:EMPTY_BLOCK_ROOT_ROLLUP:ab98c9347edeb7ad546ef87b8aecab4c05597ebc20e57afdf67ff79b7e34c2ca type=EMPTY_BLOCK_ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22resul... 07:52:38 [07:52:38.879] INFO: prover-client:proving-broker Proving job complete id=0:EMPTY_BLOCK_ROOT_ROLLUP:ab98c9347edeb7ad546ef87b8aecab4c05597ebc20e57afdf67ff79b7e34c2ca type=EMPTY_BLOCK_ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:ab98c9347edeb7ad546ef87b8aecab4c05597ebc20e57afdf67ff79b7e34c2ca"} 07:52:39 [07:52:39.216] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 2, total jobs ready: 1 07:52:39 [07:52:39.223] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:ab98c9347edeb7ad546ef87b8aecab4c05597ebc20e57afdf67ff79b7e34c2ca type=EMPTY_BLOCK_ROOT_ROLLUP 07:52:39 [07:52:39.223] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 07:52:41 [07:52:41.203] INFO: prover-client:proving-agent Job id=0:EMPTY_BLOCK_ROOT_ROLLUP:422dc13da85bd3f440416e84dcb3da64c8c8f3529b738c4bccb057957ef14e5a type=EMPTY_BLOCK_ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22resul... 07:52:41 [07:52:41.204] INFO: prover-client:proving-broker Proving job complete id=0:EMPTY_BLOCK_ROOT_ROLLUP:422dc13da85bd3f440416e84dcb3da64c8c8f3529b738c4bccb057957ef14e5a type=EMPTY_BLOCK_ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:422dc13da85bd3f440416e84dcb3da64c8c8f3529b738c4bccb057957ef14e5a"} 07:52:41 [07:52:41.226] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 07:52:41 [07:52:41.229] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:422dc13da85bd3f440416e84dcb3da64c8c8f3529b738c4bccb057957ef14e5a type=EMPTY_BLOCK_ROOT_ROLLUP 07:52:41 [07:52:41.230] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 07:52:41 [07:52:41.242] INFO: prover-client:proving-broker New proving job id=0:ROOT_ROLLUP:d70b8458c96a13e0edc05df01678464b6e7b8792bdc0c3f1bb1585e656e69c93 epochNumber=0 {"provingJobId":"0:ROOT_ROLLUP:d70b8458c96a13e0edc05df01678464b6e7b8792bdc0c3f1bb1585e656e69c93"} 07:52:41 [07:52:41.257] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_ROLLUP:d70b8458c96a13e0edc05df01678464b6e7b8792bdc0c3f1bb1585e656e69c93 type=ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:ROOT_ROLLUP:d70b8458c96a13e0edc05df01678464b6e7b8792bdc0c3f1bb1585e656e69c93","provingJobType":"ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22input...","status":"not-found","numOutstandingJobs":1} 07:52:41 [07:52:41.301] INFO: prover-client:proving-agent Starting job id=0:ROOT_ROLLUP:d70b8458c96a13e0edc05df01678464b6e7b8792bdc0c3f1bb1585e656e69c93 type=ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22input... 07:52:41 [07:52:41.319] INFO: prover-client:proving-agent:job-controller-ce51c643 Job controller started jobId=0:ROOT_ROLLUP:d70b8458c96a13e0edc05df01678464b6e7b8792bdc0c3f1bb1585e656e69c93 {"jobId":"0:ROOT_ROLLUP:d70b8458c96a13e0edc05df01678464b6e7b8792bdc0c3f1bb1585e656e69c93"} 07:52:41 [07:52:41.466] INFO: prover-client:proving-agent Job id=0:ROOT_ROLLUP:d70b8458c96a13e0edc05df01678464b6e7b8792bdc0c3f1bb1585e656e69c93 type=ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22resul... 07:52:41 [07:52:41.467] INFO: prover-client:proving-broker Proving job complete id=0:ROOT_ROLLUP:d70b8458c96a13e0edc05df01678464b6e7b8792bdc0c3f1bb1585e656e69c93 type=ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:ROOT_ROLLUP:d70b8458c96a13e0edc05df01678464b6e7b8792bdc0c3f1bb1585e656e69c93"} 07:52:42 [07:52:42.231] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 07:52:42 [07:52:42.233] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:ROOT_ROLLUP:d70b8458c96a13e0edc05df01678464b6e7b8792bdc0c3f1bb1585e656e69c93 type=ROOT_ROLLUP 07:52:42 [07:52:42.233] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 07:52:42 [07:52:42.234] VERBOSE: prover-client:orchestrator Orchestrator completed root rollup for epoch 0 07:52:42 [07:52:42.236] INFO: prover-node:epoch-proving-job Finalised proof for epoch 0 {"epochNumber":0,"uuid":"76a088b9-37df-48be-8eab-e3e308cb18dd","duration":7051.360561999987} 07:52:42 [07:52:42.237] INFO: prover-node:epoch-proving-job Submitted proof for epoch 0 (blocks 1 to 2) {"epochNumber":0,"uuid":"76a088b9-37df-48be-8eab-e3e308cb18dd"} 07:52:42 [07:52:42.237] VERBOSE: prover-client:broker-circuit-prover-facade Stopping BrokerCircuitProverFacade 07:52:42 [07:52:42.238] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Completed job for epoch 0 with status completed 07:52:42 [07:52:42.238] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Test succeeded 07:52:42 [07:52:42.239] INFO: prover-node:prover-node Stopping ProverNode 07:52:42 [07:52:42.239] WARN: prover-node:prover-node Running promise was not started 07:52:42 [07:52:42.239] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 07:52:42 [07:52:42.240] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 07:52:42 [07:52:42.240] WARN: archiver:prover-node Running promise was not started 07:52:42 [07:52:42.240] INFO: archiver:prover-node Stopped. 07:52:42 [07:52:42.240] WARN: world-state:block_stream:prover-node Running promise was not started 07:52:42 [07:52:42.240] INFO: world_state:prover-node Stopped world state synchronizer 07:52:42 [07:52:42.240] INFO: prover-node:prover-node Stopped ProverNode 07:52:42 [07:52:42.240] INFO: node Stopping Aztec Node 07:52:44 [07:52:44.241] INFO: slasher Slasher client stopped. 07:52:44 [07:52:44.241] WARN: validator Running promise was not started 07:52:44 [07:52:44.242] WARN: sequencer Running promise was not started 07:52:44 [07:52:44.242] INFO: sequencer Stopped sequencer 07:52:44 [07:52:44.242] WARN: p2p:l2-block-stream Running promise was not started 07:52:44 [07:52:44.242] INFO: p2p P2P client stopped 07:52:44 [07:52:44.242] WARN: world-state:block_stream Running promise was not started 07:52:44 [07:52:44.243] INFO: world_state Stopped world state synchronizer 07:52:44 [07:52:44.243] WARN: archiver Running promise was not started 07:52:44 [07:52:44.243] INFO: archiver Stopped. 07:52:44 [07:52:44.243] INFO: node Stopped Aztec Node 07:52:44 [07:52:44.249] INFO: node Stopping Aztec Node 07:52:46 [07:52:46.250] INFO: slasher Slasher client stopped. 07:52:46 [07:52:46.250] WARN: validator Running promise was not started 07:52:46 [07:52:46.251] WARN: sequencer Running promise was not started 07:52:46 [07:52:46.251] INFO: sequencer Stopped sequencer 07:52:46 [07:52:46.251] WARN: p2p:l2-block-stream Running promise was not started 07:52:46 [07:52:46.251] INFO: p2p P2P client stopped 07:52:46 [07:52:46.251] WARN: world-state:block_stream Running promise was not started 07:52:46 [07:52:46.251] INFO: world_state Stopped world state synchronizer 07:52:46 [07:52:46.251] WARN: archiver Running promise was not started 07:52:46 [07:52:46.252] INFO: archiver Stopped. 07:52:46 [07:52:46.252] INFO: node Stopped Aztec Node 07:52:46 [07:52:46.252] INFO: prover-node:prover-node Stopping ProverNode 07:52:46 [07:52:46.252] WARN: prover-node:prover-node Running promise was not started 07:52:46 [07:52:46.252] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 07:52:46 [07:52:46.252] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 07:52:46 [07:52:46.252] WARN: archiver:prover-node Running promise was not started 07:52:46 [07:52:46.252] INFO: archiver:prover-node Stopped. 07:52:46 [07:52:46.252] WARN: world-state:block_stream:prover-node Running promise was not started 07:52:46 [07:52:46.253] INFO: world_state:prover-node Stopped world state synchronizer 07:52:46 [07:52:46.253] INFO: prover-node:prover-node Stopped ProverNode 07:52:46 [07:52:46.254] INFO: blob-sink:server Stopping blob sink 07:52:46 [07:52:46.254] INFO: blob-sink:server Blob sink already stopped 07:52:46 PASS src/e2e_epochs/epochs_upload_failed_proof.test.ts 07:52:46 e2e_epochs/epochs_upload_failed_proof 07:52:46 ✓ uploads failed proving job state and re-runs it on a fresh instance (95411 ms) 07:52:46 07:52:46 Test Suites: 1 passed, 1 total 07:52:46 Tests: 1 passed, 1 total 07:52:46 Snapshots: 0 total 07:52:46 Time: 103.882 s 07:52:46 Ran all test suites matching /src\/e2e_epochs\/epochs_upload_failed_proof.test.ts/i. 07:52:46 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?