Parent Log: http://ci.aztec-labs.com/e80db4f962749b47 Command: bd36d210f0eb503c:ISOLATE=1:NAME=e2e_epochs/epochs_upload_failed_proof yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_upload_failed_proof.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/314d7622c6bacc8333ae49fe9583967cab78349b Env: REF_NAME=gh-readonly-queue/next/pr-15000-c51485c507bcf668c6e55129eb2c1794af4a0732 CURRENT_VERSION=0.87.6 CI_FULL=0 Date: Fri Jun 13 11:30:17 UTC 2025 System: ARCH=arm64 CPUS=64 MEM=247Gi HOSTNAME=pr-15000_arm64_a1-fast Resources: CPU_LIST=0-63 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_476a42720cde10eb_next 11:30:17 +++ id -u 11:30:17 +++ id -g 11:30:17 ++ docker run -d --name e2e_epochs_epochs_upload_failed_proof --net=none --cpuset-cpus=0-63 --cpus=2 --memory=8g --user 1000:1000 -v/home/aztec-dev:/home/aztec-dev --mount type=tmpfs,target=/tmp,tmpfs-size=1g --workdir /home/aztec-dev/aztec-packages -e HOME -e VERBOSE -e GIT_CONFIG_GLOBAL=/home/aztec-dev/aztec-packages/build-images/src/home/.gitconfig -e FORCE_COLOR=true -e CPUS -e MEM aztecprotocol/build:3.0 /bin/bash -c 'timeout -v 600s bash -c '\''yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_upload_failed_proof.test.ts'\''' 11:30:17 + cid=bc0ad135f765d011811f3a38eae9dbf9c35334efe037f5022c26de94c2648c52 11:30:17 + set +x 11:30:18 {"level":25,"time":1749814218165,"pid":12,"hostname":"bc0ad135f765","module":"logger","msg":"Logger initialized with level verbose"} 11:30:22 [11:30:22.643] INFO: e2e:epochs_upload_failed_proof Running test: e2e_epochs/epochs_upload_failed_proof uploads failed proving job state and re-runs it on a fresh instance 11:30:22 [11:30:22.725] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Logging metrics to log/e2e_epochs_epochs_upload_failed_proof.jsonl 11:30:22 [11:30:22.848] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Calling anvil_setBlockTimestampInterval with params: [8] 11:30:22 [11:30:22.870] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Set block interval to 8 11:30:22 [11:30:22.871] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deploying contracts from 0xf39Fd6e51aad88F6F4ce6aB8827279cffFb92266 11:30:22 [11:30:22.926] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xff8f3047f70ec9e63079d7903c02a47802dc292d5660d2da825ac209bbd9cd89 {"gasLimit":867658,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 11:30:22 [11:30:22.927] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xd8B56421e9b573AE62f2997B7b58858a4413A967 in tx 0xff8f3047f70ec9e63079d7903c02a47802dc292d5660d2da825ac209bbd9cd89. 11:30:22 [11:30:22.929] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Fee Asset at 0xd8b56421e9b573ae62f2997b7b58858a4413a967 11:30:22 [11:30:22.948] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xb8a727e5dcee31d2ee7a6a94b8b01df7952fdc685dfb1b5bb36a0dbda9d08d89 {"gasLimit":867644,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 11:30:22 [11:30:22.950] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x026208feE3F4461826C8838C3569272E8C08E131 in tx 0xb8a727e5dcee31d2ee7a6a94b8b01df7952fdc685dfb1b5bb36a0dbda9d08d89. 11:30:22 [11:30:22.950] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Staking Asset at 0x026208fee3f4461826c8838c3569272e8c08e131 11:30:22 [11:30:22.970] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x84345970a64bc89d244665c6d19bcf62f7a1fb0c5497fd61c66569ea96442f1f {"gasLimit":3118894,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 11:30:22 [11:30:22.970] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xad2120681B02De3e9b8aFd325977CDeDDf15f01C in tx 0x84345970a64bc89d244665c6d19bcf62f7a1fb0c5497fd61c66569ea96442f1f. 11:30:22 [11:30:22.971] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed GSE at 0xad2120681b02de3e9b8afd325977cdeddf15f01c 11:30:22 [11:30:22.988] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x40bfc817bfed5dfbca83952f55f11755aeb54736e365af6a265a15c9788aece6 {"gasLimit":1030470,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 11:30:22 [11:30:22.988] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x0457E1c5875A76Ea6d70DF6504C35Ea0cA700D09 in tx 0x40bfc817bfed5dfbca83952f55f11755aeb54736e365af6a265a15c9788aece6. 11:30:22 [11:30:22.989] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Registry at 0x0457e1c5875a76ea6d70df6504c35ea0ca700d09 11:30:23 [11:30:23.011] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x8cba4af1cad9ce9278c21a46cf43bd8845d57b1e4554ef1b9fcec12d20b54d4f {"gasLimit":1998700,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 11:30:23 [11:30:23.011] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x0217F3C7d46D9Cb492e32a15fd0445C9002cA8b9 in tx 0x8cba4af1cad9ce9278c21a46cf43bd8845d57b1e4554ef1b9fcec12d20b54d4f. 11:30:23 [11:30:23.012] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed GovernanceProposer at 0x0217f3c7d46d9cb492e32a15fd0445c9002ca8b9 11:30:23 [11:30:23.032] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x93bfef551bbe879f16110e0a281537d501d404c043f2e37b41f4c4d75e407cd4 {"gasLimit":3091993,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 11:30:23 [11:30:23.032] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x31450eba15e933a5F875fe4f7dc33cd88fDF8a44 in tx 0x93bfef551bbe879f16110e0a281537d501d404c043f2e37b41f4c4d75e407cd4. 11:30:23 [11:30:23.032] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Governance at 0x31450eba15e933a5f875fe4f7dc33cd88fdf8a44 11:30:23 [11:30:23.041] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x731703106887c29c95dd96015a179b62177be5123206a6592459940c08f5fdb8 {"gasLimit":100000,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 11:30:23 [11:30:23.041] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Set governance on GSE in 0x731703106887c29c95dd96015a179b62177be5123206a6592459940c08f5fdb8 11:30:23 [11:30:23.056] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x043a80579eff838b6825a59ed3a98f990727338e4a2dc7df2810da5fe5aa6105 {"gasLimit":397390,"maxFeePerGas":"2.80180664","maxPriorityFeePerGas":"1.2"} 11:30:23 [11:30:23.056] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xFCE82e68Bade0325dc37c132A77C3599e9c5E45D in tx 0x043a80579eff838b6825a59ed3a98f990727338e4a2dc7df2810da5fe5aa6105. 11:30:23 [11:30:23.057] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed CoinIssuer at 0xfce82e68bade0325dc37c132a77c3599e9c5e45d 11:30:23 [11:30:23.058] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for deployments to complete 11:30:23 [11:30:23.058] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 7 transactions to be mined... 11:30:31 [11:30:31.077] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 11:30:31 [11:30:31.087] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xdd6817c8e02963f7c3d3fb5a63a82063561cf51dbd27a1b6909801d60d60bac2 {"gasLimit":100000,"maxFeePerGas":"3.04180664","maxPriorityFeePerGas":"1.44"} 11:30:31 [11:30:31.088] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added coin issuer 0xfce82e68bade0325dc37c132a77c3599e9c5e45d as minter on fee asset in 0xdd6817c8e02963f7c3d3fb5a63a82063561cf51dbd27a1b6909801d60d60bac2 11:30:31 [11:30:31.100] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xc4771a5a693e179fd41c682b7ddce4ef0c8349e0e0ea00758013a69c05af54e7 {"gasLimit":56661,"maxFeePerGas":"3.04180664","maxPriorityFeePerGas":"1.44"} 11:30:31 [11:30:31.114] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xa67ff7f4001dc5703375e116caba00222d15ec13472e10af8018f62318b463cb {"gasLimit":344517,"maxFeePerGas":"3.04180664","maxPriorityFeePerGas":"1.44"} 11:30:31 [11:30:31.114] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x3607dbAfDe17871E0D6A8f929151C30b83510D39 in tx 0xa67ff7f4001dc5703375e116caba00222d15ec13472e10af8018f62318b463cb. 11:30:31 [11:30:31.115] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed FeeAssetHandler at 0x3607dbafde17871e0d6a8f929151c30b83510d39 11:30:31 [11:30:31.126] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xa32bc1b02f5f02b41626611ec0e0056cad989330fbf908181b5d4f7678377aae {"gasLimit":56804,"maxFeePerGas":"3.04180664","maxPriorityFeePerGas":"1.44"} 11:30:31 [11:30:31.126] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added fee asset handler 0x3607dbafde17871e0d6a8f929151c30b83510d39 as minter on fee asset in 0xa32bc1b02f5f02b41626611ec0e0056cad989330fbf908181b5d4f7678377aae 11:30:31 [11:30:31.145] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x85c431a281fc3df6007a449bf2a843691449ac6268d83d65bdcb1294f8876a46 {"gasLimit":2514669,"maxFeePerGas":"3.04180664","maxPriorityFeePerGas":"1.44"} 11:30:31 [11:30:31.145] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xa5a138ed7e10B4aa19c9339Af8Fd36871867E20E in tx 0x85c431a281fc3df6007a449bf2a843691449ac6268d83d65bdcb1294f8876a46. 11:30:31 [11:30:31.146] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed StakingAssetHandler at 0xa5a138ed7e10b4aa19c9339af8fd36871867e20e 11:30:31 [11:30:31.157] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x68b1ac52702fab746a6709a8d071ed396372db7375e9f9731172c3ff76cc253f {"gasLimit":56804,"maxFeePerGas":"3.04180664","maxPriorityFeePerGas":"1.44"} 11:30:31 [11:30:31.157] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Added staking asset handler 0xa5a138ed7e10b4aa19c9339af8fd36871867e20e as minter on staking asset in 0x68b1ac52702fab746a6709a8d071ed396372db7375e9f9731172c3ff76cc253f 11:30:31 [11:30:31.158] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for deployments to complete 11:30:31 [11:30:31.158] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 9 transactions to be mined... 11:30:39 [11:30:39.168] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 11:30:39 [11:30:39.180] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed shared contracts 11:30:39 [11:30:39.194] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x0f6e8d0a7fa27679d65afe958385a9cfe3f900d7c2c8678773eea4a83c2f3565 {"gasLimit":84823,"maxFeePerGas":"3.254960181","maxPriorityFeePerGas":"1.728"} 11:30:39 [11:30:39.195] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Funded reward distributor with 10000000000000000000000000 fee asset in 0x0f6e8d0a7fa27679d65afe958385a9cfe3f900d7c2c8678773eea4a83c2f3565 11:30:39 [11:30:39.208] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xafae2bce817964e03d65ffc7098a5931443a78f3c2cf5bc1ad54cab3f74cba7e {"gasLimit":154658,"maxFeePerGas":"3.254960181","maxPriorityFeePerGas":"1.728"} 11:30:39 [11:30:39.209] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x277E22B0C9698d7f2A1cD7C6d857511617587309 in tx 0xafae2bce817964e03d65ffc7098a5931443a78f3c2cf5bc1ad54cab3f74cba7e. 11:30:39 [11:30:39.209] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup will use the mock verifier at 0x277e22b0c9698d7f2a1cd7c6d857511617587309 11:30:39 [11:30:39.209] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup config args {"aztecSlotDuration":16,"aztecEpochDuration":4,"targetCommitteeSize":48,"aztecProofSubmissionWindow":7,"slashingQuorum":6,"slashingRoundSize":10,"manaTarget":10000000000,"provingCostPerMana":100,"rewardConfig":{"sequencerBps":5000,"increment":200000,"maxScore":5000000,"a":5000,"k":1000000,"minimum":100000}} 11:30:39 [11:30:39.221] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x9b8fcce8fbf1b288af249076ad3b42bd30c3426b19b46e3df7ee5adc7dd1ae89 {"gasLimit":87007,"maxFeePerGas":"3.254960181","maxPriorityFeePerGas":"1.728"} 11:30:39 [11:30:39.221] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xd48A22E7Ff69d668F57f3552EFbD1A216CE88de0 in tx 0x9b8fcce8fbf1b288af249076ad3b42bd30c3426b19b46e3df7ee5adc7dd1ae89. 11:30:39 [11:30:39.243] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x8752e6a308655bcf9ddf88cd1fead0dd2c1f44c22bdc116d4644a7a534e56259 {"gasLimit":5159372,"maxFeePerGas":"3.254960181","maxPriorityFeePerGas":"1.728"} 11:30:39 [11:30:39.244] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xd35a88d9600aA0E1b78606BEFC75cF8eBDbfaEB7 in tx 0x8752e6a308655bcf9ddf88cd1fead0dd2c1f44c22bdc116d4644a7a534e56259. 11:30:39 [11:30:39.262] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x6d8d68310157b335b5bdefeaac9432898319097ddb6649e56299be1234b6747f {"gasLimit":2478502,"maxFeePerGas":"3.254960181","maxPriorityFeePerGas":"1.728"} 11:30:39 [11:30:39.263] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x362ed3b498254b6eBA23fF1C62fE7dc7F2085E25 in tx 0x6d8d68310157b335b5bdefeaac9432898319097ddb6649e56299be1234b6747f. 11:30:39 [11:30:39.263] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Awaiting for linked libraries to be deployed 11:30:47 [11:30:47.330] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x41e58269054ed057d09d1dcd59073940c03815ae589e2ea321cb8b4d62ba0760 {"gasLimit":10881888,"maxFeePerGas":"3.442000992","maxPriorityFeePerGas":"2.0736"} 11:30:47 [11:30:47.330] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x710a7410b9E5c432bF30DBE8488eE6a1D605ad98 in tx 0x41e58269054ed057d09d1dcd59073940c03815ae589e2ea321cb8b4d62ba0760. 11:30:47 [11:30:47.331] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed Rollup at 0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98 {"aztecSlotDuration":16,"aztecEpochDuration":4,"targetCommitteeSize":48,"aztecProofSubmissionWindow":7,"slashingQuorum":6,"slashingRoundSize":10,"manaTarget":10000000000,"provingCostPerMana":100,"rewardConfig":{"sequencerBps":5000,"increment":200000,"maxScore":5000000,"a":5000,"k":1000000,"minimum":100000}} 11:30:47 [11:30:47.331] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 11 transactions to be mined... 11:30:55 [11:30:55.342] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 11:30:55 [11:30:55.342] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof All core contracts have been deployed 11:30:55 [11:30:55.360] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xcd568bf83b8cdf37f91146d37468b098f31e2f351c6d4a798a456fecbeb13fc6 {"gasLimit":1056496,"maxFeePerGas":"3.760309389","maxPriorityFeePerGas":"2.48832"} 11:30:55 [11:30:55.360] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x228B335f402495ef473c8C7F21888c9D6bA6e259 in tx 0xcd568bf83b8cdf37f91146d37468b098f31e2f351c6d4a798a456fecbeb13fc6. 11:30:55 [11:30:55.361] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Deployed SlashFactory at 0x228b335f402495ef473c8c7f21888c9d6ba6e259 11:30:55 [11:30:55.386] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x5509e7c59fd67a5b9c62b6645f5dbea86c69f1abfb37c42c5a545fbce4f3a419 {"gasLimit":116979,"maxFeePerGas":"3.760309389","maxPriorityFeePerGas":"2.48832"} 11:30:55 [11:30:55.386] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Adding rollup 0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98 to registry 0x0457e1c5875a76ea6d70df6504c35ea0ca700d09 in tx 0x5509e7c59fd67a5b9c62b6645f5dbea86c69f1abfb37c42c5a545fbce4f3a419 11:30:55 [11:30:55.402] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xa8ab1c842c263f7b318a7199847131e0a1a1fb08109857d7bd20905234992c96 {"gasLimit":109478,"maxFeePerGas":"3.760309389","maxPriorityFeePerGas":"2.48832"} 11:30:55 [11:30:55.403] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Adding rollup 0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98 to GSE 0xad2120681b02de3e9b8afd325977cdeddf15f01c in tx 0xa8ab1c842c263f7b318a7199847131e0a1a1fb08109857d7bd20905234992c96 11:31:03 [11:31:03.411] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 12 transactions to be mined... 11:31:03 [11:31:03.444] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 11:31:03 [11:31:03.449] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Rollup deployed 11:31:03 [11:31:03.449] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for rollup and slash factory to be deployed 11:31:03 [11:31:03.449] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 12 transactions to be mined... 11:31:03 [11:31:03.478] INFO: e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully 11:31:03 [11:31:03.478] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof All transactions for L1 deployment have been mined 11:31:03 [11:31:03.496] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Aztec L1 contracts initialized {"registryAddress":"0x0457e1c5875a76ea6d70df6504c35ea0ca700d09","governanceAddress":"0x31450eba15e933a5f875fe4f7dc33cd88fdf8a44","governanceProposerAddress":"0x0217f3c7d46d9cb492e32a15fd0445c9002ca8b9","rollupAddress":"0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98","inboxAddress":"0x532329e607f50ffb130b273d067884845da6ad0e","outboxAddress":"0x5bf178d6a4947c326747729f026e07241800cc7b","feeJuicePortalAddress":"0x250004947a2f2471d6206e8eab4b092258b00b4a","feeJuiceAddress":"0xd8b56421e9b573ae62f2997b7b58858a4413a967","stakingAssetAddress":"0x026208fee3f4461826c8838c3569272e8c08e131","rewardDistributorAddress":"0x9381ccab81e4825ecea8790086173fa46818441a","gseAddress":"0xad2120681b02de3e9b8afd325977cdeddf15f01c","coinIssuerAddress":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266"} 11:31:03 [11:31:03.496] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Handing over to governance 11:31:03 [11:31:03.499] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Calling evm_setNextBlockTimestamp with params: [1749814270] 11:31:03 [11:31:03.500] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Calling hardhat_mine with params: [1] 11:31:03 [11:31:03.503] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Jumped to slot 1 11:31:03 [11:31:03.508] INFO: aztecjs:utils:watcher Watcher not started because not auto mining 11:31:03 [11:31:03.509] INFO: telemetry:client Using NoopTelemetryClient 11:31:03 [11:31:03.511] INFO: kv-store:lmdb-v2:blob-sink Creating blob-sink data store at directory /tmp/4ba6213dcfee43ed/blob-sink with map size 134217728 KB (LMDB v2) 11:31:03 [11:31:03.514] INFO: kv-store:lmdb-v2:blob-sink Starting data store with maxReaders 16 11:31:03 [11:31:03.521] INFO: blob-sink:server Server is running on http://localhost:44601 11:31:03 [11:31:03.521] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating and synching an aztec node... 11:31:03 [11:31:03.521] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Using native ACVM binary at ../../noir/noir-repo/target/release/acvm with working directory /tmp/a9557e4f/acvm 11:31:03 [11:31:03.522] INFO: node:blob-sink:client Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:44601"} 11:31:03 [11:31:03.543] VERBOSE: node Snapshot sync is disabled. No snapshots URL provided. 11:31:03 [11:31:03.544] INFO: archiver:lmdb Creating archiver data store at directory /tmp/4ba6213dcfee43ed/archiver with map size 134217728 KB (LMDB v2) 11:31:03 [11:31:03.545] INFO: archiver:lmdb Starting data store with maxReaders 16 11:31:04 [11:31:04.138] INFO: node:blob-sink:client Testing configured blob sources {"blobSinkUrl":"http://localhost:44601"} 11:31:04 [11:31:04.153] INFO: node:blob-sink:client Blob sink is reachable {"blobSinkUrl":"http://localhost:44601"} 11:31:04 [11:31:04.153] WARN: node:blob-sink:client No L1 consensus host urls configured 11:31:04 [11:31:04.153] WARN: node:blob-sink:client No archive client configured 11:31:04 [11:31:04.156] INFO: archiver Starting archiver sync to rollup contract 0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98 from L1 block 4 to current L1 block 6 with hash 0x81e9cecc3538d2c33ae21bcdd969a9ad867e6bebfc083f3554c203aa16c08c68 {"blocksSynchedTo":4,"messagesSynchedTo":{"l1BlockHash":"0x05abffdb94b1dbe8bf745ba236d17281b0ce78c810ca270884ffc6b4be22ac42","l1BlockNumber":4}} 11:31:04 [11:31:04.170] INFO: archiver Initial archiver sync to L1 block 6 complete. {"l1BlockNumber":6,"syncPoint":{"blocksSynchedTo":6,"messagesSynchedTo":{"l1BlockHash":"0x81e9cecc3538d2c33ae21bcdd969a9ad867e6bebfc083f3554c203aa16c08c68","l1BlockNumber":6}},"latest":{"number":0},"proven":{"number":0},"finalized":{"number":0}} 11:31:04 [11:31:04.174] INFO: world-state:database Creating world state data store at directory /tmp/4ba6213dcfee43ed/world_state with map sizes {"archiveTreeMapSizeKb":134217728,"nullifierTreeMapSizeKb":134217728,"noteHashTreeMapSizeKb":134217728,"messageTreeMapSizeKb":134217728,"publicDataTreeMapSizeKb":134217728} and 2 threads. 11:31:04 [11:31:04.197] INFO: world_state Created world state synchroniser with block history of 2 11:31:04 [11:31:04.198] WARN: node Aztec node is accepting fake proofs 11:31:04 [11:31:04.210] INFO: p2p:lmdb-v2 Creating p2p data store at directory /tmp/4ba6213dcfee43ed/p2p with map size 134217728 KB (LMDB v2) 11:31:04 [11:31:04.211] INFO: p2p:lmdb-v2 Starting data store with maxReaders 16 11:31:04 [11:31:04.212] INFO: p2p-archive:lmdb-v2 Creating p2p-archive data store at directory /tmp/4ba6213dcfee43ed/p2p-archive with map size 134217728 KB (LMDB v2) 11:31:04 [11:31:04.213] INFO: p2p-archive:lmdb-v2 Starting data store with maxReaders 16 11:31:04 [11:31:04.214] INFO: p2p-peer:lmdb-v2 Creating p2p-peers data store at directory /tmp/4ba6213dcfee43ed/p2p-peers with map size 134217728 KB (LMDB v2) 11:31:04 [11:31:04.215] INFO: p2p-peer:lmdb-v2 Starting data store with maxReaders 16 11:31:04 [11:31:04.216] INFO: p2p:tx_pool Setting maximum tx mempool size {"maxTxPoolSize":100000000} 11:31:04 [11:31:04.216] VERBOSE: p2p P2P is disabled. Using dummy P2P service 11:31:04 [11:31:04.219] VERBOSE: world-state:block_stream Starting L2 block stream {"proven":false,"pollIntervalMS":50} 11:31:04 [11:31:04.219] INFO: world_state Started world state synchronizer from block 1 11:31:04 [11:31:04.221] VERBOSE: world-state:block_stream Starting sync from block number 0 11:31:04 [11:31:04.224] INFO: p2p Starting p2p client from block 0 with empty mempools 11:31:04 [11:31:04.225] VERBOSE: p2p:l2-block-stream Starting L2 block stream {"batchSize":20,"pollIntervalMS":100,"startingBlock":0} 11:31:04 [11:31:04.465] INFO: epoch-prune-watcher EpochPruneWatcher initialized 11:31:04 [11:31:04.498] VERBOSE: validator Initialized validator with addresses: 0xa7ad7990bb626fafcea7bec5d462755f42b3caef 11:31:04 [11:31:04.498] VERBOSE: node All Aztec Node subsystems synced 11:31:04 [11:31:04.507] INFO: slasher Starting Slasher client... 11:31:04 [11:31:04.517] INFO: sequencer-client Deploying forwarder contract 11:31:04 [11:31:04.518] VERBOSE: p2p:l2-block-stream Starting sync from block number 0 11:31:04 [11:31:04.534] VERBOSE: sequencer-client Sent L1 transaction 0x3d07cbb2e2a50f106d409ba54b95c43263e3739c559dd5a92c2a2d757d427921 {"gasLimit":323704,"maxFeePerGas":"2.26741193","maxPriorityFeePerGas":"1.2"} 11:31:04 [11:31:04.534] VERBOSE: sequencer-client Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000042 to address 0x0fe4d493871B0C51332De8A330B02BA8172Da4aC in tx 0x3d07cbb2e2a50f106d409ba54b95c43263e3739c559dd5a92c2a2d757d427921. 11:31:12 [11:31:12.541] INFO: sequencer-client Forwarder contract deployed at 0x0fe4d493871b0c51332de8a330b02ba8172da4ac 11:31:12 [11:31:12.548] INFO: validator Started validator with addresses: 0xa7ad7990bb626fafcea7bec5d462755f42b3caef 11:31:12 [11:31:12.548] VERBOSE: validator Validators 0xa7ad7990bb626fafcea7bec5d462755f42b3caef are not on the validator committee for epoch 0 11:31:12 [11:31:12.549] INFO: sequencer Sequencer config set {"transactionPollingIntervalMS":500,"maxTxsPerBlock":32,"minTxsPerBlock":0,"maxL2BlockGas":10000000000,"publishTxsWithProposals":false,"maxDABlockGas":10000000000,"acvmWorkingDirectory":"/tmp/a9557e4f/acvm","acvmBinaryPath":"../../noir/noir-repo/target/release/acvm","maxBlockSizeInBytes":1048576,"governanceProposerPayload":"0x0000000000000000000000000000000000000000","maxL1TxInclusionTimeIntoSlot":8,"enforceTimeTable":false} 11:31:12 [11:31:12.549] VERBOSE: sequencer Sequencer timetable updated {"enforceTimeTable":false} 11:31:12 [11:31:12.551] INFO: sequencer Sequencer started with address 0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266 11:31:12 [11:31:12.552] INFO: node Aztec Node version: 0.87.6 11:31:12 [11:31:12.552] INFO: node Aztec Node started on chain 0x7a69 {"registryAddress":"0x0457e1c5875a76ea6d70df6504c35ea0ca700d09","governanceAddress":"0x31450eba15e933a5f875fe4f7dc33cd88fdf8a44","governanceProposerAddress":"0x0217f3c7d46d9cb492e32a15fd0445c9002ca8b9","rollupAddress":"0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98","inboxAddress":"0x532329e607f50ffb130b273d067884845da6ad0e","outboxAddress":"0x5bf178d6a4947c326747729f026e07241800cc7b","feeJuicePortalAddress":"0x250004947a2f2471d6206e8eab4b092258b00b4a","feeJuiceAddress":"0xd8b56421e9b573ae62f2997b7b58858a4413a967","stakingAssetAddress":"0x026208fee3f4461826c8838c3569272e8c08e131","rewardDistributorAddress":"0x9381ccab81e4825ecea8790086173fa46818441a","gseAddress":"0xad2120681b02de3e9b8afd325977cdeddf15f01c","coinIssuerAddress":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","slashFactoryAddress":"0x228b335f402495ef473c8c7f21888c9d6ba6e259","feeAssetHandlerAddress":"0x3607dbafde17871e0d6a8f929151c30b83510d39","stakingAssetHandlerAddress":"0xa5a138ed7e10b4aa19c9339af8fd36871867e20e","zkPassportVerifierAddress":"0xee9f10f38319eae2730dba28fb09081db806c5e5"} 11:31:12 [11:31:12.553] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating and syncing a simulated prover node... 11:31:12 [11:31:12.596] INFO: blob-sink:client:prover-node Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:44601"} 11:31:12 [11:31:12.604] INFO: archiver:lmdb:prover-node Creating archiver data store at directory /tmp/4ba6213dcfee43ed/538339eeb5a6f348/archiver with map size 134217728 KB (LMDB v2) 11:31:12 [11:31:12.607] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 11:31:12 [11:31:12.608] INFO: archiver:lmdb:prover-node Starting data store with maxReaders 16 11:31:12 [11:31:12.864] INFO: blob-sink:client:prover-node Testing configured blob sources {"blobSinkUrl":"http://localhost:44601"} 11:31:12 [11:31:12.867] INFO: blob-sink:client:prover-node Blob sink is reachable {"blobSinkUrl":"http://localhost:44601"} 11:31:12 [11:31:12.867] WARN: blob-sink:client:prover-node No L1 consensus host urls configured 11:31:12 [11:31:12.867] WARN: blob-sink:client:prover-node No archive client configured 11:31:12 [11:31:12.869] INFO: archiver:prover-node Starting archiver sync to rollup contract 0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98 from L1 block 4 to current L1 block 7 with hash 0x07cd822a603b2b430e1a751dce93f7428b15323f67fbbcb080dbfffbb8a413c3 {"blocksSynchedTo":4,"messagesSynchedTo":{"l1BlockHash":"0x05abffdb94b1dbe8bf745ba236d17281b0ce78c810ca270884ffc6b4be22ac42","l1BlockNumber":4}} 11:31:12 [11:31:12.885] INFO: archiver:prover-node Initial archiver sync to L1 block 7 complete. {"l1BlockNumber":7,"syncPoint":{"blocksSynchedTo":7,"messagesSynchedTo":{"l1BlockHash":"0x07cd822a603b2b430e1a751dce93f7428b15323f67fbbcb080dbfffbb8a413c3","l1BlockNumber":7}},"latest":{"number":0},"proven":{"number":0},"finalized":{"number":0}} 11:31:12 [11:31:12.887] INFO: prover-node:blob-sink:client:prover-node Creating HTTP blob sink client. {"blobSinkUrl":"http://localhost:44601"} 11:31:12 [11:31:12.887] VERBOSE: prover-node:prover-node Snapshot sync is disabled. No snapshots URL provided. 11:31:12 [11:31:12.888] VERBOSE: prover-node:prover-node Created archiver and synced to block 0 11:31:12 [11:31:12.891] INFO: world-state:database:prover-node Creating world state data store at directory /tmp/4ba6213dcfee43ed/538339eeb5a6f348/world_state with map sizes {"archiveTreeMapSizeKb":134217728,"nullifierTreeMapSizeKb":134217728,"noteHashTreeMapSizeKb":134217728,"messageTreeMapSizeKb":134217728,"publicDataTreeMapSizeKb":134217728} and 2 threads. 11:31:12 [11:31:12.912] INFO: world_state:prover-node Created world state synchroniser with block history of 2 11:31:12 [11:31:12.913] VERBOSE: world-state:block_stream:prover-node Starting L2 block stream {"proven":false,"pollIntervalMS":50} 11:31:12 [11:31:12.913] INFO: world_state:prover-node Started world state synchronizer from block 1 11:31:12 [11:31:12.914] VERBOSE: world-state:block_stream:prover-node Starting sync from block number 0 11:31:12 [11:31:12.915] WARN: prover-client:proving-broker-database:prover-node Found invalid epoch directory /tmp/4ba6213dcfee43ed/538339eeb5a6f348/archiver when loading epoch databases, ignoring 11:31:12 [11:31:12.915] WARN: prover-client:proving-broker-database:prover-node Found invalid epoch directory /tmp/4ba6213dcfee43ed/538339eeb5a6f348/world_state when loading epoch databases, ignoring 11:31:12 [11:31:12.916] INFO: prover-client:proving-broker:prover-node Proving Broker started 11:31:12 [11:31:12.926] INFO: prover-node:prover-coordination:prover-node Using prover coordination via aztec node 11:31:12 [11:31:12.928] INFO: e2e:e2e_epochs:epochs_upload_failed_proof:prover-node Created and synced prover node {"publisherAddress":"0x3C44CdDdB6a900fa2b585dd299e03d12FA4293BC"} 11:31:12 [11:31:12.928] INFO: prover-node:epoch-monitor:prover-node Started EpochMonitor {"pollingIntervalMs":200} 11:31:12 [11:31:12.932] INFO: prover-node:prover-node Started Prover Node with prover id 0x0000000000000000000000000000000000000000000000000000000000000001 {"proverNodePollingIntervalMs":200,"proverNodeMaxPendingJobs":10,"proverNodeMaxParallelBlocksPerEpoch":32,"txGatheringIntervalMs":1000,"txGatheringBatchSize":10,"txGatheringMaxParallelRequestsPerNode":100,"proverNodeFailedEpochStore":"file:///tmp/failed-proofs-d9YsPr","dataDirectory":"/tmp/4ba6213dcfee43ed/538339eeb5a6f348","l1ChainId":31337,"rollupVersion":2144252525} 11:31:12 [11:31:12.932] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Creating a pxe... 11:31:12 [11:31:12.935] INFO: pxe:data:lmdb Creating pxe_data data store at directory /tmp/d33db54a841f8d10/pxe_data with map size 134217728 KB (LMDB v2) 11:31:12 [11:31:12.937] INFO: pxe:data:lmdb Starting data store with maxReaders 16 11:31:13 [11:31:13.181] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 11:31:13 [11:31:13.216] VERBOSE: pxe:service Registered protocol contracts in pxe {"AuthRegistry":"0x0000000000000000000000000000000000000000000000000000000000000001","ContractInstanceDeployer":"0x0000000000000000000000000000000000000000000000000000000000000002","ContractClassRegisterer":"0x0000000000000000000000000000000000000000000000000000000000000003","MultiCallEntrypoint":"0x0000000000000000000000000000000000000000000000000000000000000004","FeeJuice":"0x0000000000000000000000000000000000000000000000000000000000000005","Router":"0x0000000000000000000000000000000000000000000000000000000000000006"} 11:31:13 [11:31:13.217] INFO: pxe:service Started PXE connected to chain 31337 version 2144252525 11:31:13 [11:31:13.221] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L2 genesis at L1 block 4 (timestamp 1749814254) 11:31:13 [11:31:13.222] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Waiting until L1 timestamp 1749814318 is reached as the start of epoch 1 11:31:13 [11:31:13.448] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 7 mined at 11:31:18 with new L2 block 0 for epoch 0 with proof up to L2 block 0 for epoch 0 {"l1Timestamp":1749814278,"l1BlockNumber":7,"l2SlotNumber":1,"l2BlockNumber":0,"l2ProvenBlockNumber":0,"totalL2Messages":0} 11:31:13 [11:31:13.686] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 11:31:14 [11:31:14.192] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 11:31:14 [11:31:14.698] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 11:31:15 [11:31:15.204] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 11:31:15 [11:31:15.709] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 11:31:16 [11:31:16.216] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 11:31:16 [11:31:16.721] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 11:31:17 [11:31:17.228] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 11:31:17 [11:31:17.733] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 1 but got 2. {"rollup":[2,1],"newBlockNumber":1,"expectedSlot":1} 11:31:18 [11:31:18.243] VERBOSE: sequencer Preparing proposal for block 1 at slot 2 {"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1749814286,"version":2144252525},"chainTipArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","blockNumber":1,"slot":2} 11:31:18 [11:31:18.254] VERBOSE: block-builder Building block 1 for slot 2 {"slot":2,"slotStart":"2025-06-13T11:31:26.000Z","now":"2025-06-13T11:31:18.254Z","blockNumber":1,"msgCount":0,"opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}} 11:31:18 [11:31:18.257] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.00043318900000303983s {"duration":0.00043318900000303983,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 11:31:18 [11:31:18.271] INFO: sequencer Built block 1 for slot 2 with 0 txs and 0 messages. 0 mana/s {"blockHash":"0x288d2c4eedb3ce75808cba9da702e42b08788d25d7be8b6ef11b99eb48a1b4cb","globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1749814286,"version":2144252525},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":23.29443700000411,"publicProcessDuration":1.1450089999998454,"rollupCircuitsDuration":16.770528000000922,"txCount":0,"blockNumber":1,"blockTimestamp":1749814286,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 11:31:18 [11:31:18.273] VERBOSE: sequencer Attesting committee is empty 11:31:18 [11:31:18.826] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 8 mined at 11:31:26 {"l1Timestamp":1749814286,"l1BlockNumber":8,"l2SlotNumber":2,"l2BlockNumber":0,"l2ProvenBlockNumber":0,"totalL2Messages":0} 11:31:20 [11:31:20.871] VERBOSE: ethereum:tx_delayer Sent tx immediately 0x9b87ad2d833a21a37df9b235d71560fdb46f4f4322a6f2495b158e5735b73779 11:31:20 [11:31:20.871] VERBOSE: node Sent L1 transaction 0x9b87ad2d833a21a37df9b235d71560fdb46f4f4322a6f2495b158e5735b73779 {"gasLimit":485668,"maxFeePerGas":"2.373985441","maxPriorityFeePerGas":"1.44","maxFeePerBlobGas":"0.000000001"} 11:31:26 [11:31:26.740] INFO: sequencer:publisher Bundled [propose] transaction [succeeded] 11:31:26 [11:31:26.741] VERBOSE: sequencer:publisher Published L2 block to L1 rollup contract {"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0x9b87ad2d833a21a37df9b235d71560fdb46f4f4322a6f2495b158e5735b73779","calldataSize":1220,"calldataGas":8840,"txCount":0,"blockNumber":1,"blockTimestamp":1749814286,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 11:31:26 [11:31:26.741] VERBOSE: node:blob-sink:client Sending 1 blobs to blob sink 11:31:26 [11:31:26.754] INFO: blob-sink:server Received blob sidecar for block 0x0ce7f3744ced10b18dd2cc635d661b49d6ccb28735f47914d09cd52db89191c5 11:31:26 [11:31:26.761] INFO: blob-sink:server Blob sidecar stored successfully for block 0x0ce7f3744ced10b18dd2cc635d661b49d6ccb28735f47914d09cd52db89191c5 11:31:26 [11:31:26.828] INFO: archiver:prover-node Downloaded L2 block 1 {"blockHash":"0x288d2c4eedb3ce75808cba9da702e42b08788d25d7be8b6ef11b99eb48a1b4cb","blockNumber":1,"txCount":0,"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1749814286,"version":2144252525},"archiveRoot":"0x171b1a57e2378bb0b5f2275780220fd30bebbdb75e71094cf7a1074130bee2b7","archiveNextLeafIndex":2} 11:31:26 [11:31:26.855] INFO: archiver Downloaded L2 block 1 {"blockHash":"0x288d2c4eedb3ce75808cba9da702e42b08788d25d7be8b6ef11b99eb48a1b4cb","blockNumber":1,"txCount":0,"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1749814286,"version":2144252525},"archiveRoot":"0x171b1a57e2378bb0b5f2275780220fd30bebbdb75e71094cf7a1074130bee2b7","archiveNextLeafIndex":2} 11:31:26 [11:31:26.864] INFO: world_state:prover-node World state updated with L2 block 1 {"eventName":"l2-block-handled","duration":4.991347000002861,"unfinalisedBlockNumber":1,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":1,"blockTimestamp":1749814286,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 11:31:26 [11:31:26.868] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 9 mined at 11:31:34 with new L2 block 1 for epoch 0 {"l1Timestamp":1749814294,"l1BlockNumber":9,"l2SlotNumber":2,"l2BlockNumber":1,"l2ProvenBlockNumber":0,"totalL2Messages":0} 11:31:26 [11:31:26.884] INFO: world_state World state updated with L2 block 1 {"eventName":"l2-block-handled","duration":2.3568899999954738,"unfinalisedBlockNumber":1,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":1,"blockTimestamp":1749814286,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 11:31:26 [11:31:26.900] VERBOSE: p2p Synched to latest block 1 11:31:26 [11:31:26.938] VERBOSE: prover-node:prover-node Fetching 0 tx hashes for block number 1 from coordination 11:31:26 [11:31:26.938] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 11:31:27 [11:31:27.252] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 11:31:27 [11:31:27.759] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 11:31:28 [11:31:28.268] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 11:31:28 [11:31:28.777] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 11:31:29 [11:31:29.283] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 11:31:29 [11:31:29.792] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 11:31:30 [11:31:30.298] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 11:31:30 [11:31:30.807] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 11:31:31 [11:31:31.315] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 11:31:31 [11:31:31.826] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 11:31:32 [11:31:32.333] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 11:31:32 [11:31:32.841] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 11:31:33 [11:31:33.350] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 11:31:33 [11:31:33.857] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 2 but got 3. {"rollup":[3,2],"newBlockNumber":2,"expectedSlot":2} 11:31:34 [11:31:34.368] VERBOSE: sequencer Preparing proposal for block 2 at slot 3 {"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1749814302,"version":2144252525},"chainTipArchive":"0x171b1a57e2378bb0b5f2275780220fd30bebbdb75e71094cf7a1074130bee2b7","blockNumber":2,"slot":3} 11:31:34 [11:31:34.379] VERBOSE: block-builder Building block 2 for slot 3 {"slot":3,"slotStart":"2025-06-13T11:31:42.000Z","now":"2025-06-13T11:31:34.379Z","blockNumber":2,"msgCount":0,"opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}} 11:31:34 [11:31:34.381] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.0002152979999955278s {"duration":0.0002152979999955278,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 11:31:34 [11:31:34.394] INFO: sequencer Built block 2 for slot 3 with 0 txs and 0 messages. 0 mana/s {"blockHash":"0x210201de7820ed6e8cd9f3e74ae4d9ff235903a09865c895c5e271d7da578796","globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1749814302,"version":2144252525},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":19.107734999997774,"publicProcessDuration":0.5605460000078892,"rollupCircuitsDuration":14.31768199999351,"txCount":0,"blockNumber":2,"blockTimestamp":1749814302,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 11:31:34 [11:31:34.395] VERBOSE: sequencer Attesting committee is empty 11:31:34 [11:31:34.463] VERBOSE: ethereum:tx_delayer Sent tx immediately 0x417d919c1670a55763ff0c97ab80d36be6fd9f0a3e6ba85b62b23868104193c6 11:31:34 [11:31:34.463] VERBOSE: node Sent L1 transaction 0x417d919c1670a55763ff0c97ab80d36be6fd9f0a3e6ba85b62b23868104193c6 {"gasLimit":414631,"maxFeePerGas":"2.444898715","maxPriorityFeePerGas":"1.728","maxFeePerBlobGas":"0.000000001"} 11:31:34 [11:31:34.779] INFO: sequencer:publisher Bundled [propose] transaction [succeeded] 11:31:34 [11:31:34.780] VERBOSE: sequencer:publisher Published L2 block to L1 rollup contract {"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0x417d919c1670a55763ff0c97ab80d36be6fd9f0a3e6ba85b62b23868104193c6","calldataSize":1220,"calldataGas":8840,"txCount":0,"blockNumber":2,"blockTimestamp":1749814302,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 11:31:34 [11:31:34.780] VERBOSE: node:blob-sink:client Sending 1 blobs to blob sink 11:31:34 [11:31:34.789] WARN: blob-sink:client:prover-node Unable to get blob sidecar for 0x0fd611754a51b510c2a416ab3e75e0355094612a34c71a32e542efea4a972a65: Not Found (404) {"status":404,"statusText":"Not Found","body":"{\"error\":\"Blob not found\"}"} 11:31:34 [11:31:34.790] WARN: blob-sink:client:prover-node Failed to fetch blobs for 0x0fd611754a51b510c2a416ab3e75e0355094612a34c71a32e542efea4a972a65 from all blob sources {"blobSinkUrl":"http://localhost:44601"} 11:31:34 [11:31:34.791] INFO: blob-sink:server Received blob sidecar for block 0x0fd611754a51b510c2a416ab3e75e0355094612a34c71a32e542efea4a972a65 11:31:34 [11:31:34.796] INFO: blob-sink:server Blob sidecar stored successfully for block 0x0fd611754a51b510c2a416ab3e75e0355094612a34c71a32e542efea4a972a65 11:31:34 [11:31:34.835] INFO: archiver Downloaded L2 block 2 {"blockHash":"0x210201de7820ed6e8cd9f3e74ae4d9ff235903a09865c895c5e271d7da578796","blockNumber":2,"txCount":0,"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1749814302,"version":2144252525},"archiveRoot":"0x1baa7ef64a7f7b6652f64c3e627fb205c9216dd0061ecfa9fb06590d7e30cf1f","archiveNextLeafIndex":3} 11:31:34 [11:31:34.844] INFO: e2e:e2e_epochs:epochs_upload_failed_proof L1 block 10 mined at 11:31:42 with new L2 block 2 for epoch 0 {"l1Timestamp":1749814302,"l1BlockNumber":10,"l2SlotNumber":3,"l2BlockNumber":2,"l2ProvenBlockNumber":0,"totalL2Messages":0} 11:31:34 [11:31:34.856] VERBOSE: p2p Synched to latest block 2 11:31:34 [11:31:34.880] INFO: archiver:prover-node Downloaded L2 block 2 {"blockHash":"0x210201de7820ed6e8cd9f3e74ae4d9ff235903a09865c895c5e271d7da578796","blockNumber":2,"txCount":0,"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1749814302,"version":2144252525},"archiveRoot":"0x1baa7ef64a7f7b6652f64c3e627fb205c9216dd0061ecfa9fb06590d7e30cf1f","archiveNextLeafIndex":3} 11:31:34 [11:31:34.886] INFO: world_state World state updated with L2 block 2 {"eventName":"l2-block-handled","duration":2.578829999998561,"unfinalisedBlockNumber":2,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":2,"blockTimestamp":1749814302,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 11:31:34 [11:31:34.904] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 11:31:34 [11:31:34.904] VERBOSE: prover-node:prover-node Gathered all 0 txs for epoch 0 {"epochNumber":0} 11:31:34 [11:31:34.905] INFO: world_state:prover-node World state updated with L2 block 2 {"eventName":"l2-block-handled","duration":3.4422559999948135,"unfinalisedBlockNumber":2,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":2,"blockTimestamp":1749814302,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0} 11:31:34 [11:31:34.906] VERBOSE: prover-node:prover-node Gathered all 0 messages for epoch 0 {"epochNumber":0} 11:31:34 [11:31:34.906] VERBOSE: prover-node:prover-node Gathered previous block header 0 for epoch 0 11:31:34 [11:31:34.906] VERBOSE: prover-node:prover-node Creating proving job for epoch 0 for block range 1 to 2 11:31:34 [11:31:34.908] INFO: prover-node:epoch-proving-job Starting epoch 0 proving job with blocks 1 to 2 {"fromBlock":1,"toBlock":2,"epochSizeBlocks":2,"epochNumber":0,"uuid":"381442ba-da24-411f-8d15-03158ed10ad8"} 11:31:34 [11:31:34.923] INFO: prover-client:orchestrator Starting epoch 0 with 2 blocks 11:31:34 [11:31:34.923] VERBOSE: prover-client:broker-circuit-prover-facade Starting BrokerCircuitProverFacade 11:31:34 [11:31:34.925] VERBOSE: prover-node:epoch-proving-job Starting processing block 1 {"number":1,"blockHash":"0x288d2c4eedb3ce75808cba9da702e42b08788d25d7be8b6ef11b99eb48a1b4cb","lastArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"381442ba-da24-411f-8d15-03158ed10ad8","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x000000000000000000000000000000000000000000000000000000007fceb26d","blockNumber":1,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 11:31:34 [11:31:34.925] INFO: prover-client:orchestrator Starting block 1 for slot 2 11:31:34 [11:31:34.926] VERBOSE: prover-node:epoch-proving-job Starting processing block 2 {"number":2,"blockHash":"0x210201de7820ed6e8cd9f3e74ae4d9ff235903a09865c895c5e271d7da578796","lastArchive":"0x171b1a57e2378bb0b5f2275780220fd30bebbdb75e71094cf7a1074130bee2b7","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"381442ba-da24-411f-8d15-03158ed10ad8","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x000000000000000000000000000000000000000000000000000000007fceb26d","blockNumber":2,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000003","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 11:31:34 [11:31:34.926] INFO: prover-client:orchestrator Starting block 2 for slot 3 11:31:34 [11:31:34.934] INFO: prover-client:proving-broker:prover-node New proving job id=0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8 epochNumber=0 {"provingJobId":"0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8"} 11:31:34 [11:31:34.935] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8","provingJobType":"BASE_PARITY"} 11:31:34 [11:31:34.935] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8","provingJobType":"BASE_PARITY"} 11:31:34 [11:31:34.935] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8","provingJobType":"BASE_PARITY"} 11:31:34 [11:31:34.942] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000014084000009461307s {"duration":0.000014084000009461307,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 11:31:34 [11:31:34.943] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 11:31:34 [11:31:34.945] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 1 {"blockNumber":1,"blockHash":"0x288d2c4eedb3ce75808cba9da702e42b08788d25d7be8b6ef11b99eb48a1b4cb","uuid":"381442ba-da24-411f-8d15-03158ed10ad8"} 11:31:34 [11:31:34.945] VERBOSE: prover-client:orchestrator Block 1 completed. Assembling header. 11:31:34 [11:31:34.949] VERBOSE: prover-node:prover-node Fetching 0 tx hashes for block number 2 from coordination 11:31:34 [11:31:34.949] INFO: prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool 11:31:34 [11:31:34.953] VERBOSE: prover-client:orchestrator Updating archive tree with block 1 header 0x288d2c4eedb3ce75808cba9da702e42b08788d25d7be8b6ef11b99eb48a1b4cb 11:31:34 [11:31:34.956] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8","provingJobType":"BASE_PARITY"} 11:31:34 [11:31:34.956] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8","provingJobType":"BASE_PARITY"} 11:31:34 [11:31:34.956] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8","provingJobType":"BASE_PARITY"} 11:31:34 [11:31:34.957] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8","provingJobType":"BASE_PARITY"} 11:31:34 [11:31:34.958] VERBOSE: prover-client:orchestrator Orchestrator finalised block 1 11:31:34 [11:31:34.967] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000011100999996415339s {"duration":0.000011100999996415339,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 11:31:34 [11:31:34.967] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 11:31:34 [11:31:34.968] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 2 {"blockNumber":2,"blockHash":"0x210201de7820ed6e8cd9f3e74ae4d9ff235903a09865c895c5e271d7da578796","uuid":"381442ba-da24-411f-8d15-03158ed10ad8"} 11:31:34 [11:31:34.969] VERBOSE: prover-client:orchestrator Block 2 completed. Assembling header. 11:31:34 [11:31:34.973] VERBOSE: prover-client:orchestrator Updating archive tree with block 2 header 0x210201de7820ed6e8cd9f3e74ae4d9ff235903a09865c895c5e271d7da578796 11:31:34 [11:31:34.975] VERBOSE: prover-client:orchestrator Orchestrator finalised block 2 11:31:34 [11:31:34.988] INFO: prover-client:proving-broker-database:prover-node Creating broker database for epoch 0 at /tmp/4ba6213dcfee43ed/538339eeb5a6f348/0 with map size 134217728 11:31:34 [11:31:34.990] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 11:31:34 [11:31:34.991] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8 type=BASE_PARITY epochNumber=0 {"provingJobId":"0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8","provingJobType":"BASE_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...","status":"not-found","numOutstandingJobs":1} 11:31:35 [11:31:35.088] INFO: prover-client:proving-agent:prover-node Starting job id=0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8 type=BASE_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input... 11:31:35 [11:31:35.100] INFO: prover-client:proving-agent:job-controller-043f217b Job controller started jobId=0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8 {"jobId":"0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8"} 11:31:35 [11:31:35.179] INFO: prover-client:proving-agent:prover-node Job id=0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8 type=BASE_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22resul... 11:31:35 [11:31:35.180] INFO: prover-client:proving-broker:prover-node Proving job complete id=0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8 type=BASE_PARITY totalAttempts=1 {"provingJobId":"0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8"} 11:31:35 [11:31:35.295] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 11:31:35 error: "Rollup__SlotAlreadyInChain(3, 3)" 11:31:35 [11:31:35.296] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 11:31:35 [11:31:35.808] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 11:31:35 error: "Rollup__SlotAlreadyInChain(3, 3)" 11:31:35 [11:31:35.808] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 11:31:35 [11:31:35.924] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 11:31:35 [11:31:35.926] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8 type=BASE_PARITY 11:31:35 [11:31:35.926] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 11:31:35 [11:31:35.937] INFO: prover-client:proving-broker:prover-node New proving job id=0:ROOT_PARITY:6b1f42d6109bfe2ce2a4aa1e3b8fb4b8e545bf5d231d584b39a4ecb8cc4c2711 epochNumber=0 {"provingJobId":"0:ROOT_PARITY:6b1f42d6109bfe2ce2a4aa1e3b8fb4b8e545bf5d231d584b39a4ecb8cc4c2711"} 11:31:35 [11:31:35.942] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:ROOT_PARITY:6b1f42d6109bfe2ce2a4aa1e3b8fb4b8e545bf5d231d584b39a4ecb8cc4c2711 type=ROOT_PARITY {"provingJobId":"0:ROOT_PARITY:6b1f42d6109bfe2ce2a4aa1e3b8fb4b8e545bf5d231d584b39a4ecb8cc4c2711","provingJobType":"ROOT_PARITY"} 11:31:35 [11:31:35.986] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Triggering error on finaliseEpoch 11:31:35 [11:31:35.993] ERROR: prover-node:epoch-proving-job Error running epoch 0 prover job: Error: Fake error while proving epoch 11:31:35 at ServerEpochProver.epochProver.finaliseEpoch (/home/aztec-dev/aztec-packages/yarn-project/end-to-end/src/e2e_epochs/epochs_upload_failed_proof.test.ts:60:15) 11:31:35 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:142:64) 11:31:35 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) {"uuid":"381442ba-da24-411f-8d15-03158ed10ad8","epochNumber":0} 11:31:35 [11:31:35.993] VERBOSE: prover-client:broker-circuit-prover-facade Stopping BrokerCircuitProverFacade 11:31:35 [11:31:35.994] ERROR: prover-client:broker-circuit-prover-facade Job errored with 'Broker facade stopped' id=0:ROOT_PARITY:6b1f42d6109bfe2ce2a4aa1e3b8fb4b8e545bf5d231d584b39a4ecb8cc4c2711 type=ROOT_PARITY: { 11:31:35 provingJobId: '0:ROOT_PARITY:6b1f42d6109bfe2ce2a4aa1e3b8fb4b8e545bf5d231d584b39a4ecb8cc4c2711', 11:31:35 provingJobType: 'ROOT_PARITY' 11:31:35 } 11:31:35 [11:31:35.995] ERROR: prover-client:orchestrator Error thrown when proving job: Error: Broker facade stopped 11:31:35 at BrokerCircuitProverFacade.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/proving_broker/broker_prover_facade.js:142:31) 11:31:35 at ServerEpochProver.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/prover-client/server-epoch-prover.js:31:9) 11:31:35 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:183:13) 11:31:35 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) 11:31:35 [11:31:35.995] ERROR: prover-node:prover-node Job for 0 exited with state failed: { 11:31:35 id: '381442ba-da24-411f-8d15-03158ed10ad8', 11:31:35 epochNumber: 0n, 11:31:35 state: 'failed' 11:31:35 } 11:31:35 [11:31:35.996] WARN: prover-node:prover-node Uploading epoch proof failure for 0 to file:///tmp/failed-proofs-d9YsPr {"epochNumber":0,"jobId":"381442ba-da24-411f-8d15-03158ed10ad8","location":"file:///tmp/failed-proofs-d9YsPr"} 11:31:35 [11:31:35.997] INFO: stdlib:file-store Creating local file file store at /tmp/failed-proofs-d9YsPr 11:31:35 [11:31:35.998] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_PARITY:6b1f42d6109bfe2ce2a4aa1e3b8fb4b8e545bf5d231d584b39a4ecb8cc4c2711 type=ROOT_PARITY epochNumber=0 {"provingJobId":"0:ROOT_PARITY:6b1f42d6109bfe2ce2a4aa1e3b8fb4b8e545bf5d231d584b39a4ecb8cc4c2711","provingJobType":"ROOT_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu...","status":"not-found","numOutstandingJobs":0} 11:31:35 [11:31:35.998] ERROR: prover-client:orchestrator Error thrown when proving job: Error: Broker facade stopped 11:31:35 at BrokerCircuitProverFacade.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/proving_broker/broker_prover_facade.js:142:31) 11:31:35 at ServerEpochProver.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/prover-client/server-epoch-prover.js:31:9) 11:31:35 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:183:13) 11:31:35 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13) 11:31:35 [11:31:35.999] INFO: prover-node:prover-node Pausing archiver and world state sync to start snapshot upload 11:31:36 [11:31:36.000] INFO: archiver:prover-node Stopped. 11:31:36 [11:31:36.000] INFO: world_state:prover-node Stopped sync 11:31:36 [11:31:36.000] INFO: prover-node:prover-node Creating backups of lmdb environments to /tmp/4ba6213dcfee43ed/538339eeb5a6f348/epoch-proof-data-ZfJJbO 11:31:36 [11:31:36.003] INFO: prover-node:prover-node Data stores backed up to /tmp/4ba6213dcfee43ed/538339eeb5a6f348/epoch-proof-data-ZfJJbO {"paths":{"l1-to-l2-message-tree":"/tmp/4ba6213dcfee43ed/538339eeb5a6f348/epoch-proof-data-ZfJJbO/world-state/L1ToL2MessageTree/data.mdb","archive-tree":"/tmp/4ba6213dcfee43ed/538339eeb5a6f348/epoch-proof-data-ZfJJbO/world-state/ArchiveTree/data.mdb","public-data-tree":"/tmp/4ba6213dcfee43ed/538339eeb5a6f348/epoch-proof-data-ZfJJbO/world-state/PublicDataTree/data.mdb","note-hash-tree":"/tmp/4ba6213dcfee43ed/538339eeb5a6f348/epoch-proof-data-ZfJJbO/world-state/NoteHashTree/data.mdb","nullifier-tree":"/tmp/4ba6213dcfee43ed/538339eeb5a6f348/epoch-proof-data-ZfJJbO/world-state/NullifierTree/data.mdb","archiver":"/tmp/4ba6213dcfee43ed/538339eeb5a6f348/epoch-proof-data-ZfJJbO/archiver/data.mdb"}} 11:31:36 [11:31:36.003] INFO: prover-node:prover-node Resuming archiver and world state sync 11:31:36 [11:31:36.003] VERBOSE: world-state:block_stream:prover-node Starting L2 block stream {"proven":false,"pollIntervalMS":50} 11:31:36 [11:31:36.004] INFO: world_state:prover-node Resumed sync 11:31:36 [11:31:36.004] INFO: archiver:prover-node Restarting archiver 11:31:36 [11:31:36.008] INFO: prover-client:proving-agent:prover-node Starting job id=0:ROOT_PARITY:6b1f42d6109bfe2ce2a4aa1e3b8fb4b8e545bf5d231d584b39a4ecb8cc4c2711 type=ROOT_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu... 11:31:36 [11:31:36.025] INFO: prover-client:proving-agent:job-controller-642fc8b1 Job controller started jobId=0:ROOT_PARITY:6b1f42d6109bfe2ce2a4aa1e3b8fb4b8e545bf5d231d584b39a4ecb8cc4c2711 {"jobId":"0:ROOT_PARITY:6b1f42d6109bfe2ce2a4aa1e3b8fb4b8e545bf5d231d584b39a4ecb8cc4c2711"} 11:31:36 [11:31:36.035] WARN: prover-node:prover-node Uploaded epoch 0 proof failure data to file:///tmp/failed-proofs-d9YsPr/aztec-31337-2144252525-0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98/0-20250613113136-381442ba-da24-411f-8d15-03158ed10ad8 {"epochNumber":0,"location":"file:///tmp/failed-proofs-d9YsPr","basePath":"aztec-31337-2144252525-0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98/0-20250613113136-381442ba-da24-411f-8d15-03158ed10ad8","metadataUrl":"file:///tmp/failed-proofs-d9YsPr/aztec-31337-2144252525-0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98/0-20250613113136-381442ba-da24-411f-8d15-03158ed10ad8/metadata.json","dataUrl":"file:///tmp/failed-proofs-d9YsPr/aztec-31337-2144252525-0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98/0-20250613113136-381442ba-da24-411f-8d15-03158ed10ad8/data.bin","metadata":{"l1BlockNumber":10,"l2BlockHash":"0x210201de7820ed6e8cd9f3e74ae4d9ff235903a09865c895c5e271d7da578796","l2BlockNumber":2,"schemaVersions":{"archiver":2,"worldState":1},"timestamp":1749814296004,"dataUrls":{"l1-to-l2-message-tree":"file:///tmp/failed-proofs-d9YsPr/aztec-31337-2144252525-0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98/0-20250613113136-381442ba-da24-411f-8d15-03158ed10ad8/l1-to-l2-message-tree.db","archive-tree":"file:///tmp/failed-proofs-d9YsPr/aztec-31337-2144252525-0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98/0-20250613113136-381442ba-da24-411f-8d15-03158ed10ad8/archive-tree.db","public-data-tree":"file:///tmp/failed-proofs-d9YsPr/aztec-31337-2144252525-0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98/0-20250613113136-381442ba-da24-411f-8d15-03158ed10ad8/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-d9YsPr/aztec-31337-2144252525-0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98/0-20250613113136-381442ba-da24-411f-8d15-03158ed10ad8/note-hash-tree.db","nullifier-tree":"file:///tmp/failed-proofs-d9YsPr/aztec-31337-2144252525-0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98/0-20250613113136-381442ba-da24-411f-8d15-03158ed10ad8/nullifier-tree.db","archiver":"file:///tmp/failed-proofs-d9YsPr/aztec-31337-2144252525-0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98/0-20250613113136-381442ba-da24-411f-8d15-03158ed10ad8/archiver.db"}},"jobId":"381442ba-da24-411f-8d15-03158ed10ad8"} 11:31:36 [11:31:36.035] INFO: prover-node:prover-node Cleaning up backup dir /tmp/4ba6213dcfee43ed/538339eeb5a6f348/epoch-proof-data-ZfJJbO 11:31:36 [11:31:36.141] INFO: prover-client:proving-agent:prover-node Job id=0:ROOT_PARITY:6b1f42d6109bfe2ce2a4aa1e3b8fb4b8e545bf5d231d584b39a4ecb8cc4c2711 type=ROOT_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22resu... 11:31:36 [11:31:36.142] INFO: prover-client:proving-broker:prover-node Proving job complete id=0:ROOT_PARITY:6b1f42d6109bfe2ce2a4aa1e3b8fb4b8e545bf5d231d584b39a4ecb8cc4c2711 type=ROOT_PARITY totalAttempts=1 {"provingJobId":"0:ROOT_PARITY:6b1f42d6109bfe2ce2a4aa1e3b8fb4b8e545bf5d231d584b39a4ecb8cc4c2711"} 11:31:36 [11:31:36.318] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 11:31:36 error: "Rollup__SlotAlreadyInChain(3, 3)" 11:31:36 [11:31:36.319] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 11:31:36 [11:31:36.832] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 11:31:36 error: "Rollup__SlotAlreadyInChain(3, 3)" 11:31:36 [11:31:36.832] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 11:31:37 [11:31:37.341] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 11:31:37 error: "Rollup__SlotAlreadyInChain(3, 3)" 11:31:37 [11:31:37.341] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 11:31:37 [11:31:37.850] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 11:31:37 error: "Rollup__SlotAlreadyInChain(3, 3)" 11:31:37 [11:31:37.850] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 11:31:38 [11:31:38.358] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 11:31:38 error: "Rollup__SlotAlreadyInChain(3, 3)" 11:31:38 [11:31:38.358] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 11:31:38 [11:31:38.868] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 11:31:38 error: "Rollup__SlotAlreadyInChain(3, 3)" 11:31:38 [11:31:38.868] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 11:31:39 [11:31:39.378] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 11:31:39 error: "Rollup__SlotAlreadyInChain(3, 3)" 11:31:39 [11:31:39.378] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 11:31:39 [11:31:39.888] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 11:31:39 error: "Rollup__SlotAlreadyInChain(3, 3)" 11:31:39 [11:31:39.888] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 11:31:40 [11:31:40.397] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 11:31:40 error: "Rollup__SlotAlreadyInChain(3, 3)" 11:31:40 [11:31:40.397] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 11:31:40 [11:31:40.906] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 11:31:40 error: "Rollup__SlotAlreadyInChain(3, 3)" 11:31:40 [11:31:40.906] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 11:31:41 [11:31:41.415] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 11:31:41 error: "Rollup__SlotAlreadyInChain(3, 3)" 11:31:41 [11:31:41.415] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 11:31:41 [11:31:41.925] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 11:31:41 error: "Rollup__SlotAlreadyInChain(3, 3)" 11:31:41 [11:31:41.925] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 11:31:42 [11:31:42.433] WARN: sequencer:publisher Failed canProposeAtTime check with SlotAlreadyInChain 11:31:42 error: "Rollup__SlotAlreadyInChain(3, 3)" 11:31:42 [11:31:42.434] WARN: sequencer Cannot propose block 3 at slot 3 due to failed rollup contract check 11:31:42 [11:31:42.741] INFO: prover-node:prover-node Stopping ProverNode 11:31:42 [11:31:42.741] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 11:31:42 [11:31:42.742] INFO: archiver:prover-node Stopped. 11:31:42 [11:31:42.743] INFO: world_state:prover-node Stopped world state synchronizer 11:31:42 [11:31:42.743] INFO: prover-node:prover-node Stopped ProverNode 11:31:42 [11:31:42.743] INFO: node Stopping Aztec Node 11:31:42 [11:31:42.940] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 3 but got 4. {"rollup":[4,3],"newBlockNumber":3,"expectedSlot":3} 11:31:43 [11:31:43.447] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 3 but got 4. {"rollup":[4,3],"newBlockNumber":3,"expectedSlot":3} 11:31:43 [11:31:43.953] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 3 but got 4. {"rollup":[4,3],"newBlockNumber":3,"expectedSlot":3} 11:31:44 [11:31:44.460] WARN: sequencer Cannot propose block due to slot mismatch with rollup contract (this can be caused by a clock out of sync). Expected slot 3 but got 4. {"rollup":[4,3],"newBlockNumber":3,"expectedSlot":3} 11:31:44 [11:31:44.744] INFO: slasher Slasher client stopped. 11:31:44 [11:31:44.745] INFO: sequencer Stopped sequencer 11:31:44 [11:31:44.745] INFO: p2p P2P client stopped 11:31:44 [11:31:44.746] INFO: world_state Stopped world state synchronizer 11:31:44 [11:31:44.746] INFO: archiver Stopped. 11:31:44 [11:31:44.747] INFO: node Stopped Aztec Node 11:31:44 [11:31:44.747] INFO: node Stopping Aztec Node 11:31:46 [11:31:46.748] INFO: slasher Slasher client stopped. 11:31:46 [11:31:46.749] WARN: validator Running promise was not started 11:31:46 [11:31:46.749] WARN: sequencer Running promise was not started 11:31:46 [11:31:46.749] INFO: sequencer Stopped sequencer 11:31:46 [11:31:46.749] WARN: p2p:l2-block-stream Running promise was not started 11:31:46 [11:31:46.749] INFO: p2p P2P client stopped 11:31:46 [11:31:46.749] WARN: world-state:block_stream Running promise was not started 11:31:46 [11:31:46.749] INFO: world_state Stopped world state synchronizer 11:31:46 [11:31:46.750] WARN: archiver Running promise was not started 11:31:46 [11:31:46.750] INFO: archiver Stopped. 11:31:46 [11:31:46.750] INFO: node Stopped Aztec Node 11:31:46 [11:31:46.750] INFO: prover-node:prover-node Stopping ProverNode 11:31:46 [11:31:46.750] WARN: prover-node:prover-node Running promise was not started 11:31:46 [11:31:46.750] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 11:31:46 [11:31:46.750] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 11:31:46 [11:31:46.750] WARN: archiver:prover-node Running promise was not started 11:31:46 [11:31:46.750] INFO: archiver:prover-node Stopped. 11:31:46 [11:31:46.750] WARN: world-state:block_stream:prover-node Running promise was not started 11:31:46 [11:31:46.751] INFO: world_state:prover-node Stopped world state synchronizer 11:31:46 [11:31:46.751] INFO: prover-node:prover-node Stopped ProverNode 11:31:46 [11:31:46.758] INFO: blob-sink:server Stopping blob sink 11:31:46 [11:31:46.759] INFO: blob-sink:server Blob sink stopped 11:31:46 [11:31:46.761] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data and state {"uploadPath":"/tmp/failed-proofs-d9YsPr","rerunDataDir":"/tmp/rerun-data-KKOG3u","rerunDownloadPath":"/tmp/rerun-download-qBo54X/data.bin"} 11:31:46 [11:31:46.762] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data from file:///tmp/failed-proofs-d9YsPr/aztec-31337-2144252525-0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98/0-20250613113136-381442ba-da24-411f-8d15-03158ed10ad8 11:31:46 [11:31:46.762] INFO: stdlib:file-store Creating local file file store at /tmp/failed-proofs-d9YsPr/aztec-31337-2144252525-0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98/0-20250613113136-381442ba-da24-411f-8d15-03158ed10ad8 11:31:46 [11:31:46.763] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading state snapshot from file:///tmp/failed-proofs-d9YsPr/aztec-31337-2144252525-0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98/0-20250613113136-381442ba-da24-411f-8d15-03158ed10ad8 to local data directory {"metadata":{"l2BlockNumber":2,"l2BlockHash":"0x210201de7820ed6e8cd9f3e74ae4d9ff235903a09865c895c5e271d7da578796","l1BlockNumber":10,"l1ChainId":31337,"rollupVersion":2144252525,"rollupAddress":"0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98"},"dataUrls":{"archiver":"file:///tmp/failed-proofs-d9YsPr/aztec-31337-2144252525-0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98/0-20250613113136-381442ba-da24-411f-8d15-03158ed10ad8/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-d9YsPr/aztec-31337-2144252525-0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98/0-20250613113136-381442ba-da24-411f-8d15-03158ed10ad8/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-d9YsPr/aztec-31337-2144252525-0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98/0-20250613113136-381442ba-da24-411f-8d15-03158ed10ad8/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-d9YsPr/aztec-31337-2144252525-0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98/0-20250613113136-381442ba-da24-411f-8d15-03158ed10ad8/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-d9YsPr/aztec-31337-2144252525-0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98/0-20250613113136-381442ba-da24-411f-8d15-03158ed10ad8/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-d9YsPr/aztec-31337-2144252525-0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98/0-20250613113136-381442ba-da24-411f-8d15-03158ed10ad8/l1-to-l2-message-tree.db"}} 11:31:46 [11:31:46.763] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Creating local file file store at /tmp/failed-proofs-d9YsPr/aztec-31337-2144252525-0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98/0-20250613113136-381442ba-da24-411f-8d15-03158ed10ad8 11:31:46 [11:31:46.764] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading snapshot to /tmp/rerun-data-KKOG3u/download-PeKnP1 {"snapshot":{"dataUrls":{"archiver":"file:///tmp/failed-proofs-d9YsPr/aztec-31337-2144252525-0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98/0-20250613113136-381442ba-da24-411f-8d15-03158ed10ad8/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-d9YsPr/aztec-31337-2144252525-0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98/0-20250613113136-381442ba-da24-411f-8d15-03158ed10ad8/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-d9YsPr/aztec-31337-2144252525-0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98/0-20250613113136-381442ba-da24-411f-8d15-03158ed10ad8/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-d9YsPr/aztec-31337-2144252525-0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98/0-20250613113136-381442ba-da24-411f-8d15-03158ed10ad8/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-d9YsPr/aztec-31337-2144252525-0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98/0-20250613113136-381442ba-da24-411f-8d15-03158ed10ad8/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-d9YsPr/aztec-31337-2144252525-0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98/0-20250613113136-381442ba-da24-411f-8d15-03158ed10ad8/l1-to-l2-message-tree.db"}},"downloadPaths":{"archiver":"/tmp/rerun-data-KKOG3u/download-PeKnP1/archiver.db","nullifier-tree":"/tmp/rerun-data-KKOG3u/download-PeKnP1/nullifier-tree.db","public-data-tree":"/tmp/rerun-data-KKOG3u/download-PeKnP1/public-data-tree.db","note-hash-tree":"/tmp/rerun-data-KKOG3u/download-PeKnP1/note-hash-tree.db","archive-tree":"/tmp/rerun-data-KKOG3u/download-PeKnP1/archive-tree.db","l1-to-l2-message-tree":"/tmp/rerun-data-KKOG3u/download-PeKnP1/l1-to-l2-message-tree.db"}} 11:31:46 [11:31:46.765] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Snapshot downloaded at /tmp/rerun-data-KKOG3u/download-PeKnP1 {"snapshot":{"dataUrls":{"archiver":"file:///tmp/failed-proofs-d9YsPr/aztec-31337-2144252525-0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98/0-20250613113136-381442ba-da24-411f-8d15-03158ed10ad8/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-d9YsPr/aztec-31337-2144252525-0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98/0-20250613113136-381442ba-da24-411f-8d15-03158ed10ad8/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-d9YsPr/aztec-31337-2144252525-0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98/0-20250613113136-381442ba-da24-411f-8d15-03158ed10ad8/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-d9YsPr/aztec-31337-2144252525-0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98/0-20250613113136-381442ba-da24-411f-8d15-03158ed10ad8/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-d9YsPr/aztec-31337-2144252525-0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98/0-20250613113136-381442ba-da24-411f-8d15-03158ed10ad8/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-d9YsPr/aztec-31337-2144252525-0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98/0-20250613113136-381442ba-da24-411f-8d15-03158ed10ad8/l1-to-l2-message-tree.db"}},"downloadPaths":{"archiver":"/tmp/rerun-data-KKOG3u/download-PeKnP1/archiver.db","nullifier-tree":"/tmp/rerun-data-KKOG3u/download-PeKnP1/nullifier-tree.db","public-data-tree":"/tmp/rerun-data-KKOG3u/download-PeKnP1/public-data-tree.db","note-hash-tree":"/tmp/rerun-data-KKOG3u/download-PeKnP1/note-hash-tree.db","archive-tree":"/tmp/rerun-data-KKOG3u/download-PeKnP1/archive-tree.db","l1-to-l2-message-tree":"/tmp/rerun-data-KKOG3u/download-PeKnP1/l1-to-l2-message-tree.db"}} 11:31:46 [11:31:46.766] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Archiver database set up from snapshot {"path":"/tmp/rerun-data-KKOG3u/archiver","dbVersion":2,"rollupAddress":"0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98"} 11:31:46 [11:31:46.767] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database l1-to-l2-message-tree set up from snapshot {"path":"/tmp/rerun-data-KKOG3u/world_state/L1ToL2MessageTree","dbVersion":1,"rollupAddress":"0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98"} 11:31:46 [11:31:46.767] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database archive-tree set up from snapshot {"path":"/tmp/rerun-data-KKOG3u/world_state/ArchiveTree","dbVersion":1,"rollupAddress":"0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98"} 11:31:46 [11:31:46.767] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database public-data-tree set up from snapshot {"path":"/tmp/rerun-data-KKOG3u/world_state/PublicDataTree","dbVersion":1,"rollupAddress":"0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98"} 11:31:46 [11:31:46.767] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database note-hash-tree set up from snapshot {"path":"/tmp/rerun-data-KKOG3u/world_state/NoteHashTree","dbVersion":1,"rollupAddress":"0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98"} 11:31:46 [11:31:46.768] INFO: e2e:e2e_epochs:epochs_upload_failed_proof World state database nullifier-tree set up from snapshot {"path":"/tmp/rerun-data-KKOG3u/world_state/NullifierTree","dbVersion":1,"rollupAddress":"0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98"} 11:31:46 [11:31:46.768] INFO: e2e:e2e_epochs:epochs_upload_failed_proof P2P database cleared {"path":"/tmp/rerun-data-KKOG3u/p2p"} 11:31:46 [11:31:46.768] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data from file:///tmp/failed-proofs-d9YsPr/aztec-31337-2144252525-0x710a7410b9e5c432bf30dbe8488ee6a1d605ad98/0-20250613113136-381442ba-da24-411f-8d15-03158ed10ad8/data.bin to /tmp/rerun-download-qBo54X/data.bin 11:31:46 [11:31:46.769] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Epoch proving job data for epoch 0 downloaded successfully 11:31:46 [11:31:46.769] WARN: e2e:e2e_epochs:epochs_upload_failed_proof Rerunning proving job from /tmp/rerun-download-qBo54X/data.bin 11:31:46 [11:31:46.770] VERBOSE: e2e:e2e_epochs:epochs_upload_failed_proof Using native ACVM binary at ../../noir/noir-repo/target/release/acvm with working directory /tmp/48982520/acvm 11:31:46 [11:31:46.770] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Loaded proving job data for epoch 0 11:31:46 [11:31:46.772] INFO: world-state:database Creating world state data store at directory /tmp/rerun-data-KKOG3u/world_state with map sizes {"archiveTreeMapSizeKb":1048576,"nullifierTreeMapSizeKb":1048576,"noteHashTreeMapSizeKb":1048576,"messageTreeMapSizeKb":1048576,"publicDataTreeMapSizeKb":1048576} and 2 threads. 11:31:46 [11:31:46.783] INFO: archiver:lmdb Creating archiver data store at directory /tmp/rerun-data-KKOG3u/archiver with map size 1048576 KB (LMDB v2) 11:31:46 [11:31:46.784] INFO: archiver:lmdb Starting data store with maxReaders 16 11:31:46 [11:31:46.785] WARN: prover-client:proving-broker-database Found invalid epoch directory /tmp/rerun-data-KKOG3u/archiver when loading epoch databases, ignoring 11:31:46 [11:31:46.785] WARN: prover-client:proving-broker-database Found invalid epoch directory /tmp/rerun-data-KKOG3u/world_state when loading epoch databases, ignoring 11:31:46 [11:31:46.786] INFO: prover-client:proving-broker Proving Broker started 11:31:46 [11:31:46.786] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Rerunning epoch proving job for epoch 0 11:31:46 [11:31:46.786] INFO: prover-node:epoch-proving-job Starting epoch 0 proving job with blocks 1 to 2 {"fromBlock":1,"toBlock":2,"epochSizeBlocks":2,"epochNumber":0,"uuid":"8ccb055e-1c6d-4a90-8be8-c880da72adc2"} 11:31:46 [11:31:46.801] INFO: prover-client:orchestrator Starting epoch 0 with 2 blocks 11:31:46 [11:31:46.801] VERBOSE: prover-client:broker-circuit-prover-facade Starting BrokerCircuitProverFacade 11:31:46 [11:31:46.802] VERBOSE: prover-node:epoch-proving-job Starting processing block 1 {"number":1,"blockHash":"0x288d2c4eedb3ce75808cba9da702e42b08788d25d7be8b6ef11b99eb48a1b4cb","lastArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"8ccb055e-1c6d-4a90-8be8-c880da72adc2","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x000000000000000000000000000000000000000000000000000000007fceb26d","blockNumber":1,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 11:31:46 [11:31:46.803] INFO: prover-client:orchestrator Starting block 1 for slot 2 11:31:46 [11:31:46.803] VERBOSE: prover-node:epoch-proving-job Starting processing block 2 {"number":2,"blockHash":"0x210201de7820ed6e8cd9f3e74ae4d9ff235903a09865c895c5e271d7da578796","lastArchive":"0x171b1a57e2378bb0b5f2275780220fd30bebbdb75e71094cf7a1074130bee2b7","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"8ccb055e-1c6d-4a90-8be8-c880da72adc2","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x000000000000000000000000000000000000000000000000000000007fceb26d","blockNumber":2,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000003","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}} 11:31:46 [11:31:46.803] INFO: prover-client:orchestrator Starting block 2 for slot 3 11:31:46 [11:31:46.810] INFO: prover-client:proving-broker New proving job id=0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8 epochNumber=0 {"provingJobId":"0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8"} 11:31:46 [11:31:46.810] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8","provingJobType":"BASE_PARITY"} 11:31:46 [11:31:46.811] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8","provingJobType":"BASE_PARITY"} 11:31:46 [11:31:46.811] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8","provingJobType":"BASE_PARITY"} 11:31:46 [11:31:46.814] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8","provingJobType":"BASE_PARITY"} 11:31:46 [11:31:46.814] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8","provingJobType":"BASE_PARITY"} 11:31:46 [11:31:46.814] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8","provingJobType":"BASE_PARITY"} 11:31:46 [11:31:46.814] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8 type=BASE_PARITY {"provingJobId":"0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8","provingJobType":"BASE_PARITY"} 11:31:46 [11:31:46.816] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000011263000007602385s {"duration":0.000011263000007602385,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 11:31:46 [11:31:46.816] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 11:31:46 [11:31:46.816] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 1 {"blockNumber":1,"blockHash":"0x288d2c4eedb3ce75808cba9da702e42b08788d25d7be8b6ef11b99eb48a1b4cb","uuid":"8ccb055e-1c6d-4a90-8be8-c880da72adc2"} 11:31:46 [11:31:46.816] VERBOSE: prover-client:orchestrator Block 1 completed. Assembling header. 11:31:46 [11:31:46.821] VERBOSE: prover-client:orchestrator Updating archive tree with block 1 header 0x288d2c4eedb3ce75808cba9da702e42b08788d25d7be8b6ef11b99eb48a1b4cb 11:31:46 [11:31:46.822] INFO: simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000011139000009279698s {"duration":0.000011139000009279698,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0} 11:31:46 [11:31:46.822] WARN: prover-client:orchestrator Provided no txs to orchestrator addTxs. 11:31:46 [11:31:46.823] VERBOSE: prover-node:epoch-proving-job Processed all 0 txs for block 2 {"blockNumber":2,"blockHash":"0x210201de7820ed6e8cd9f3e74ae4d9ff235903a09865c895c5e271d7da578796","uuid":"8ccb055e-1c6d-4a90-8be8-c880da72adc2"} 11:31:46 [11:31:46.823] VERBOSE: prover-client:orchestrator Block 2 completed. Assembling header. 11:31:46 [11:31:46.823] VERBOSE: prover-client:orchestrator Orchestrator finalised block 1 11:31:46 [11:31:46.835] VERBOSE: prover-client:orchestrator Updating archive tree with block 2 header 0x210201de7820ed6e8cd9f3e74ae4d9ff235903a09865c895c5e271d7da578796 11:31:46 [11:31:46.837] VERBOSE: prover-client:orchestrator Orchestrator finalised block 2 11:31:46 [11:31:46.860] INFO: prover-client:proving-broker-database Creating broker database for epoch 0 at /tmp/rerun-data-KKOG3u/0 with map size 1048576 11:31:46 [11:31:46.862] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 11:31:46 [11:31:46.864] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8 type=BASE_PARITY epochNumber=0 {"provingJobId":"0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8","provingJobType":"BASE_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...","status":"not-found","numOutstandingJobs":1} 11:31:46 [11:31:46.886] INFO: prover-client:proving-agent Starting job id=0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8 type=BASE_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input... 11:31:46 [11:31:46.887] INFO: prover-client:proving-agent:job-controller-c3f1e3f8 Job controller started jobId=0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8 {"jobId":"0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8"} 11:31:46 [11:31:46.942] INFO: prover-client:proving-agent Job id=0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8 type=BASE_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22resul... 11:31:46 [11:31:46.942] INFO: prover-client:proving-broker Proving job complete id=0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8 type=BASE_PARITY totalAttempts=1 {"provingJobId":"0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8"} 11:31:47 [11:31:47.802] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 11:31:47 [11:31:47.803] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:BASE_PARITY:d9717f04d366ac5420129e4dcc8ca082ff8061385bc4238be035cacc5373f9a8 type=BASE_PARITY 11:31:47 [11:31:47.803] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 11:31:47 [11:31:47.812] INFO: prover-client:proving-broker New proving job id=0:ROOT_PARITY:6b1f42d6109bfe2ce2a4aa1e3b8fb4b8e545bf5d231d584b39a4ecb8cc4c2711 epochNumber=0 {"provingJobId":"0:ROOT_PARITY:6b1f42d6109bfe2ce2a4aa1e3b8fb4b8e545bf5d231d584b39a4ecb8cc4c2711"} 11:31:47 [11:31:47.817] VERBOSE: prover-client:broker-circuit-prover-facade Job already found in facade id=0:ROOT_PARITY:6b1f42d6109bfe2ce2a4aa1e3b8fb4b8e545bf5d231d584b39a4ecb8cc4c2711 type=ROOT_PARITY {"provingJobId":"0:ROOT_PARITY:6b1f42d6109bfe2ce2a4aa1e3b8fb4b8e545bf5d231d584b39a4ecb8cc4c2711","provingJobType":"ROOT_PARITY"} 11:31:47 [11:31:47.864] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_PARITY:6b1f42d6109bfe2ce2a4aa1e3b8fb4b8e545bf5d231d584b39a4ecb8cc4c2711 type=ROOT_PARITY epochNumber=0 {"provingJobId":"0:ROOT_PARITY:6b1f42d6109bfe2ce2a4aa1e3b8fb4b8e545bf5d231d584b39a4ecb8cc4c2711","provingJobType":"ROOT_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu...","status":"not-found","numOutstandingJobs":1} 11:31:47 [11:31:47.892] INFO: prover-client:proving-agent Starting job id=0:ROOT_PARITY:6b1f42d6109bfe2ce2a4aa1e3b8fb4b8e545bf5d231d584b39a4ecb8cc4c2711 type=ROOT_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu... 11:31:47 [11:31:47.905] INFO: prover-client:proving-agent:job-controller-08ec8056 Job controller started jobId=0:ROOT_PARITY:6b1f42d6109bfe2ce2a4aa1e3b8fb4b8e545bf5d231d584b39a4ecb8cc4c2711 {"jobId":"0:ROOT_PARITY:6b1f42d6109bfe2ce2a4aa1e3b8fb4b8e545bf5d231d584b39a4ecb8cc4c2711"} 11:31:48 [11:31:48.006] INFO: prover-client:proving-agent Job id=0:ROOT_PARITY:6b1f42d6109bfe2ce2a4aa1e3b8fb4b8e545bf5d231d584b39a4ecb8cc4c2711 type=ROOT_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22resu... 11:31:48 [11:31:48.006] INFO: prover-client:proving-broker Proving job complete id=0:ROOT_PARITY:6b1f42d6109bfe2ce2a4aa1e3b8fb4b8e545bf5d231d584b39a4ecb8cc4c2711 type=ROOT_PARITY totalAttempts=1 {"provingJobId":"0:ROOT_PARITY:6b1f42d6109bfe2ce2a4aa1e3b8fb4b8e545bf5d231d584b39a4ecb8cc4c2711"} 11:31:48 [11:31:48.804] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 11:31:48 [11:31:48.805] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:ROOT_PARITY:6b1f42d6109bfe2ce2a4aa1e3b8fb4b8e545bf5d231d584b39a4ecb8cc4c2711 type=ROOT_PARITY 11:31:48 [11:31:48.805] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 11:31:48 [11:31:48.817] INFO: prover-client:proving-broker New proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:c13778410ab32496173114b2a748ee90e785d4a4c5c07451adfdcc78cfba4b9a epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:c13778410ab32496173114b2a748ee90e785d4a4c5c07451adfdcc78cfba4b9a"} 11:31:48 [11:31:48.820] INFO: prover-client:proving-broker New proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:be7155082101362bd8bdc69c99c611cb558829003e429a156b862d3a6e9944ce epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:be7155082101362bd8bdc69c99c611cb558829003e429a156b862d3a6e9944ce"} 11:31:48 [11:31:48.868] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:EMPTY_BLOCK_ROOT_ROLLUP:c13778410ab32496173114b2a748ee90e785d4a4c5c07451adfdcc78cfba4b9a type=EMPTY_BLOCK_ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:c13778410ab32496173114b2a748ee90e785d4a4c5c07451adfdcc78cfba4b9a","provingJobType":"EMPTY_BLOCK_ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input...","status":"not-found","numOutstandingJobs":2} 11:31:48 [11:31:48.869] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:EMPTY_BLOCK_ROOT_ROLLUP:be7155082101362bd8bdc69c99c611cb558829003e429a156b862d3a6e9944ce type=EMPTY_BLOCK_ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:be7155082101362bd8bdc69c99c611cb558829003e429a156b862d3a6e9944ce","provingJobType":"EMPTY_BLOCK_ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input...","status":"not-found","numOutstandingJobs":2} 11:31:48 [11:31:48.922] INFO: prover-client:proving-agent Starting job id=0:EMPTY_BLOCK_ROOT_ROLLUP:c13778410ab32496173114b2a748ee90e785d4a4c5c07451adfdcc78cfba4b9a type=EMPTY_BLOCK_ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input... 11:31:48 [11:31:48.928] INFO: prover-client:proving-agent:job-controller-79ffc058 Job controller started jobId=0:EMPTY_BLOCK_ROOT_ROLLUP:c13778410ab32496173114b2a748ee90e785d4a4c5c07451adfdcc78cfba4b9a {"jobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:c13778410ab32496173114b2a748ee90e785d4a4c5c07451adfdcc78cfba4b9a"} 11:31:48 [11:31:48.960] INFO: prover-client:proving-agent Starting job id=0:EMPTY_BLOCK_ROOT_ROLLUP:be7155082101362bd8bdc69c99c611cb558829003e429a156b862d3a6e9944ce type=EMPTY_BLOCK_ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input... 11:31:48 [11:31:48.965] INFO: prover-client:proving-agent:job-controller-412dc7c2 Job controller started jobId=0:EMPTY_BLOCK_ROOT_ROLLUP:be7155082101362bd8bdc69c99c611cb558829003e429a156b862d3a6e9944ce {"jobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:be7155082101362bd8bdc69c99c611cb558829003e429a156b862d3a6e9944ce"} 11:31:49 [11:31:49.847] INFO: prover-client:proving-agent Job id=0:EMPTY_BLOCK_ROOT_ROLLUP:c13778410ab32496173114b2a748ee90e785d4a4c5c07451adfdcc78cfba4b9a type=EMPTY_BLOCK_ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22resul... 11:31:49 [11:31:49.848] INFO: prover-client:proving-broker Proving job complete id=0:EMPTY_BLOCK_ROOT_ROLLUP:c13778410ab32496173114b2a748ee90e785d4a4c5c07451adfdcc78cfba4b9a type=EMPTY_BLOCK_ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:c13778410ab32496173114b2a748ee90e785d4a4c5c07451adfdcc78cfba4b9a"} 11:31:50 [11:31:50.842] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 2, total jobs ready: 1 11:31:50 [11:31:50.844] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:c13778410ab32496173114b2a748ee90e785d4a4c5c07451adfdcc78cfba4b9a type=EMPTY_BLOCK_ROOT_ROLLUP 11:31:50 [11:31:50.844] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 11:31:51 [11:31:51.408] INFO: prover-client:proving-agent Job id=0:EMPTY_BLOCK_ROOT_ROLLUP:be7155082101362bd8bdc69c99c611cb558829003e429a156b862d3a6e9944ce type=EMPTY_BLOCK_ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22resul... 11:31:51 [11:31:51.408] INFO: prover-client:proving-broker Proving job complete id=0:EMPTY_BLOCK_ROOT_ROLLUP:be7155082101362bd8bdc69c99c611cb558829003e429a156b862d3a6e9944ce type=EMPTY_BLOCK_ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:be7155082101362bd8bdc69c99c611cb558829003e429a156b862d3a6e9944ce"} 11:31:51 [11:31:51.844] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 11:31:51 [11:31:51.846] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:be7155082101362bd8bdc69c99c611cb558829003e429a156b862d3a6e9944ce type=EMPTY_BLOCK_ROOT_ROLLUP 11:31:51 [11:31:51.846] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 11:31:51 [11:31:51.854] INFO: prover-client:proving-broker New proving job id=0:ROOT_ROLLUP:ebaa1b184d5dd375cd20a433c822f7e8b832557f8bc0da06d9c45949ed58591f epochNumber=0 {"provingJobId":"0:ROOT_ROLLUP:ebaa1b184d5dd375cd20a433c822f7e8b832557f8bc0da06d9c45949ed58591f"} 11:31:51 [11:31:51.906] VERBOSE: prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_ROLLUP:ebaa1b184d5dd375cd20a433c822f7e8b832557f8bc0da06d9c45949ed58591f type=ROOT_ROLLUP epochNumber=0 {"provingJobId":"0:ROOT_ROLLUP:ebaa1b184d5dd375cd20a433c822f7e8b832557f8bc0da06d9c45949ed58591f","provingJobType":"ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22input...","status":"not-found","numOutstandingJobs":1} 11:31:51 [11:31:51.964] INFO: prover-client:proving-agent Starting job id=0:ROOT_ROLLUP:ebaa1b184d5dd375cd20a433c822f7e8b832557f8bc0da06d9c45949ed58591f type=ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22input... 11:31:51 [11:31:51.976] INFO: prover-client:proving-agent:job-controller-6075c7d7 Job controller started jobId=0:ROOT_ROLLUP:ebaa1b184d5dd375cd20a433c822f7e8b832557f8bc0da06d9c45949ed58591f {"jobId":"0:ROOT_ROLLUP:ebaa1b184d5dd375cd20a433c822f7e8b832557f8bc0da06d9c45949ed58591f"} 11:31:52 [11:31:52.072] INFO: prover-client:proving-agent Job id=0:ROOT_ROLLUP:ebaa1b184d5dd375cd20a433c822f7e8b832557f8bc0da06d9c45949ed58591f type=ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22resul... 11:31:52 [11:31:52.072] INFO: prover-client:proving-broker Proving job complete id=0:ROOT_ROLLUP:ebaa1b184d5dd375cd20a433c822f7e8b832557f8bc0da06d9c45949ed58591f type=ROOT_ROLLUP totalAttempts=1 {"provingJobId":"0:ROOT_ROLLUP:ebaa1b184d5dd375cd20a433c822f7e8b832557f8bc0da06d9c45949ed58591f"} 11:31:52 [11:31:52.847] VERBOSE: prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1 11:31:52 [11:31:52.848] VERBOSE: prover-client:broker-circuit-prover-facade Resolved proving job id=0:ROOT_ROLLUP:ebaa1b184d5dd375cd20a433c822f7e8b832557f8bc0da06d9c45949ed58591f type=ROOT_ROLLUP 11:31:52 [11:31:52.849] VERBOSE: prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0 11:31:52 [11:31:52.849] VERBOSE: prover-client:orchestrator Orchestrator completed root rollup for epoch 0 11:31:52 [11:31:52.851] INFO: prover-node:epoch-proving-job Finalised proof for epoch 0 {"epochNumber":0,"uuid":"8ccb055e-1c6d-4a90-8be8-c880da72adc2","duration":6064.328253999993} 11:31:52 [11:31:52.851] INFO: prover-node:epoch-proving-job Submitted proof for epoch 0 (blocks 1 to 2) {"epochNumber":0,"uuid":"8ccb055e-1c6d-4a90-8be8-c880da72adc2"} 11:31:52 [11:31:52.852] VERBOSE: prover-client:broker-circuit-prover-facade Stopping BrokerCircuitProverFacade 11:31:52 [11:31:52.852] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Completed job for epoch 0 with status completed 11:31:52 [11:31:52.852] INFO: e2e:e2e_epochs:epochs_upload_failed_proof Test succeeded 11:31:52 [11:31:52.852] INFO: prover-node:prover-node Stopping ProverNode 11:31:52 [11:31:52.852] WARN: prover-node:prover-node Running promise was not started 11:31:52 [11:31:52.853] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 11:31:52 [11:31:52.853] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 11:31:52 [11:31:52.853] WARN: archiver:prover-node Running promise was not started 11:31:52 [11:31:52.853] INFO: archiver:prover-node Stopped. 11:31:52 [11:31:52.853] WARN: world-state:block_stream:prover-node Running promise was not started 11:31:52 [11:31:52.853] INFO: world_state:prover-node Stopped world state synchronizer 11:31:52 [11:31:52.853] INFO: prover-node:prover-node Stopped ProverNode 11:31:52 [11:31:52.853] INFO: node Stopping Aztec Node 11:31:54 [11:31:54.854] INFO: slasher Slasher client stopped. 11:31:54 [11:31:54.854] WARN: validator Running promise was not started 11:31:54 [11:31:54.854] WARN: sequencer Running promise was not started 11:31:54 [11:31:54.854] INFO: sequencer Stopped sequencer 11:31:54 [11:31:54.854] WARN: p2p:l2-block-stream Running promise was not started 11:31:54 [11:31:54.855] INFO: p2p P2P client stopped 11:31:54 [11:31:54.855] WARN: world-state:block_stream Running promise was not started 11:31:54 [11:31:54.855] INFO: world_state Stopped world state synchronizer 11:31:54 [11:31:54.855] WARN: archiver Running promise was not started 11:31:54 [11:31:54.855] INFO: archiver Stopped. 11:31:54 [11:31:54.855] INFO: node Stopped Aztec Node 11:31:54 [11:31:54.855] INFO: node Stopping Aztec Node 11:31:56 [11:31:56.856] INFO: slasher Slasher client stopped. 11:31:56 [11:31:56.856] WARN: validator Running promise was not started 11:31:56 [11:31:56.856] WARN: sequencer Running promise was not started 11:31:56 [11:31:56.856] INFO: sequencer Stopped sequencer 11:31:56 [11:31:56.857] WARN: p2p:l2-block-stream Running promise was not started 11:31:56 [11:31:56.857] INFO: p2p P2P client stopped 11:31:56 [11:31:56.857] WARN: world-state:block_stream Running promise was not started 11:31:56 [11:31:56.857] INFO: world_state Stopped world state synchronizer 11:31:56 [11:31:56.857] WARN: archiver Running promise was not started 11:31:56 [11:31:56.857] INFO: archiver Stopped. 11:31:56 [11:31:56.857] INFO: node Stopped Aztec Node 11:31:56 [11:31:56.857] INFO: prover-node:prover-node Stopping ProverNode 11:31:56 [11:31:56.857] WARN: prover-node:prover-node Running promise was not started 11:31:56 [11:31:56.858] WARN: prover-node:epoch-monitor:prover-node Running promise was not started 11:31:56 [11:31:56.858] INFO: prover-node:epoch-monitor:prover-node Stopped EpochMonitor 11:31:56 [11:31:56.858] WARN: archiver:prover-node Running promise was not started 11:31:56 [11:31:56.858] INFO: archiver:prover-node Stopped. 11:31:56 [11:31:56.858] WARN: world-state:block_stream:prover-node Running promise was not started 11:31:56 [11:31:56.858] INFO: world_state:prover-node Stopped world state synchronizer 11:31:56 [11:31:56.858] INFO: prover-node:prover-node Stopped ProverNode 11:31:56 [11:31:56.859] INFO: blob-sink:server Stopping blob sink 11:31:56 [11:31:56.859] INFO: blob-sink:server Blob sink already stopped 11:31:56 PASS src/e2e_epochs/epochs_upload_failed_proof.test.ts 11:31:56 e2e_epochs/epochs_upload_failed_proof 11:31:56 uploads failed proving job state and re-runs it on a fresh instance (94221 ms) 11:31:56 11:31:56 Test Suites: 1 passed, 1 total 11:31:56 Tests: 1 passed, 1 total 11:31:56 Snapshots: 0 total 11:31:56 Time: 98.863 s 11:31:56 Ran all test suites matching /src\/e2e_epochs\/epochs_upload_failed_proof.test.ts/i. 11:31:56 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?