Parent Log:
http://ci.aztec-labs.com/b09c2f8563deb099
Command: f49566f2a253bc96:ISOLATE=1:NAME=e2e_epochs/epochs_upload_failed_proof yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_upload_failed_proof.test.ts
Commit:
https://github.com/AztecProtocol/aztec-packages/commit/e1613ca4b54a0ae509638dc4114780dd3cb0bc9b
Env: REF_NAME=gh-readonly-queue/next/pr-15239-282da3bd25d49b92970e6fc85f110092e8566299 CURRENT_VERSION=0.87.6 CI_FULL=0
Date: Tue Jun 24 15:12:10 UTC 2025
System: ARCH=arm64 CPUS=64 MEM=247Gi HOSTNAME=pr-15239_arm64_a1-fast
Resources: CPU_LIST=0-63 CPUS=2 MEM=8g TIMEOUT=600s
History:
http://ci.aztec-labs.com/list/history_476a42720cde10eb_next
15:12:10 +++ id -u
15:12:10 +++ id -g
15:12:10 ++ docker run -d --name e2e_epochs_epochs_upload_failed_proof --net=none --cpuset-cpus=0-63 --cpus=2 --memory=8g --user 1000:1000 -v/home/aztec-dev:/home/aztec-dev --mount type=tmpfs,target=/tmp,tmpfs-size=1g --workdir /home/aztec-dev/aztec-packages -e HOME -e VERBOSE -e GIT_CONFIG_GLOBAL=/home/aztec-dev/aztec-packages/build-images/src/home/.gitconfig -e FORCE_COLOR=true -e CPUS -e MEM aztecprotocol/build:3.0 /bin/bash -c 'timeout -v 600s bash -c '\''yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_upload_failed_proof.test.ts'\'''
15:12:10 + cid=92de2290d99b1bc4d4f1e827793001625c9c45e55e00847c47b8a5bc73c36b4b
15:12:10 + set +x
15:12:11 {"level":25,"time":1750777931118,"pid":12,"hostname":"92de2290d99b","module":"logger","msg":"Logger initialized with level verbose"}
15:12:15 [15:12:15.955]
INFO:
e2e:epochs_upload_failed_proof Running test: e2e_epochs/epochs_upload_failed_proof uploads failed proving job state and re-runs it on a fresh instance
15:12:16 [15:12:16.040]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Logging metrics to log/e2e_epochs_epochs_upload_failed_proof.jsonl
15:12:16 [15:12:16.191]
WARN:
ethereum:cheat_codes Set L1 automine to true
15:12:16 [15:12:16.216]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Sent 0.1 ETH to deployer
{"deployer":"0x05f32b3cc3888453ff71b01135b34ff8e41263f2","value":100000000000000000}
15:12:16 [15:12:16.228]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Sent 0.1 ETH to deployer
{"deployer":"0x05f32b3cc3888453ff71b01135b34ff8e41263f2","value":100000000000000000}
15:12:16 [15:12:16.235]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed Multicall3
15:12:16 [15:12:16.237]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Calling anvil_setBlockTimestampInterval with params: [8]
15:12:16 [15:12:16.238]
WARN:
e2e:e2e_epochs:epochs_upload_failed_proof Set block interval to 8
15:12:16 [15:12:16.239]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deploying contracts from 0xf39Fd6e51aad88F6F4ce6aB8827279cffFb92266
15:12:16 [15:12:16.241]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001
15:12:16 [15:12:16.269]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x8166bb789c828e492198babef9becf8ac44628f059d48e6f68114a9ae2ade6ec
{"gasLimit":867658,"maxFeePerGas":"120.351651125","maxPriorityFeePerGas":"118.94979"}
15:12:16 [15:12:16.269]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xB8999345dA8041f1Da51ac5179B1F055A560f397 in tx 0x8166bb789c828e492198babef9becf8ac44628f059d48e6f68114a9ae2ade6ec.
15:12:16 [15:12:16.271]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed Fee Asset at 0xb8999345da8041f1da51ac5179b1f055a560f397
15:12:16 [15:12:16.271]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001
15:12:16 [15:12:16.289]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x07d928293fb6819e2a8abf9d0b32b04560f633065cf07cefb5dcf9ca71af1db2
{"gasLimit":867644,"maxFeePerGas":"143.976575211","maxPriorityFeePerGas":"142.739748"}
15:12:16 [15:12:16.289]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xBb9e13665Cfb3d531F288a11E7312b6b91C59292 in tx 0x07d928293fb6819e2a8abf9d0b32b04560f633065cf07cefb5dcf9ca71af1db2.
15:12:16 [15:12:16.290]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed Staking Asset at 0xbb9e13665cfb3d531f288a11e7312b6b91c59292
15:12:16 [15:12:16.290]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001
15:12:16 [15:12:16.311]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xd90adcaa1621a861dd7b09565f9dc422367574ea376355a4c91cd87ed3fbfeba
{"gasLimit":3252094,"maxFeePerGas":"172.377275728","maxPriorityFeePerGas":"171.2876976"}
15:12:16 [15:12:16.311]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x6f26a1916Df432654607f9c75b764e535e65cf3e in tx 0xd90adcaa1621a861dd7b09565f9dc422367574ea376355a4c91cd87ed3fbfeba.
15:12:16 [15:12:16.312]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed GSE at 0x6f26a1916df432654607f9c75b764e535e65cf3e
15:12:16 [15:12:16.312]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001
15:12:16 [15:12:16.330]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xc6bb96b972383aade82d230cb0c861a0362867228d18483a86f9e4a83b780d2d
{"gasLimit":1081864,"maxFeePerGas":"206.505096634","maxPriorityFeePerGas":"205.54523712"}
15:12:16 [15:12:16.331]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x3C709AFec1acEaE522c13145005De788a3CC65c8 in tx 0xc6bb96b972383aade82d230cb0c861a0362867228d18483a86f9e4a83b780d2d.
15:12:16 [15:12:16.332]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed Registry at 0x3c709afec1aceae522c13145005de788a3cc65c8
15:12:16 [15:12:16.332]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001
15:12:16 [15:12:16.351]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xf8dde39eb44898986f540429eb4a3f0eeec377763a24054290d85bb8101ac8e4
{"gasLimit":2232036,"maxFeePerGas":"247.515532347","maxPriorityFeePerGas":"246.654284544"}
15:12:16 [15:12:16.351]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xEDE9b34af448F9261efea2DafB2364866b09E01A in tx 0xf8dde39eb44898986f540429eb4a3f0eeec377763a24054290d85bb8101ac8e4.
15:12:16 [15:12:16.352]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed GovernanceProposer at 0xede9b34af448f9261efea2dafb2364866b09e01a
15:12:16 [15:12:16.352]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001
15:12:16 [15:12:16.371]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xaf7178913b5905e53367fb0465133faf75227c51bf46428c817f48a06700bb71
{"gasLimit":3092007,"maxFeePerGas":"296.745116241","maxPriorityFeePerGas":"295.985141452"}
15:12:16 [15:12:16.371]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xa49A3d51a71916F87d60f0e919Fb66E4b933b4df in tx 0xaf7178913b5905e53367fb0465133faf75227c51bf46428c817f48a06700bb71.
15:12:16 [15:12:16.372]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed Governance at 0xa49a3d51a71916f87d60f0e919fb66e4b933b4df
15:12:16 [15:12:16.383]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x12d6424d782ad27b9fe44dec1624cf29720992859e74e4ee26f6a49bf5e682cc
{"gasLimit":100000,"maxFeePerGas":"355.858763396","maxPriorityFeePerGas":"355.182169742"}
15:12:16 [15:12:16.383]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Set governance on GSE in 0x12d6424d782ad27b9fe44dec1624cf29720992859e74e4ee26f6a49bf5e682cc
15:12:16 [15:12:16.383]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001
15:12:16 [15:12:16.397]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x593e4091a1e08f47177928f9a458263f67a911112187ec79e9a4bc019be7546f
{"gasLimit":397405,"maxFeePerGas":"426.824946124","maxPriorityFeePerGas":"426.21860369"}
15:12:16 [15:12:16.397]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x705baA0D3bF675F9B7F169fd5FEA260c436Cd50c in tx 0x593e4091a1e08f47177928f9a458263f67a911112187ec79e9a4bc019be7546f.
15:12:16 [15:12:16.398]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed CoinIssuer at 0x705baa0d3bf675f9b7f169fd5fea260c436cd50c
15:12:16 [15:12:16.398]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Waiting for deployments to complete
15:12:16 [15:12:16.398]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 7 transactions to be mined...
15:12:16 [15:12:16.423]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully
15:12:16 [15:12:16.431]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x5d6132645b455679b93fe6fc019047a89d80cbc5fb7cbc890344c07a449854fc
{"gasLimit":100000,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"}
15:12:16 [15:12:16.431]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Added coin issuer 0x705baa0d3bf675f9b7f169fd5fea260c436cd50c as minter on fee asset in 0x5d6132645b455679b93fe6fc019047a89d80cbc5fb7cbc890344c07a449854fc
15:12:16 [15:12:16.442]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xd01ce626c7c7ee3a243b24780a9fd0dc5184345d6bec4ec1cc5aafc15402dc62
{"gasLimit":56661,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"}
15:12:16 [15:12:16.443]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001
15:12:16 [15:12:16.456]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x100b31bd1e3992df58985c26db7e5351f01cbb7b9c2e961c411c57733fb6cfa5
{"gasLimit":344517,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"}
15:12:16 [15:12:16.456]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xB4fF23c4B1E2Bc7C86090d4FBDa21A457ee6727F in tx 0x100b31bd1e3992df58985c26db7e5351f01cbb7b9c2e961c411c57733fb6cfa5.
15:12:16 [15:12:16.457]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed FeeAssetHandler at 0xb4ff23c4b1e2bc7c86090d4fbda21a457ee6727f
15:12:16 [15:12:16.469]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xc451aae80a23ef806a4bacf2e291d1c2ae150b6200ea2ea4e841b119a7e7c28b
{"gasLimit":56804,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"}
15:12:16 [15:12:16.469]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Added fee asset handler 0xb4ff23c4b1e2bc7c86090d4fbda21a457ee6727f as minter on fee asset in 0xc451aae80a23ef806a4bacf2e291d1c2ae150b6200ea2ea4e841b119a7e7c28b
15:12:16 [15:12:16.470]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001
15:12:16 [15:12:16.489]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x1faf8bcc8977c90fecabc48f92ddae8dbb0acd71a8ae2fde378732b4f5280dfb
{"gasLimit":2434549,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"}
15:12:16 [15:12:16.489]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xD8C49C848A06990E1B1Ad8DF26dbc5725b657aCA in tx 0x1faf8bcc8977c90fecabc48f92ddae8dbb0acd71a8ae2fde378732b4f5280dfb.
15:12:16 [15:12:16.490]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed StakingAssetHandler at 0xd8c49c848a06990e1b1ad8df26dbc5725b657aca
15:12:16 [15:12:16.502]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x79eec47a96882b804264d6c66ccded4e9ed9ee94a3f9212268001418f61c01b6
{"gasLimit":56804,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"}
15:12:16 [15:12:16.502]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Added staking asset handler 0xd8c49c848a06990e1b1ad8df26dbc5725b657aca as minter on staking asset in 0x79eec47a96882b804264d6c66ccded4e9ed9ee94a3f9212268001418f61c01b6
15:12:16 [15:12:16.502]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Waiting for deployments to complete
15:12:16 [15:12:16.502]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 9 transactions to be mined...
15:12:16 [15:12:16.526]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully
15:12:16 [15:12:16.537]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed shared contracts
15:12:16 [15:12:16.552]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x3a452c44942037f215b905f38ac51163490a9b231c6bd08b7e958ae2dd00642b
{"gasLimit":84837,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"}
15:12:16 [15:12:16.552]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Funded reward distributor with 10000000000000000000000000 fee asset in 0x3a452c44942037f215b905f38ac51163490a9b231c6bd08b7e958ae2dd00642b
15:12:16 [15:12:16.554]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001
15:12:16 [15:12:16.568]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x6732a13052b668b6ed53c2db691f949dc5751b43ca937a6796aab9388f3cb12a
{"gasLimit":154658,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"}
15:12:16 [15:12:16.569]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x277E22B0C9698d7f2A1cD7C6d857511617587309 in tx 0x6732a13052b668b6ed53c2db691f949dc5751b43ca937a6796aab9388f3cb12a.
15:12:16 [15:12:16.569]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Rollup will use the mock verifier at 0x277e22b0c9698d7f2a1cd7c6d857511617587309
15:12:16 [15:12:16.570]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Rollup config args
{"aztecSlotDuration":16,"aztecEpochDuration":4,"targetCommitteeSize":0,"aztecProofSubmissionEpochs":1,"slashingQuorum":6,"slashingRoundSize":10,"manaTarget":10000000000,"entryQueueFlushSizeMin":48,"entryQueueFlushSizeQuotient":2,"provingCostPerMana":100,"rewardConfig":{"sequencerBps":5000,"increment":200000,"maxScore":5000000,"a":5000,"k":1000000,"minimum":100000,"rewardDistributor":"0x4a51916a6b10a43f6565042be5b6b69d8d613f64"}}
15:12:16 [15:12:16.570]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001
15:12:16 [15:12:16.582]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x41f1a97b4169402d8ffffe2c1e10e4208f2cbb77f013e5d13b610e6af83d24f5
{"gasLimit":86992,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"}
15:12:16 [15:12:16.582]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x8036677644039d4E4b3C48DADc5de700c64ACe8f in tx 0x41f1a97b4169402d8ffffe2c1e10e4208f2cbb77f013e5d13b610e6af83d24f5.
15:12:16 [15:12:16.583]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001
15:12:16 [15:12:16.610]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xe6ea7e3b8ed4d00f0a2db44996d4a8f19a743b75ae4885d46a4ce4cd6559eaf1
{"gasLimit":5125076,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"}
15:12:16 [15:12:16.610]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x76836C865645796c7eE9068efbDed634783a00AF in tx 0xe6ea7e3b8ed4d00f0a2db44996d4a8f19a743b75ae4885d46a4ce4cd6559eaf1.
15:12:16 [15:12:16.611]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001
15:12:16 [15:12:16.629]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xb61d555a7dec6e9c985806cddb053e8d13705025eb222f14584644dbba2f1668
{"gasLimit":2891348,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"}
15:12:16 [15:12:16.629]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x48Bc5abFAa35F60Aec77dC10a45DA59e057BEF17 in tx 0xb61d555a7dec6e9c985806cddb053e8d13705025eb222f14584644dbba2f1668.
15:12:16 [15:12:16.629]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Awaiting for linked libraries to be deployed
15:12:16 [15:12:16.637]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001
15:12:16 [15:12:16.676]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x11c2a6d620bb6dd24503630817b190a339a1b6fe37f6025724a431543b58c943
{"gasLimit":11292829,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"}
15:12:16 [15:12:16.677]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x1bd1b5A0AC2Df415643C67319e7001f853a04d32 in tx 0x11c2a6d620bb6dd24503630817b190a339a1b6fe37f6025724a431543b58c943.
15:12:16 [15:12:16.677]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed Rollup at 0x1bd1b5a0ac2df415643c67319e7001f853a04d32
{"aztecSlotDuration":16,"aztecEpochDuration":4,"targetCommitteeSize":0,"aztecProofSubmissionEpochs":1,"slashingQuorum":6,"slashingRoundSize":10,"manaTarget":10000000000,"entryQueueFlushSizeMin":48,"entryQueueFlushSizeQuotient":2,"provingCostPerMana":100,"rewardConfig":{"sequencerBps":5000,"increment":200000,"maxScore":5000000,"a":5000,"k":1000000,"minimum":100000,"rewardDistributor":"0x4a51916a6b10a43f6565042be5b6b69d8d613f64"}}
15:12:16 [15:12:16.677]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 11 transactions to be mined...
15:12:16 [15:12:16.703]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully
15:12:16 [15:12:16.703]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof All core contracts have been deployed
15:12:16 [15:12:16.703]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001
15:12:16 [15:12:16.717]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xbb8588d7390baf9840dfa1a7cb8c2a1acc33fe0e6f1effb67e8576b0d97cc3a8
{"gasLimit":1056482,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"}
15:12:16 [15:12:16.718]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x0831354267749DCA1021C97F96Ae7cd30B2A9B6f in tx 0xbb8588d7390baf9840dfa1a7cb8c2a1acc33fe0e6f1effb67e8576b0d97cc3a8.
15:12:16 [15:12:16.718]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed SlashFactory at 0x0831354267749dca1021c97f96ae7cd30b2a9b6f
15:12:16 [15:12:16.739]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x3e72ebd268ad6a86b1deecf7b5e1a14406b60928ea6f50ff7096f70937781cf0
{"gasLimit":117006,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"}
15:12:16 [15:12:16.739]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Adding rollup 0x1bd1b5a0ac2df415643c67319e7001f853a04d32 to registry 0x3c709afec1aceae522c13145005de788a3cc65c8 in tx 0x3e72ebd268ad6a86b1deecf7b5e1a14406b60928ea6f50ff7096f70937781cf0
15:12:16 [15:12:16.753]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xbdb4f81d742cc702810b958b92b17c7c1a62b5c99eea401c9c29aa7cc2a2269b
{"gasLimit":109478,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"}
15:12:16 [15:12:16.753]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Adding rollup 0x1bd1b5a0ac2df415643c67319e7001f853a04d32 to GSE 0x6f26a1916df432654607f9c75b764e535e65cf3e in tx 0xbdb4f81d742cc702810b958b92b17c7c1a62b5c99eea401c9c29aa7cc2a2269b
15:12:16 [15:12:16.757]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 12 transactions to be mined...
15:12:16 [15:12:16.782]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully
15:12:16 [15:12:16.786]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Rollup deployed
15:12:16 [15:12:16.787]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Waiting for rollup and slash factory to be deployed
15:12:16 [15:12:16.787]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 12 transactions to be mined...
15:12:16 [15:12:16.809]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully
15:12:16 [15:12:16.809]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof All transactions for L1 deployment have been mined
15:12:16 [15:12:16.824]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Aztec L1 contracts initialized
{"registryAddress":"0x3c709afec1aceae522c13145005de788a3cc65c8","governanceAddress":"0xa49a3d51a71916f87d60f0e919fb66e4b933b4df","governanceProposerAddress":"0xede9b34af448f9261efea2dafb2364866b09e01a","rollupAddress":"0x1bd1b5a0ac2df415643c67319e7001f853a04d32","inboxAddress":"0xdd4dbb621d3001ff1d4ee7495e8650be834f7d5e","outboxAddress":"0x3c4266f8f121ec97a70f1bcdc433ba0a31aeeab1","feeJuicePortalAddress":"0x0c50d7346f1753a263974959d25bbbdfa3d7e72e","feeJuiceAddress":"0xb8999345da8041f1da51ac5179b1f055a560f397","stakingAssetAddress":"0xbb9e13665cfb3d531f288a11e7312b6b91c59292","rewardDistributorAddress":"0x4a51916a6b10a43f6565042be5b6b69d8d613f64","gseAddress":"0x6f26a1916df432654607f9c75b764e535e65cf3e","coinIssuerAddress":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266"}
15:12:16 [15:12:16.825]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Handing over to governance
15:12:16 [15:12:16.829]
WARN:
ethereum:cheat_codes Set L1 automine to false
15:12:16 [15:12:16.830]
WARN:
ethereum:cheat_codes Set L1 interval mining to 8 seconds
15:12:16 [15:12:16.832]
WARN:
foundation:test-date-provider Time set to 2025-06-24T15:15:20.000Z
{"offset":183168,"timeMs":1750778120000}
15:12:16 [15:12:16.836]
INFO:
aztecjs:utils:watcher Watcher not started because not auto mining
15:12:16 [15:12:16.836]
INFO:
telemetry:client Using NoopTelemetryClient
15:12:16 [15:12:16.839]
INFO:
kv-store:lmdb-v2:blob-sink Creating blob-sink data store at directory /tmp/4b42610963c7105e/blob-sink with map size 134217728 KB (LMDB v2)
15:12:16 [15:12:16.841]
INFO:
kv-store:lmdb-v2:blob-sink Starting data store with maxReaders 16
15:12:16 [15:12:16.848]
INFO:
blob-sink:server Server is running on
http://localhost:42075
15:12:16 [15:12:16.848]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Creating and synching an aztec node...
15:12:16 [15:12:16.849]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Using native ACVM binary at ../../noir/noir-repo/target/release/acvm with working directory /tmp/9ac8fa4d/acvm
15:12:16 [15:12:16.850]
INFO:
node:blob-sink:client Creating HTTP blob sink client.
{"blobSinkUrl":"http://localhost:42075"}
15:12:16 [15:12:16.870]
VERBOSE:
node:MAIN-aztec-node Snapshot sync is disabled. No snapshots URL provided.
15:12:16 [15:12:16.871]
INFO:
archiver:lmdb Creating archiver data store at directory /tmp/4b42610963c7105e/archiver with map size 134217728 KB (LMDB v2)
15:12:16 [15:12:16.872]
INFO:
archiver:lmdb Starting data store with maxReaders 16
15:12:17 [15:12:17.471]
INFO:
node:blob-sink:client Testing configured blob sources
{"blobSinkUrl":"http://localhost:42075"}
15:12:17 [15:12:17.486]
INFO:
node:blob-sink:client Blob sink is reachable
{"blobSinkUrl":"http://localhost:42075"}
15:12:17 [15:12:17.486]
WARN:
node:blob-sink:client No L1 consensus host urls configured
15:12:17 [15:12:17.487]
WARN:
node:blob-sink:client No archive client configured
15:12:17 [15:12:17.489]
INFO:
archiver Starting archiver sync to rollup contract 0x1bd1b5a0ac2df415643c67319e7001f853a04d32 from L1 block 22 to current L1 block 25 with hash 0x9123a3c73ddb53d3f7c75be4c968c22ecf5e96f0cbf92079568ae63387b1a212
{"blocksSynchedTo":22,"messagesSynchedTo":{"l1BlockHash":"0xad4218b278c351b64c0c0433e5e5d70c3b0d4f4fabc9ea55b95b2fc688efde62","l1BlockNumber":22}}
15:12:17 [15:12:17.503]
INFO:
archiver Initial archiver sync to L1 block 25 complete.
{"l1BlockNumber":25,"syncPoint":{"blocksSynchedTo":25},"latest":{"number":0},"proven":{"number":0},"finalized":{"number":0}}
15:12:17 [15:12:17.511]
INFO:
world-state:database Creating world state data store at directory /tmp/4b42610963c7105e/world_state with map sizes {"archiveTreeMapSizeKb":134217728,"nullifierTreeMapSizeKb":134217728,"noteHashTreeMapSizeKb":134217728,"messageTreeMapSizeKb":134217728,"publicDataTreeMapSizeKb":134217728} and 2 threads.
15:12:17 [15:12:17.534]
INFO:
world_state Created world state synchroniser with block history of 2
15:12:17 [15:12:17.535]
WARN:
node:MAIN-aztec-node Aztec node is accepting fake proofs
15:12:17 [15:12:17.535]
INFO:
bb-prover:queued_ivc_verifier Starting QueuedIVCVerifier with 8 concurrent verifiers
15:12:17 [15:12:17.546]
INFO:
p2p:lmdb-v2 Creating p2p data store at directory /tmp/4b42610963c7105e/p2p with map size 134217728 KB (LMDB v2)
15:12:17 [15:12:17.548]
INFO:
p2p:lmdb-v2 Starting data store with maxReaders 16
15:12:17 [15:12:17.549]
INFO:
p2p-archive:lmdb-v2 Creating p2p-archive data store at directory /tmp/4b42610963c7105e/p2p-archive with map size 134217728 KB (LMDB v2)
15:12:17 [15:12:17.550]
INFO:
p2p-archive:lmdb-v2 Starting data store with maxReaders 16
15:12:17 [15:12:17.551]
INFO:
p2p-peer:lmdb-v2 Creating p2p-peers data store at directory /tmp/4b42610963c7105e/p2p-peers with map size 134217728 KB (LMDB v2)
15:12:17 [15:12:17.552]
INFO:
p2p-peer:lmdb-v2 Starting data store with maxReaders 16
15:12:17 [15:12:17.553]
INFO:
p2p:tx_pool Setting maximum tx mempool size
{"maxTxPoolSize":100000000}
15:12:17 [15:12:17.553]
VERBOSE:
p2p P2P is disabled. Using dummy P2P service.
15:12:17 [15:12:17.556]
VERBOSE:
world-state:block_stream Starting L2 block stream
{"proven":false,"pollIntervalMS":50}
15:12:17 [15:12:17.557]
INFO:
world_state Started world state synchronizer from block 1
15:12:17 [15:12:17.559]
VERBOSE:
world-state:block_stream Starting sync from block number 0
15:12:17 [15:12:17.562]
INFO:
p2p Starting p2p client from block 0 with empty mempools
15:12:17 [15:12:17.562]
VERBOSE:
p2p:l2-block-stream Starting L2 block stream
{"batchSize":20,"pollIntervalMS":100,"startingBlock":0}
15:12:17 [15:12:17.785]
INFO:
epoch-prune-watcher EpochPruneWatcher initialized
15:12:17 [15:12:17.821]
VERBOSE:
validator Initialized validator with addresses: 0xfbb85a8e7f9f60aa03edf2378d4d2ec934dc3723
15:12:17 [15:12:17.822]
VERBOSE:
node:MAIN-aztec-node All Aztec Node subsystems synced
15:12:17 [15:12:17.831]
INFO:
slasher Starting Slasher client...
15:12:17 [15:12:17.837]
VERBOSE:
p2p:l2-block-stream Starting sync from block number 0
15:12:17 [15:12:17.846]
INFO:
validator Started validator with addresses: 0xfbb85a8e7f9f60aa03edf2378d4d2ec934dc3723
15:12:17 [15:12:17.847]
VERBOSE:
validator Validators 0xfbb85a8e7f9f60aa03edf2378d4d2ec934dc3723 are not on the validator committee for epoch 0
15:12:17 [15:12:17.847]
INFO:
sequencer Sequencer config set
{"transactionPollingIntervalMS":500,"maxTxsPerBlock":32,"minTxsPerBlock":0,"maxL2BlockGas":10000000000,"publishTxsWithProposals":false,"maxDABlockGas":10000000000,"acvmWorkingDirectory":"/tmp/9ac8fa4d/acvm","acvmBinaryPath":"../../noir/noir-repo/target/release/acvm","maxBlockSizeInBytes":1048576,"governanceProposerPayload":"0x0000000000000000000000000000000000000000","maxL1TxInclusionTimeIntoSlot":8,"enforceTimeTable":false}
15:12:17 [15:12:17.848]
VERBOSE:
sequencer Sequencer timetable updated
{"enforceTimeTable":false}
15:12:17 [15:12:17.849]
INFO:
sequencer Sequencer started with address 0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266
15:12:17 [15:12:17.850]
VERBOSE:
node:MAIN-aztec-node Sequencer started
15:12:17 [15:12:17.850]
INFO:
node:MAIN-aztec-node Aztec Node version: 0.87.6
15:12:17 [15:12:17.850]
INFO:
node:MAIN-aztec-node Aztec Node started on chain 0x7a69
{"registryAddress":"0x3c709afec1aceae522c13145005de788a3cc65c8","governanceAddress":"0xa49a3d51a71916f87d60f0e919fb66e4b933b4df","governanceProposerAddress":"0xede9b34af448f9261efea2dafb2364866b09e01a","rollupAddress":"0x1bd1b5a0ac2df415643c67319e7001f853a04d32","inboxAddress":"0xdd4dbb621d3001ff1d4ee7495e8650be834f7d5e","outboxAddress":"0x3c4266f8f121ec97a70f1bcdc433ba0a31aeeab1","feeJuicePortalAddress":"0x0c50d7346f1753a263974959d25bbbdfa3d7e72e","feeJuiceAddress":"0xb8999345da8041f1da51ac5179b1f055a560f397","stakingAssetAddress":"0xbb9e13665cfb3d531f288a11e7312b6b91c59292","rewardDistributorAddress":"0x4a51916a6b10a43f6565042be5b6b69d8d613f64","gseAddress":"0x6f26a1916df432654607f9c75b764e535e65cf3e","coinIssuerAddress":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","slashFactoryAddress":"0x0831354267749dca1021c97f96ae7cd30b2a9b6f","feeAssetHandlerAddress":"0xb4ff23c4b1e2bc7c86090d4fbda21a457ee6727f","stakingAssetHandlerAddress":"0xd8c49c848a06990e1b1ad8df26dbc5725b657aca","zkPassportVerifierAddress":"0xee9f10f38319eae2730dba28fb09081db806c5e5"}
15:12:17 [15:12:17.851]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Creating and syncing a simulated prover node...
15:12:17 [15:12:17.885]
INFO:
blob-sink:client:prover-node Creating HTTP blob sink client.
{"blobSinkUrl":"http://localhost:42075"}
15:12:17 [15:12:17.890]
INFO:
archiver:lmdb:prover-node Creating archiver data store at directory /tmp/4b42610963c7105e/dff060e316a8953a/archiver with map size 134217728 KB (LMDB v2)
15:12:17 [15:12:17.901]
VERBOSE:
sequencer Preparing proposal for block 1 at slot 2
{"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750778128,"version":3942611033},"chainTipArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","blockNumber":1,"slot":2}
15:12:17 [15:12:17.905]
INFO:
archiver:lmdb:prover-node Starting data store with maxReaders 16
15:12:17 [15:12:17.988]
VERBOSE:
block-builder Building block 1 for slot 2
{"slot":2,"slotStart":"2025-06-24T15:15:28.000Z","now":"2025-06-24T15:15:21.155Z","blockNumber":1,"msgCount":0,"initialStateReference":{"l1ToL2MessageTree":"0x2e33ee2008411c04b99c24b313513d097a0d21a5040b6193d1f978b8226892d6","noteHashTree":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTree":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTree":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9"},"initialArchiveRoot":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}}
15:12:18 [15:12:18.112]
INFO:
simulator:public-processor:prover-node Processed 0 successful txs and 0 failed txs in 0.1207879439999997s
{"duration":0.1207879439999997,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0}
15:12:18 [15:12:18.213]
INFO:
sequencer Built block 1 for slot 2 with 0 txs and 0 messages. 0 mana/s
{"blockHash":"0x19d18f0a205f90ef42258371d73104b60cb8ad384bc1dc97f0537f89fd427be7","globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750778128,"version":3942611033},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":266.58370300000024,"publicProcessDuration":121.5650510000005,"rollupCircuitsDuration":227.96128100000078,"txCount":0,"blockNumber":1,"blockTimestamp":1750778128,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0}
15:12:18 [15:12:18.217]
VERBOSE:
sequencer Attesting committee is empty
15:12:18 [15:12:18.239]
INFO:
blob-sink:client:prover-node Testing configured blob sources
{"blobSinkUrl":"http://localhost:42075"}
15:12:18 [15:12:18.246]
INFO:
blob-sink:client:prover-node Blob sink is reachable
{"blobSinkUrl":"http://localhost:42075"}
15:12:18 [15:12:18.246]
WARN:
blob-sink:client:prover-node No L1 consensus host urls configured
15:12:18 [15:12:18.246]
WARN:
blob-sink:client:prover-node No archive client configured
15:12:18 [15:12:18.249]
INFO:
archiver:prover-node Starting archiver sync to rollup contract 0x1bd1b5a0ac2df415643c67319e7001f853a04d32 from L1 block 22 to current L1 block 25 with hash 0x9123a3c73ddb53d3f7c75be4c968c22ecf5e96f0cbf92079568ae63387b1a212
{"blocksSynchedTo":22,"messagesSynchedTo":{"l1BlockHash":"0xad4218b278c351b64c0c0433e5e5d70c3b0d4f4fabc9ea55b95b2fc688efde62","l1BlockNumber":22}}
15:12:18 [15:12:18.285]
INFO:
archiver:prover-node Initial archiver sync to L1 block 25 complete.
{"l1BlockNumber":25,"syncPoint":{"blocksSynchedTo":25},"latest":{"number":0},"proven":{"number":0},"finalized":{"number":0}}
15:12:18 [15:12:18.287]
INFO:
prover-node:blob-sink:client:prover-node Creating HTTP blob sink client.
{"blobSinkUrl":"http://localhost:42075"}
15:12:18 [15:12:18.288]
VERBOSE:
prover-node:prover-node Snapshot sync is disabled. No snapshots URL provided.
15:12:18 [15:12:18.291]
VERBOSE:
prover-node:prover-node Created archiver and synced to block 0
15:12:18 [15:12:18.320]
INFO:
world-state:database:prover-node Creating world state data store at directory /tmp/4b42610963c7105e/dff060e316a8953a/world_state with map sizes {"archiveTreeMapSizeKb":134217728,"nullifierTreeMapSizeKb":134217728,"noteHashTreeMapSizeKb":134217728,"messageTreeMapSizeKb":134217728,"publicDataTreeMapSizeKb":134217728} and 2 threads.
15:12:18 [15:12:18.340]
INFO:
world_state:prover-node Created world state synchroniser with block history of 2
15:12:18 [15:12:18.341]
VERBOSE:
world-state:block_stream:prover-node Starting L2 block stream
{"proven":false,"pollIntervalMS":50}
15:12:18 [15:12:18.342]
INFO:
world_state:prover-node Started world state synchronizer from block 1
15:12:18 [15:12:18.343]
VERBOSE:
world-state:block_stream:prover-node Starting sync from block number 0
15:12:18 [15:12:18.344]
WARN:
prover-client:proving-broker-database:prover-node Found invalid epoch directory /tmp/4b42610963c7105e/dff060e316a8953a/archiver when loading epoch databases, ignoring
15:12:18 [15:12:18.344]
WARN:
prover-client:proving-broker-database:prover-node Found invalid epoch directory /tmp/4b42610963c7105e/dff060e316a8953a/world_state when loading epoch databases, ignoring
15:12:18 [15:12:18.345]
INFO:
prover-client:proving-broker:prover-node Proving Broker started
15:12:18 [15:12:18.358]
INFO:
prover-node:prover-coordination:prover-node Using prover coordination via aztec node
15:12:18 [15:12:18.359]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof:prover-node Created and synced prover node
{"publisherAddress":"0x3C44CdDdB6a900fa2b585dd299e03d12FA4293BC"}
15:12:18 [15:12:18.360]
INFO:
prover-node:epoch-monitor:prover-node Started EpochMonitor
{"pollingIntervalMs":200}
15:12:18 [15:12:18.363]
INFO:
prover-node:prover-node Started Prover Node with prover id 0x0000000000000000000000000000000000000000000000000000000000000001
{"proverNodePollingIntervalMs":200,"proverNodeMaxPendingJobs":10,"proverNodeMaxParallelBlocksPerEpoch":32,"txGatheringIntervalMs":1000,"txGatheringBatchSize":10,"txGatheringMaxParallelRequestsPerNode":100,"proverNodeFailedEpochStore":"file:///tmp/failed-proofs-yyLwZ9","dataDirectory":"/tmp/4b42610963c7105e/dff060e316a8953a","l1ChainId":31337,"rollupVersion":3942611033}
15:12:18 [15:12:18.363]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Creating a pxe...
15:12:18 [15:12:18.366]
INFO:
pxe:data:lmdb Creating pxe_data data store at directory /tmp/4cbc744d17ee1740/pxe_data with map size 134217728 KB (LMDB v2)
15:12:18 [15:12:18.370]
INFO:
pxe:data:lmdb Starting data store with maxReaders 16
15:12:18 [15:12:18.714]
VERBOSE:
pxe:service Registered protocol contracts in pxe
{"AuthRegistry":"0x0000000000000000000000000000000000000000000000000000000000000001","ContractInstanceDeployer":"0x0000000000000000000000000000000000000000000000000000000000000002","ContractClassRegisterer":"0x0000000000000000000000000000000000000000000000000000000000000003","MultiCallEntrypoint":"0x0000000000000000000000000000000000000000000000000000000000000004","FeeJuice":"0x0000000000000000000000000000000000000000000000000000000000000005","Router":"0x0000000000000000000000000000000000000000000000000000000000000006"}
15:12:18 [15:12:18.714]
INFO:
pxe:service Started PXE connected to chain 31337 version 3942611033
15:12:18 [15:12:18.721]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof L2 genesis at L1 block 22 (timestamp 1750778096)
15:12:18 [15:12:18.722]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Waiting until L1 timestamp 1750778160 is reached as the start of epoch 1
15:12:18 [15:12:18.939]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof L1 block 25 mined at 15:15:20 with new L2 block 0 for epoch 0 with proof up to L2 block 0 for epoch 0
{"l1Timestamp":1750778120,"l1BlockNumber":25,"l2SlotNumber":1,"l2BlockNumber":0,"l2ProvenBlockNumber":0,"totalL2Messages":0}
15:12:20 [15:12:20.878]
VERBOSE:
ethereum:tx_delayer Sent tx immediately 0xe2227fa458d7940768d317a28ac57ed3033ecdc3b415561af75307b13e8801ef
15:12:20 [15:12:20.879]
VERBOSE:
node:MAIN-aztec-node Sent L1 transaction 0xe2227fa458d7940768d317a28ac57ed3033ecdc3b415561af75307b13e8801ef
{"gasLimit":470455,"maxFeePerGas":"500","maxPriorityFeePerGas":"500","maxFeePerBlobGas":"0.000000001"}
15:12:24 [15:12:24.874]
INFO:
sequencer:publisher Bundled [propose] transaction [succeeded]
15:12:24 [15:12:24.874]
VERBOSE:
sequencer:publisher Published L2 block to L1 rollup contract
{"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0xe2227fa458d7940768d317a28ac57ed3033ecdc3b415561af75307b13e8801ef","calldataSize":1220,"calldataGas":8828,"txCount":0,"blockNumber":1,"blockTimestamp":1750778128,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0}
15:12:24 [15:12:24.875]
VERBOSE:
node:blob-sink:client Sending 1 blobs to blob sink
15:12:24 [15:12:24.895]
INFO:
blob-sink:server Received blob sidecar for block 0x2dbc9cd4847b3ca62d81952cf0ba8b03f4b9e8fbc821567b247b180e3d46d1c1
15:12:24 [15:12:24.903]
INFO:
blob-sink:server Blob sidecar stored successfully for block 0x2dbc9cd4847b3ca62d81952cf0ba8b03f4b9e8fbc821567b247b180e3d46d1c1
15:12:24 [15:12:24.978]
INFO:
archiver:prover-node Downloaded L2 block 1
{"blockHash":"0x19d18f0a205f90ef42258371d73104b60cb8ad384bc1dc97f0537f89fd427be7","blockNumber":1,"txCount":0,"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750778128,"version":3942611033},"archiveRoot":"0x1f5bbd8747628d35a6cd24fdb9d8963d05c93c465b507b8cbe4267b3c694400a","archiveNextLeafIndex":2}
15:12:24 [15:12:24.997]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof L1 block 26 mined at 15:15:28 with new L2 block 1 for epoch 0
{"l1Timestamp":1750778128,"l1BlockNumber":26,"l2SlotNumber":2,"l2BlockNumber":1,"l2ProvenBlockNumber":0,"totalL2Messages":0}
15:12:25 [15:12:25.002]
INFO:
archiver Downloaded L2 block 1
{"blockHash":"0x19d18f0a205f90ef42258371d73104b60cb8ad384bc1dc97f0537f89fd427be7","blockNumber":1,"txCount":0,"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750778128,"version":3942611033},"archiveRoot":"0x1f5bbd8747628d35a6cd24fdb9d8963d05c93c465b507b8cbe4267b3c694400a","archiveNextLeafIndex":2}
15:12:25 [15:12:25.026]
INFO:
world_state:prover-node World state updated with L2 block 1
{"eventName":"l2-block-handled","duration":3.0745090000000346,"unfinalisedBlockNumber":1,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":1,"blockTimestamp":1750778128,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0}
15:12:25 [15:12:25.027]
INFO:
world_state World state updated with L2 block 1
{"eventName":"l2-block-handled","duration":2.9050029999998515,"unfinalisedBlockNumber":1,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":1,"blockTimestamp":1750778128,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0}
15:12:25 [15:12:25.084]
VERBOSE:
p2p Synched to latest block 1
15:12:25 [15:12:25.367]
VERBOSE:
prover-node:prover-node Fetching 0 tx hashes for block number 1 from coordination
15:12:25 [15:12:25.367]
INFO:
prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool
15:12:32 [15:12:32.932]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof L1 block 27 mined at 15:15:36
{"l1Timestamp":1750778136,"l1BlockNumber":27,"l2SlotNumber":2,"l2BlockNumber":1,"l2ProvenBlockNumber":0,"totalL2Messages":0}
15:12:32 [15:12:32.966]
VERBOSE:
sequencer Preparing proposal for block 2 at slot 3
{"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750778144,"version":3942611033},"chainTipArchive":"0x1f5bbd8747628d35a6cd24fdb9d8963d05c93c465b507b8cbe4267b3c694400a","blockNumber":2,"slot":3}
15:12:32 [15:12:32.981]
VERBOSE:
block-builder Building block 2 for slot 3
{"slot":3,"slotStart":"2025-06-24T15:15:44.000Z","now":"2025-06-24T15:15:36.149Z","blockNumber":2,"msgCount":0,"initialStateReference":{"l1ToL2MessageTree":"0x2e33ee2008411c04b99c24b313513d097a0d21a5040b6193d1f978b8226892d6","noteHashTree":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTree":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTree":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9"},"initialArchiveRoot":"0x1f5bbd8747628d35a6cd24fdb9d8963d05c93c465b507b8cbe4267b3c694400a","opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}}
15:12:32 [15:12:32.984]
INFO:
simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.0010736259999976029s
{"duration":0.0010736259999976029,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0}
15:12:33 [15:12:33.002]
INFO:
sequencer Built block 2 for slot 3 with 0 txs and 0 messages. 0 mana/s
{"blockHash":"0x2e94b39bf6fa2da72aa971c4ff7d743f734e1508898d66a13f7f5d65019ec779","globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750778144,"version":3942611033},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":28.58429000000251,"publicProcessDuration":1.4355739999991783,"rollupCircuitsDuration":22.54221999999936,"txCount":0,"blockNumber":2,"blockTimestamp":1750778144,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0}
15:12:33 [15:12:33.004]
VERBOSE:
sequencer Attesting committee is empty
15:12:33 [15:12:33.069]
VERBOSE:
ethereum:tx_delayer Sent tx immediately 0x661540641a7d4d24755e27ba853d6350316ba6a55b349533ea3f96cefdff5710
15:12:33 [15:12:33.069]
VERBOSE:
node:MAIN-aztec-node Sent L1 transaction 0x661540641a7d4d24755e27ba853d6350316ba6a55b349533ea3f96cefdff5710
{"gasLimit":391098,"maxFeePerGas":"1.266215001","maxPriorityFeePerGas":"1.2","maxFeePerBlobGas":"0.000000001"}
15:12:40 [15:12:40.883]
INFO:
sequencer:publisher Bundled [propose] transaction [succeeded]
15:12:40 [15:12:40.883]
VERBOSE:
sequencer:publisher Published L2 block to L1 rollup contract
{"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0x661540641a7d4d24755e27ba853d6350316ba6a55b349533ea3f96cefdff5710","calldataSize":1220,"calldataGas":8828,"txCount":0,"blockNumber":2,"blockTimestamp":1750778144,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0}
15:12:40 [15:12:40.884]
VERBOSE:
node:blob-sink:client Sending 1 blobs to blob sink
15:12:40 [15:12:40.900]
INFO:
blob-sink:server Received blob sidecar for block 0x3f69d9ccf24f70a939ec99f2d553321b3c00d90dc38d377cae46574ea58d628b
15:12:40 [15:12:40.905]
INFO:
blob-sink:server Blob sidecar stored successfully for block 0x3f69d9ccf24f70a939ec99f2d553321b3c00d90dc38d377cae46574ea58d628b
15:12:40 [15:12:40.908]
WARN:
node:blob-sink:client Unable to get blob sidecar for 0x3f69d9ccf24f70a939ec99f2d553321b3c00d90dc38d377cae46574ea58d628b: Not Found (404)
{"status":404,"statusText":"Not Found","body":"{\"error\":\"Blob not found\"}"}
15:12:40 [15:12:40.908]
WARN:
node:blob-sink:client Failed to fetch blobs for 0x3f69d9ccf24f70a939ec99f2d553321b3c00d90dc38d377cae46574ea58d628b from all blob sources
{"blobSinkUrl":"http://localhost:42075"}
15:12:40 [15:12:40.927]
INFO:
archiver:prover-node Downloaded L2 block 2
{"blockHash":"0x2e94b39bf6fa2da72aa971c4ff7d743f734e1508898d66a13f7f5d65019ec779","blockNumber":2,"txCount":0,"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750778144,"version":3942611033},"archiveRoot":"0x030fc75b33df2cc9356a7721ad5913925b3fdc1a4a5ccef83fc852abb9fa6f6f","archiveNextLeafIndex":3}
15:12:40 [15:12:40.938]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof L1 block 28 mined at 15:15:44 with new L2 block 2 for epoch 0
{"l1Timestamp":1750778144,"l1BlockNumber":28,"l2SlotNumber":3,"l2BlockNumber":2,"l2ProvenBlockNumber":0,"totalL2Messages":0}
15:12:41 [15:12:41.005]
INFO:
archiver Downloaded L2 block 2
{"blockHash":"0x2e94b39bf6fa2da72aa971c4ff7d743f734e1508898d66a13f7f5d65019ec779","blockNumber":2,"txCount":0,"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750778144,"version":3942611033},"archiveRoot":"0x030fc75b33df2cc9356a7721ad5913925b3fdc1a4a5ccef83fc852abb9fa6f6f","archiveNextLeafIndex":3}
15:12:41 [15:12:41.012]
INFO:
world_state:prover-node World state updated with L2 block 2
{"eventName":"l2-block-handled","duration":3.399110999998811,"unfinalisedBlockNumber":2,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":2,"blockTimestamp":1750778144,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0}
15:12:41 [15:12:41.014]
INFO:
prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool
15:12:41 [15:12:41.014]
VERBOSE:
prover-node:prover-node Gathered all 0 txs for epoch 0
{"epochNumber":0}
15:12:41 [15:12:41.015]
VERBOSE:
prover-node:prover-node Gathered all 0 messages for epoch 0
{"epochNumber":0}
15:12:41 [15:12:41.015]
VERBOSE:
prover-node:prover-node Gathered previous block header 0 for epoch 0
15:12:41 [15:12:41.015]
VERBOSE:
prover-node:prover-node Creating proving job for epoch 0 for block range 1 to 2
15:12:41 [15:12:41.017]
INFO:
prover-node:epoch-proving-job Starting epoch 0 proving job with blocks 1 to 2
{"fromBlock":1,"toBlock":2,"epochSizeBlocks":2,"epochNumber":0,"uuid":"2c2137da-0308-4ed7-9a78-5ccdefbff1ca"}
15:12:41 [15:12:41.032]
INFO:
prover-client:orchestrator Starting epoch 0 with 2 blocks
15:12:41 [15:12:41.033]
VERBOSE:
prover-client:broker-circuit-prover-facade Starting BrokerCircuitProverFacade
15:12:41 [15:12:41.034]
VERBOSE:
prover-node:epoch-proving-job Starting processing block 1
{"number":1,"blockHash":"0x19d18f0a205f90ef42258371d73104b60cb8ad384bc1dc97f0537f89fd427be7","lastArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"2c2137da-0308-4ed7-9a78-5ccdefbff1ca","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x00000000000000000000000000000000000000000000000000000000eaff7859","blockNumber":1,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}}
15:12:41 [15:12:41.034]
INFO:
prover-client:orchestrator Starting block 1 for slot 2
15:12:41 [15:12:41.035]
VERBOSE:
prover-node:epoch-proving-job Starting processing block 2
{"number":2,"blockHash":"0x2e94b39bf6fa2da72aa971c4ff7d743f734e1508898d66a13f7f5d65019ec779","lastArchive":"0x1f5bbd8747628d35a6cd24fdb9d8963d05c93c465b507b8cbe4267b3c694400a","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"2c2137da-0308-4ed7-9a78-5ccdefbff1ca","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x00000000000000000000000000000000000000000000000000000000eaff7859","blockNumber":2,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000003","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}}
15:12:41 [15:12:41.035]
INFO:
prover-client:orchestrator Starting block 2 for slot 3
15:12:41 [15:12:41.043]
INFO:
prover-client:proving-broker:prover-node New proving job id=0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568 epochNumber=0
{"provingJobId":"0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568"}
15:12:41 [15:12:41.044]
VERBOSE:
prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568 type=BASE_PARITY
{"provingJobId":"0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568","provingJobType":"BASE_PARITY"}
15:12:41 [15:12:41.044]
VERBOSE:
prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568 type=BASE_PARITY
{"provingJobId":"0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568","provingJobType":"BASE_PARITY"}
15:12:41 [15:12:41.045]
VERBOSE:
prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568 type=BASE_PARITY
{"provingJobId":"0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568","provingJobType":"BASE_PARITY"}
15:12:41 [15:12:41.048]
VERBOSE:
prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568 type=BASE_PARITY
{"provingJobId":"0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568","provingJobType":"BASE_PARITY"}
15:12:41 [15:12:41.048]
VERBOSE:
prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568 type=BASE_PARITY
{"provingJobId":"0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568","provingJobType":"BASE_PARITY"}
15:12:41 [15:12:41.048]
VERBOSE:
prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568 type=BASE_PARITY
{"provingJobId":"0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568","provingJobType":"BASE_PARITY"}
15:12:41 [15:12:41.049]
VERBOSE:
prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568 type=BASE_PARITY
{"provingJobId":"0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568","provingJobType":"BASE_PARITY"}
15:12:41 [15:12:41.050]
INFO:
simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000016789000001153908s
{"duration":0.000016789000001153908,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0}
15:12:41 [15:12:41.050]
WARN:
prover-client:orchestrator Provided no txs to orchestrator addTxs.
15:12:41 [15:12:41.050]
VERBOSE:
prover-node:epoch-proving-job Processed all 0 txs for block 1
{"blockNumber":1,"blockHash":"0x19d18f0a205f90ef42258371d73104b60cb8ad384bc1dc97f0537f89fd427be7","uuid":"2c2137da-0308-4ed7-9a78-5ccdefbff1ca"}
15:12:41 [15:12:41.051]
VERBOSE:
prover-client:orchestrator Block 1 completed. Assembling header.
15:12:41 [15:12:41.056]
VERBOSE:
prover-client:orchestrator Updating archive tree with block 1 header 0x19d18f0a205f90ef42258371d73104b60cb8ad384bc1dc97f0537f89fd427be7
15:12:41 [15:12:41.057]
INFO:
simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000013542000000597909s
{"duration":0.000013542000000597909,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0}
15:12:41 [15:12:41.058]
WARN:
prover-client:orchestrator Provided no txs to orchestrator addTxs.
15:12:41 [15:12:41.058]
VERBOSE:
prover-node:epoch-proving-job Processed all 0 txs for block 2
{"blockNumber":2,"blockHash":"0x2e94b39bf6fa2da72aa971c4ff7d743f734e1508898d66a13f7f5d65019ec779","uuid":"2c2137da-0308-4ed7-9a78-5ccdefbff1ca"}
15:12:41 [15:12:41.059]
VERBOSE:
prover-client:orchestrator Block 2 completed. Assembling header.
15:12:41 [15:12:41.061]
VERBOSE:
prover-client:orchestrator Orchestrator finalised block 1
15:12:41 [15:12:41.079]
VERBOSE:
prover-client:orchestrator Updating archive tree with block 2 header 0x2e94b39bf6fa2da72aa971c4ff7d743f734e1508898d66a13f7f5d65019ec779
15:12:41 [15:12:41.081]
INFO:
world_state World state updated with L2 block 2
{"eventName":"l2-block-handled","duration":7.396970999998302,"unfinalisedBlockNumber":2,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":2,"blockTimestamp":1750778144,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0}
15:12:41 [15:12:41.084]
VERBOSE:
prover-client:orchestrator Orchestrator finalised block 2
15:12:41 [15:12:41.096]
INFO:
prover-client:proving-broker-database:prover-node Creating broker database for epoch 0 at /tmp/4b42610963c7105e/dff060e316a8953a/0 with map size 134217728
15:12:41 [15:12:41.097]
INFO:
kv-store:lmdb-v2 Starting data store with maxReaders 16
15:12:41 [15:12:41.099]
VERBOSE:
prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568 type=BASE_PARITY epochNumber=0
{"provingJobId":"0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568","provingJobType":"BASE_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...","status":"not-found","numOutstandingJobs":1}
15:12:41 [15:12:41.117]
VERBOSE:
p2p Synched to latest block 2
15:12:41 [15:12:41.158]
INFO:
prover-client:proving-agent:prover-node Starting job id=0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568 type=BASE_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...
15:12:41 [15:12:41.169]
INFO:
prover-client:proving-agent:job-controller-61316158 Job controller started jobId=0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568
{"jobId":"0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568"}
15:12:41 [15:12:41.246]
INFO:
prover-client:proving-agent:prover-node Job id=0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568 type=BASE_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22resul...
15:12:41 [15:12:41.246]
INFO:
prover-client:proving-broker:prover-node Proving job complete id=0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568 type=BASE_PARITY totalAttempts=1
{"provingJobId":"0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568"}
15:12:41 [15:12:41.376]
VERBOSE:
prover-node:prover-node Fetching 0 tx hashes for block number 2 from coordination
15:12:41 [15:12:41.377]
INFO:
prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool
15:12:42 [15:12:42.034]
VERBOSE:
prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1
15:12:42 [15:12:42.036]
VERBOSE:
prover-client:broker-circuit-prover-facade Resolved proving job id=0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568 type=BASE_PARITY
15:12:42 [15:12:42.036]
VERBOSE:
prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0
15:12:42 [15:12:42.047]
INFO:
prover-client:proving-broker:prover-node New proving job id=0:ROOT_PARITY:036ef6d1c35f3a38fcb8de74713948fb49b8b4f22f0cf2ad8727f6d9340850e3 epochNumber=0
{"provingJobId":"0:ROOT_PARITY:036ef6d1c35f3a38fcb8de74713948fb49b8b4f22f0cf2ad8727f6d9340850e3"}
15:12:42 [15:12:42.053]
VERBOSE:
prover-client:broker-circuit-prover-facade Job already found in facade id=0:ROOT_PARITY:036ef6d1c35f3a38fcb8de74713948fb49b8b4f22f0cf2ad8727f6d9340850e3 type=ROOT_PARITY
{"provingJobId":"0:ROOT_PARITY:036ef6d1c35f3a38fcb8de74713948fb49b8b4f22f0cf2ad8727f6d9340850e3","provingJobType":"ROOT_PARITY"}
15:12:42 [15:12:42.095]
WARN:
e2e:e2e_epochs:epochs_upload_failed_proof Triggering error on finaliseEpoch
15:12:42 [15:12:42.100]
ERROR:
prover-node:epoch-proving-job Error running epoch 0 prover job: Error: Fake error while proving epoch
15:12:42 at ServerEpochProver.epochProver.finaliseEpoch (/home/aztec-dev/aztec-packages/yarn-project/end-to-end/src/e2e_epochs/epochs_upload_failed_proof.test.ts:60:15)
15:12:42 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:142:64)
15:12:42 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13)
{"uuid":"2c2137da-0308-4ed7-9a78-5ccdefbff1ca","epochNumber":0}
15:12:42 [15:12:42.101]
VERBOSE:
prover-client:broker-circuit-prover-facade Stopping BrokerCircuitProverFacade
15:12:42 [15:12:42.101]
ERROR:
prover-client:broker-circuit-prover-facade Job errored with 'Broker facade stopped' id=0:ROOT_PARITY:036ef6d1c35f3a38fcb8de74713948fb49b8b4f22f0cf2ad8727f6d9340850e3 type=ROOT_PARITY: {
15:12:42 provingJobId: '0:ROOT_PARITY:036ef6d1c35f3a38fcb8de74713948fb49b8b4f22f0cf2ad8727f6d9340850e3',
15:12:42 provingJobType: 'ROOT_PARITY'
15:12:42 }
15:12:42 [15:12:42.102]
ERROR:
prover-client:orchestrator Error thrown when proving job: Error: Broker facade stopped
15:12:42 at BrokerCircuitProverFacade.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/proving_broker/broker_prover_facade.js:142:31)
15:12:42 at ServerEpochProver.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/prover-client/server-epoch-prover.js:31:9)
15:12:42 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:183:13)
15:12:42 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13)
15:12:42 [15:12:42.103]
ERROR:
prover-node:prover-node Job for 0 exited with state failed: {
15:12:42 id: '2c2137da-0308-4ed7-9a78-5ccdefbff1ca',
15:12:42 epochNumber: 0n,
15:12:42 state: 'failed'
15:12:42 }
15:12:42 [15:12:42.103]
WARN:
prover-node:prover-node Uploading epoch proof failure for 0 to file:///tmp/failed-proofs-yyLwZ9
{"epochNumber":0,"jobId":"2c2137da-0308-4ed7-9a78-5ccdefbff1ca","location":"file:///tmp/failed-proofs-yyLwZ9"}
15:12:42 [15:12:42.105]
INFO:
stdlib:file-store Creating local file file store at /tmp/failed-proofs-yyLwZ9
15:12:42 [15:12:42.105]
VERBOSE:
prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_PARITY:036ef6d1c35f3a38fcb8de74713948fb49b8b4f22f0cf2ad8727f6d9340850e3 type=ROOT_PARITY epochNumber=0
{"provingJobId":"0:ROOT_PARITY:036ef6d1c35f3a38fcb8de74713948fb49b8b4f22f0cf2ad8727f6d9340850e3","provingJobType":"ROOT_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu...","status":"not-found","numOutstandingJobs":0}
15:12:42 [15:12:42.106]
ERROR:
prover-client:orchestrator Error thrown when proving job: Error: Broker facade stopped
15:12:42 at BrokerCircuitProverFacade.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/proving_broker/broker_prover_facade.js:142:31)
15:12:42 at ServerEpochProver.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/prover-client/server-epoch-prover.js:31:9)
15:12:42 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:183:13)
15:12:42 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13)
15:12:42 [15:12:42.107]
INFO:
prover-node:prover-node Pausing archiver and world state sync to start snapshot upload
15:12:42 [15:12:42.107]
INFO:
archiver:prover-node Stopped.
15:12:42 [15:12:42.107]
INFO:
world_state:prover-node Stopped sync
15:12:42 [15:12:42.108]
INFO:
prover-node:prover-node Creating backups of lmdb environments to /tmp/4b42610963c7105e/dff060e316a8953a/epoch-proof-data-LniB6r
15:12:42 [15:12:42.110]
INFO:
prover-node:prover-node Data stores backed up to /tmp/4b42610963c7105e/dff060e316a8953a/epoch-proof-data-LniB6r
{"paths":{"l1-to-l2-message-tree":"/tmp/4b42610963c7105e/dff060e316a8953a/epoch-proof-data-LniB6r/world-state/L1ToL2MessageTree/data.mdb","archive-tree":"/tmp/4b42610963c7105e/dff060e316a8953a/epoch-proof-data-LniB6r/world-state/ArchiveTree/data.mdb","public-data-tree":"/tmp/4b42610963c7105e/dff060e316a8953a/epoch-proof-data-LniB6r/world-state/PublicDataTree/data.mdb","note-hash-tree":"/tmp/4b42610963c7105e/dff060e316a8953a/epoch-proof-data-LniB6r/world-state/NoteHashTree/data.mdb","nullifier-tree":"/tmp/4b42610963c7105e/dff060e316a8953a/epoch-proof-data-LniB6r/world-state/NullifierTree/data.mdb","archiver":"/tmp/4b42610963c7105e/dff060e316a8953a/epoch-proof-data-LniB6r/archiver/data.mdb"}}
15:12:42 [15:12:42.110]
INFO:
prover-node:prover-node Resuming archiver and world state sync
15:12:42 [15:12:42.111]
VERBOSE:
world-state:block_stream:prover-node Starting L2 block stream
{"proven":false,"pollIntervalMS":50}
15:12:42 [15:12:42.111]
INFO:
world_state:prover-node Resumed sync
15:12:42 [15:12:42.111]
INFO:
archiver:prover-node Restarting archiver
15:12:42 [15:12:42.122]
WARN:
prover-node:prover-node Uploaded epoch 0 proof failure data to file:///tmp/failed-proofs-yyLwZ9/aztec-31337-3942611033-0x1bd1b5a0ac2df415643c67319e7001f853a04d32/0-20250624151242-2c2137da-0308-4ed7-9a78-5ccdefbff1ca
{"epochNumber":0,"location":"file:///tmp/failed-proofs-yyLwZ9","basePath":"aztec-31337-3942611033-0x1bd1b5a0ac2df415643c67319e7001f853a04d32/0-20250624151242-2c2137da-0308-4ed7-9a78-5ccdefbff1ca","metadataUrl":"file:///tmp/failed-proofs-yyLwZ9/aztec-31337-3942611033-0x1bd1b5a0ac2df415643c67319e7001f853a04d32/0-20250624151242-2c2137da-0308-4ed7-9a78-5ccdefbff1ca/metadata.json","dataUrl":"file:///tmp/failed-proofs-yyLwZ9/aztec-31337-3942611033-0x1bd1b5a0ac2df415643c67319e7001f853a04d32/0-20250624151242-2c2137da-0308-4ed7-9a78-5ccdefbff1ca/data.bin","metadata":{"l1BlockNumber":28,"l2BlockHash":"0x2e94b39bf6fa2da72aa971c4ff7d743f734e1508898d66a13f7f5d65019ec779","l2BlockNumber":2,"schemaVersions":{"archiver":3,"worldState":2},"timestamp":1750777962112,"dataUrls":{"l1-to-l2-message-tree":"file:///tmp/failed-proofs-yyLwZ9/aztec-31337-3942611033-0x1bd1b5a0ac2df415643c67319e7001f853a04d32/0-20250624151242-2c2137da-0308-4ed7-9a78-5ccdefbff1ca/l1-to-l2-message-tree.db","archive-tree":"file:///tmp/failed-proofs-yyLwZ9/aztec-31337-3942611033-0x1bd1b5a0ac2df415643c67319e7001f853a04d32/0-20250624151242-2c2137da-0308-4ed7-9a78-5ccdefbff1ca/archive-tree.db","public-data-tree":"file:///tmp/failed-proofs-yyLwZ9/aztec-31337-3942611033-0x1bd1b5a0ac2df415643c67319e7001f853a04d32/0-20250624151242-2c2137da-0308-4ed7-9a78-5ccdefbff1ca/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-yyLwZ9/aztec-31337-3942611033-0x1bd1b5a0ac2df415643c67319e7001f853a04d32/0-20250624151242-2c2137da-0308-4ed7-9a78-5ccdefbff1ca/note-hash-tree.db","nullifier-tree":"file:///tmp/failed-proofs-yyLwZ9/aztec-31337-3942611033-0x1bd1b5a0ac2df415643c67319e7001f853a04d32/0-20250624151242-2c2137da-0308-4ed7-9a78-5ccdefbff1ca/nullifier-tree.db","archiver":"file:///tmp/failed-proofs-yyLwZ9/aztec-31337-3942611033-0x1bd1b5a0ac2df415643c67319e7001f853a04d32/0-20250624151242-2c2137da-0308-4ed7-9a78-5ccdefbff1ca/archiver.db"}},"jobId":"2c2137da-0308-4ed7-9a78-5ccdefbff1ca"}
15:12:42 [15:12:42.122]
INFO:
prover-node:prover-node Cleaning up backup dir /tmp/4b42610963c7105e/dff060e316a8953a/epoch-proof-data-LniB6r
15:12:42 [15:12:42.175]
INFO:
prover-client:proving-agent:prover-node Starting job id=0:ROOT_PARITY:036ef6d1c35f3a38fcb8de74713948fb49b8b4f22f0cf2ad8727f6d9340850e3 type=ROOT_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu...
15:12:42 [15:12:42.192]
INFO:
prover-client:proving-agent:job-controller-11c118de Job controller started jobId=0:ROOT_PARITY:036ef6d1c35f3a38fcb8de74713948fb49b8b4f22f0cf2ad8727f6d9340850e3
{"jobId":"0:ROOT_PARITY:036ef6d1c35f3a38fcb8de74713948fb49b8b4f22f0cf2ad8727f6d9340850e3"}
15:12:42 [15:12:42.302]
INFO:
prover-client:proving-agent:prover-node Job id=0:ROOT_PARITY:036ef6d1c35f3a38fcb8de74713948fb49b8b4f22f0cf2ad8727f6d9340850e3 type=ROOT_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22resu...
15:12:42 [15:12:42.302]
INFO:
prover-client:proving-broker:prover-node Proving job complete id=0:ROOT_PARITY:036ef6d1c35f3a38fcb8de74713948fb49b8b4f22f0cf2ad8727f6d9340850e3 type=ROOT_PARITY totalAttempts=1
{"provingJobId":"0:ROOT_PARITY:036ef6d1c35f3a38fcb8de74713948fb49b8b4f22f0cf2ad8727f6d9340850e3"}
15:12:48 [15:12:48.854]
INFO:
prover-node:prover-node Stopping ProverNode
15:12:48 [15:12:48.855]
INFO:
prover-node:epoch-monitor:prover-node Stopped EpochMonitor
15:12:48 [15:12:48.868]
INFO:
archiver:prover-node Stopped.
15:12:48 [15:12:48.869]
INFO:
world_state:prover-node Stopped world state synchronizer
15:12:48 [15:12:48.870]
INFO:
prover-node:prover-node Stopped ProverNode
15:12:48 [15:12:48.870]
INFO:
node:MAIN-aztec-node Stopping Aztec Node
15:12:48 [15:12:48.977]
VERBOSE:
sequencer Preparing proposal for block 3 at slot 4
{"globalVariables":{"blockNumber":3,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":4,"timestamp":1750778160,"version":3942611033},"chainTipArchive":"0x030fc75b33df2cc9356a7721ad5913925b3fdc1a4a5ccef83fc852abb9fa6f6f","blockNumber":3,"slot":4}
15:12:48 [15:12:48.994]
VERBOSE:
block-builder Building block 3 for slot 4
{"slot":4,"slotStart":"2025-06-24T15:16:00.000Z","now":"2025-06-24T15:15:52.162Z","blockNumber":3,"msgCount":0,"initialStateReference":{"l1ToL2MessageTree":"0x2e33ee2008411c04b99c24b313513d097a0d21a5040b6193d1f978b8226892d6","noteHashTree":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTree":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTree":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9"},"initialArchiveRoot":"0x030fc75b33df2cc9356a7721ad5913925b3fdc1a4a5ccef83fc852abb9fa6f6f","opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}}
15:12:48 [15:12:48.996]
INFO:
simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.00017102200000226731s
{"duration":0.00017102200000226731,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0}
15:12:49 [15:12:49.008]
INFO:
sequencer Built block 3 for slot 4 with 0 txs and 0 messages. 0 mana/s
{"blockHash":"0x055ef9099560d1fafab0f625a273939c24b0005ba194a68ed14b86294c4d4e7f","globalVariables":{"blockNumber":3,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":4,"timestamp":1750778160,"version":3942611033},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":18.850501000000804,"publicProcessDuration":0.5036189999955241,"rollupCircuitsDuration":14.259725000003527,"txCount":0,"blockNumber":3,"blockTimestamp":1750778160,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0}
15:12:49 [15:12:49.010]
VERBOSE:
sequencer Attesting committee is empty
15:12:49 [15:12:49.070]
VERBOSE:
ethereum:tx_delayer Sent tx immediately 0x37062a7dfbf41aa68fe2167dd97afd957cc7a84aef4611474a9129a57b93a8bb
15:12:49 [15:12:49.071]
VERBOSE:
node:MAIN-aztec-node Sent L1 transaction 0x37062a7dfbf41aa68fe2167dd97afd957cc7a84aef4611474a9129a57b93a8bb
{"gasLimit":464655,"maxFeePerGas":"1.250823812","maxPriorityFeePerGas":"1.2","maxFeePerBlobGas":"0.000000001"}
15:12:50 [15:12:50.871]
INFO:
slasher Slasher client stopped.
15:12:56 [15:12:56.840]
INFO:
sequencer:publisher Bundled [propose] transaction [succeeded]
15:12:56 [15:12:56.840]
VERBOSE:
sequencer:publisher Published L2 block to L1 rollup contract
{"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0x37062a7dfbf41aa68fe2167dd97afd957cc7a84aef4611474a9129a57b93a8bb","calldataSize":1220,"calldataGas":8828,"txCount":0,"blockNumber":3,"blockTimestamp":1750778160,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0}
15:12:56 [15:12:56.841]
VERBOSE:
node:blob-sink:client Sending 1 blobs to blob sink
15:12:56 [15:12:56.843]
INFO:
sequencer Stopped sequencer
15:12:56 [15:12:56.844]
INFO:
p2p P2P client stopped
15:12:56 [15:12:56.845]
INFO:
blob-sink:server Received blob sidecar for block 0x220bd2875bbfda8068c255e0964fdb606793ba8f111b24d955a3ba6f4a881cf2
15:12:56 [15:12:56.847]
INFO:
world_state Stopped world state synchronizer
15:12:56 [15:12:56.847]
INFO:
archiver Stopped.
15:12:56 [15:12:56.847]
INFO:
node:MAIN-aztec-node Stopped Aztec Node
15:12:56 [15:12:56.849]
INFO:
node:MAIN-aztec-node Stopping Aztec Node
15:12:56 [15:12:56.850]
INFO:
blob-sink:server Blob sidecar stored successfully for block 0x220bd2875bbfda8068c255e0964fdb606793ba8f111b24d955a3ba6f4a881cf2
15:12:58 [15:12:58.850]
INFO:
slasher Slasher client stopped.
15:12:58 [15:12:58.851]
WARN:
validator Running promise was not started
15:12:58 [15:12:58.851]
WARN:
sequencer Running promise was not started
15:12:58 [15:12:58.851]
INFO:
sequencer Stopped sequencer
15:12:58 [15:12:58.851]
WARN:
p2p:l2-block-stream Running promise was not started
15:12:58 [15:12:58.851]
INFO:
p2p P2P client stopped
15:12:58 [15:12:58.851]
WARN:
world-state:block_stream Running promise was not started
15:12:58 [15:12:58.852]
INFO:
world_state Stopped world state synchronizer
15:12:58 [15:12:58.852]
WARN:
archiver Running promise was not started
15:12:58 [15:12:58.852]
INFO:
archiver Stopped.
15:12:58 [15:12:58.852]
INFO:
node:MAIN-aztec-node Stopped Aztec Node
15:12:58 [15:12:58.852]
INFO:
prover-node:prover-node Stopping ProverNode
15:12:58 [15:12:58.852]
WARN:
prover-node:prover-node Running promise was not started
15:12:58 [15:12:58.852]
WARN:
prover-node:epoch-monitor:prover-node Running promise was not started
15:12:58 [15:12:58.852]
INFO:
prover-node:epoch-monitor:prover-node Stopped EpochMonitor
15:12:58 [15:12:58.853]
WARN:
archiver:prover-node Running promise was not started
15:12:58 [15:12:58.853]
INFO:
archiver:prover-node Stopped.
15:12:58 [15:12:58.853]
WARN:
world-state:block_stream:prover-node Running promise was not started
15:12:58 [15:12:58.853]
INFO:
world_state:prover-node Stopped world state synchronizer
15:12:58 [15:12:58.853]
INFO:
prover-node:prover-node Stopped ProverNode
15:12:58 [15:12:58.861]
INFO:
blob-sink:server Stopping blob sink
15:12:58 [15:12:58.861]
INFO:
blob-sink:server Blob sink stopped
15:12:58 [15:12:58.864]
WARN:
e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data and state
{"uploadPath":"/tmp/failed-proofs-yyLwZ9","rerunDataDir":"/tmp/rerun-data-8ZpTaD","rerunDownloadPath":"/tmp/rerun-download-x0QLed/data.bin"}
15:12:58 [15:12:58.865]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data from file:///tmp/failed-proofs-yyLwZ9/aztec-31337-3942611033-0x1bd1b5a0ac2df415643c67319e7001f853a04d32/0-20250624151242-2c2137da-0308-4ed7-9a78-5ccdefbff1ca
15:12:58 [15:12:58.865]
INFO:
stdlib:file-store Creating local file file store at /tmp/failed-proofs-yyLwZ9/aztec-31337-3942611033-0x1bd1b5a0ac2df415643c67319e7001f853a04d32/0-20250624151242-2c2137da-0308-4ed7-9a78-5ccdefbff1ca
15:12:58 [15:12:58.866]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Downloading state snapshot from file:///tmp/failed-proofs-yyLwZ9/aztec-31337-3942611033-0x1bd1b5a0ac2df415643c67319e7001f853a04d32/0-20250624151242-2c2137da-0308-4ed7-9a78-5ccdefbff1ca to local data directory
{"metadata":{"l2BlockNumber":2,"l2BlockHash":"0x2e94b39bf6fa2da72aa971c4ff7d743f734e1508898d66a13f7f5d65019ec779","l1BlockNumber":28,"l1ChainId":31337,"rollupVersion":3942611033,"rollupAddress":"0x1bd1b5a0ac2df415643c67319e7001f853a04d32"},"dataUrls":{"archiver":"file:///tmp/failed-proofs-yyLwZ9/aztec-31337-3942611033-0x1bd1b5a0ac2df415643c67319e7001f853a04d32/0-20250624151242-2c2137da-0308-4ed7-9a78-5ccdefbff1ca/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-yyLwZ9/aztec-31337-3942611033-0x1bd1b5a0ac2df415643c67319e7001f853a04d32/0-20250624151242-2c2137da-0308-4ed7-9a78-5ccdefbff1ca/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-yyLwZ9/aztec-31337-3942611033-0x1bd1b5a0ac2df415643c67319e7001f853a04d32/0-20250624151242-2c2137da-0308-4ed7-9a78-5ccdefbff1ca/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-yyLwZ9/aztec-31337-3942611033-0x1bd1b5a0ac2df415643c67319e7001f853a04d32/0-20250624151242-2c2137da-0308-4ed7-9a78-5ccdefbff1ca/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-yyLwZ9/aztec-31337-3942611033-0x1bd1b5a0ac2df415643c67319e7001f853a04d32/0-20250624151242-2c2137da-0308-4ed7-9a78-5ccdefbff1ca/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-yyLwZ9/aztec-31337-3942611033-0x1bd1b5a0ac2df415643c67319e7001f853a04d32/0-20250624151242-2c2137da-0308-4ed7-9a78-5ccdefbff1ca/l1-to-l2-message-tree.db"}}
15:12:58 [15:12:58.867]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Creating local file file store at /tmp/failed-proofs-yyLwZ9/aztec-31337-3942611033-0x1bd1b5a0ac2df415643c67319e7001f853a04d32/0-20250624151242-2c2137da-0308-4ed7-9a78-5ccdefbff1ca
15:12:58 [15:12:58.867]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Downloading snapshot to /tmp/rerun-data-8ZpTaD/download-20mTA3
{"snapshot":{"dataUrls":{"archiver":"file:///tmp/failed-proofs-yyLwZ9/aztec-31337-3942611033-0x1bd1b5a0ac2df415643c67319e7001f853a04d32/0-20250624151242-2c2137da-0308-4ed7-9a78-5ccdefbff1ca/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-yyLwZ9/aztec-31337-3942611033-0x1bd1b5a0ac2df415643c67319e7001f853a04d32/0-20250624151242-2c2137da-0308-4ed7-9a78-5ccdefbff1ca/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-yyLwZ9/aztec-31337-3942611033-0x1bd1b5a0ac2df415643c67319e7001f853a04d32/0-20250624151242-2c2137da-0308-4ed7-9a78-5ccdefbff1ca/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-yyLwZ9/aztec-31337-3942611033-0x1bd1b5a0ac2df415643c67319e7001f853a04d32/0-20250624151242-2c2137da-0308-4ed7-9a78-5ccdefbff1ca/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-yyLwZ9/aztec-31337-3942611033-0x1bd1b5a0ac2df415643c67319e7001f853a04d32/0-20250624151242-2c2137da-0308-4ed7-9a78-5ccdefbff1ca/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-yyLwZ9/aztec-31337-3942611033-0x1bd1b5a0ac2df415643c67319e7001f853a04d32/0-20250624151242-2c2137da-0308-4ed7-9a78-5ccdefbff1ca/l1-to-l2-message-tree.db"}},"downloadPaths":{"archiver":"/tmp/rerun-data-8ZpTaD/download-20mTA3/archiver.db","nullifier-tree":"/tmp/rerun-data-8ZpTaD/download-20mTA3/nullifier-tree.db","public-data-tree":"/tmp/rerun-data-8ZpTaD/download-20mTA3/public-data-tree.db","note-hash-tree":"/tmp/rerun-data-8ZpTaD/download-20mTA3/note-hash-tree.db","archive-tree":"/tmp/rerun-data-8ZpTaD/download-20mTA3/archive-tree.db","l1-to-l2-message-tree":"/tmp/rerun-data-8ZpTaD/download-20mTA3/l1-to-l2-message-tree.db"}}
15:12:58 [15:12:58.869]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Snapshot downloaded at /tmp/rerun-data-8ZpTaD/download-20mTA3
{"snapshot":{"dataUrls":{"archiver":"file:///tmp/failed-proofs-yyLwZ9/aztec-31337-3942611033-0x1bd1b5a0ac2df415643c67319e7001f853a04d32/0-20250624151242-2c2137da-0308-4ed7-9a78-5ccdefbff1ca/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-yyLwZ9/aztec-31337-3942611033-0x1bd1b5a0ac2df415643c67319e7001f853a04d32/0-20250624151242-2c2137da-0308-4ed7-9a78-5ccdefbff1ca/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-yyLwZ9/aztec-31337-3942611033-0x1bd1b5a0ac2df415643c67319e7001f853a04d32/0-20250624151242-2c2137da-0308-4ed7-9a78-5ccdefbff1ca/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-yyLwZ9/aztec-31337-3942611033-0x1bd1b5a0ac2df415643c67319e7001f853a04d32/0-20250624151242-2c2137da-0308-4ed7-9a78-5ccdefbff1ca/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-yyLwZ9/aztec-31337-3942611033-0x1bd1b5a0ac2df415643c67319e7001f853a04d32/0-20250624151242-2c2137da-0308-4ed7-9a78-5ccdefbff1ca/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-yyLwZ9/aztec-31337-3942611033-0x1bd1b5a0ac2df415643c67319e7001f853a04d32/0-20250624151242-2c2137da-0308-4ed7-9a78-5ccdefbff1ca/l1-to-l2-message-tree.db"}},"downloadPaths":{"archiver":"/tmp/rerun-data-8ZpTaD/download-20mTA3/archiver.db","nullifier-tree":"/tmp/rerun-data-8ZpTaD/download-20mTA3/nullifier-tree.db","public-data-tree":"/tmp/rerun-data-8ZpTaD/download-20mTA3/public-data-tree.db","note-hash-tree":"/tmp/rerun-data-8ZpTaD/download-20mTA3/note-hash-tree.db","archive-tree":"/tmp/rerun-data-8ZpTaD/download-20mTA3/archive-tree.db","l1-to-l2-message-tree":"/tmp/rerun-data-8ZpTaD/download-20mTA3/l1-to-l2-message-tree.db"}}
15:12:58 [15:12:58.870]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Archiver database set up from snapshot
{"path":"/tmp/rerun-data-8ZpTaD/archiver","dbVersion":3,"rollupAddress":"0x1bd1b5a0ac2df415643c67319e7001f853a04d32"}
15:12:58 [15:12:58.870]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof World state database l1-to-l2-message-tree set up from snapshot
{"path":"/tmp/rerun-data-8ZpTaD/world_state/L1ToL2MessageTree","dbVersion":2,"rollupAddress":"0x1bd1b5a0ac2df415643c67319e7001f853a04d32"}
15:12:58 [15:12:58.871]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof World state database archive-tree set up from snapshot
{"path":"/tmp/rerun-data-8ZpTaD/world_state/ArchiveTree","dbVersion":2,"rollupAddress":"0x1bd1b5a0ac2df415643c67319e7001f853a04d32"}
15:12:58 [15:12:58.871]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof World state database public-data-tree set up from snapshot
{"path":"/tmp/rerun-data-8ZpTaD/world_state/PublicDataTree","dbVersion":2,"rollupAddress":"0x1bd1b5a0ac2df415643c67319e7001f853a04d32"}
15:12:58 [15:12:58.871]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof World state database note-hash-tree set up from snapshot
{"path":"/tmp/rerun-data-8ZpTaD/world_state/NoteHashTree","dbVersion":2,"rollupAddress":"0x1bd1b5a0ac2df415643c67319e7001f853a04d32"}
15:12:58 [15:12:58.872]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof World state database nullifier-tree set up from snapshot
{"path":"/tmp/rerun-data-8ZpTaD/world_state/NullifierTree","dbVersion":2,"rollupAddress":"0x1bd1b5a0ac2df415643c67319e7001f853a04d32"}
15:12:58 [15:12:58.872]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof P2P database cleared
{"path":"/tmp/rerun-data-8ZpTaD/p2p"}
15:12:58 [15:12:58.872]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data from file:///tmp/failed-proofs-yyLwZ9/aztec-31337-3942611033-0x1bd1b5a0ac2df415643c67319e7001f853a04d32/0-20250624151242-2c2137da-0308-4ed7-9a78-5ccdefbff1ca/data.bin to /tmp/rerun-download-x0QLed/data.bin
15:12:58 [15:12:58.873]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Epoch proving job data for epoch 0 downloaded successfully
15:12:58 [15:12:58.873]
WARN:
e2e:e2e_epochs:epochs_upload_failed_proof Rerunning proving job from /tmp/rerun-download-x0QLed/data.bin
15:12:58 [15:12:58.874]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Using native ACVM binary at ../../noir/noir-repo/target/release/acvm with working directory /tmp/31e48b4d/acvm
15:12:58 [15:12:58.875]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Loaded proving job data for epoch 0
15:12:58 [15:12:58.877]
INFO:
world-state:database Creating world state data store at directory /tmp/rerun-data-8ZpTaD/world_state with map sizes {"archiveTreeMapSizeKb":1048576,"nullifierTreeMapSizeKb":1048576,"noteHashTreeMapSizeKb":1048576,"messageTreeMapSizeKb":1048576,"publicDataTreeMapSizeKb":1048576} and 2 threads.
15:12:58 [15:12:58.887]
INFO:
archiver:lmdb Creating archiver data store at directory /tmp/rerun-data-8ZpTaD/archiver with map size 1048576 KB (LMDB v2)
15:12:58 [15:12:58.888]
INFO:
archiver:lmdb Starting data store with maxReaders 16
15:12:58 [15:12:58.890]
WARN:
prover-client:proving-broker-database Found invalid epoch directory /tmp/rerun-data-8ZpTaD/archiver when loading epoch databases, ignoring
15:12:58 [15:12:58.890]
WARN:
prover-client:proving-broker-database Found invalid epoch directory /tmp/rerun-data-8ZpTaD/world_state when loading epoch databases, ignoring
15:12:58 [15:12:58.890]
INFO:
prover-client:proving-broker Proving Broker started
15:12:58 [15:12:58.891]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Rerunning epoch proving job for epoch 0
15:12:58 [15:12:58.891]
INFO:
prover-node:epoch-proving-job Starting epoch 0 proving job with blocks 1 to 2
{"fromBlock":1,"toBlock":2,"epochSizeBlocks":2,"epochNumber":0,"uuid":"9d225fd6-151a-436d-a7d4-8bc568e7e8df"}
15:12:58 [15:12:58.905]
INFO:
prover-client:orchestrator Starting epoch 0 with 2 blocks
15:12:58 [15:12:58.906]
VERBOSE:
prover-client:broker-circuit-prover-facade Starting BrokerCircuitProverFacade
15:12:58 [15:12:58.907]
VERBOSE:
prover-node:epoch-proving-job Starting processing block 1
{"number":1,"blockHash":"0x19d18f0a205f90ef42258371d73104b60cb8ad384bc1dc97f0537f89fd427be7","lastArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"9d225fd6-151a-436d-a7d4-8bc568e7e8df","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x00000000000000000000000000000000000000000000000000000000eaff7859","blockNumber":1,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}}
15:12:58 [15:12:58.907]
INFO:
prover-client:orchestrator Starting block 1 for slot 2
15:12:58 [15:12:58.908]
VERBOSE:
prover-node:epoch-proving-job Starting processing block 2
{"number":2,"blockHash":"0x2e94b39bf6fa2da72aa971c4ff7d743f734e1508898d66a13f7f5d65019ec779","lastArchive":"0x1f5bbd8747628d35a6cd24fdb9d8963d05c93c465b507b8cbe4267b3c694400a","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"9d225fd6-151a-436d-a7d4-8bc568e7e8df","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x00000000000000000000000000000000000000000000000000000000eaff7859","blockNumber":2,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000003","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}}
15:12:58 [15:12:58.908]
INFO:
prover-client:orchestrator Starting block 2 for slot 3
15:12:58 [15:12:58.915]
INFO:
prover-client:proving-broker New proving job id=0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568 epochNumber=0
{"provingJobId":"0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568"}
15:12:58 [15:12:58.916]
VERBOSE:
prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568 type=BASE_PARITY
{"provingJobId":"0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568","provingJobType":"BASE_PARITY"}
15:12:58 [15:12:58.916]
VERBOSE:
prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568 type=BASE_PARITY
{"provingJobId":"0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568","provingJobType":"BASE_PARITY"}
15:12:58 [15:12:58.916]
VERBOSE:
prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568 type=BASE_PARITY
{"provingJobId":"0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568","provingJobType":"BASE_PARITY"}
15:12:58 [15:12:58.919]
VERBOSE:
prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568 type=BASE_PARITY
{"provingJobId":"0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568","provingJobType":"BASE_PARITY"}
15:12:58 [15:12:58.919]
VERBOSE:
prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568 type=BASE_PARITY
{"provingJobId":"0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568","provingJobType":"BASE_PARITY"}
15:12:58 [15:12:58.920]
VERBOSE:
prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568 type=BASE_PARITY
{"provingJobId":"0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568","provingJobType":"BASE_PARITY"}
15:12:58 [15:12:58.920]
VERBOSE:
prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568 type=BASE_PARITY
{"provingJobId":"0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568","provingJobType":"BASE_PARITY"}
15:12:58 [15:12:58.921]
INFO:
simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000014385000002221204s
{"duration":0.000014385000002221204,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0}
15:12:58 [15:12:58.921]
WARN:
prover-client:orchestrator Provided no txs to orchestrator addTxs.
15:12:58 [15:12:58.921]
VERBOSE:
prover-node:epoch-proving-job Processed all 0 txs for block 1
{"blockNumber":1,"blockHash":"0x19d18f0a205f90ef42258371d73104b60cb8ad384bc1dc97f0537f89fd427be7","uuid":"9d225fd6-151a-436d-a7d4-8bc568e7e8df"}
15:12:58 [15:12:58.922]
VERBOSE:
prover-client:orchestrator Block 1 completed. Assembling header.
15:12:58 [15:12:58.926]
VERBOSE:
prover-client:orchestrator Updating archive tree with block 1 header 0x19d18f0a205f90ef42258371d73104b60cb8ad384bc1dc97f0537f89fd427be7
15:12:58 [15:12:58.927]
INFO:
simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000013661999997566455s
{"duration":0.000013661999997566455,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0}
15:12:58 [15:12:58.928]
WARN:
prover-client:orchestrator Provided no txs to orchestrator addTxs.
15:12:58 [15:12:58.928]
VERBOSE:
prover-node:epoch-proving-job Processed all 0 txs for block 2
{"blockNumber":2,"blockHash":"0x2e94b39bf6fa2da72aa971c4ff7d743f734e1508898d66a13f7f5d65019ec779","uuid":"9d225fd6-151a-436d-a7d4-8bc568e7e8df"}
15:12:58 [15:12:58.928]
VERBOSE:
prover-client:orchestrator Block 2 completed. Assembling header.
15:12:58 [15:12:58.929]
VERBOSE:
prover-client:orchestrator Orchestrator finalised block 1
15:12:58 [15:12:58.941]
VERBOSE:
prover-client:orchestrator Updating archive tree with block 2 header 0x2e94b39bf6fa2da72aa971c4ff7d743f734e1508898d66a13f7f5d65019ec779
15:12:58 [15:12:58.943]
VERBOSE:
prover-client:orchestrator Orchestrator finalised block 2
15:12:58 [15:12:58.965]
INFO:
prover-client:proving-broker-database Creating broker database for epoch 0 at /tmp/rerun-data-8ZpTaD/0 with map size 1048576
15:12:58 [15:12:58.966]
INFO:
kv-store:lmdb-v2 Starting data store with maxReaders 16
15:12:58 [15:12:58.968]
VERBOSE:
prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568 type=BASE_PARITY epochNumber=0
{"provingJobId":"0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568","provingJobType":"BASE_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...","status":"not-found","numOutstandingJobs":1}
15:12:58 [15:12:58.991]
INFO:
prover-client:proving-agent Starting job id=0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568 type=BASE_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...
15:12:58 [15:12:58.992]
INFO:
prover-client:proving-agent:job-controller-7d9ac136 Job controller started jobId=0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568
{"jobId":"0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568"}
15:12:59 [15:12:59.059]
INFO:
prover-client:proving-agent Job id=0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568 type=BASE_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22resul...
15:12:59 [15:12:59.059]
INFO:
prover-client:proving-broker Proving job complete id=0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568 type=BASE_PARITY totalAttempts=1
{"provingJobId":"0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568"}
15:12:59 [15:12:59.906]
VERBOSE:
prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1
15:12:59 [15:12:59.907]
VERBOSE:
prover-client:broker-circuit-prover-facade Resolved proving job id=0:BASE_PARITY:cdcae7ce16ca44a8ffdd3f73df9ec6cd148be79778ccdc1957286a7f94ea2568 type=BASE_PARITY
15:12:59 [15:12:59.907]
VERBOSE:
prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0
15:12:59 [15:12:59.917]
INFO:
prover-client:proving-broker New proving job id=0:ROOT_PARITY:036ef6d1c35f3a38fcb8de74713948fb49b8b4f22f0cf2ad8727f6d9340850e3 epochNumber=0
{"provingJobId":"0:ROOT_PARITY:036ef6d1c35f3a38fcb8de74713948fb49b8b4f22f0cf2ad8727f6d9340850e3"}
15:12:59 [15:12:59.923]
VERBOSE:
prover-client:broker-circuit-prover-facade Job already found in facade id=0:ROOT_PARITY:036ef6d1c35f3a38fcb8de74713948fb49b8b4f22f0cf2ad8727f6d9340850e3 type=ROOT_PARITY
{"provingJobId":"0:ROOT_PARITY:036ef6d1c35f3a38fcb8de74713948fb49b8b4f22f0cf2ad8727f6d9340850e3","provingJobType":"ROOT_PARITY"}
15:12:59 [15:12:59.969]
VERBOSE:
prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_PARITY:036ef6d1c35f3a38fcb8de74713948fb49b8b4f22f0cf2ad8727f6d9340850e3 type=ROOT_PARITY epochNumber=0
{"provingJobId":"0:ROOT_PARITY:036ef6d1c35f3a38fcb8de74713948fb49b8b4f22f0cf2ad8727f6d9340850e3","provingJobType":"ROOT_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu...","status":"not-found","numOutstandingJobs":1}
15:12:59 [15:12:59.997]
INFO:
prover-client:proving-agent Starting job id=0:ROOT_PARITY:036ef6d1c35f3a38fcb8de74713948fb49b8b4f22f0cf2ad8727f6d9340850e3 type=ROOT_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu...
15:13:00 [15:13:00.010]
INFO:
prover-client:proving-agent:job-controller-0815fd49 Job controller started jobId=0:ROOT_PARITY:036ef6d1c35f3a38fcb8de74713948fb49b8b4f22f0cf2ad8727f6d9340850e3
{"jobId":"0:ROOT_PARITY:036ef6d1c35f3a38fcb8de74713948fb49b8b4f22f0cf2ad8727f6d9340850e3"}
15:13:00 [15:13:00.106]
INFO:
prover-client:proving-agent Job id=0:ROOT_PARITY:036ef6d1c35f3a38fcb8de74713948fb49b8b4f22f0cf2ad8727f6d9340850e3 type=ROOT_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22resu...
15:13:00 [15:13:00.106]
INFO:
prover-client:proving-broker Proving job complete id=0:ROOT_PARITY:036ef6d1c35f3a38fcb8de74713948fb49b8b4f22f0cf2ad8727f6d9340850e3 type=ROOT_PARITY totalAttempts=1
{"provingJobId":"0:ROOT_PARITY:036ef6d1c35f3a38fcb8de74713948fb49b8b4f22f0cf2ad8727f6d9340850e3"}
15:13:00 [15:13:00.908]
VERBOSE:
prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1
15:13:00 [15:13:00.909]
VERBOSE:
prover-client:broker-circuit-prover-facade Resolved proving job id=0:ROOT_PARITY:036ef6d1c35f3a38fcb8de74713948fb49b8b4f22f0cf2ad8727f6d9340850e3 type=ROOT_PARITY
15:13:00 [15:13:00.909]
VERBOSE:
prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0
15:13:00 [15:13:00.921]
INFO:
prover-client:proving-broker New proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:fe9d544a2a7f6c8c2c77619bce0623f795ddd6f4efabb1410c274575135650e4 epochNumber=0
{"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:fe9d544a2a7f6c8c2c77619bce0623f795ddd6f4efabb1410c274575135650e4"}
15:13:00 [15:13:00.925]
INFO:
prover-client:proving-broker New proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:f852ec9ce203846a83eda2d277b49ce69e9897f6fa12547ea5410eaeb60696bb epochNumber=0
{"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:f852ec9ce203846a83eda2d277b49ce69e9897f6fa12547ea5410eaeb60696bb"}
15:13:00 [15:13:00.973]
VERBOSE:
prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:EMPTY_BLOCK_ROOT_ROLLUP:fe9d544a2a7f6c8c2c77619bce0623f795ddd6f4efabb1410c274575135650e4 type=EMPTY_BLOCK_ROOT_ROLLUP epochNumber=0
{"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:fe9d544a2a7f6c8c2c77619bce0623f795ddd6f4efabb1410c274575135650e4","provingJobType":"EMPTY_BLOCK_ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input...","status":"not-found","numOutstandingJobs":2}
15:13:00 [15:13:00.973]
VERBOSE:
prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:EMPTY_BLOCK_ROOT_ROLLUP:f852ec9ce203846a83eda2d277b49ce69e9897f6fa12547ea5410eaeb60696bb type=EMPTY_BLOCK_ROOT_ROLLUP epochNumber=0
{"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:f852ec9ce203846a83eda2d277b49ce69e9897f6fa12547ea5410eaeb60696bb","provingJobType":"EMPTY_BLOCK_ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input...","status":"not-found","numOutstandingJobs":2}
15:13:01 [15:13:01.045]
INFO:
prover-client:proving-agent Starting job id=0:EMPTY_BLOCK_ROOT_ROLLUP:fe9d544a2a7f6c8c2c77619bce0623f795ddd6f4efabb1410c274575135650e4 type=EMPTY_BLOCK_ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input...
15:13:01 [15:13:01.052]
INFO:
prover-client:proving-agent:job-controller-cef32fe6 Job controller started jobId=0:EMPTY_BLOCK_ROOT_ROLLUP:fe9d544a2a7f6c8c2c77619bce0623f795ddd6f4efabb1410c274575135650e4
{"jobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:fe9d544a2a7f6c8c2c77619bce0623f795ddd6f4efabb1410c274575135650e4"}
15:13:01 [15:13:01.083]
INFO:
prover-client:proving-agent Starting job id=0:EMPTY_BLOCK_ROOT_ROLLUP:f852ec9ce203846a83eda2d277b49ce69e9897f6fa12547ea5410eaeb60696bb type=EMPTY_BLOCK_ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input...
15:13:01 [15:13:01.089]
INFO:
prover-client:proving-agent:job-controller-5ffc8c24 Job controller started jobId=0:EMPTY_BLOCK_ROOT_ROLLUP:f852ec9ce203846a83eda2d277b49ce69e9897f6fa12547ea5410eaeb60696bb
{"jobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:f852ec9ce203846a83eda2d277b49ce69e9897f6fa12547ea5410eaeb60696bb"}
15:13:02 [15:13:02.037]
INFO:
prover-client:proving-agent Job id=0:EMPTY_BLOCK_ROOT_ROLLUP:fe9d544a2a7f6c8c2c77619bce0623f795ddd6f4efabb1410c274575135650e4 type=EMPTY_BLOCK_ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22resul...
15:13:02 [15:13:02.037]
INFO:
prover-client:proving-broker Proving job complete id=0:EMPTY_BLOCK_ROOT_ROLLUP:fe9d544a2a7f6c8c2c77619bce0623f795ddd6f4efabb1410c274575135650e4 type=EMPTY_BLOCK_ROOT_ROLLUP totalAttempts=1
{"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:fe9d544a2a7f6c8c2c77619bce0623f795ddd6f4efabb1410c274575135650e4"}
15:13:02 [15:13:02.940]
VERBOSE:
prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 2, total jobs ready: 1
15:13:02 [15:13:02.942]
VERBOSE:
prover-client:broker-circuit-prover-facade Resolved proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:fe9d544a2a7f6c8c2c77619bce0623f795ddd6f4efabb1410c274575135650e4 type=EMPTY_BLOCK_ROOT_ROLLUP
15:13:02 [15:13:02.942]
VERBOSE:
prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0
15:13:04 [15:13:04.215]
INFO:
prover-client:proving-agent Job id=0:EMPTY_BLOCK_ROOT_ROLLUP:f852ec9ce203846a83eda2d277b49ce69e9897f6fa12547ea5410eaeb60696bb type=EMPTY_BLOCK_ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22resul...
15:13:04 [15:13:04.215]
INFO:
prover-client:proving-broker Proving job complete id=0:EMPTY_BLOCK_ROOT_ROLLUP:f852ec9ce203846a83eda2d277b49ce69e9897f6fa12547ea5410eaeb60696bb type=EMPTY_BLOCK_ROOT_ROLLUP totalAttempts=1
{"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:f852ec9ce203846a83eda2d277b49ce69e9897f6fa12547ea5410eaeb60696bb"}
15:13:04 [15:13:04.943]
VERBOSE:
prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1
15:13:04 [15:13:04.945]
VERBOSE:
prover-client:broker-circuit-prover-facade Resolved proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:f852ec9ce203846a83eda2d277b49ce69e9897f6fa12547ea5410eaeb60696bb type=EMPTY_BLOCK_ROOT_ROLLUP
15:13:04 [15:13:04.945]
VERBOSE:
prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0
15:13:04 [15:13:04.954]
INFO:
prover-client:proving-broker New proving job id=0:ROOT_ROLLUP:d8644769e042605f509da299e9f9187dbccf46501563e373163a6f9a689a97ae epochNumber=0
{"provingJobId":"0:ROOT_ROLLUP:d8644769e042605f509da299e9f9187dbccf46501563e373163a6f9a689a97ae"}
15:13:05 [15:13:05.005]
VERBOSE:
prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_ROLLUP:d8644769e042605f509da299e9f9187dbccf46501563e373163a6f9a689a97ae type=ROOT_ROLLUP epochNumber=0
{"provingJobId":"0:ROOT_ROLLUP:d8644769e042605f509da299e9f9187dbccf46501563e373163a6f9a689a97ae","provingJobType":"ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22input...","status":"not-found","numOutstandingJobs":1}
15:13:05 [15:13:05.020]
INFO:
prover-client:proving-agent Starting job id=0:ROOT_ROLLUP:d8644769e042605f509da299e9f9187dbccf46501563e373163a6f9a689a97ae type=ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22input...
15:13:05 [15:13:05.031]
INFO:
prover-client:proving-agent:job-controller-30750e74 Job controller started jobId=0:ROOT_ROLLUP:d8644769e042605f509da299e9f9187dbccf46501563e373163a6f9a689a97ae
{"jobId":"0:ROOT_ROLLUP:d8644769e042605f509da299e9f9187dbccf46501563e373163a6f9a689a97ae"}
15:13:05 [15:13:05.121]
INFO:
prover-client:proving-agent Job id=0:ROOT_ROLLUP:d8644769e042605f509da299e9f9187dbccf46501563e373163a6f9a689a97ae type=ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A8%2C%22resul...
15:13:05 [15:13:05.121]
INFO:
prover-client:proving-broker Proving job complete id=0:ROOT_ROLLUP:d8644769e042605f509da299e9f9187dbccf46501563e373163a6f9a689a97ae type=ROOT_ROLLUP totalAttempts=1
{"provingJobId":"0:ROOT_ROLLUP:d8644769e042605f509da299e9f9187dbccf46501563e373163a6f9a689a97ae"}
15:13:05 [15:13:05.945]
VERBOSE:
prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1
15:13:05 [15:13:05.947]
VERBOSE:
prover-client:broker-circuit-prover-facade Resolved proving job id=0:ROOT_ROLLUP:d8644769e042605f509da299e9f9187dbccf46501563e373163a6f9a689a97ae type=ROOT_ROLLUP
15:13:05 [15:13:05.947]
VERBOSE:
prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0
15:13:05 [15:13:05.947]
VERBOSE:
prover-client:orchestrator Orchestrator completed root rollup for epoch 0
15:13:05 [15:13:05.949]
INFO:
prover-node:epoch-proving-job Finalised proof for epoch 0
{"epochNumber":0,"uuid":"9d225fd6-151a-436d-a7d4-8bc568e7e8df","duration":7058.171974000004}
15:13:05 [15:13:05.950]
INFO:
prover-node:epoch-proving-job Submitted proof for epoch 0 (blocks 1 to 2)
{"epochNumber":0,"uuid":"9d225fd6-151a-436d-a7d4-8bc568e7e8df"}
15:13:05 [15:13:05.950]
VERBOSE:
prover-client:broker-circuit-prover-facade Stopping BrokerCircuitProverFacade
15:13:05 [15:13:05.950]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Completed job for epoch 0 with status completed
15:13:05 [15:13:05.950]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Test succeeded
15:13:05 [15:13:05.951]
INFO:
prover-node:prover-node Stopping ProverNode
15:13:05 [15:13:05.951]
WARN:
prover-node:prover-node Running promise was not started
15:13:05 [15:13:05.951]
WARN:
prover-node:epoch-monitor:prover-node Running promise was not started
15:13:05 [15:13:05.951]
INFO:
prover-node:epoch-monitor:prover-node Stopped EpochMonitor
15:13:05 [15:13:05.951]
WARN:
archiver:prover-node Running promise was not started
15:13:05 [15:13:05.952]
INFO:
archiver:prover-node Stopped.
15:13:05 [15:13:05.952]
WARN:
world-state:block_stream:prover-node Running promise was not started
15:13:05 [15:13:05.952]
INFO:
world_state:prover-node Stopped world state synchronizer
15:13:05 [15:13:05.952]
INFO:
prover-node:prover-node Stopped ProverNode
15:13:05 [15:13:05.952]
INFO:
node:MAIN-aztec-node Stopping Aztec Node
15:13:07 [15:13:07.952]
INFO:
slasher Slasher client stopped.
15:13:07 [15:13:07.952]
WARN:
validator Running promise was not started
15:13:07 [15:13:07.952]
WARN:
sequencer Running promise was not started
15:13:07 [15:13:07.952]
INFO:
sequencer Stopped sequencer
15:13:07 [15:13:07.953]
WARN:
p2p:l2-block-stream Running promise was not started
15:13:07 [15:13:07.953]
INFO:
p2p P2P client stopped
15:13:07 [15:13:07.953]
WARN:
world-state:block_stream Running promise was not started
15:13:07 [15:13:07.953]
INFO:
world_state Stopped world state synchronizer
15:13:07 [15:13:07.953]
WARN:
archiver Running promise was not started
15:13:07 [15:13:07.953]
INFO:
archiver Stopped.
15:13:07 [15:13:07.953]
INFO:
node:MAIN-aztec-node Stopped Aztec Node
15:13:07 [15:13:07.954]
INFO:
node:MAIN-aztec-node Stopping Aztec Node
15:13:09 [15:13:09.954]
INFO:
slasher Slasher client stopped.
15:13:09 [15:13:09.955]
WARN:
validator Running promise was not started
15:13:09 [15:13:09.955]
WARN:
sequencer Running promise was not started
15:13:09 [15:13:09.955]
INFO:
sequencer Stopped sequencer
15:13:09 [15:13:09.955]
WARN:
p2p:l2-block-stream Running promise was not started
15:13:09 [15:13:09.955]
INFO:
p2p P2P client stopped
15:13:09 [15:13:09.955]
WARN:
world-state:block_stream Running promise was not started
15:13:09 [15:13:09.956]
INFO:
world_state Stopped world state synchronizer
15:13:09 [15:13:09.956]
WARN:
archiver Running promise was not started
15:13:09 [15:13:09.956]
INFO:
archiver Stopped.
15:13:09 [15:13:09.956]
INFO:
node:MAIN-aztec-node Stopped Aztec Node
15:13:09 [15:13:09.956]
INFO:
prover-node:prover-node Stopping ProverNode
15:13:09 [15:13:09.956]
WARN:
prover-node:prover-node Running promise was not started
15:13:09 [15:13:09.956]
WARN:
prover-node:epoch-monitor:prover-node Running promise was not started
15:13:09 [15:13:09.956]
INFO:
prover-node:epoch-monitor:prover-node Stopped EpochMonitor
15:13:09 [15:13:09.956]
WARN:
archiver:prover-node Running promise was not started
15:13:09 [15:13:09.957]
INFO:
archiver:prover-node Stopped.
15:13:09 [15:13:09.957]
WARN:
world-state:block_stream:prover-node Running promise was not started
15:13:09 [15:13:09.957]
INFO:
world_state:prover-node Stopped world state synchronizer
15:13:09 [15:13:09.957]
INFO:
prover-node:prover-node Stopped ProverNode
15:13:09 [15:13:09.957]
INFO:
blob-sink:server Stopping blob sink
15:13:09 [15:13:09.958]
INFO:
blob-sink:server Blob sink already stopped
15:13:09
PASS src/e2e_epochs/epochs_upload_failed_proof.test.ts
15:13:09 e2e_epochs/epochs_upload_failed_proof
15:13:09
✓ uploads failed proving job state and re-runs it on a fresh instance (54007 ms)
15:13:09
15:13:09
Test Suites: 1 passed, 1 total
15:13:09
Tests: 1 passed, 1 total
15:13:09
Snapshots: 0 total
15:13:09
Time: 59.112 s
15:13:09
Ran all test suites matching src/e2e_epochs/epochs_upload_failed_proof.test.ts
.
15:13:09
Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?