Parent Log:
http://ci.aztec-labs.com/c7f88074b48c686e
Command: 5ef1981c53cfa68e:ISOLATE=1:NAME=e2e_epochs/epochs_upload_failed_proof yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_upload_failed_proof.test.ts
Commit:
https://github.com/AztecProtocol/aztec-packages/commit/9636546b7b88f24965b498122e4da02f29ccc564
Env: REF_NAME=gh-readonly-queue/next/pr-15307-d01c091885c427bb3cc3b780e321f201b0fd06d5 CURRENT_VERSION=0.87.6 CI_FULL=0
Date: Thu Jun 26 18:34:10 UTC 2025
System: ARCH=arm64 CPUS=64 MEM=247Gi HOSTNAME=pr-15307_arm64_a1-fast
Resources: CPU_LIST=0-63 CPUS=2 MEM=8g TIMEOUT=600s
History:
http://ci.aztec-labs.com/list/history_476a42720cde10eb_next
18:34:10 +++ id -u
18:34:10 +++ id -g
18:34:10 ++ docker run -d --name e2e_epochs_epochs_upload_failed_proof --net=none --cpuset-cpus=0-63 --cpus=2 --memory=8g --user 1000:1000 -v/home/aztec-dev:/home/aztec-dev --mount type=tmpfs,target=/tmp,tmpfs-size=1g --workdir /home/aztec-dev/aztec-packages -e HOME -e VERBOSE -e GIT_CONFIG_GLOBAL=/home/aztec-dev/aztec-packages/build-images/src/home/.gitconfig -e FORCE_COLOR=true -e CPUS -e MEM aztecprotocol/build:3.0 /bin/bash -c 'timeout -v 600s bash -c '\''yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_upload_failed_proof.test.ts'\'''
18:34:10 + cid=9e007f6ad7ae9ed53ce13e0ccc657f25740b01041b6f5bce1d5a1cae8c253a5c
18:34:10 + set +x
18:34:11 {"level":25,"time":1750962851318,"pid":12,"hostname":"9e007f6ad7ae","module":"logger","msg":"Logger initialized with level verbose"}
18:34:16 [18:34:16.116]
INFO:
e2e:epochs_upload_failed_proof Running test: e2e_epochs/epochs_upload_failed_proof uploads failed proving job state and re-runs it on a fresh instance
18:34:16 [18:34:16.201]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Logging metrics to log/e2e_epochs_epochs_upload_failed_proof.jsonl
18:34:16 [18:34:16.353]
WARN:
ethereum:cheat_codes Set L1 automine to true
18:34:16 [18:34:16.376]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Sent 0.1 ETH to deployer
{"deployer":"0x05f32b3cc3888453ff71b01135b34ff8e41263f2","value":100000000000000000}
18:34:16 [18:34:16.388]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Sent 0.1 ETH to deployer
{"deployer":"0x05f32b3cc3888453ff71b01135b34ff8e41263f2","value":100000000000000000}
18:34:16 [18:34:16.395]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed Multicall3
18:34:16 [18:34:16.396]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Calling anvil_setBlockTimestampInterval with params: [8]
18:34:16 [18:34:16.398]
WARN:
e2e:e2e_epochs:epochs_upload_failed_proof Set block interval to 8
18:34:16 [18:34:16.399]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deploying contracts from 0xf39Fd6e51aad88F6F4ce6aB8827279cffFb92266
18:34:16 [18:34:16.401]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001
18:34:16 [18:34:16.430]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x8166bb789c828e492198babef9becf8ac44628f059d48e6f68114a9ae2ade6ec
{"gasLimit":867658,"maxFeePerGas":"120.351651125","maxPriorityFeePerGas":"118.94979"}
18:34:16 [18:34:16.430]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xB8999345dA8041f1Da51ac5179B1F055A560f397 in tx 0x8166bb789c828e492198babef9becf8ac44628f059d48e6f68114a9ae2ade6ec.
18:34:16 [18:34:16.431]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed Fee Asset at 0xb8999345da8041f1da51ac5179b1f055a560f397
18:34:16 [18:34:16.432]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001
18:34:16 [18:34:16.448]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x07d928293fb6819e2a8abf9d0b32b04560f633065cf07cefb5dcf9ca71af1db2
{"gasLimit":867644,"maxFeePerGas":"143.976575211","maxPriorityFeePerGas":"142.739748"}
18:34:16 [18:34:16.449]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xBb9e13665Cfb3d531F288a11E7312b6b91C59292 in tx 0x07d928293fb6819e2a8abf9d0b32b04560f633065cf07cefb5dcf9ca71af1db2.
18:34:16 [18:34:16.450]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed Staking Asset at 0xbb9e13665cfb3d531f288a11e7312b6b91c59292
18:34:16 [18:34:16.450]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001
18:34:16 [18:34:16.472]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xd90adcaa1621a861dd7b09565f9dc422367574ea376355a4c91cd87ed3fbfeba
{"gasLimit":3252094,"maxFeePerGas":"172.377275728","maxPriorityFeePerGas":"171.2876976"}
18:34:16 [18:34:16.472]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x6f26a1916Df432654607f9c75b764e535e65cf3e in tx 0xd90adcaa1621a861dd7b09565f9dc422367574ea376355a4c91cd87ed3fbfeba.
18:34:16 [18:34:16.473]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed GSE at 0x6f26a1916df432654607f9c75b764e535e65cf3e
18:34:16 [18:34:16.473]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001
18:34:16 [18:34:16.489]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xc6bb96b972383aade82d230cb0c861a0362867228d18483a86f9e4a83b780d2d
{"gasLimit":1081864,"maxFeePerGas":"206.505096634","maxPriorityFeePerGas":"205.54523712"}
18:34:16 [18:34:16.490]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x3C709AFec1acEaE522c13145005De788a3CC65c8 in tx 0xc6bb96b972383aade82d230cb0c861a0362867228d18483a86f9e4a83b780d2d.
18:34:16 [18:34:16.490]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed Registry at 0x3c709afec1aceae522c13145005de788a3cc65c8
18:34:16 [18:34:16.491]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001
18:34:16 [18:34:16.509]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xafd772702f9a95277d2cfc460540ed5ea11d516b4fc7fc76d53a87d482b811af
{"gasLimit":2283120,"maxFeePerGas":"247.515532347","maxPriorityFeePerGas":"246.654284544"}
18:34:16 [18:34:16.509]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xE1B8d53934450A003D5449db6d55dccA6eA44454 in tx 0xafd772702f9a95277d2cfc460540ed5ea11d516b4fc7fc76d53a87d482b811af.
18:34:16 [18:34:16.510]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed GovernanceProposer at 0xe1b8d53934450a003d5449db6d55dcca6ea44454
18:34:16 [18:34:16.510]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001
18:34:16 [18:34:16.528]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x00789c495defa2b82bcac750570b0806d4cc62703412eaa439543e4d0a8203e8
{"gasLimit":3091993,"maxFeePerGas":"296.745116241","maxPriorityFeePerGas":"295.985141452"}
18:34:16 [18:34:16.529]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x3eCB912be92103E7e8a5d1b8D047E4863d175C85 in tx 0x00789c495defa2b82bcac750570b0806d4cc62703412eaa439543e4d0a8203e8.
18:34:16 [18:34:16.529]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed Governance at 0x3ecb912be92103e7e8a5d1b8d047e4863d175c85
18:34:16 [18:34:16.540]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x2a56e112af66ebd79699a353b7b34b82da1d088ea3cfe543ad003f2245928ca4
{"gasLimit":100000,"maxFeePerGas":"355.859029091","maxPriorityFeePerGas":"355.182169742"}
18:34:16 [18:34:16.541]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Set governance on GSE in 0x2a56e112af66ebd79699a353b7b34b82da1d088ea3cfe543ad003f2245928ca4
18:34:16 [18:34:16.541]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001
18:34:16 [18:34:16.554]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xec5be601a7607f1c12da0a6bdecf0dd2205a45ab0e3fbbfe3937b3f3a9b798d7
{"gasLimit":397405,"maxFeePerGas":"426.825184162","maxPriorityFeePerGas":"426.21860369"}
18:34:16 [18:34:16.554]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xa9BF2bdA2Cd8DbafD501dDF696f88A9AA803DBde in tx 0xec5be601a7607f1c12da0a6bdecf0dd2205a45ab0e3fbbfe3937b3f3a9b798d7.
18:34:16 [18:34:16.555]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed CoinIssuer at 0xa9bf2bda2cd8dbafd501ddf696f88a9aa803dbde
18:34:16 [18:34:16.555]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Waiting for deployments to complete
18:34:16 [18:34:16.555]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 7 transactions to be mined...
18:34:16 [18:34:16.580]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully
18:34:16 [18:34:16.588]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x38e3c52fa8480cfe70fbb7f3b3c49a7df48469ab2e3bed60b09fd15d420ac13c
{"gasLimit":100000,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"}
18:34:16 [18:34:16.588]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Added coin issuer 0xa9bf2bda2cd8dbafd501ddf696f88a9aa803dbde as minter on fee asset in 0x38e3c52fa8480cfe70fbb7f3b3c49a7df48469ab2e3bed60b09fd15d420ac13c
18:34:16 [18:34:16.600]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x16152a2efc0c0b249600a9d172a4ce920fca9ee61830bbc9239bcd048f376ca2
{"gasLimit":56661,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"}
18:34:16 [18:34:16.600]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001
18:34:16 [18:34:16.613]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x100b31bd1e3992df58985c26db7e5351f01cbb7b9c2e961c411c57733fb6cfa5
{"gasLimit":344517,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"}
18:34:16 [18:34:16.613]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xB4fF23c4B1E2Bc7C86090d4FBDa21A457ee6727F in tx 0x100b31bd1e3992df58985c26db7e5351f01cbb7b9c2e961c411c57733fb6cfa5.
18:34:16 [18:34:16.614]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed FeeAssetHandler at 0xb4ff23c4b1e2bc7c86090d4fbda21a457ee6727f
18:34:16 [18:34:16.626]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xc451aae80a23ef806a4bacf2e291d1c2ae150b6200ea2ea4e841b119a7e7c28b
{"gasLimit":56804,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"}
18:34:16 [18:34:16.627]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Added fee asset handler 0xb4ff23c4b1e2bc7c86090d4fbda21a457ee6727f as minter on fee asset in 0xc451aae80a23ef806a4bacf2e291d1c2ae150b6200ea2ea4e841b119a7e7c28b
18:34:16 [18:34:16.627]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001
18:34:16 [18:34:16.646]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x816f060dc276be953b13ab8312ba0642aaab9b1f29f08262a786d18004180480
{"gasLimit":2434549,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"}
18:34:16 [18:34:16.646]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x62690b89983Da9400fD50566478fA105a9A29aB5 in tx 0x816f060dc276be953b13ab8312ba0642aaab9b1f29f08262a786d18004180480.
18:34:16 [18:34:16.647]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed StakingAssetHandler at 0x62690b89983da9400fd50566478fa105a9a29ab5
18:34:16 [18:34:16.661]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xf31bc8dc40fc78cc780ffe9262b6d36733aaee0be8d7bc78be6200eac44d7b28
{"gasLimit":56804,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"}
18:34:16 [18:34:16.661]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Added staking asset handler 0x62690b89983da9400fd50566478fa105a9a29ab5 as minter on staking asset in 0xf31bc8dc40fc78cc780ffe9262b6d36733aaee0be8d7bc78be6200eac44d7b28
18:34:16 [18:34:16.661]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Waiting for deployments to complete
18:34:16 [18:34:16.661]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 9 transactions to be mined...
18:34:16 [18:34:16.680]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully
18:34:16 [18:34:16.693]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed shared contracts
18:34:16 [18:34:16.708]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x3a452c44942037f215b905f38ac51163490a9b231c6bd08b7e958ae2dd00642b
{"gasLimit":84837,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"}
18:34:16 [18:34:16.708]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Funded reward distributor with 10000000000000000000000000 fee asset in 0x3a452c44942037f215b905f38ac51163490a9b231c6bd08b7e958ae2dd00642b
18:34:16 [18:34:16.710]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001
18:34:16 [18:34:16.723]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x6732a13052b668b6ed53c2db691f949dc5751b43ca937a6796aab9388f3cb12a
{"gasLimit":154658,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"}
18:34:16 [18:34:16.723]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x277E22B0C9698d7f2A1cD7C6d857511617587309 in tx 0x6732a13052b668b6ed53c2db691f949dc5751b43ca937a6796aab9388f3cb12a.
18:34:16 [18:34:16.723]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Rollup will use the mock verifier at 0x277e22b0c9698d7f2a1cd7c6d857511617587309
18:34:16 [18:34:16.724]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Rollup config args
{"aztecSlotDuration":16,"aztecEpochDuration":4,"targetCommitteeSize":0,"aztecProofSubmissionEpochs":1,"slashingQuorum":6,"slashingRoundSize":10,"manaTarget":10000000000,"provingCostPerMana":100,"rewardConfig":{"sequencerBps":5000,"rewardDistributor":"0x4a51916a6b10a43f6565042be5b6b69d8d613f64","booster":"0x0000000000000000000000000000000000000000"},"rewardBoostConfig":{"increment":200000,"maxScore":5000000,"a":5000,"k":1000000,"minimum":100000},"stakingQueueConfig":{"bootstrapValidatorSetSize":0,"bootstrapFlushSize":0,"normalFlushSizeMin":48,"normalFlushSizeQuotient":2}}
18:34:16 [18:34:16.724]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001
18:34:16 [18:34:16.736]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xf0035dc96cbcf12e4ff26aaeeb91727aab604a1ec550ea1a369d3e0766be60f6
{"gasLimit":87007,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"}
18:34:16 [18:34:16.737]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0xF4ee5362A0cF12574c0b7c58e3Bf49da6C1eE7f8 in tx 0xf0035dc96cbcf12e4ff26aaeeb91727aab604a1ec550ea1a369d3e0766be60f6.
18:34:16 [18:34:16.737]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001
18:34:16 [18:34:16.762]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xe7326e7ff52fa4e48a0f4f8038d4b998aacad7b33d9ffe42304e731fb3493983
{"gasLimit":5149203,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"}
18:34:16 [18:34:16.762]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x0BE1B57D42aEA757bc5eb8dC3379e0e7342a6EB8 in tx 0xe7326e7ff52fa4e48a0f4f8038d4b998aacad7b33d9ffe42304e731fb3493983.
18:34:16 [18:34:16.763]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001
18:34:16 [18:34:16.782]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x286b04e8c48d962d48cf824fb6df3f6bba2246df7c3c08c7507f3f7299bff5b7
{"gasLimit":3907183,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"}
18:34:16 [18:34:16.783]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x82ecc909dE552D32f16455b2894bff0a03702877 in tx 0x286b04e8c48d962d48cf824fb6df3f6bba2246df7c3c08c7507f3f7299bff5b7.
18:34:16 [18:34:16.783]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Awaiting for linked libraries to be deployed
18:34:16 [18:34:16.791]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001
18:34:16 [18:34:16.831]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xf85a4ef1f38f48129208be6047eff09364978cd7b1a19ee3f912be7b82bec56e
{"gasLimit":11805386,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"}
18:34:16 [18:34:16.832]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x20FEA58404fff6234c9B31E06071e8D4fBEEcC20 in tx 0xf85a4ef1f38f48129208be6047eff09364978cd7b1a19ee3f912be7b82bec56e.
18:34:16 [18:34:16.832]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed Rollup at 0x20fea58404fff6234c9b31e06071e8d4fbeecc20
{"aztecSlotDuration":16,"aztecEpochDuration":4,"targetCommitteeSize":0,"aztecProofSubmissionEpochs":1,"slashingQuorum":6,"slashingRoundSize":10,"manaTarget":10000000000,"provingCostPerMana":100,"rewardConfig":{"sequencerBps":5000,"rewardDistributor":"0x4a51916a6b10a43f6565042be5b6b69d8d613f64","booster":"0x0000000000000000000000000000000000000000"},"rewardBoostConfig":{"increment":200000,"maxScore":5000000,"a":5000,"k":1000000,"minimum":100000},"stakingQueueConfig":{"bootstrapValidatorSetSize":0,"bootstrapFlushSize":0,"normalFlushSizeMin":48,"normalFlushSizeQuotient":2}}
18:34:16 [18:34:16.832]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 11 transactions to be mined...
18:34:16 [18:34:16.857]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully
18:34:16 [18:34:16.858]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof All core contracts have been deployed
18:34:16 [18:34:16.858]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Deploying contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001
18:34:16 [18:34:16.872]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xe4be2e004283f5ed9159ea1a2169b17091b18ecf551e9de081532203a929195e
{"gasLimit":1056496,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"}
18:34:16 [18:34:16.872]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed contract with salt 0x0000000000000000000000000000000000000000000000000000000000000001 to address 0x482b1Ed796AAf7812F61BebfF29c03715B5B821a in tx 0xe4be2e004283f5ed9159ea1a2169b17091b18ecf551e9de081532203a929195e.
18:34:16 [18:34:16.872]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Deployed SlashFactory at 0x482b1ed796aaf7812f61bebff29c03715b5b821a
18:34:16 [18:34:16.892]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0x633d221085d7b9fcf1c6be0451ba2c965d087e6e6b69298d4f1e17d7a2a62e5d
{"gasLimit":117006,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"}
18:34:16 [18:34:16.893]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Adding rollup 0x20fea58404fff6234c9b31e06071e8d4fbeecc20 to registry 0x3c709afec1aceae522c13145005de788a3cc65c8 in tx 0x633d221085d7b9fcf1c6be0451ba2c965d087e6e6b69298d4f1e17d7a2a62e5d
18:34:16 [18:34:16.906]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Sent L1 transaction 0xe23e4087443cb9f467c22d60eb53275ad6da683afc3533d4d88926b362e0aed5
{"gasLimit":109478,"maxFeePerGas":"500","maxPriorityFeePerGas":"500"}
18:34:16 [18:34:16.907]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Adding rollup 0x20fea58404fff6234c9b31e06071e8d4fbeecc20 to GSE 0x6f26a1916df432654607f9c75b764e535e65cf3e in tx 0xe23e4087443cb9f467c22d60eb53275ad6da683afc3533d4d88926b362e0aed5
18:34:16 [18:34:16.911]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 12 transactions to be mined...
18:34:16 [18:34:16.936]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully
18:34:16 [18:34:16.940]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Rollup deployed
18:34:16 [18:34:16.940]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Waiting for rollup and slash factory to be deployed
18:34:16 [18:34:16.940]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Waiting for 12 transactions to be mined...
18:34:16 [18:34:16.961]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof All transactions mined successfully
18:34:16 [18:34:16.961]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof All transactions for L1 deployment have been mined
18:34:16 [18:34:16.975]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Aztec L1 contracts initialized
{"registryAddress":"0x3c709afec1aceae522c13145005de788a3cc65c8","governanceAddress":"0x3ecb912be92103e7e8a5d1b8d047e4863d175c85","governanceProposerAddress":"0xe1b8d53934450a003d5449db6d55dcca6ea44454","rollupAddress":"0x20fea58404fff6234c9b31e06071e8d4fbeecc20","inboxAddress":"0x188555fcbb14bbca904493c5d7eb6e717131053a","outboxAddress":"0xa3c377d88bd71d798f155c83260b00a3dea4972e","feeJuicePortalAddress":"0xae57fbf2281efd3bde4babeac80a3998492cfb0e","feeJuiceAddress":"0xb8999345da8041f1da51ac5179b1f055a560f397","stakingAssetAddress":"0xbb9e13665cfb3d531f288a11e7312b6b91c59292","rewardDistributorAddress":"0x4a51916a6b10a43f6565042be5b6b69d8d613f64","gseAddress":"0x6f26a1916df432654607f9c75b764e535e65cf3e","coinIssuerAddress":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266"}
18:34:16 [18:34:16.976]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Handing over to governance
18:34:16 [18:34:16.979]
WARN:
ethereum:cheat_codes Set L1 automine to false
18:34:16 [18:34:16.980]
WARN:
ethereum:cheat_codes Set L1 interval mining to 8 seconds
18:34:16 [18:34:16.982]
WARN:
foundation:test-date-provider Time set to 2025-06-26T18:37:20.000Z
{"offset":183018,"timeMs":1750963040000}
18:34:16 [18:34:16.986]
INFO:
aztecjs:utils:watcher Watcher not started because not auto mining
18:34:16 [18:34:16.986]
INFO:
telemetry:client Using NoopTelemetryClient
18:34:16 [18:34:16.988]
INFO:
kv-store:lmdb-v2:blob-sink Creating blob-sink data store at directory /tmp/a4f54c68bcc84402/blob-sink with map size 134217728 KB (LMDB v2)
18:34:16 [18:34:16.990]
INFO:
kv-store:lmdb-v2:blob-sink Starting data store with maxReaders 16
18:34:16 [18:34:16.998]
INFO:
blob-sink:server Server is running on
http://localhost:38551
18:34:16 [18:34:16.998]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Creating and synching an aztec node...
18:34:16 [18:34:16.998]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Using native ACVM binary at ../../noir/noir-repo/target/release/acvm with working directory /tmp/3b8f333b/acvm
18:34:16 [18:34:16.999]
INFO:
node:blob-sink:client Creating HTTP blob sink client.
{"blobSinkUrl":"http://localhost:38551"}
18:34:17 [18:34:17.021]
VERBOSE:
node:MAIN-aztec-node Snapshot sync is disabled. No snapshots URL provided.
18:34:17 [18:34:17.021]
INFO:
archiver:lmdb Creating archiver data store at directory /tmp/a4f54c68bcc84402/archiver with map size 134217728 KB (LMDB v2)
18:34:17 [18:34:17.022]
INFO:
archiver:lmdb Starting data store with maxReaders 16
18:34:17 [18:34:17.595]
INFO:
node:blob-sink:client Testing configured blob sources
{"blobSinkUrl":"http://localhost:38551"}
18:34:17 [18:34:17.609]
INFO:
node:blob-sink:client Blob sink is reachable
{"blobSinkUrl":"http://localhost:38551"}
18:34:17 [18:34:17.610]
WARN:
node:blob-sink:client No L1 consensus host urls configured
18:34:17 [18:34:17.610]
WARN:
node:blob-sink:client No archive client configured
18:34:17 [18:34:17.612]
INFO:
archiver Starting archiver sync to rollup contract 0x20fea58404fff6234c9b31e06071e8d4fbeecc20 from L1 block 22 to current L1 block 25 with hash 0x442a1d47e2a1a5d911aaff6182b20a5d9ccbf7d7a73ed4cfbfae94b294d65d71
{"blocksSynchedTo":22,"messagesSynchedTo":{"l1BlockHash":"0x4f23954caa549c234b17743b45f43639b64714328850dd5fd4d4ad014c830ffc","l1BlockNumber":22}}
18:34:17 [18:34:17.626]
INFO:
archiver Initial archiver sync to L1 block 25 complete.
{"l1BlockNumber":25,"syncPoint":{"blocksSynchedTo":25},"latest":{"number":0},"proven":{"number":0},"finalized":{"number":0}}
18:34:17 [18:34:17.633]
INFO:
world-state:database Creating world state data store at directory /tmp/a4f54c68bcc84402/world_state with map sizes {"archiveTreeMapSizeKb":134217728,"nullifierTreeMapSizeKb":134217728,"noteHashTreeMapSizeKb":134217728,"messageTreeMapSizeKb":134217728,"publicDataTreeMapSizeKb":134217728} and 2 threads.
18:34:17 [18:34:17.656]
INFO:
world_state Created world state synchroniser with block history of 2
18:34:17 [18:34:17.656]
WARN:
node:MAIN-aztec-node Aztec node is accepting fake proofs
18:34:17 [18:34:17.656]
INFO:
bb-prover:queued_ivc_verifier Starting QueuedIVCVerifier with 8 concurrent verifiers
18:34:17 [18:34:17.667]
INFO:
p2p:lmdb-v2 Creating p2p data store at directory /tmp/a4f54c68bcc84402/p2p with map size 134217728 KB (LMDB v2)
18:34:17 [18:34:17.668]
INFO:
p2p:lmdb-v2 Starting data store with maxReaders 16
18:34:17 [18:34:17.669]
INFO:
p2p-archive:lmdb-v2 Creating p2p-archive data store at directory /tmp/a4f54c68bcc84402/p2p-archive with map size 134217728 KB (LMDB v2)
18:34:17 [18:34:17.670]
INFO:
p2p-archive:lmdb-v2 Starting data store with maxReaders 16
18:34:17 [18:34:17.671]
INFO:
p2p-peer:lmdb-v2 Creating p2p-peers data store at directory /tmp/a4f54c68bcc84402/p2p-peers with map size 134217728 KB (LMDB v2)
18:34:17 [18:34:17.672]
INFO:
p2p-peer:lmdb-v2 Starting data store with maxReaders 16
18:34:17 [18:34:17.673]
INFO:
p2p:tx_pool Setting maximum tx mempool size
{"maxTxPoolSize":100000000}
18:34:17 [18:34:17.673]
VERBOSE:
p2p P2P is disabled. Using dummy P2P service.
18:34:17 [18:34:17.676]
VERBOSE:
world-state:block_stream Starting L2 block stream
{"proven":false,"pollIntervalMS":50}
18:34:17 [18:34:17.676]
INFO:
world_state Started world state synchronizer from block 1
18:34:17 [18:34:17.678]
VERBOSE:
world-state:block_stream Starting sync from block number 0
18:34:17 [18:34:17.680]
INFO:
p2p Starting p2p client from block 0 with empty mempools
18:34:17 [18:34:17.680]
VERBOSE:
p2p:l2-block-stream Starting L2 block stream
{"batchSize":20,"pollIntervalMS":100,"startingBlock":0}
18:34:17 [18:34:17.898]
INFO:
epoch-prune-watcher EpochPruneWatcher initialized
18:34:17 [18:34:17.932]
VERBOSE:
validator Initialized validator with addresses: 0x2f39f47b3fa1b3dfb29c22b9daec0aa98043bbb9
18:34:17 [18:34:17.932]
VERBOSE:
node:MAIN-aztec-node All Aztec Node subsystems synced
18:34:17 [18:34:17.941]
INFO:
slasher Starting Slasher client...
18:34:17 [18:34:17.946]
VERBOSE:
p2p:l2-block-stream Starting sync from block number 0
18:34:17 [18:34:17.957]
INFO:
validator Started validator with addresses: 0x2f39f47b3fa1b3dfb29c22b9daec0aa98043bbb9
18:34:17 [18:34:17.957]
VERBOSE:
validator Validators 0x2f39f47b3fa1b3dfb29c22b9daec0aa98043bbb9 are not on the validator committee for epoch 0
18:34:17 [18:34:17.958]
INFO:
sequencer Sequencer config set
{"transactionPollingIntervalMS":500,"maxTxsPerBlock":32,"minTxsPerBlock":0,"maxL2BlockGas":10000000000,"publishTxsWithProposals":false,"maxDABlockGas":10000000000,"acvmWorkingDirectory":"/tmp/3b8f333b/acvm","acvmBinaryPath":"../../noir/noir-repo/target/release/acvm","maxBlockSizeInBytes":1048576,"governanceProposerPayload":"0x0000000000000000000000000000000000000000","maxL1TxInclusionTimeIntoSlot":8,"enforceTimeTable":false}
18:34:17 [18:34:17.958]
VERBOSE:
sequencer Sequencer timetable updated
{"enforceTimeTable":false}
18:34:17 [18:34:17.960]
INFO:
sequencer Sequencer started with address 0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266
18:34:17 [18:34:17.960]
VERBOSE:
node:MAIN-aztec-node Sequencer started
18:34:17 [18:34:17.961]
INFO:
node:MAIN-aztec-node Aztec Node version: 0.87.6
18:34:17 [18:34:17.961]
INFO:
node:MAIN-aztec-node Aztec Node started on chain 0x7a69
{"registryAddress":"0x3c709afec1aceae522c13145005de788a3cc65c8","governanceAddress":"0x3ecb912be92103e7e8a5d1b8d047e4863d175c85","governanceProposerAddress":"0xe1b8d53934450a003d5449db6d55dcca6ea44454","rollupAddress":"0x20fea58404fff6234c9b31e06071e8d4fbeecc20","inboxAddress":"0x188555fcbb14bbca904493c5d7eb6e717131053a","outboxAddress":"0xa3c377d88bd71d798f155c83260b00a3dea4972e","feeJuicePortalAddress":"0xae57fbf2281efd3bde4babeac80a3998492cfb0e","feeJuiceAddress":"0xb8999345da8041f1da51ac5179b1f055a560f397","stakingAssetAddress":"0xbb9e13665cfb3d531f288a11e7312b6b91c59292","rewardDistributorAddress":"0x4a51916a6b10a43f6565042be5b6b69d8d613f64","gseAddress":"0x6f26a1916df432654607f9c75b764e535e65cf3e","coinIssuerAddress":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","slashFactoryAddress":"0x482b1ed796aaf7812f61bebff29c03715b5b821a","feeAssetHandlerAddress":"0xb4ff23c4b1e2bc7c86090d4fbda21a457ee6727f","stakingAssetHandlerAddress":"0x62690b89983da9400fd50566478fa105a9a29ab5","zkPassportVerifierAddress":"0xee9f10f38319eae2730dba28fb09081db806c5e5"}
18:34:17 [18:34:17.962]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Creating and syncing a simulated prover node...
18:34:17 [18:34:17.995]
INFO:
blob-sink:client:prover-node Creating HTTP blob sink client.
{"blobSinkUrl":"http://localhost:38551"}
18:34:17 [18:34:17.999]
INFO:
archiver:lmdb:prover-node Creating archiver data store at directory /tmp/a4f54c68bcc84402/c62dd91dbef6a4f7/archiver with map size 134217728 KB (LMDB v2)
18:34:18 [18:34:18.011]
VERBOSE:
sequencer Preparing proposal for block 1 at slot 2
{"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750963048,"version":482646216},"chainTipArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","blockNumber":1,"slot":2}
18:34:18 [18:34:18.016]
INFO:
archiver:lmdb:prover-node Starting data store with maxReaders 16
18:34:18 [18:34:18.095]
VERBOSE:
block-builder Building block 1 for slot 2
{"slot":2,"slotStart":"2025-06-26T18:37:28.000Z","now":"2025-06-26T18:37:21.113Z","blockNumber":1,"msgCount":0,"initialStateReference":{"l1ToL2MessageTree":"0x2e33ee2008411c04b99c24b313513d097a0d21a5040b6193d1f978b8226892d6","noteHashTree":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTree":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTree":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9"},"initialArchiveRoot":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}}
18:34:18 [18:34:18.216]
INFO:
simulator:public-processor:prover-node Processed 0 successful txs and 0 failed txs in 0.11731308300000001s
{"duration":0.11731308300000001,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0}
18:34:18 [18:34:18.317]
INFO:
sequencer Built block 1 for slot 2 with 0 txs and 0 messages. 0 mana/s
{"blockHash":"0x23f9726a83c83b2e47531dee80c298cdf64b28ad90b3838692f1cb60e934b06c","globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750963048,"version":482646216},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":260.80761900000016,"publicProcessDuration":118.16804700000012,"rollupCircuitsDuration":224.09150500000032,"txCount":0,"blockNumber":1,"blockTimestamp":1750963048,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0}
18:34:18 [18:34:18.320]
VERBOSE:
sequencer Attesting committee is empty
18:34:18 [18:34:18.341]
INFO:
blob-sink:client:prover-node Testing configured blob sources
{"blobSinkUrl":"http://localhost:38551"}
18:34:18 [18:34:18.347]
INFO:
blob-sink:client:prover-node Blob sink is reachable
{"blobSinkUrl":"http://localhost:38551"}
18:34:18 [18:34:18.347]
WARN:
blob-sink:client:prover-node No L1 consensus host urls configured
18:34:18 [18:34:18.347]
WARN:
blob-sink:client:prover-node No archive client configured
18:34:18 [18:34:18.351]
INFO:
archiver:prover-node Starting archiver sync to rollup contract 0x20fea58404fff6234c9b31e06071e8d4fbeecc20 from L1 block 22 to current L1 block 25 with hash 0x442a1d47e2a1a5d911aaff6182b20a5d9ccbf7d7a73ed4cfbfae94b294d65d71
{"blocksSynchedTo":22,"messagesSynchedTo":{"l1BlockHash":"0x4f23954caa549c234b17743b45f43639b64714328850dd5fd4d4ad014c830ffc","l1BlockNumber":22}}
18:34:18 [18:34:18.391]
INFO:
archiver:prover-node Initial archiver sync to L1 block 25 complete.
{"l1BlockNumber":25,"syncPoint":{"blocksSynchedTo":25},"latest":{"number":0},"proven":{"number":0},"finalized":{"number":0}}
18:34:18 [18:34:18.393]
INFO:
prover-node:blob-sink:client:prover-node Creating HTTP blob sink client.
{"blobSinkUrl":"http://localhost:38551"}
18:34:18 [18:34:18.393]
VERBOSE:
prover-node:prover-node Snapshot sync is disabled. No snapshots URL provided.
18:34:18 [18:34:18.397]
VERBOSE:
prover-node:prover-node Created archiver and synced to block 0
18:34:18 [18:34:18.420]
INFO:
world-state:database:prover-node Creating world state data store at directory /tmp/a4f54c68bcc84402/c62dd91dbef6a4f7/world_state with map sizes {"archiveTreeMapSizeKb":134217728,"nullifierTreeMapSizeKb":134217728,"noteHashTreeMapSizeKb":134217728,"messageTreeMapSizeKb":134217728,"publicDataTreeMapSizeKb":134217728} and 2 threads.
18:34:18 [18:34:18.442]
INFO:
world_state:prover-node Created world state synchroniser with block history of 2
18:34:18 [18:34:18.445]
VERBOSE:
world-state:block_stream:prover-node Starting L2 block stream
{"proven":false,"pollIntervalMS":50}
18:34:18 [18:34:18.445]
INFO:
world_state:prover-node Started world state synchronizer from block 1
18:34:18 [18:34:18.447]
VERBOSE:
world-state:block_stream:prover-node Starting sync from block number 0
18:34:18 [18:34:18.447]
WARN:
prover-client:proving-broker-database:prover-node Found invalid epoch directory /tmp/a4f54c68bcc84402/c62dd91dbef6a4f7/archiver when loading epoch databases, ignoring
18:34:18 [18:34:18.447]
WARN:
prover-client:proving-broker-database:prover-node Found invalid epoch directory /tmp/a4f54c68bcc84402/c62dd91dbef6a4f7/world_state when loading epoch databases, ignoring
18:34:18 [18:34:18.448]
INFO:
prover-client:proving-broker:prover-node Proving Broker started
18:34:18 [18:34:18.461]
INFO:
prover-node:prover-coordination:prover-node Using prover coordination via aztec node
18:34:18 [18:34:18.463]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof:prover-node Created and synced prover node
{"publisherAddress":"0x3C44CdDdB6a900fa2b585dd299e03d12FA4293BC"}
18:34:18 [18:34:18.463]
INFO:
prover-node:epoch-monitor:prover-node Started EpochMonitor
{"pollingIntervalMs":200}
18:34:18 [18:34:18.466]
INFO:
prover-node:prover-node Started Prover Node with prover id 0x0000000000000000000000000000000000000000000000000000000000000001
{"proverNodePollingIntervalMs":200,"proverNodeMaxPendingJobs":10,"proverNodeMaxParallelBlocksPerEpoch":32,"txGatheringIntervalMs":1000,"txGatheringBatchSize":10,"txGatheringMaxParallelRequestsPerNode":100,"proverNodeFailedEpochStore":"file:///tmp/failed-proofs-KFwmU9","dataDirectory":"/tmp/a4f54c68bcc84402/c62dd91dbef6a4f7","l1ChainId":31337,"rollupVersion":482646216}
18:34:18 [18:34:18.466]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Creating a pxe...
18:34:18 [18:34:18.471]
INFO:
pxe:data:lmdb Creating pxe_data data store at directory /tmp/79a3e641b2edb3c5/pxe_data with map size 134217728 KB (LMDB v2)
18:34:18 [18:34:18.474]
INFO:
pxe:data:lmdb Starting data store with maxReaders 16
18:34:18 [18:34:18.816]
VERBOSE:
pxe:service Registered protocol contracts in pxe
{"AuthRegistry":"0x0000000000000000000000000000000000000000000000000000000000000001","ContractInstanceDeployer":"0x0000000000000000000000000000000000000000000000000000000000000002","ContractClassRegisterer":"0x0000000000000000000000000000000000000000000000000000000000000003","MultiCallEntrypoint":"0x0000000000000000000000000000000000000000000000000000000000000004","FeeJuice":"0x0000000000000000000000000000000000000000000000000000000000000005","Router":"0x0000000000000000000000000000000000000000000000000000000000000006"}
18:34:18 [18:34:18.817]
INFO:
pxe:service Started PXE connected to chain 31337 version 482646216
18:34:18 [18:34:18.818]
INFO:
sequencer Sequencer config set
{"minTxsPerBlock":0}
18:34:18 [18:34:18.818]
VERBOSE:
sequencer Sequencer timetable updated
{"enforceTimeTable":false}
18:34:20 [18:34:20.965]
VERBOSE:
ethereum:tx_delayer Sent tx immediately 0x778612b7f4e58ec1771d4ce44c65e0daff22b395c5dd1b15cc68d16699cdb8e4
18:34:20 [18:34:20.966]
VERBOSE:
node:MAIN-aztec-node Sent L1 transaction 0x778612b7f4e58ec1771d4ce44c65e0daff22b395c5dd1b15cc68d16699cdb8e4
{"gasLimit":471331,"maxFeePerGas":"500","maxPriorityFeePerGas":"500","maxFeePerBlobGas":"0.000000001"}
18:34:25 [18:34:25.026]
INFO:
sequencer:publisher Bundled [propose] transaction [succeeded]
18:34:25 [18:34:25.027]
VERBOSE:
sequencer:publisher Published L2 block to L1 rollup contract
{"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0x778612b7f4e58ec1771d4ce44c65e0daff22b395c5dd1b15cc68d16699cdb8e4","calldataSize":1316,"calldataGas":9236,"txCount":0,"blockNumber":1,"blockTimestamp":1750963048,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0}
18:34:25 [18:34:25.027]
VERBOSE:
node:blob-sink:client Sending 1 blobs to blob sink
18:34:25 [18:34:25.040]
INFO:
blob-sink:server Received blob sidecar for block 0x400cdf903e3b8a645ecffe850e0a0346e6a530deda060899e0cddad64a4d3ac6
18:34:25 [18:34:25.048]
INFO:
blob-sink:server Blob sidecar stored successfully for block 0x400cdf903e3b8a645ecffe850e0a0346e6a530deda060899e0cddad64a4d3ac6
18:34:25 [18:34:25.117]
INFO:
archiver Downloaded L2 block 1
{"blockHash":"0x23f9726a83c83b2e47531dee80c298cdf64b28ad90b3838692f1cb60e934b06c","blockNumber":1,"txCount":0,"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750963048,"version":482646216},"archiveRoot":"0x20b16fa2f229976ca36dcdd4d36f8697095ca3956b2a3139e29d9123c9d30aeb","archiveNextLeafIndex":2}
18:34:25 [18:34:25.140]
INFO:
archiver:prover-node Downloaded L2 block 1
{"blockHash":"0x23f9726a83c83b2e47531dee80c298cdf64b28ad90b3838692f1cb60e934b06c","blockNumber":1,"txCount":0,"globalVariables":{"blockNumber":1,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":2,"timestamp":1750963048,"version":482646216},"archiveRoot":"0x20b16fa2f229976ca36dcdd4d36f8697095ca3956b2a3139e29d9123c9d30aeb","archiveNextLeafIndex":2}
18:34:25 [18:34:25.172]
INFO:
world_state:prover-node World state updated with L2 block 1
{"eventName":"l2-block-handled","duration":3.126329999999143,"unfinalisedBlockNumber":1,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":1,"blockTimestamp":1750963048,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0}
18:34:25 [18:34:25.173]
INFO:
world_state World state updated with L2 block 1
{"eventName":"l2-block-handled","duration":2.8376509999998234,"unfinalisedBlockNumber":1,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":1,"blockTimestamp":1750963048,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0}
18:34:25 [18:34:25.240]
VERBOSE:
p2p Synched to latest block 1
18:34:25 [18:34:25.471]
VERBOSE:
prover-node:prover-node Fetching 0 tx hashes for block number 1 from coordination
18:34:25 [18:34:25.471]
INFO:
prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool
18:34:26 [18:34:26.820]
INFO:
sequencer Sequencer config set
{"minTxsPerBlock":0}
18:34:26 [18:34:26.820]
VERBOSE:
sequencer Sequencer timetable updated
{"enforceTimeTable":false}
18:34:26 [18:34:26.825]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof L2 genesis at L1 block 22 (timestamp 1750963016)
18:34:26 [18:34:26.826]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Waiting until L1 timestamp 1750963080 is reached as the start of epoch 1
18:34:27 [18:34:27.044]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof L1 block 26 mined at 18:37:28 with new L2 block 1 for epoch 0 with proof up to L2 block 0 for epoch 0
{"l1Timestamp":1750963048,"l1BlockNumber":26,"l2SlotNumber":2,"l2BlockNumber":1,"l2ProvenBlockNumber":0,"totalL2Messages":0}
18:34:33 [18:34:33.031]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof L1 block 27 mined at 18:37:36
{"l1Timestamp":1750963056,"l1BlockNumber":27,"l2SlotNumber":2,"l2BlockNumber":1,"l2ProvenBlockNumber":0,"totalL2Messages":0}
18:34:33 [18:34:33.113]
VERBOSE:
sequencer Preparing proposal for block 2 at slot 3
{"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750963064,"version":482646216},"chainTipArchive":"0x20b16fa2f229976ca36dcdd4d36f8697095ca3956b2a3139e29d9123c9d30aeb","blockNumber":2,"slot":3}
18:34:33 [18:34:33.134]
VERBOSE:
block-builder Building block 2 for slot 3
{"slot":3,"slotStart":"2025-06-26T18:37:44.000Z","now":"2025-06-26T18:37:36.152Z","blockNumber":2,"msgCount":0,"initialStateReference":{"l1ToL2MessageTree":"0x2e33ee2008411c04b99c24b313513d097a0d21a5040b6193d1f978b8226892d6","noteHashTree":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTree":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTree":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9"},"initialArchiveRoot":"0x20b16fa2f229976ca36dcdd4d36f8697095ca3956b2a3139e29d9123c9d30aeb","opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}}
18:34:33 [18:34:33.138]
INFO:
simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.001116743000002316s
{"duration":0.001116743000002316,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0}
18:34:33 [18:34:33.153]
INFO:
sequencer Built block 2 for slot 3 with 0 txs and 0 messages. 0 mana/s
{"blockHash":"0x245cfe697202099bf997919ac526748b0248ffd1b662cb576a2a961f717bdd24","globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750963064,"version":482646216},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":25.402743000002374,"publicProcessDuration":1.4342910000013944,"rollupCircuitsDuration":20.358318999999028,"txCount":0,"blockNumber":2,"blockTimestamp":1750963064,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0}
18:34:33 [18:34:33.154]
VERBOSE:
sequencer Attesting committee is empty
18:34:33 [18:34:33.231]
VERBOSE:
ethereum:tx_delayer Sent tx immediately 0x9a5bdb8d79baf61e1f60912719a26393247ee35ee92f38b36eefcc6f8de4ed8b
18:34:33 [18:34:33.232]
VERBOSE:
node:MAIN-aztec-node Sent L1 transaction 0x9a5bdb8d79baf61e1f60912719a26393247ee35ee92f38b36eefcc6f8de4ed8b
{"gasLimit":392073,"maxFeePerGas":"1.267013871","maxPriorityFeePerGas":"1.2","maxFeePerBlobGas":"0.000000001"}
18:34:40 [18:34:40.990]
INFO:
sequencer:publisher Bundled [propose] transaction [succeeded]
18:34:40 [18:34:40.990]
VERBOSE:
sequencer:publisher Published L2 block to L1 rollup contract
{"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0x9a5bdb8d79baf61e1f60912719a26393247ee35ee92f38b36eefcc6f8de4ed8b","calldataSize":1316,"calldataGas":9236,"txCount":0,"blockNumber":2,"blockTimestamp":1750963064,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0}
18:34:40 [18:34:40.991]
VERBOSE:
node:blob-sink:client Sending 1 blobs to blob sink
18:34:41 [18:34:41.000]
INFO:
blob-sink:server Received blob sidecar for block 0xde316b7b40792b9b6ba39c930320f36cde05d7d58ede839f6a9baf247a18b977
18:34:41 [18:34:41.006]
INFO:
blob-sink:server Blob sidecar stored successfully for block 0xde316b7b40792b9b6ba39c930320f36cde05d7d58ede839f6a9baf247a18b977
18:34:41 [18:34:41.075]
INFO:
archiver Downloaded L2 block 2
{"blockHash":"0x245cfe697202099bf997919ac526748b0248ffd1b662cb576a2a961f717bdd24","blockNumber":2,"txCount":0,"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750963064,"version":482646216},"archiveRoot":"0x1407106bd1dda91f526f5a9794f4524b7277b7b3ff09d5360b4314312e87b899","archiveNextLeafIndex":3}
18:34:41 [18:34:41.106]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof L1 block 28 mined at 18:37:44 with new L2 block 2 for epoch 0
{"l1Timestamp":1750963064,"l1BlockNumber":28,"l2SlotNumber":3,"l2BlockNumber":2,"l2ProvenBlockNumber":0,"totalL2Messages":0}
18:34:41 [18:34:41.108]
INFO:
archiver:prover-node Downloaded L2 block 2
{"blockHash":"0x245cfe697202099bf997919ac526748b0248ffd1b662cb576a2a961f717bdd24","blockNumber":2,"txCount":0,"globalVariables":{"blockNumber":2,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":3,"timestamp":1750963064,"version":482646216},"archiveRoot":"0x1407106bd1dda91f526f5a9794f4524b7277b7b3ff09d5360b4314312e87b899","archiveNextLeafIndex":3}
18:34:41 [18:34:41.113]
INFO:
prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool
18:34:41 [18:34:41.113]
VERBOSE:
prover-node:prover-node Gathered all 0 txs for epoch 0
{"epochNumber":0}
18:34:41 [18:34:41.114]
VERBOSE:
prover-node:prover-node Gathered all 0 messages for epoch 0
{"epochNumber":0}
18:34:41 [18:34:41.115]
VERBOSE:
prover-node:prover-node Gathered previous block header 0 for epoch 0
18:34:41 [18:34:41.115]
VERBOSE:
prover-node:prover-node Creating proving job for epoch 0 for block range 1 to 2
18:34:41 [18:34:41.121]
INFO:
world_state:prover-node World state updated with L2 block 2
{"eventName":"l2-block-handled","duration":2.38223399999697,"unfinalisedBlockNumber":2,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":2,"blockTimestamp":1750963064,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0}
18:34:41 [18:34:41.123]
INFO:
prover-node:epoch-proving-job Starting epoch 0 proving job with blocks 1 to 2
{"fromBlock":1,"toBlock":2,"epochSizeBlocks":2,"epochNumber":0,"uuid":"45c1696d-d994-40ec-8f74-c30904b8c0ff"}
18:34:41 [18:34:41.141]
INFO:
prover-client:orchestrator Starting epoch 0 with 2 blocks
18:34:41 [18:34:41.141]
VERBOSE:
prover-client:broker-circuit-prover-facade Starting BrokerCircuitProverFacade
18:34:41 [18:34:41.142]
VERBOSE:
prover-node:epoch-proving-job Starting processing block 1
{"number":1,"blockHash":"0x23f9726a83c83b2e47531dee80c298cdf64b28ad90b3838692f1cb60e934b06c","lastArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"45c1696d-d994-40ec-8f74-c30904b8c0ff","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x000000000000000000000000000000000000000000000000000000001cc498c8","blockNumber":1,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}}
18:34:41 [18:34:41.143]
INFO:
prover-client:orchestrator Starting block 1 for slot 2
18:34:41 [18:34:41.143]
VERBOSE:
prover-node:epoch-proving-job Starting processing block 2
{"number":2,"blockHash":"0x245cfe697202099bf997919ac526748b0248ffd1b662cb576a2a961f717bdd24","lastArchive":"0x20b16fa2f229976ca36dcdd4d36f8697095ca3956b2a3139e29d9123c9d30aeb","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"45c1696d-d994-40ec-8f74-c30904b8c0ff","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x000000000000000000000000000000000000000000000000000000001cc498c8","blockNumber":2,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000003","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}}
18:34:41 [18:34:41.143]
INFO:
prover-client:orchestrator Starting block 2 for slot 3
18:34:41 [18:34:41.152]
INFO:
world_state World state updated with L2 block 2
{"eventName":"l2-block-handled","duration":2.6203409999980067,"unfinalisedBlockNumber":2,"finalisedBlockNumber":0,"oldestHistoricBlock":1,"txCount":0,"blockNumber":2,"blockTimestamp":1750963064,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0}
18:34:41 [18:34:41.157]
INFO:
prover-client:proving-broker:prover-node New proving job id=0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e epochNumber=0
{"provingJobId":"0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e"}
18:34:41 [18:34:41.157]
VERBOSE:
prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e type=BASE_PARITY
{"provingJobId":"0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e","provingJobType":"BASE_PARITY"}
18:34:41 [18:34:41.158]
VERBOSE:
prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e type=BASE_PARITY
{"provingJobId":"0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e","provingJobType":"BASE_PARITY"}
18:34:41 [18:34:41.158]
VERBOSE:
prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e type=BASE_PARITY
{"provingJobId":"0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e","provingJobType":"BASE_PARITY"}
18:34:41 [18:34:41.161]
INFO:
simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000014936999999918044s
{"duration":0.000014936999999918044,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0}
18:34:41 [18:34:41.161]
WARN:
prover-client:orchestrator Provided no txs to orchestrator addTxs.
18:34:41 [18:34:41.162]
VERBOSE:
prover-node:epoch-proving-job Processed all 0 txs for block 1
{"blockNumber":1,"blockHash":"0x23f9726a83c83b2e47531dee80c298cdf64b28ad90b3838692f1cb60e934b06c","uuid":"45c1696d-d994-40ec-8f74-c30904b8c0ff"}
18:34:41 [18:34:41.162]
VERBOSE:
prover-client:orchestrator Block 1 completed. Assembling header.
18:34:41 [18:34:41.165]
VERBOSE:
prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e type=BASE_PARITY
{"provingJobId":"0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e","provingJobType":"BASE_PARITY"}
18:34:41 [18:34:41.165]
VERBOSE:
prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e type=BASE_PARITY
{"provingJobId":"0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e","provingJobType":"BASE_PARITY"}
18:34:41 [18:34:41.165]
VERBOSE:
prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e type=BASE_PARITY
{"provingJobId":"0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e","provingJobType":"BASE_PARITY"}
18:34:41 [18:34:41.166]
VERBOSE:
prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e type=BASE_PARITY
{"provingJobId":"0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e","provingJobType":"BASE_PARITY"}
18:34:41 [18:34:41.172]
VERBOSE:
prover-client:orchestrator Updating archive tree with block 1 header 0x23f9726a83c83b2e47531dee80c298cdf64b28ad90b3838692f1cb60e934b06c
18:34:41 [18:34:41.174]
INFO:
simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.000013413000000582542s
{"duration":0.000013413000000582542,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0}
18:34:41 [18:34:41.174]
WARN:
prover-client:orchestrator Provided no txs to orchestrator addTxs.
18:34:41 [18:34:41.175]
VERBOSE:
prover-node:epoch-proving-job Processed all 0 txs for block 2
{"blockNumber":2,"blockHash":"0x245cfe697202099bf997919ac526748b0248ffd1b662cb576a2a961f717bdd24","uuid":"45c1696d-d994-40ec-8f74-c30904b8c0ff"}
18:34:41 [18:34:41.176]
VERBOSE:
prover-client:orchestrator Block 2 completed. Assembling header.
18:34:41 [18:34:41.178]
VERBOSE:
prover-client:orchestrator Orchestrator finalised block 1
18:34:41 [18:34:41.198]
VERBOSE:
prover-client:orchestrator Updating archive tree with block 2 header 0x245cfe697202099bf997919ac526748b0248ffd1b662cb576a2a961f717bdd24
18:34:41 [18:34:41.200]
VERBOSE:
prover-client:orchestrator Orchestrator finalised block 2
18:34:41 [18:34:41.215]
INFO:
prover-client:proving-broker-database:prover-node Creating broker database for epoch 0 at /tmp/a4f54c68bcc84402/c62dd91dbef6a4f7/0 with map size 134217728
18:34:41 [18:34:41.224]
INFO:
kv-store:lmdb-v2 Starting data store with maxReaders 16
18:34:41 [18:34:41.228]
VERBOSE:
p2p Synched to latest block 2
18:34:41 [18:34:41.230]
VERBOSE:
prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e type=BASE_PARITY epochNumber=0
{"provingJobId":"0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e","provingJobType":"BASE_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu...","status":"not-found","numOutstandingJobs":1}
18:34:41 [18:34:41.260]
INFO:
prover-client:proving-agent:prover-node Starting job id=0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e type=BASE_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu...
18:34:41 [18:34:41.273]
INFO:
prover-client:proving-agent:job-controller-9f9e4e4c Job controller started jobId=0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e
{"jobId":"0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e"}
18:34:41 [18:34:41.365]
INFO:
prover-client:proving-agent:prover-node Job id=0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e type=BASE_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22resu...
18:34:41 [18:34:41.365]
INFO:
prover-client:proving-broker:prover-node Proving job complete id=0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e type=BASE_PARITY totalAttempts=1
{"provingJobId":"0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e"}
18:34:41 [18:34:41.482]
VERBOSE:
prover-node:prover-node Fetching 0 tx hashes for block number 2 from coordination
18:34:41 [18:34:41.483]
INFO:
prover-node:combined-prover-coordination:prover-node Check for 0 txs found all in the pool
18:34:42 [18:34:42.142]
VERBOSE:
prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1
18:34:42 [18:34:42.144]
VERBOSE:
prover-client:broker-circuit-prover-facade Resolved proving job id=0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e type=BASE_PARITY
18:34:42 [18:34:42.144]
VERBOSE:
prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0
18:34:42 [18:34:42.156]
INFO:
prover-client:proving-broker:prover-node New proving job id=0:ROOT_PARITY:5c09dd94c7b7df0bce61a606cd22205167b9a4ab235ac8073ebb9ff827bb9e96 epochNumber=0
{"provingJobId":"0:ROOT_PARITY:5c09dd94c7b7df0bce61a606cd22205167b9a4ab235ac8073ebb9ff827bb9e96"}
18:34:42 [18:34:42.162]
VERBOSE:
prover-client:broker-circuit-prover-facade Job already found in facade id=0:ROOT_PARITY:5c09dd94c7b7df0bce61a606cd22205167b9a4ab235ac8073ebb9ff827bb9e96 type=ROOT_PARITY
{"provingJobId":"0:ROOT_PARITY:5c09dd94c7b7df0bce61a606cd22205167b9a4ab235ac8073ebb9ff827bb9e96","provingJobType":"ROOT_PARITY"}
18:34:42 [18:34:42.207]
VERBOSE:
prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_PARITY:5c09dd94c7b7df0bce61a606cd22205167b9a4ab235ac8073ebb9ff827bb9e96 type=ROOT_PARITY epochNumber=0
{"provingJobId":"0:ROOT_PARITY:5c09dd94c7b7df0bce61a606cd22205167b9a4ab235ac8073ebb9ff827bb9e96","provingJobType":"ROOT_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A11%2C%22inpu...","status":"not-found","numOutstandingJobs":1}
18:34:42 [18:34:42.214]
WARN:
e2e:e2e_epochs:epochs_upload_failed_proof Triggering error on finaliseEpoch
18:34:42 [18:34:42.220]
ERROR:
prover-node:epoch-proving-job Error running epoch 0 prover job: Error: Fake error while proving epoch
18:34:42 at ServerEpochProver.epochProver.finaliseEpoch (/home/aztec-dev/aztec-packages/yarn-project/end-to-end/src/e2e_epochs/epochs_upload_failed_proof.test.ts:60:15)
18:34:42 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:142:64)
18:34:42 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13)
{"uuid":"45c1696d-d994-40ec-8f74-c30904b8c0ff","epochNumber":0}
18:34:42 [18:34:42.221]
VERBOSE:
prover-client:broker-circuit-prover-facade Stopping BrokerCircuitProverFacade
18:34:42 [18:34:42.221]
ERROR:
prover-client:broker-circuit-prover-facade Job errored with 'Broker facade stopped' id=0:ROOT_PARITY:5c09dd94c7b7df0bce61a606cd22205167b9a4ab235ac8073ebb9ff827bb9e96 type=ROOT_PARITY: {
18:34:42 provingJobId: '0:ROOT_PARITY:5c09dd94c7b7df0bce61a606cd22205167b9a4ab235ac8073ebb9ff827bb9e96',
18:34:42 provingJobType: 'ROOT_PARITY'
18:34:42 }
18:34:42 [18:34:42.222]
INFO:
prover-client:proving-broker:prover-node Cancelling job id=0:ROOT_PARITY:5c09dd94c7b7df0bce61a606cd22205167b9a4ab235ac8073ebb9ff827bb9e96
{"provingJobId":"0:ROOT_PARITY:5c09dd94c7b7df0bce61a606cd22205167b9a4ab235ac8073ebb9ff827bb9e96"}
18:34:42 [18:34:42.222]
WARN:
prover-client:proving-broker:prover-node Proving job id=0:ROOT_PARITY:5c09dd94c7b7df0bce61a606cd22205167b9a4ab235ac8073ebb9ff827bb9e96 type=ROOT_PARITY not in the in-progress set
{"provingJobId":"0:ROOT_PARITY:5c09dd94c7b7df0bce61a606cd22205167b9a4ab235ac8073ebb9ff827bb9e96"}
18:34:42 [18:34:42.222]
INFO:
prover-client:proving-broker:prover-node Marking proving job as failed id=0:ROOT_PARITY:5c09dd94c7b7df0bce61a606cd22205167b9a4ab235ac8073ebb9ff827bb9e96 type=ROOT_PARITY totalAttempts=1 err=Aborted
{"provingJobId":"0:ROOT_PARITY:5c09dd94c7b7df0bce61a606cd22205167b9a4ab235ac8073ebb9ff827bb9e96"}
18:34:42 [18:34:42.223]
ERROR:
prover-client:orchestrator Error thrown when proving job: Error: Broker facade stopped
18:34:42 at BrokerCircuitProverFacade.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/proving_broker/broker_prover_facade.js:142:31)
18:34:42 at ServerEpochProver.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/prover-client/server-epoch-prover.js:31:9)
18:34:42 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:183:13)
18:34:42 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13)
18:34:42 [18:34:42.223]
ERROR:
prover-client:orchestrator Error thrown when proving job: Error: Broker facade stopped
18:34:42 at BrokerCircuitProverFacade.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/proving_broker/broker_prover_facade.js:142:31)
18:34:42 at ServerEpochProver.stop (/home/aztec-dev/aztec-packages/yarn-project/prover-client/dest/prover-client/server-epoch-prover.js:31:9)
18:34:42 at EpochProvingJob.run (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/job/epoch-proving-job.js:183:13)
18:34:42 at ProverNode.runJob (/home/aztec-dev/aztec-packages/yarn-project/prover-node/dest/prover-node.js:160:13)
18:34:42 [18:34:42.224]
ERROR:
prover-node:prover-node Job for 0 exited with state failed: {
18:34:42 id: '45c1696d-d994-40ec-8f74-c30904b8c0ff',
18:34:42 epochNumber: 0n,
18:34:42 state: 'failed'
18:34:42 }
18:34:42 [18:34:42.224]
WARN:
prover-node:prover-node Uploading epoch proof failure for 0 to file:///tmp/failed-proofs-KFwmU9
{"epochNumber":0,"jobId":"45c1696d-d994-40ec-8f74-c30904b8c0ff","location":"file:///tmp/failed-proofs-KFwmU9"}
18:34:42 [18:34:42.225]
INFO:
stdlib:file-store Creating local file file store at /tmp/failed-proofs-KFwmU9
18:34:42 [18:34:42.230]
INFO:
prover-node:prover-node Pausing archiver and world state sync to start snapshot upload
18:34:42 [18:34:42.234]
INFO:
archiver:prover-node Stopped.
18:34:42 [18:34:42.235]
INFO:
world_state:prover-node Stopped sync
18:34:42 [18:34:42.235]
INFO:
prover-node:prover-node Creating backups of lmdb environments to /tmp/a4f54c68bcc84402/c62dd91dbef6a4f7/epoch-proof-data-rRYW2u
18:34:42 [18:34:42.238]
INFO:
prover-node:prover-node Data stores backed up to /tmp/a4f54c68bcc84402/c62dd91dbef6a4f7/epoch-proof-data-rRYW2u
{"paths":{"l1-to-l2-message-tree":"/tmp/a4f54c68bcc84402/c62dd91dbef6a4f7/epoch-proof-data-rRYW2u/world-state/L1ToL2MessageTree/data.mdb","archive-tree":"/tmp/a4f54c68bcc84402/c62dd91dbef6a4f7/epoch-proof-data-rRYW2u/world-state/ArchiveTree/data.mdb","public-data-tree":"/tmp/a4f54c68bcc84402/c62dd91dbef6a4f7/epoch-proof-data-rRYW2u/world-state/PublicDataTree/data.mdb","note-hash-tree":"/tmp/a4f54c68bcc84402/c62dd91dbef6a4f7/epoch-proof-data-rRYW2u/world-state/NoteHashTree/data.mdb","nullifier-tree":"/tmp/a4f54c68bcc84402/c62dd91dbef6a4f7/epoch-proof-data-rRYW2u/world-state/NullifierTree/data.mdb","archiver":"/tmp/a4f54c68bcc84402/c62dd91dbef6a4f7/epoch-proof-data-rRYW2u/archiver/data.mdb"}}
18:34:42 [18:34:42.238]
INFO:
prover-node:prover-node Resuming archiver and world state sync
18:34:42 [18:34:42.238]
VERBOSE:
world-state:block_stream:prover-node Starting L2 block stream
{"proven":false,"pollIntervalMS":50}
18:34:42 [18:34:42.238]
INFO:
world_state:prover-node Resumed sync
18:34:42 [18:34:42.238]
INFO:
archiver:prover-node Restarting archiver
18:34:42 [18:34:42.246]
WARN:
prover-node:prover-node Uploaded epoch 0 proof failure data to file:///tmp/failed-proofs-KFwmU9/aztec-31337-482646216-0x20fea58404fff6234c9b31e06071e8d4fbeecc20/0-20250626183442-45c1696d-d994-40ec-8f74-c30904b8c0ff
{"epochNumber":0,"location":"file:///tmp/failed-proofs-KFwmU9","basePath":"aztec-31337-482646216-0x20fea58404fff6234c9b31e06071e8d4fbeecc20/0-20250626183442-45c1696d-d994-40ec-8f74-c30904b8c0ff","metadataUrl":"file:///tmp/failed-proofs-KFwmU9/aztec-31337-482646216-0x20fea58404fff6234c9b31e06071e8d4fbeecc20/0-20250626183442-45c1696d-d994-40ec-8f74-c30904b8c0ff/metadata.json","dataUrl":"file:///tmp/failed-proofs-KFwmU9/aztec-31337-482646216-0x20fea58404fff6234c9b31e06071e8d4fbeecc20/0-20250626183442-45c1696d-d994-40ec-8f74-c30904b8c0ff/data.bin","metadata":{"l1BlockNumber":28,"l2BlockHash":"0x245cfe697202099bf997919ac526748b0248ffd1b662cb576a2a961f717bdd24","l2BlockNumber":2,"schemaVersions":{"archiver":3,"worldState":2},"timestamp":1750962882239,"dataUrls":{"l1-to-l2-message-tree":"file:///tmp/failed-proofs-KFwmU9/aztec-31337-482646216-0x20fea58404fff6234c9b31e06071e8d4fbeecc20/0-20250626183442-45c1696d-d994-40ec-8f74-c30904b8c0ff/l1-to-l2-message-tree.db","archive-tree":"file:///tmp/failed-proofs-KFwmU9/aztec-31337-482646216-0x20fea58404fff6234c9b31e06071e8d4fbeecc20/0-20250626183442-45c1696d-d994-40ec-8f74-c30904b8c0ff/archive-tree.db","public-data-tree":"file:///tmp/failed-proofs-KFwmU9/aztec-31337-482646216-0x20fea58404fff6234c9b31e06071e8d4fbeecc20/0-20250626183442-45c1696d-d994-40ec-8f74-c30904b8c0ff/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-KFwmU9/aztec-31337-482646216-0x20fea58404fff6234c9b31e06071e8d4fbeecc20/0-20250626183442-45c1696d-d994-40ec-8f74-c30904b8c0ff/note-hash-tree.db","nullifier-tree":"file:///tmp/failed-proofs-KFwmU9/aztec-31337-482646216-0x20fea58404fff6234c9b31e06071e8d4fbeecc20/0-20250626183442-45c1696d-d994-40ec-8f74-c30904b8c0ff/nullifier-tree.db","archiver":"file:///tmp/failed-proofs-KFwmU9/aztec-31337-482646216-0x20fea58404fff6234c9b31e06071e8d4fbeecc20/0-20250626183442-45c1696d-d994-40ec-8f74-c30904b8c0ff/archiver.db"}},"jobId":"45c1696d-d994-40ec-8f74-c30904b8c0ff"}
18:34:42 [18:34:42.247]
INFO:
prover-node:prover-node Cleaning up backup dir /tmp/a4f54c68bcc84402/c62dd91dbef6a4f7/epoch-proof-data-rRYW2u
18:34:49 [18:34:49.027]
INFO:
prover-node:prover-node Stopping ProverNode
18:34:49 [18:34:49.027]
INFO:
prover-node:epoch-monitor:prover-node Stopped EpochMonitor
18:34:49 [18:34:49.029]
INFO:
archiver:prover-node Stopped.
18:34:49 [18:34:49.030]
INFO:
world_state:prover-node Stopped world state synchronizer
18:34:49 [18:34:49.031]
INFO:
prover-node:prover-node Stopped ProverNode
18:34:49 [18:34:49.031]
INFO:
node:MAIN-aztec-node Stopping Aztec Node
18:34:49 [18:34:49.080]
VERBOSE:
sequencer Preparing proposal for block 3 at slot 4
{"globalVariables":{"blockNumber":3,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":4,"timestamp":1750963080,"version":482646216},"chainTipArchive":"0x1407106bd1dda91f526f5a9794f4524b7277b7b3ff09d5360b4314312e87b899","blockNumber":3,"slot":4}
18:34:49 [18:34:49.096]
VERBOSE:
block-builder Building block 3 for slot 4
{"slot":4,"slotStart":"2025-06-26T18:38:00.000Z","now":"2025-06-26T18:37:52.114Z","blockNumber":3,"msgCount":0,"initialStateReference":{"l1ToL2MessageTree":"0x2e33ee2008411c04b99c24b313513d097a0d21a5040b6193d1f978b8226892d6","noteHashTree":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTree":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTree":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9"},"initialArchiveRoot":"0x1407106bd1dda91f526f5a9794f4524b7277b7b3ff09d5360b4314312e87b899","opts":{"maxTransactions":32,"maxBlockSize":1048576,"maxBlockGas":{"daGas":10000000000,"l2Gas":10000000000}}}
18:34:49 [18:34:49.098]
INFO:
simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.00015966699999989941s
{"duration":0.00015966699999989941,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0}
18:34:49 [18:34:49.110]
INFO:
sequencer Built block 3 for slot 4 with 0 txs and 0 messages. 0 mana/s
{"blockHash":"0x2ac1280f29abc567ae5d9b40ac88f0ce6484fa123e8a5a229fadd1442f5cae43","globalVariables":{"blockNumber":3,"chainId":31337,"coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feePerDaGas":0,"feePerL2Gas":551010,"feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","slotNumber":4,"timestamp":1750963080,"version":482646216},"txHashes":[],"eventName":"l2-block-built","creator":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","duration":19.067253000001074,"publicProcessDuration":0.452964999996766,"rollupCircuitsDuration":14.451246999997238,"txCount":0,"blockNumber":3,"blockTimestamp":1750963080,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0}
18:34:49 [18:34:49.112]
VERBOSE:
sequencer Attesting committee is empty
18:34:49 [18:34:49.178]
VERBOSE:
ethereum:tx_delayer Sent tx immediately 0xacbb45d31de0a46f6c648a1b22fa1c556ee7603abbed4361c964d691841e1269
18:34:49 [18:34:49.178]
VERBOSE:
node:MAIN-aztec-node Sent L1 transaction 0xacbb45d31de0a46f6c648a1b22fa1c556ee7603abbed4361c964d691841e1269
{"gasLimit":465618,"maxFeePerGas":"1.251437389","maxPriorityFeePerGas":"1.2","maxFeePerBlobGas":"0.000000001"}
18:34:51 [18:34:51.032]
INFO:
slasher Slasher client stopped.
18:34:57 [18:34:57.008]
WARN:
node:blob-sink:client Unable to get blob sidecar for 0x9ad8008c85629a99546f5c6d519ce6bbc04e9ddac34db22aef6b7217745e67f5: Not Found (404)
{"status":404,"statusText":"Not Found","body":"{\"error\":\"Blob not found\"}"}
18:34:57 [18:34:57.009]
WARN:
node:blob-sink:client Failed to fetch blobs for 0x9ad8008c85629a99546f5c6d519ce6bbc04e9ddac34db22aef6b7217745e67f5 from all blob sources
{"blobSinkUrl":"http://localhost:38551"}
18:34:57 [18:34:57.034]
INFO:
sequencer:publisher Bundled [propose] transaction [succeeded]
18:34:57 [18:34:57.034]
VERBOSE:
sequencer:publisher Published L2 block to L1 rollup contract
{"sender":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","transactionHash":"0xacbb45d31de0a46f6c648a1b22fa1c556ee7603abbed4361c964d691841e1269","calldataSize":1316,"calldataGas":9236,"txCount":0,"blockNumber":3,"blockTimestamp":1750963080,"privateLogCount":0,"publicLogCount":0,"contractClassLogCount":0,"contractClassLogSize":0}
18:34:57 [18:34:57.034]
VERBOSE:
node:blob-sink:client Sending 1 blobs to blob sink
18:34:57 [18:34:57.037]
INFO:
blob-sink:server Received blob sidecar for block 0x9ad8008c85629a99546f5c6d519ce6bbc04e9ddac34db22aef6b7217745e67f5
18:34:57 [18:34:57.039]
INFO:
sequencer Stopped sequencer
18:34:57 [18:34:57.039]
INFO:
p2p P2P client stopped
18:34:57 [18:34:57.041]
INFO:
world_state Stopped world state synchronizer
18:34:57 [18:34:57.041]
INFO:
archiver Stopped.
18:34:57 [18:34:57.041]
INFO:
node:MAIN-aztec-node Stopped Aztec Node
18:34:57 [18:34:57.042]
INFO:
blob-sink:server Blob sidecar stored successfully for block 0x9ad8008c85629a99546f5c6d519ce6bbc04e9ddac34db22aef6b7217745e67f5
18:34:57 [18:34:57.044]
INFO:
node:MAIN-aztec-node Stopping Aztec Node
18:34:59 [18:34:59.044]
INFO:
slasher Slasher client stopped.
18:34:59 [18:34:59.044]
WARN:
validator Running promise was not started
18:34:59 [18:34:59.045]
WARN:
sequencer Running promise was not started
18:34:59 [18:34:59.045]
INFO:
sequencer Stopped sequencer
18:34:59 [18:34:59.045]
WARN:
p2p:l2-block-stream Running promise was not started
18:34:59 [18:34:59.045]
INFO:
p2p P2P client stopped
18:34:59 [18:34:59.045]
WARN:
world-state:block_stream Running promise was not started
18:34:59 [18:34:59.045]
INFO:
world_state Stopped world state synchronizer
18:34:59 [18:34:59.045]
WARN:
archiver Running promise was not started
18:34:59 [18:34:59.046]
INFO:
archiver Stopped.
18:34:59 [18:34:59.046]
INFO:
node:MAIN-aztec-node Stopped Aztec Node
18:34:59 [18:34:59.046]
INFO:
prover-node:prover-node Stopping ProverNode
18:34:59 [18:34:59.046]
WARN:
prover-node:prover-node Running promise was not started
18:34:59 [18:34:59.046]
WARN:
prover-node:epoch-monitor:prover-node Running promise was not started
18:34:59 [18:34:59.046]
INFO:
prover-node:epoch-monitor:prover-node Stopped EpochMonitor
18:34:59 [18:34:59.046]
WARN:
archiver:prover-node Running promise was not started
18:34:59 [18:34:59.046]
INFO:
archiver:prover-node Stopped.
18:34:59 [18:34:59.046]
WARN:
world-state:block_stream:prover-node Running promise was not started
18:34:59 [18:34:59.047]
INFO:
world_state:prover-node Stopped world state synchronizer
18:34:59 [18:34:59.047]
INFO:
prover-node:prover-node Stopped ProverNode
18:34:59 [18:34:59.055]
INFO:
blob-sink:server Stopping blob sink
18:34:59 [18:34:59.055]
INFO:
blob-sink:server Blob sink stopped
18:34:59 [18:34:59.059]
WARN:
e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data and state
{"uploadPath":"/tmp/failed-proofs-KFwmU9","rerunDataDir":"/tmp/rerun-data-1yTNNx","rerunDownloadPath":"/tmp/rerun-download-ni8X96/data.bin"}
18:34:59 [18:34:59.059]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data from file:///tmp/failed-proofs-KFwmU9/aztec-31337-482646216-0x20fea58404fff6234c9b31e06071e8d4fbeecc20/0-20250626183442-45c1696d-d994-40ec-8f74-c30904b8c0ff
18:34:59 [18:34:59.060]
INFO:
stdlib:file-store Creating local file file store at /tmp/failed-proofs-KFwmU9/aztec-31337-482646216-0x20fea58404fff6234c9b31e06071e8d4fbeecc20/0-20250626183442-45c1696d-d994-40ec-8f74-c30904b8c0ff
18:34:59 [18:34:59.061]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Downloading state snapshot from file:///tmp/failed-proofs-KFwmU9/aztec-31337-482646216-0x20fea58404fff6234c9b31e06071e8d4fbeecc20/0-20250626183442-45c1696d-d994-40ec-8f74-c30904b8c0ff to local data directory
{"metadata":{"l2BlockNumber":2,"l2BlockHash":"0x245cfe697202099bf997919ac526748b0248ffd1b662cb576a2a961f717bdd24","l1BlockNumber":28,"l1ChainId":31337,"rollupVersion":482646216,"rollupAddress":"0x20fea58404fff6234c9b31e06071e8d4fbeecc20"},"dataUrls":{"archiver":"file:///tmp/failed-proofs-KFwmU9/aztec-31337-482646216-0x20fea58404fff6234c9b31e06071e8d4fbeecc20/0-20250626183442-45c1696d-d994-40ec-8f74-c30904b8c0ff/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-KFwmU9/aztec-31337-482646216-0x20fea58404fff6234c9b31e06071e8d4fbeecc20/0-20250626183442-45c1696d-d994-40ec-8f74-c30904b8c0ff/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-KFwmU9/aztec-31337-482646216-0x20fea58404fff6234c9b31e06071e8d4fbeecc20/0-20250626183442-45c1696d-d994-40ec-8f74-c30904b8c0ff/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-KFwmU9/aztec-31337-482646216-0x20fea58404fff6234c9b31e06071e8d4fbeecc20/0-20250626183442-45c1696d-d994-40ec-8f74-c30904b8c0ff/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-KFwmU9/aztec-31337-482646216-0x20fea58404fff6234c9b31e06071e8d4fbeecc20/0-20250626183442-45c1696d-d994-40ec-8f74-c30904b8c0ff/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-KFwmU9/aztec-31337-482646216-0x20fea58404fff6234c9b31e06071e8d4fbeecc20/0-20250626183442-45c1696d-d994-40ec-8f74-c30904b8c0ff/l1-to-l2-message-tree.db"}}
18:34:59 [18:34:59.061]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Creating local file file store at /tmp/failed-proofs-KFwmU9/aztec-31337-482646216-0x20fea58404fff6234c9b31e06071e8d4fbeecc20/0-20250626183442-45c1696d-d994-40ec-8f74-c30904b8c0ff
18:34:59 [18:34:59.062]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Downloading snapshot to /tmp/rerun-data-1yTNNx/download-P3CzLT
{"snapshot":{"dataUrls":{"archiver":"file:///tmp/failed-proofs-KFwmU9/aztec-31337-482646216-0x20fea58404fff6234c9b31e06071e8d4fbeecc20/0-20250626183442-45c1696d-d994-40ec-8f74-c30904b8c0ff/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-KFwmU9/aztec-31337-482646216-0x20fea58404fff6234c9b31e06071e8d4fbeecc20/0-20250626183442-45c1696d-d994-40ec-8f74-c30904b8c0ff/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-KFwmU9/aztec-31337-482646216-0x20fea58404fff6234c9b31e06071e8d4fbeecc20/0-20250626183442-45c1696d-d994-40ec-8f74-c30904b8c0ff/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-KFwmU9/aztec-31337-482646216-0x20fea58404fff6234c9b31e06071e8d4fbeecc20/0-20250626183442-45c1696d-d994-40ec-8f74-c30904b8c0ff/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-KFwmU9/aztec-31337-482646216-0x20fea58404fff6234c9b31e06071e8d4fbeecc20/0-20250626183442-45c1696d-d994-40ec-8f74-c30904b8c0ff/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-KFwmU9/aztec-31337-482646216-0x20fea58404fff6234c9b31e06071e8d4fbeecc20/0-20250626183442-45c1696d-d994-40ec-8f74-c30904b8c0ff/l1-to-l2-message-tree.db"}},"downloadPaths":{"archiver":"/tmp/rerun-data-1yTNNx/download-P3CzLT/archiver.db","nullifier-tree":"/tmp/rerun-data-1yTNNx/download-P3CzLT/nullifier-tree.db","public-data-tree":"/tmp/rerun-data-1yTNNx/download-P3CzLT/public-data-tree.db","note-hash-tree":"/tmp/rerun-data-1yTNNx/download-P3CzLT/note-hash-tree.db","archive-tree":"/tmp/rerun-data-1yTNNx/download-P3CzLT/archive-tree.db","l1-to-l2-message-tree":"/tmp/rerun-data-1yTNNx/download-P3CzLT/l1-to-l2-message-tree.db"}}
18:34:59 [18:34:59.063]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Snapshot downloaded at /tmp/rerun-data-1yTNNx/download-P3CzLT
{"snapshot":{"dataUrls":{"archiver":"file:///tmp/failed-proofs-KFwmU9/aztec-31337-482646216-0x20fea58404fff6234c9b31e06071e8d4fbeecc20/0-20250626183442-45c1696d-d994-40ec-8f74-c30904b8c0ff/archiver.db","nullifier-tree":"file:///tmp/failed-proofs-KFwmU9/aztec-31337-482646216-0x20fea58404fff6234c9b31e06071e8d4fbeecc20/0-20250626183442-45c1696d-d994-40ec-8f74-c30904b8c0ff/nullifier-tree.db","public-data-tree":"file:///tmp/failed-proofs-KFwmU9/aztec-31337-482646216-0x20fea58404fff6234c9b31e06071e8d4fbeecc20/0-20250626183442-45c1696d-d994-40ec-8f74-c30904b8c0ff/public-data-tree.db","note-hash-tree":"file:///tmp/failed-proofs-KFwmU9/aztec-31337-482646216-0x20fea58404fff6234c9b31e06071e8d4fbeecc20/0-20250626183442-45c1696d-d994-40ec-8f74-c30904b8c0ff/note-hash-tree.db","archive-tree":"file:///tmp/failed-proofs-KFwmU9/aztec-31337-482646216-0x20fea58404fff6234c9b31e06071e8d4fbeecc20/0-20250626183442-45c1696d-d994-40ec-8f74-c30904b8c0ff/archive-tree.db","l1-to-l2-message-tree":"file:///tmp/failed-proofs-KFwmU9/aztec-31337-482646216-0x20fea58404fff6234c9b31e06071e8d4fbeecc20/0-20250626183442-45c1696d-d994-40ec-8f74-c30904b8c0ff/l1-to-l2-message-tree.db"}},"downloadPaths":{"archiver":"/tmp/rerun-data-1yTNNx/download-P3CzLT/archiver.db","nullifier-tree":"/tmp/rerun-data-1yTNNx/download-P3CzLT/nullifier-tree.db","public-data-tree":"/tmp/rerun-data-1yTNNx/download-P3CzLT/public-data-tree.db","note-hash-tree":"/tmp/rerun-data-1yTNNx/download-P3CzLT/note-hash-tree.db","archive-tree":"/tmp/rerun-data-1yTNNx/download-P3CzLT/archive-tree.db","l1-to-l2-message-tree":"/tmp/rerun-data-1yTNNx/download-P3CzLT/l1-to-l2-message-tree.db"}}
18:34:59 [18:34:59.068]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Archiver database set up from snapshot
{"path":"/tmp/rerun-data-1yTNNx/archiver","dbVersion":3,"rollupAddress":"0x20fea58404fff6234c9b31e06071e8d4fbeecc20"}
18:34:59 [18:34:59.068]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof World state database l1-to-l2-message-tree set up from snapshot
{"path":"/tmp/rerun-data-1yTNNx/world_state/L1ToL2MessageTree","dbVersion":2,"rollupAddress":"0x20fea58404fff6234c9b31e06071e8d4fbeecc20"}
18:34:59 [18:34:59.069]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof World state database archive-tree set up from snapshot
{"path":"/tmp/rerun-data-1yTNNx/world_state/ArchiveTree","dbVersion":2,"rollupAddress":"0x20fea58404fff6234c9b31e06071e8d4fbeecc20"}
18:34:59 [18:34:59.069]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof World state database public-data-tree set up from snapshot
{"path":"/tmp/rerun-data-1yTNNx/world_state/PublicDataTree","dbVersion":2,"rollupAddress":"0x20fea58404fff6234c9b31e06071e8d4fbeecc20"}
18:34:59 [18:34:59.069]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof World state database note-hash-tree set up from snapshot
{"path":"/tmp/rerun-data-1yTNNx/world_state/NoteHashTree","dbVersion":2,"rollupAddress":"0x20fea58404fff6234c9b31e06071e8d4fbeecc20"}
18:34:59 [18:34:59.070]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof World state database nullifier-tree set up from snapshot
{"path":"/tmp/rerun-data-1yTNNx/world_state/NullifierTree","dbVersion":2,"rollupAddress":"0x20fea58404fff6234c9b31e06071e8d4fbeecc20"}
18:34:59 [18:34:59.070]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof P2P database cleared
{"path":"/tmp/rerun-data-1yTNNx/p2p"}
18:34:59 [18:34:59.070]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Downloading epoch proving job data from file:///tmp/failed-proofs-KFwmU9/aztec-31337-482646216-0x20fea58404fff6234c9b31e06071e8d4fbeecc20/0-20250626183442-45c1696d-d994-40ec-8f74-c30904b8c0ff/data.bin to /tmp/rerun-download-ni8X96/data.bin
18:34:59 [18:34:59.071]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Epoch proving job data for epoch 0 downloaded successfully
18:34:59 [18:34:59.072]
WARN:
e2e:e2e_epochs:epochs_upload_failed_proof Rerunning proving job from /tmp/rerun-download-ni8X96/data.bin
18:34:59 [18:34:59.072]
VERBOSE:
e2e:e2e_epochs:epochs_upload_failed_proof Using native ACVM binary at ../../noir/noir-repo/target/release/acvm with working directory /tmp/847daced/acvm
18:34:59 [18:34:59.073]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Loaded proving job data for epoch 0
18:34:59 [18:34:59.075]
INFO:
world-state:database Creating world state data store at directory /tmp/rerun-data-1yTNNx/world_state with map sizes {"archiveTreeMapSizeKb":1048576,"nullifierTreeMapSizeKb":1048576,"noteHashTreeMapSizeKb":1048576,"messageTreeMapSizeKb":1048576,"publicDataTreeMapSizeKb":1048576} and 2 threads.
18:34:59 [18:34:59.085]
INFO:
archiver:lmdb Creating archiver data store at directory /tmp/rerun-data-1yTNNx/archiver with map size 1048576 KB (LMDB v2)
18:34:59 [18:34:59.086]
INFO:
archiver:lmdb Starting data store with maxReaders 16
18:34:59 [18:34:59.088]
WARN:
prover-client:proving-broker-database Found invalid epoch directory /tmp/rerun-data-1yTNNx/archiver when loading epoch databases, ignoring
18:34:59 [18:34:59.088]
WARN:
prover-client:proving-broker-database Found invalid epoch directory /tmp/rerun-data-1yTNNx/world_state when loading epoch databases, ignoring
18:34:59 [18:34:59.088]
INFO:
prover-client:proving-broker Proving Broker started
18:34:59 [18:34:59.089]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Rerunning epoch proving job for epoch 0
18:34:59 [18:34:59.089]
INFO:
prover-node:epoch-proving-job Starting epoch 0 proving job with blocks 1 to 2
{"fromBlock":1,"toBlock":2,"epochSizeBlocks":2,"epochNumber":0,"uuid":"2d777e0c-780f-4305-9eb2-b6384d9c56da"}
18:34:59 [18:34:59.103]
INFO:
prover-client:orchestrator Starting epoch 0 with 2 blocks
18:34:59 [18:34:59.103]
VERBOSE:
prover-client:broker-circuit-prover-facade Starting BrokerCircuitProverFacade
18:34:59 [18:34:59.105]
VERBOSE:
prover-node:epoch-proving-job Starting processing block 1
{"number":1,"blockHash":"0x23f9726a83c83b2e47531dee80c298cdf64b28ad90b3838692f1cb60e934b06c","lastArchive":"0x1f9c798be7975bb34c3e605a4c92c75796eae7b9a08644bc9a6a55354ed470be","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"2d777e0c-780f-4305-9eb2-b6384d9c56da","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x000000000000000000000000000000000000000000000000000000001cc498c8","blockNumber":1,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000002","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}}
18:34:59 [18:34:59.105]
INFO:
prover-client:orchestrator Starting block 1 for slot 2
18:34:59 [18:34:59.105]
VERBOSE:
prover-node:epoch-proving-job Starting processing block 2
{"number":2,"blockHash":"0x245cfe697202099bf997919ac526748b0248ffd1b662cb576a2a961f717bdd24","lastArchive":"0x20b16fa2f229976ca36dcdd4d36f8697095ca3956b2a3139e29d9123c9d30aeb","noteHashTreeRoot":"0x1fd848aa69e1633722fe249a5b7f53b094f1c9cef9f5c694b073fd1cc5850dfb","nullifierTreeRoot":"0x0c499b373a1f0fe1b510a63563546d2d39e206895056a5af0143c5f30d639073","publicDataTreeRoot":"0x23c08a6b1297210c5e24c76b9a936250a1ce2721576c26ea797c7ec35f9e46a9","previousHeader":{},"uuid":"2d777e0c-780f-4305-9eb2-b6384d9c56da","chainId":"0x0000000000000000000000000000000000000000000000000000000000007a69","version":"0x000000000000000000000000000000000000000000000000000000001cc498c8","blockNumber":2,"slotNumber":"0x0000000000000000000000000000000000000000000000000000000000000003","coinbase":"0xf39fd6e51aad88f6f4ce6ab8827279cfffb92266","feeRecipient":"0x0000000000000000000000000000000000000000000000000000000000000000","gasFees":{"feePerDaGas":0,"feePerL2Gas":551010}}
18:34:59 [18:34:59.106]
INFO:
prover-client:orchestrator Starting block 2 for slot 3
18:34:59 [18:34:59.113]
INFO:
prover-client:proving-broker New proving job id=0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e epochNumber=0
{"provingJobId":"0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e"}
18:34:59 [18:34:59.113]
VERBOSE:
prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e type=BASE_PARITY
{"provingJobId":"0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e","provingJobType":"BASE_PARITY"}
18:34:59 [18:34:59.114]
VERBOSE:
prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e type=BASE_PARITY
{"provingJobId":"0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e","provingJobType":"BASE_PARITY"}
18:34:59 [18:34:59.114]
VERBOSE:
prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e type=BASE_PARITY
{"provingJobId":"0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e","provingJobType":"BASE_PARITY"}
18:34:59 [18:34:59.117]
VERBOSE:
prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e type=BASE_PARITY
{"provingJobId":"0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e","provingJobType":"BASE_PARITY"}
18:34:59 [18:34:59.118]
VERBOSE:
prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e type=BASE_PARITY
{"provingJobId":"0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e","provingJobType":"BASE_PARITY"}
18:34:59 [18:34:59.118]
VERBOSE:
prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e type=BASE_PARITY
{"provingJobId":"0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e","provingJobType":"BASE_PARITY"}
18:34:59 [18:34:59.118]
VERBOSE:
prover-client:broker-circuit-prover-facade Job already found in facade id=0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e type=BASE_PARITY
{"provingJobId":"0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e","provingJobType":"BASE_PARITY"}
18:34:59 [18:34:59.119]
INFO:
simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.00001474400000006426s
{"duration":0.00001474400000006426,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0}
18:34:59 [18:34:59.119]
WARN:
prover-client:orchestrator Provided no txs to orchestrator addTxs.
18:34:59 [18:34:59.119]
VERBOSE:
prover-node:epoch-proving-job Processed all 0 txs for block 1
{"blockNumber":1,"blockHash":"0x23f9726a83c83b2e47531dee80c298cdf64b28ad90b3838692f1cb60e934b06c","uuid":"2d777e0c-780f-4305-9eb2-b6384d9c56da"}
18:34:59 [18:34:59.120]
VERBOSE:
prover-client:orchestrator Block 1 completed. Assembling header.
18:34:59 [18:34:59.124]
VERBOSE:
prover-client:orchestrator Updating archive tree with block 1 header 0x23f9726a83c83b2e47531dee80c298cdf64b28ad90b3838692f1cb60e934b06c
18:34:59 [18:34:59.126]
INFO:
simulator:public-processor Processed 0 successful txs and 0 failed txs in 0.00001482199999736622s
{"duration":0.00001482199999736622,"rate":0,"totalPublicGas":{"daGas":0,"l2Gas":0},"totalBlockGas":{"daGas":0,"l2Gas":0},"totalSizeInBytes":0}
18:34:59 [18:34:59.126]
WARN:
prover-client:orchestrator Provided no txs to orchestrator addTxs.
18:34:59 [18:34:59.126]
VERBOSE:
prover-node:epoch-proving-job Processed all 0 txs for block 2
{"blockNumber":2,"blockHash":"0x245cfe697202099bf997919ac526748b0248ffd1b662cb576a2a961f717bdd24","uuid":"2d777e0c-780f-4305-9eb2-b6384d9c56da"}
18:34:59 [18:34:59.127]
VERBOSE:
prover-client:orchestrator Block 2 completed. Assembling header.
18:34:59 [18:34:59.127]
VERBOSE:
prover-client:orchestrator Orchestrator finalised block 1
18:34:59 [18:34:59.139]
VERBOSE:
prover-client:orchestrator Updating archive tree with block 2 header 0x245cfe697202099bf997919ac526748b0248ffd1b662cb576a2a961f717bdd24
18:34:59 [18:34:59.141]
VERBOSE:
prover-client:orchestrator Orchestrator finalised block 2
18:34:59 [18:34:59.163]
INFO:
prover-client:proving-broker-database Creating broker database for epoch 0 at /tmp/rerun-data-1yTNNx/0 with map size 1048576
18:34:59 [18:34:59.164]
INFO:
kv-store:lmdb-v2 Starting data store with maxReaders 16
18:34:59 [18:34:59.166]
VERBOSE:
prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e type=BASE_PARITY epochNumber=0
{"provingJobId":"0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e","provingJobType":"BASE_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu...","status":"not-found","numOutstandingJobs":1}
18:34:59 [18:34:59.189]
INFO:
prover-client:proving-agent Starting job id=0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e type=BASE_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22inpu...
18:34:59 [18:34:59.190]
INFO:
prover-client:proving-agent:job-controller-034c5f19 Job controller started jobId=0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e
{"jobId":"0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e"}
18:34:59 [18:34:59.254]
INFO:
prover-client:proving-agent Job id=0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e type=BASE_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A10%2C%22resu...
18:34:59 [18:34:59.254]
INFO:
prover-client:proving-broker Proving job complete id=0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e type=BASE_PARITY totalAttempts=1
{"provingJobId":"0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e"}
18:35:00 [18:35:00.104]
VERBOSE:
prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1
18:35:00 [18:35:00.105]
VERBOSE:
prover-client:broker-circuit-prover-facade Resolved proving job id=0:BASE_PARITY:a9ecc159a164d7f8636efa1438fce27fa3a293dca4b51cfe7cdcbf292ad2f29e type=BASE_PARITY
18:35:00 [18:35:00.105]
VERBOSE:
prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0
18:35:00 [18:35:00.115]
INFO:
prover-client:proving-broker New proving job id=0:ROOT_PARITY:5c09dd94c7b7df0bce61a606cd22205167b9a4ab235ac8073ebb9ff827bb9e96 epochNumber=0
{"provingJobId":"0:ROOT_PARITY:5c09dd94c7b7df0bce61a606cd22205167b9a4ab235ac8073ebb9ff827bb9e96"}
18:35:00 [18:35:00.121]
VERBOSE:
prover-client:broker-circuit-prover-facade Job already found in facade id=0:ROOT_PARITY:5c09dd94c7b7df0bce61a606cd22205167b9a4ab235ac8073ebb9ff827bb9e96 type=ROOT_PARITY
{"provingJobId":"0:ROOT_PARITY:5c09dd94c7b7df0bce61a606cd22205167b9a4ab235ac8073ebb9ff827bb9e96","provingJobType":"ROOT_PARITY"}
18:35:00 [18:35:00.167]
VERBOSE:
prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_PARITY:5c09dd94c7b7df0bce61a606cd22205167b9a4ab235ac8073ebb9ff827bb9e96 type=ROOT_PARITY epochNumber=0
{"provingJobId":"0:ROOT_PARITY:5c09dd94c7b7df0bce61a606cd22205167b9a4ab235ac8073ebb9ff827bb9e96","provingJobType":"ROOT_PARITY","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A11%2C%22inpu...","status":"not-found","numOutstandingJobs":1}
18:35:00 [18:35:00.196]
INFO:
prover-client:proving-agent Starting job id=0:ROOT_PARITY:5c09dd94c7b7df0bce61a606cd22205167b9a4ab235ac8073ebb9ff827bb9e96 type=ROOT_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A11%2C%22inpu...
18:35:00 [18:35:00.213]
INFO:
prover-client:proving-agent:job-controller-faefc698 Job controller started jobId=0:ROOT_PARITY:5c09dd94c7b7df0bce61a606cd22205167b9a4ab235ac8073ebb9ff827bb9e96
{"jobId":"0:ROOT_PARITY:5c09dd94c7b7df0bce61a606cd22205167b9a4ab235ac8073ebb9ff827bb9e96"}
18:35:00 [18:35:00.314]
INFO:
prover-client:proving-agent Job id=0:ROOT_PARITY:5c09dd94c7b7df0bce61a606cd22205167b9a4ab235ac8073ebb9ff827bb9e96 type=ROOT_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A11%2C%22resu...
18:35:00 [18:35:00.314]
INFO:
prover-client:proving-broker Proving job complete id=0:ROOT_PARITY:5c09dd94c7b7df0bce61a606cd22205167b9a4ab235ac8073ebb9ff827bb9e96 type=ROOT_PARITY totalAttempts=1
{"provingJobId":"0:ROOT_PARITY:5c09dd94c7b7df0bce61a606cd22205167b9a4ab235ac8073ebb9ff827bb9e96"}
18:35:01 [18:35:01.106]
VERBOSE:
prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1
18:35:01 [18:35:01.107]
VERBOSE:
prover-client:broker-circuit-prover-facade Resolved proving job id=0:ROOT_PARITY:5c09dd94c7b7df0bce61a606cd22205167b9a4ab235ac8073ebb9ff827bb9e96 type=ROOT_PARITY
18:35:01 [18:35:01.107]
VERBOSE:
prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0
18:35:01 [18:35:01.119]
INFO:
prover-client:proving-broker New proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:48cef8ba40bed92709b0c5ea578b0c6f5717fd7ee8b5f4165bb0a120ab85fb89 epochNumber=0
{"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:48cef8ba40bed92709b0c5ea578b0c6f5717fd7ee8b5f4165bb0a120ab85fb89"}
18:35:01 [18:35:01.123]
INFO:
prover-client:proving-broker New proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:bbd2102c07b16c2eca92dee15a8c8a32ad0751c1e5dc71a57e5bbfdde50342a6 epochNumber=0
{"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:bbd2102c07b16c2eca92dee15a8c8a32ad0751c1e5dc71a57e5bbfdde50342a6"}
18:35:01 [18:35:01.170]
VERBOSE:
prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:EMPTY_BLOCK_ROOT_ROLLUP:48cef8ba40bed92709b0c5ea578b0c6f5717fd7ee8b5f4165bb0a120ab85fb89 type=EMPTY_BLOCK_ROOT_ROLLUP epochNumber=0
{"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:48cef8ba40bed92709b0c5ea578b0c6f5717fd7ee8b5f4165bb0a120ab85fb89","provingJobType":"EMPTY_BLOCK_ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input...","status":"not-found","numOutstandingJobs":2}
18:35:01 [18:35:01.171]
VERBOSE:
prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:EMPTY_BLOCK_ROOT_ROLLUP:bbd2102c07b16c2eca92dee15a8c8a32ad0751c1e5dc71a57e5bbfdde50342a6 type=EMPTY_BLOCK_ROOT_ROLLUP epochNumber=0
{"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:bbd2102c07b16c2eca92dee15a8c8a32ad0751c1e5dc71a57e5bbfdde50342a6","provingJobType":"EMPTY_BLOCK_ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input...","status":"not-found","numOutstandingJobs":2}
18:35:01 [18:35:01.251]
INFO:
prover-client:proving-agent Starting job id=0:EMPTY_BLOCK_ROOT_ROLLUP:48cef8ba40bed92709b0c5ea578b0c6f5717fd7ee8b5f4165bb0a120ab85fb89 type=EMPTY_BLOCK_ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input...
18:35:01 [18:35:01.259]
INFO:
prover-client:proving-agent:job-controller-cd41a1e8 Job controller started jobId=0:EMPTY_BLOCK_ROOT_ROLLUP:48cef8ba40bed92709b0c5ea578b0c6f5717fd7ee8b5f4165bb0a120ab85fb89
{"jobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:48cef8ba40bed92709b0c5ea578b0c6f5717fd7ee8b5f4165bb0a120ab85fb89"}
18:35:01 [18:35:01.288]
INFO:
prover-client:proving-agent Starting job id=0:EMPTY_BLOCK_ROOT_ROLLUP:bbd2102c07b16c2eca92dee15a8c8a32ad0751c1e5dc71a57e5bbfdde50342a6 type=EMPTY_BLOCK_ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22input...
18:35:01 [18:35:01.294]
INFO:
prover-client:proving-agent:job-controller-a9951e3e Job controller started jobId=0:EMPTY_BLOCK_ROOT_ROLLUP:bbd2102c07b16c2eca92dee15a8c8a32ad0751c1e5dc71a57e5bbfdde50342a6
{"jobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:bbd2102c07b16c2eca92dee15a8c8a32ad0751c1e5dc71a57e5bbfdde50342a6"}
18:35:02 [18:35:02.240]
INFO:
prover-client:proving-agent Job id=0:EMPTY_BLOCK_ROOT_ROLLUP:48cef8ba40bed92709b0c5ea578b0c6f5717fd7ee8b5f4165bb0a120ab85fb89 type=EMPTY_BLOCK_ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22resul...
18:35:02 [18:35:02.240]
INFO:
prover-client:proving-broker Proving job complete id=0:EMPTY_BLOCK_ROOT_ROLLUP:48cef8ba40bed92709b0c5ea578b0c6f5717fd7ee8b5f4165bb0a120ab85fb89 type=EMPTY_BLOCK_ROOT_ROLLUP totalAttempts=1
{"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:48cef8ba40bed92709b0c5ea578b0c6f5717fd7ee8b5f4165bb0a120ab85fb89"}
18:35:03 [18:35:03.111]
VERBOSE:
prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 2, total jobs ready: 1
18:35:03 [18:35:03.113]
VERBOSE:
prover-client:broker-circuit-prover-facade Resolved proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:48cef8ba40bed92709b0c5ea578b0c6f5717fd7ee8b5f4165bb0a120ab85fb89 type=EMPTY_BLOCK_ROOT_ROLLUP
18:35:03 [18:35:03.113]
VERBOSE:
prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0
18:35:04 [18:35:04.522]
INFO:
prover-client:proving-agent Job id=0:EMPTY_BLOCK_ROOT_ROLLUP:bbd2102c07b16c2eca92dee15a8c8a32ad0751c1e5dc71a57e5bbfdde50342a6 type=EMPTY_BLOCK_ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A4%2C%22resul...
18:35:04 [18:35:04.523]
INFO:
prover-client:proving-broker Proving job complete id=0:EMPTY_BLOCK_ROOT_ROLLUP:bbd2102c07b16c2eca92dee15a8c8a32ad0751c1e5dc71a57e5bbfdde50342a6 type=EMPTY_BLOCK_ROOT_ROLLUP totalAttempts=1
{"provingJobId":"0:EMPTY_BLOCK_ROOT_ROLLUP:bbd2102c07b16c2eca92dee15a8c8a32ad0751c1e5dc71a57e5bbfdde50342a6"}
18:35:05 [18:35:05.115]
VERBOSE:
prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1
18:35:05 [18:35:05.117]
VERBOSE:
prover-client:broker-circuit-prover-facade Resolved proving job id=0:EMPTY_BLOCK_ROOT_ROLLUP:bbd2102c07b16c2eca92dee15a8c8a32ad0751c1e5dc71a57e5bbfdde50342a6 type=EMPTY_BLOCK_ROOT_ROLLUP
18:35:05 [18:35:05.117]
VERBOSE:
prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0
18:35:05 [18:35:05.126]
INFO:
prover-client:proving-broker New proving job id=0:ROOT_ROLLUP:5818475fdbba19436dcb5300390673673d360cb5e187935470ab6658214c14b5 epochNumber=0
{"provingJobId":"0:ROOT_ROLLUP:5818475fdbba19436dcb5300390673673d360cb5e187935470ab6658214c14b5"}
18:35:05 [18:35:05.178]
VERBOSE:
prover-client:broker-circuit-prover-facade Job enqueued with broker id=0:ROOT_ROLLUP:5818475fdbba19436dcb5300390673673d360cb5e187935470ab6658214c14b5 type=ROOT_ROLLUP epochNumber=0
{"provingJobId":"0:ROOT_ROLLUP:5818475fdbba19436dcb5300390673673d360cb5e187935470ab6658214c14b5","provingJobType":"ROOT_ROLLUP","epochNumber":0,"inputsUri":"data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...","status":"not-found","numOutstandingJobs":1}
18:35:05 [18:35:05.229]
INFO:
prover-client:proving-agent Starting job id=0:ROOT_ROLLUP:5818475fdbba19436dcb5300390673673d360cb5e187935470ab6658214c14b5 type=ROOT_ROLLUP inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...
18:35:05 [18:35:05.241]
INFO:
prover-client:proving-agent:job-controller-63e1a461 Job controller started jobId=0:ROOT_ROLLUP:5818475fdbba19436dcb5300390673673d360cb5e187935470ab6658214c14b5
{"jobId":"0:ROOT_ROLLUP:5818475fdbba19436dcb5300390673673d360cb5e187935470ab6658214c14b5"}
18:35:05 [18:35:05.335]
INFO:
prover-client:proving-agent Job id=0:ROOT_ROLLUP:5818475fdbba19436dcb5300390673673d360cb5e187935470ab6658214c14b5 type=ROOT_ROLLUP completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22resul...
18:35:05 [18:35:05.335]
INFO:
prover-client:proving-broker Proving job complete id=0:ROOT_ROLLUP:5818475fdbba19436dcb5300390673673d360cb5e187935470ab6658214c14b5 type=ROOT_ROLLUP totalAttempts=1
{"provingJobId":"0:ROOT_ROLLUP:5818475fdbba19436dcb5300390673673d360cb5e187935470ab6658214c14b5"}
18:35:06 [18:35:06.117]
VERBOSE:
prover-client:broker-circuit-prover-facade Check for job completion notifications returned 1 job(s), snapshot ids length: 0, num outstanding jobs: 1, total jobs ready: 1
18:35:06 [18:35:06.118]
VERBOSE:
prover-client:broker-circuit-prover-facade Resolved proving job id=0:ROOT_ROLLUP:5818475fdbba19436dcb5300390673673d360cb5e187935470ab6658214c14b5 type=ROOT_ROLLUP
18:35:06 [18:35:06.119]
VERBOSE:
prover-client:broker-circuit-prover-facade Successfully retrieved 1 of 1 jobs that should be ready, total ready jobs is now: 0
18:35:06 [18:35:06.119]
VERBOSE:
prover-client:orchestrator Orchestrator completed root rollup for epoch 0
18:35:06 [18:35:06.121]
INFO:
prover-node:epoch-proving-job Finalised proof for epoch 0
{"epochNumber":0,"uuid":"2d777e0c-780f-4305-9eb2-b6384d9c56da","duration":7032.039670999999}
18:35:06 [18:35:06.121]
INFO:
prover-node:epoch-proving-job Submitted proof for epoch 0 (blocks 1 to 2)
{"epochNumber":0,"uuid":"2d777e0c-780f-4305-9eb2-b6384d9c56da"}
18:35:06 [18:35:06.122]
VERBOSE:
prover-client:broker-circuit-prover-facade Stopping BrokerCircuitProverFacade
18:35:06 [18:35:06.122]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Completed job for epoch 0 with status completed
18:35:06 [18:35:06.122]
INFO:
e2e:e2e_epochs:epochs_upload_failed_proof Test succeeded
18:35:06 [18:35:06.122]
INFO:
prover-node:prover-node Stopping ProverNode
18:35:06 [18:35:06.123]
WARN:
prover-node:prover-node Running promise was not started
18:35:06 [18:35:06.123]
WARN:
prover-node:epoch-monitor:prover-node Running promise was not started
18:35:06 [18:35:06.123]
INFO:
prover-node:epoch-monitor:prover-node Stopped EpochMonitor
18:35:06 [18:35:06.123]
WARN:
archiver:prover-node Running promise was not started
18:35:06 [18:35:06.123]
INFO:
archiver:prover-node Stopped.
18:35:06 [18:35:06.123]
WARN:
world-state:block_stream:prover-node Running promise was not started
18:35:06 [18:35:06.123]
INFO:
world_state:prover-node Stopped world state synchronizer
18:35:06 [18:35:06.123]
INFO:
prover-node:prover-node Stopped ProverNode
18:35:06 [18:35:06.124]
INFO:
node:MAIN-aztec-node Stopping Aztec Node
18:35:08 [18:35:08.124]
INFO:
slasher Slasher client stopped.
18:35:08 [18:35:08.124]
WARN:
validator Running promise was not started
18:35:08 [18:35:08.125]
WARN:
sequencer Running promise was not started
18:35:08 [18:35:08.125]
INFO:
sequencer Stopped sequencer
18:35:08 [18:35:08.125]
WARN:
p2p:l2-block-stream Running promise was not started
18:35:08 [18:35:08.125]
INFO:
p2p P2P client stopped
18:35:08 [18:35:08.125]
WARN:
world-state:block_stream Running promise was not started
18:35:08 [18:35:08.125]
INFO:
world_state Stopped world state synchronizer
18:35:08 [18:35:08.125]
WARN:
archiver Running promise was not started
18:35:08 [18:35:08.125]
INFO:
archiver Stopped.
18:35:08 [18:35:08.126]
INFO:
node:MAIN-aztec-node Stopped Aztec Node
18:35:08 [18:35:08.126]
INFO:
node:MAIN-aztec-node Stopping Aztec Node
18:35:10 [18:35:10.126]
INFO:
slasher Slasher client stopped.
18:35:10 [18:35:10.127]
WARN:
validator Running promise was not started
18:35:10 [18:35:10.127]
WARN:
sequencer Running promise was not started
18:35:10 [18:35:10.127]
INFO:
sequencer Stopped sequencer
18:35:10 [18:35:10.127]
WARN:
p2p:l2-block-stream Running promise was not started
18:35:10 [18:35:10.127]
INFO:
p2p P2P client stopped
18:35:10 [18:35:10.127]
WARN:
world-state:block_stream Running promise was not started
18:35:10 [18:35:10.128]
INFO:
world_state Stopped world state synchronizer
18:35:10 [18:35:10.128]
WARN:
archiver Running promise was not started
18:35:10 [18:35:10.128]
INFO:
archiver Stopped.
18:35:10 [18:35:10.128]
INFO:
node:MAIN-aztec-node Stopped Aztec Node
18:35:10 [18:35:10.128]
INFO:
prover-node:prover-node Stopping ProverNode
18:35:10 [18:35:10.128]
WARN:
prover-node:prover-node Running promise was not started
18:35:10 [18:35:10.128]
WARN:
prover-node:epoch-monitor:prover-node Running promise was not started
18:35:10 [18:35:10.128]
INFO:
prover-node:epoch-monitor:prover-node Stopped EpochMonitor
18:35:10 [18:35:10.128]
WARN:
archiver:prover-node Running promise was not started
18:35:10 [18:35:10.129]
INFO:
archiver:prover-node Stopped.
18:35:10 [18:35:10.129]
WARN:
world-state:block_stream:prover-node Running promise was not started
18:35:10 [18:35:10.129]
INFO:
world_state:prover-node Stopped world state synchronizer
18:35:10 [18:35:10.129]
INFO:
prover-node:prover-node Stopped ProverNode
18:35:10 [18:35:10.130]
INFO:
blob-sink:server Stopping blob sink
18:35:10 [18:35:10.130]
INFO:
blob-sink:server Blob sink already stopped
18:35:10
PASS src/e2e_epochs/epochs_upload_failed_proof.test.ts
18:35:10 e2e_epochs/epochs_upload_failed_proof
18:35:10
✓ uploads failed proving job state and re-runs it on a fresh instance (54018 ms)
18:35:10
18:35:10
Test Suites: 1 passed, 1 total
18:35:10
Tests: 1 passed, 1 total
18:35:10
Snapshots: 0 total
18:35:10
Time: 59.085 s
18:35:10
Ran all test suites matching src/e2e_epochs/epochs_upload_failed_proof.test.ts
.
18:35:10
Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?