Parent Log: http://ci.aztec-labs.com/d700f1f37339a11a Command: be792e9a8a7f847e:ISOLATE=1:NAME=prover-node/src/job/epoch-proving-job.test.ts yarn-project/scripts/run_test.sh prover-node/src/job/epoch-proving-job.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/a8c553f203c98e5ca274e763c8e51daaaaf760d6 Env: REF_NAME=gh-readonly-queue/next/pr-15017-30660269b33bab8cca354c41659533acf4d48e07 CURRENT_VERSION=0.87.6 CI_FULL=1 Date: Fri Jun 13 09:37:36 UTC 2025 System: ARCH=amd64 CPUS=128 MEM=493Gi HOSTNAME=pr-15017_amd64_x1-full Resources: CPU_LIST=0-127 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_4ec0c4254cabba91_next 09:37:36 +++ id -u 09:37:36 +++ id -g 09:37:36 ++ docker run -d --name prover-node_src_job_epoch-proving-job.test.ts --net=none --cpuset-cpus=0-127 --cpus=2 --memory=8g --user 1000:1000 -v/home/aztec-dev:/home/aztec-dev --mount type=tmpfs,target=/tmp,tmpfs-size=1g --workdir /home/aztec-dev/aztec-packages -e HOME -e VERBOSE -e GIT_CONFIG_GLOBAL=/home/aztec-dev/aztec-packages/build-images/src/home/.gitconfig -e FORCE_COLOR=true -e CPUS -e MEM aztecprotocol/build:3.0 /bin/bash -c 'timeout -v 600s bash -c '\''yarn-project/scripts/run_test.sh prover-node/src/job/epoch-proving-job.test.ts'\''' 09:37:37 + cid=87a3f2eaf89ec4b559deb8f4458285f6473c5a686482a8322e611b22837384c7 09:37:37 + set +x 09:37:41 [09:37:41.422] INFO: prover-node:epoch-proving-job Starting epoch 1 proving job with blocks 1 to 3 {"fromBlock":1,"toBlock":3,"epochSizeBlocks":3,"epochNumber":1,"uuid":"d367a2c3-34b5-4bfb-bd12-c1fbcb8a3835"} 09:37:42 [09:37:42.658] INFO: prover-node:epoch-proving-job Finalised proof for epoch 1 {"epochNumber":1,"uuid":"d367a2c3-34b5-4bfb-bd12-c1fbcb8a3835","duration":1228.301519} 09:37:42 [09:37:42.660] INFO: prover-node:epoch-proving-job Submitted proof for epoch 1 (blocks 1 to 3) {"epochNumber":1,"uuid":"d367a2c3-34b5-4bfb-bd12-c1fbcb8a3835"} 09:37:42 [09:37:42.820] INFO: prover-node:epoch-proving-job Starting epoch 1 proving job with blocks 1 to 3 {"fromBlock":1,"toBlock":3,"epochSizeBlocks":3,"epochNumber":1,"uuid":"b2219035-109b-4ed4-83d6-a53d9f94e1aa"} 09:37:44 [09:37:44.067] ERROR: prover-node:epoch-proving-job Error running epoch 1 prover job: Error: Txs failed processing: 0x1b0bda5f9e6f23ab4d31131db0e315927af29bc2cc982929c2baf9496f19e080 (Error: Failed to process tx), 0x27c24ff8c6ac472943bbfc199d136243d6d3569a7517c72f1c65024226ae9f3a (Error: Failed to process tx) 09:37:44 at EpochProvingJob.processTxs (/home/aztec-dev/aztec-packages/yarn-project/prover-node/src/job/epoch-proving-job.ts:320:13) 09:37:44 at runNextTicks (node:internal/process/task_queues:65:5) 09:37:44 at listOnTimeout (node:internal/timers:549:9) 09:37:44 at processTimers (node:internal/timers:523:7) 09:37:44 at /home/aztec-dev/aztec-packages/yarn-project/prover-node/src/job/epoch-proving-job.ts:151:27 {"uuid":"b2219035-109b-4ed4-83d6-a53d9f94e1aa","epochNumber":1} 09:37:44 [09:37:44.217] INFO: prover-node:epoch-proving-job Starting epoch 1 proving job with blocks 1 to 3 {"fromBlock":1,"toBlock":3,"epochSizeBlocks":3,"epochNumber":1,"uuid":"c30b9494-2bcb-4104-bdf0-e6cc3596416e"} 09:37:45 [09:37:45.468] ERROR: prover-node:epoch-proving-job Error running epoch 1 prover job: Error: Failed to process all txs: processed 0 out of 2 09:37:45 at EpochProvingJob.processTxs (/home/aztec-dev/aztec-packages/yarn-project/prover-node/src/job/epoch-proving-job.ts:328:13) 09:37:45 at /home/aztec-dev/aztec-packages/yarn-project/prover-node/src/job/epoch-proving-job.ts:151:27 {"uuid":"c30b9494-2bcb-4104-bdf0-e6cc3596416e","epochNumber":1} 09:37:45 [09:37:45.634] INFO: prover-node:epoch-proving-job Starting epoch 1 proving job with blocks 1 to 3 {"fromBlock":1,"toBlock":3,"epochSizeBlocks":3,"epochNumber":1,"uuid":"756567c6-33f0-4fb1-9b43-e5f25a56187a"} 09:37:46 [09:37:46.655] WARN: prover-node:epoch-proving-job Stopping job due to deadline hit {"uuid":"756567c6-33f0-4fb1-9b43-e5f25a56187a","epochNumber":1} 09:37:46 [09:37:46.853] WARN: prover-node:epoch-proving-job Halted execution of epoch 1 prover job {"uuid":"756567c6-33f0-4fb1-9b43-e5f25a56187a","epochNumber":1,"details":"Halted execution due to state timed-out"} 09:37:47 [09:37:47.005] INFO: prover-node:epoch-proving-job Starting epoch 1 proving job with blocks 1 to 3 {"fromBlock":1,"toBlock":3,"epochSizeBlocks":3,"epochNumber":1,"uuid":"b72ad52f-5a09-4418-9210-da2bd286e4bd"} 09:37:48 [09:37:48.188] WARN: prover-node:epoch-proving-job Halted execution of epoch 1 prover job {"uuid":"b72ad52f-5a09-4418-9210-da2bd286e4bd","epochNumber":1,"details":"Halted execution due to state stopped"} 09:37:48 [09:37:48.545] INFO: prover-node:epoch-proving-job Starting epoch 1 proving job with blocks 1 to 3 {"fromBlock":1,"toBlock":3,"epochSizeBlocks":3,"epochNumber":1,"uuid":"ff116195-0446-4d1d-840d-1b66bea2583e"} 09:37:49 [09:37:49.052] WARN: prover-node:epoch-proving-job Epoch blocks changed underfoot {"uuid":"ff116195-0446-4d1d-840d-1b66bea2583e","epochNumber":1,"oldBlockHashes":["0x1b34b8a5e0be24f9232544a30fbe0cc0eb1f40adb6aa920ab7d1958c80af6a6c","0x2e60a67b4f96054b2c8daaeb586f90d327748661a8b0255e00e462f9dc23e64c","0x19f8a69c79364893687a73b381f73ffdc7ea63f571ffb7b4cfa72dd1999b6e8c"],"newBlockHashes":["0x1b34b8a5e0be24f9232544a30fbe0cc0eb1f40adb6aa920ab7d1958c80af6a6c","0x2e60a67b4f96054b2c8daaeb586f90d327748661a8b0255e00e462f9dc23e64c","0x19f8a69c79364893687a73b381f73ffdc7ea63f571ffb7b4cfa72dd1999b6e8c","0x02908c8182d086d307ef894106f39df83cf7a7d74b03adeeca674369b53129a5"]} 09:37:49 [09:37:49.444] WARN: prover-node:epoch-proving-job Halted execution of epoch 1 prover job {"uuid":"ff116195-0446-4d1d-840d-1b66bea2583e","epochNumber":1,"details":"Halted execution due to state reorg"} 09:37:49 PASS src/job/epoch-proving-job.test.ts (11.08 s) 09:37:49 epoch-proving-job 09:37:49 ✓ works (1833 ms) 09:37:49 ✓ fails if fails to process txs for a block (1400 ms) 09:37:49 ✓ fails if does not process all txs for a block (1401 ms) 09:37:49 ✓ times out if deadline is hit (1384 ms) 09:37:49 ✓ halts if stopped externally (1335 ms) 09:37:49 ✓ halts if a new block for the epoch is found (1254 ms) 09:37:49 09:37:49 Test Suites: 1 passed, 1 total 09:37:49 Tests: 6 passed, 6 total 09:37:49 Snapshots: 0 total 09:37:49 Time: 11.189 s 09:37:49 Ran all test suites matching /prover-node\/src\/job\/epoch-proving-job.test.ts/i. 09:37:49 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?