Parent Log: http://ci.aztec-labs.com/9870e60b8d8e503f Command: 70462c95d683706b:ISOLATE=1:NAME=prover-node/src/job/epoch-proving-job.test.ts yarn-project/scripts/run_test.sh prover-node/src/job/epoch-proving-job.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/fa159c5d52a45358479f951a547fed37f141a6ed Env: REF_NAME=gh-readonly-queue/next/pr-15054-184d5f7d956dd7251670a2dd6728f313cfdf3caf CURRENT_VERSION=0.87.6 CI_FULL=1 Date: Fri Jun 13 22:34:03 UTC 2025 System: ARCH=amd64 CPUS=128 MEM=493Gi HOSTNAME=pr-15054_amd64_x4-full Resources: CPU_LIST=0-127 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_4ec0c4254cabba91_next 22:34:03 +++ id -u 22:34:03 +++ id -g 22:34:03 ++ docker run -d --name prover-node_src_job_epoch-proving-job.test.ts --net=none --cpuset-cpus=0-127 --cpus=2 --memory=8g --user 1000:1000 -v/home/aztec-dev:/home/aztec-dev --mount type=tmpfs,target=/tmp,tmpfs-size=1g --workdir /home/aztec-dev/aztec-packages -e HOME -e VERBOSE -e GIT_CONFIG_GLOBAL=/home/aztec-dev/aztec-packages/build-images/src/home/.gitconfig -e FORCE_COLOR=true -e CPUS -e MEM aztecprotocol/build:3.0 /bin/bash -c 'timeout -v 600s bash -c '\''yarn-project/scripts/run_test.sh prover-node/src/job/epoch-proving-job.test.ts'\''' 22:34:03 + cid=b64001a0dd4307b780a0cf91fffc6339dea20ffca75b20726eb6b1c9b4a7e31a 22:34:03 + set +x 22:34:07 [22:34:07.988] INFO: prover-node:epoch-proving-job Starting epoch 1 proving job with blocks 1 to 3 {"fromBlock":1,"toBlock":3,"epochSizeBlocks":3,"epochNumber":1,"uuid":"35435f05-77d5-4a10-b4d6-cdf6fb75a1d4"} 22:34:09 [22:34:09.156] INFO: prover-node:epoch-proving-job Finalised proof for epoch 1 {"epochNumber":1,"uuid":"35435f05-77d5-4a10-b4d6-cdf6fb75a1d4","duration":1161.6892399999997} 22:34:09 [22:34:09.157] INFO: prover-node:epoch-proving-job Submitted proof for epoch 1 (blocks 1 to 3) {"epochNumber":1,"uuid":"35435f05-77d5-4a10-b4d6-cdf6fb75a1d4"} 22:34:09 [22:34:09.299] INFO: prover-node:epoch-proving-job Starting epoch 1 proving job with blocks 1 to 3 {"fromBlock":1,"toBlock":3,"epochSizeBlocks":3,"epochNumber":1,"uuid":"29ccdb38-ebf0-4c9f-a0d1-e1c7e74dda32"} 22:34:10 [22:34:10.488] ERROR: prover-node:epoch-proving-job Error running epoch 1 prover job: Error: Txs failed processing: 0x07d961a5d3f3b0b4180d0e7f2963e8e8cea610b6098aca1ad944e3de79931cbf (Error: Failed to process tx), 0x1a2ff3b628a6c347d4d356f7df2ba5728cf57ae38713d478787e986c2623225a (Error: Failed to process tx) 22:34:10 at EpochProvingJob.processTxs (/home/aztec-dev/aztec-packages/yarn-project/prover-node/src/job/epoch-proving-job.ts:320:13) 22:34:10 at /home/aztec-dev/aztec-packages/yarn-project/prover-node/src/job/epoch-proving-job.ts:151:27 {"uuid":"29ccdb38-ebf0-4c9f-a0d1-e1c7e74dda32","epochNumber":1} 22:34:10 [22:34:10.656] INFO: prover-node:epoch-proving-job Starting epoch 1 proving job with blocks 1 to 3 {"fromBlock":1,"toBlock":3,"epochSizeBlocks":3,"epochNumber":1,"uuid":"93c14cf0-e550-47a1-b2cb-cd28366838fb"} 22:34:11 [22:34:11.904] ERROR: prover-node:epoch-proving-job Error running epoch 1 prover job: Error: Failed to process all txs: processed 0 out of 2 22:34:11 at EpochProvingJob.processTxs (/home/aztec-dev/aztec-packages/yarn-project/prover-node/src/job/epoch-proving-job.ts:328:13) 22:34:11 at runNextTicks (node:internal/process/task_queues:65:5) 22:34:11 at listOnTimeout (node:internal/timers:549:9) 22:34:11 at processTimers (node:internal/timers:523:7) 22:34:11 at /home/aztec-dev/aztec-packages/yarn-project/prover-node/src/job/epoch-proving-job.ts:151:27 {"uuid":"93c14cf0-e550-47a1-b2cb-cd28366838fb","epochNumber":1} 22:34:12 [22:34:12.031] INFO: prover-node:epoch-proving-job Starting epoch 1 proving job with blocks 1 to 3 {"fromBlock":1,"toBlock":3,"epochSizeBlocks":3,"epochNumber":1,"uuid":"c3233ee2-e56e-4e5b-9870-50741964f769"} 22:34:13 [22:34:13.162] WARN: prover-node:epoch-proving-job Stopping job due to deadline hit {"uuid":"c3233ee2-e56e-4e5b-9870-50741964f769","epochNumber":1} 22:34:13 [22:34:13.360] WARN: prover-node:epoch-proving-job Halted execution of epoch 1 prover job {"uuid":"c3233ee2-e56e-4e5b-9870-50741964f769","epochNumber":1,"details":"Halted execution due to state timed-out"} 22:34:13 [22:34:13.504] INFO: prover-node:epoch-proving-job Starting epoch 1 proving job with blocks 1 to 3 {"fromBlock":1,"toBlock":3,"epochSizeBlocks":3,"epochNumber":1,"uuid":"ecaf4f9d-7f6c-4643-a467-49e8785320d1"} 22:34:14 [22:34:14.659] WARN: prover-node:epoch-proving-job Halted execution of epoch 1 prover job {"uuid":"ecaf4f9d-7f6c-4643-a467-49e8785320d1","epochNumber":1,"details":"Halted execution due to state stopped"} 22:34:14 [22:34:14.998] INFO: prover-node:epoch-proving-job Starting epoch 1 proving job with blocks 1 to 3 {"fromBlock":1,"toBlock":3,"epochSizeBlocks":3,"epochNumber":1,"uuid":"de4bbc57-2a19-4a61-a501-70224714a9c2"} 22:34:15 [22:34:15.553] WARN: prover-node:epoch-proving-job Epoch blocks changed underfoot {"uuid":"de4bbc57-2a19-4a61-a501-70224714a9c2","epochNumber":1,"oldBlockHashes":["0x1b34b8a5e0be24f9232544a30fbe0cc0eb1f40adb6aa920ab7d1958c80af6a6c","0x2e60a67b4f96054b2c8daaeb586f90d327748661a8b0255e00e462f9dc23e64c","0x19f8a69c79364893687a73b381f73ffdc7ea63f571ffb7b4cfa72dd1999b6e8c"],"newBlockHashes":["0x1b34b8a5e0be24f9232544a30fbe0cc0eb1f40adb6aa920ab7d1958c80af6a6c","0x2e60a67b4f96054b2c8daaeb586f90d327748661a8b0255e00e462f9dc23e64c","0x19f8a69c79364893687a73b381f73ffdc7ea63f571ffb7b4cfa72dd1999b6e8c","0x02908c8182d086d307ef894106f39df83cf7a7d74b03adeeca674369b53129a5"]} 22:34:16 [22:34:16.007] WARN: prover-node:epoch-proving-job Halted execution of epoch 1 prover job {"uuid":"de4bbc57-2a19-4a61-a501-70224714a9c2","epochNumber":1,"details":"Halted execution due to state reorg"} 22:34:16 PASS src/job/epoch-proving-job.test.ts (11.095 s) 22:34:16 epoch-proving-job 22:34:16 ✓ works (1685 ms) 22:34:16 ✓ fails if fails to process txs for a block (1330 ms) 22:34:16 ✓ fails if does not process all txs for a block (1412 ms) 22:34:16 ✓ times out if deadline is hit (1455 ms) 22:34:16 ✓ halts if stopped externally (1299 ms) 22:34:16 ✓ halts if a new block for the epoch is found (1347 ms) 22:34:16 22:34:16 Test Suites: 1 passed, 1 total 22:34:16 Tests: 6 passed, 6 total 22:34:16 Snapshots: 0 total 22:34:16 Time: 11.175 s 22:34:16 Ran all test suites matching /prover-node\/src\/job\/epoch-proving-job.test.ts/i. 22:34:16 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?