Parent Log: http://ci.aztec-labs.com/1ac26e0b3daa6110 Command: 59d7caa3bc5b3609:ISOLATE=1:NAME=prover-node/src/job/epoch-proving-job.test.ts yarn-project/scripts/run_test.sh prover-node/src/job/epoch-proving-job.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/dada14e07a974e905ef606b4fac7c777b922587f Env: REF_NAME=gh-readonly-queue/master/pr-14898-260a6c8dbe7557aae065d685de66faa2bc362a9d CURRENT_VERSION=0.87.8 CI_FULL=1 Date: Wed Jun 11 19:34:13 UTC 2025 System: ARCH=amd64 CPUS=128 MEM=493Gi HOSTNAME=pr-14898_amd64_x2-full Resources: CPU_LIST=0-127 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_4ec0c4254cabba91_master 19:34:13 +++ id -u 19:34:13 +++ id -g 19:34:13 ++ docker run -d --name prover-node_src_job_epoch-proving-job.test.ts --net=none --cpuset-cpus=0-127 --cpus=2 --memory=8g --user 1000:1000 -v/home/aztec-dev:/home/aztec-dev --mount type=tmpfs,target=/tmp,tmpfs-size=1g --workdir /home/aztec-dev/aztec-packages -e HOME -e VERBOSE -e GIT_CONFIG_GLOBAL=/home/aztec-dev/aztec-packages/build-images/src/home/.gitconfig -e FORCE_COLOR=true -e CPUS -e MEM aztecprotocol/build:3.0 /bin/bash -c 'timeout -v 600s bash -c '\''yarn-project/scripts/run_test.sh prover-node/src/job/epoch-proving-job.test.ts'\''' 19:34:13 + cid=7c04e350b52cdef1b97f6713a02e0fd9f63adf730d69eb9c021c4cce8bbc1059 19:34:13 + set +x 19:34:17 [19:34:17.012] INFO: prover-node:epoch-proving-job Starting epoch 1 proving job with blocks 1 to 3 {"fromBlock":1,"toBlock":3,"epochSizeBlocks":3,"epochNumber":1,"uuid":"ca07d3be-008c-47d8-80a4-b41e5caa6d3b"} 19:34:17 [19:34:17.246] INFO: prover-node:epoch-proving-job Finalised proof for epoch 1 {"epochNumber":1,"uuid":"ca07d3be-008c-47d8-80a4-b41e5caa6d3b","duration":229.85824000000002} 19:34:17 [19:34:17.248] INFO: prover-node:epoch-proving-job Submitted proof for epoch 1 (blocks 1 to 3) {"epochNumber":1,"uuid":"ca07d3be-008c-47d8-80a4-b41e5caa6d3b"} 19:34:17 [19:34:17.377] INFO: prover-node:epoch-proving-job Starting epoch 1 proving job with blocks 1 to 3 {"fromBlock":1,"toBlock":3,"epochSizeBlocks":3,"epochNumber":1,"uuid":"7589431c-4f82-4e6f-a6e3-bb3358ace73e"} 19:34:17 [19:34:17.594] ERROR: prover-node:epoch-proving-job Error running epoch 1 prover job: Error: Txs failed processing: 0x0a93a098c2e4341f523e063c5f3b3c75743928a592f7eddc10393d6f5225164c (Error: Failed to process tx), 0x06f275414d48fb7a85d5a16e717db86b10280c8330eca165e04c901ddf88a4cc (Error: Failed to process tx) 19:34:17 at EpochProvingJob.processTxs (/home/aztec-dev/aztec-packages/yarn-project/prover-node/src/job/epoch-proving-job.ts:307:13) 19:34:17 at runNextTicks (node:internal/process/task_queues:65:5) 19:34:17 at listOnTimeout (node:internal/timers:549:9) 19:34:17 at processTimers (node:internal/timers:523:7) 19:34:17 at /home/aztec-dev/aztec-packages/yarn-project/prover-node/src/job/epoch-proving-job.ts:145:27 {"uuid":"7589431c-4f82-4e6f-a6e3-bb3358ace73e","epochNumber":1} 19:34:17 [19:34:17.710] INFO: prover-node:epoch-proving-job Starting epoch 1 proving job with blocks 1 to 3 {"fromBlock":1,"toBlock":3,"epochSizeBlocks":3,"epochNumber":1,"uuid":"96b6ad32-a7c9-4e98-84a0-f4bd3d5010fc"} 19:34:17 [19:34:17.915] ERROR: prover-node:epoch-proving-job Error running epoch 1 prover job: Error: Failed to process all txs: processed 0 out of 2 19:34:17 at EpochProvingJob.processTxs (/home/aztec-dev/aztec-packages/yarn-project/prover-node/src/job/epoch-proving-job.ts:315:13) 19:34:17 at /home/aztec-dev/aztec-packages/yarn-project/prover-node/src/job/epoch-proving-job.ts:145:27 {"uuid":"96b6ad32-a7c9-4e98-84a0-f4bd3d5010fc","epochNumber":1} 19:34:18 [19:34:18.019] INFO: prover-node:epoch-proving-job Starting epoch 1 proving job with blocks 1 to 3 {"fromBlock":1,"toBlock":3,"epochSizeBlocks":3,"epochNumber":1,"uuid":"95022cb2-b88b-4d3e-8bd0-415e57e47824"} 19:34:18 [19:34:18.120] WARN: prover-node:epoch-proving-job Stopping job due to deadline hit {"uuid":"95022cb2-b88b-4d3e-8bd0-415e57e47824","epochNumber":1} 19:34:18 [19:34:18.228] WARN: prover-node:epoch-proving-job Halted execution of epoch 1 prover job {"uuid":"95022cb2-b88b-4d3e-8bd0-415e57e47824","epochNumber":1,"details":"Halted execution due to state timed-out"} 19:34:18 [19:34:18.345] INFO: prover-node:epoch-proving-job Starting epoch 1 proving job with blocks 1 to 3 {"fromBlock":1,"toBlock":3,"epochSizeBlocks":3,"epochNumber":1,"uuid":"18338977-3f00-4128-a7ca-6816e920a493"} 19:34:18 [19:34:18.558] WARN: prover-node:epoch-proving-job Halted execution of epoch 1 prover job {"uuid":"18338977-3f00-4128-a7ca-6816e920a493","epochNumber":1,"details":"Halted execution due to state stopped"} 19:34:18 [19:34:18.838] INFO: prover-node:epoch-proving-job Starting epoch 1 proving job with blocks 1 to 3 {"fromBlock":1,"toBlock":3,"epochSizeBlocks":3,"epochNumber":1,"uuid":"990fa412-bccd-4f7b-99d7-d11033dd9820"} 19:34:18 [19:34:18.851] WARN: prover-node:epoch-proving-job Epoch blocks changed underfoot {"uuid":"990fa412-bccd-4f7b-99d7-d11033dd9820","epochNumber":1,"oldBlockHashes":["0x1dd5ca231b7cd9dd125113dd9a7e7132c863420a56b7ee8734c8d1de36335a1c","0x0866fdd77235edd88403965a72312c36e8337bb08180c15ca5479044562a291a","0x29caf896d04995de6f1e69242bb19fd5c95849756a948c79b0d98a885a14c1b8"],"newBlockHashes":["0x1dd5ca231b7cd9dd125113dd9a7e7132c863420a56b7ee8734c8d1de36335a1c","0x0866fdd77235edd88403965a72312c36e8337bb08180c15ca5479044562a291a","0x29caf896d04995de6f1e69242bb19fd5c95849756a948c79b0d98a885a14c1b8","0x1a23be22dfd2db42a1599baf62b5044f4ee3fc4eca9098b89971b43363fc708e"]} 19:34:19 [19:34:19.060] WARN: prover-node:epoch-proving-job Halted execution of epoch 1 prover job {"uuid":"990fa412-bccd-4f7b-99d7-d11033dd9820","epochNumber":1,"details":"Halted execution due to state reorg"} 19:34:19 PASS src/job/epoch-proving-job.test.ts 19:34:19 epoch-proving-job 19:34:19 ✓ works (699 ms) 19:34:19 ✓ fails if fails to process txs for a block (341 ms) 19:34:19 ✓ fails if does not process all txs for a block (320 ms) 19:34:19 ✓ times out if deadline is hit (313 ms) 19:34:19 ✓ halts if stopped externally (329 ms) 19:34:19 ✓ halts if a new block for the epoch is found (502 ms) 19:34:19 19:34:19 Test Suites: 1 passed, 1 total 19:34:19 Tests: 6 passed, 6 total 19:34:19 Snapshots: 0 total 19:34:19 Time: 4.647 s 19:34:19 Ran all test suites matching /prover-node\/src\/job\/epoch-proving-job.test.ts/i. 19:34:19 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?