ACI ·

Parent Log: http://ci.aztec-labs.com/f2f5cc639551c62d Command: 736bd65c2c998997 yarn-project/scripts/run_test.sh prover-client/src/proving_broker/proving_broker.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/2b96419831503435fa46a83dc2e2b7ba19109d0f Env: REF_NAME=gh-readonly-queue/next/pr-15229-af094bce13530e078c78de9f3264280e6693d533 CURRENT_VERSION=0.87.6 CI_FULL=1 Date: Tue Jun 24 08:39:55 UTC 2025 System: ARCH=amd64 CPUS=128 MEM=493Gi HOSTNAME=pr-15229_amd64_x4-full Resources: CPU_LIST=0-127 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_b95296ef06707e5f_next 08:40:00 [08:40:00.334] INFO: prover-client:proving-broker Proving Broker started 08:40:00 [08:40:00.341] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:5f572b9fb4356139 epochNumber=42 {"provingJobId":"1:BASE_PARITY:5f572b9fb4356139"} 08:40:00 [08:40:00.345] WARN: prover-client:proving-broker Tried enqueueing stale proving job id=1:BASE_PARITY:a6d8998a9e0cb55b epochNumber=1 {"provingJobId":"1:BASE_PARITY:a6d8998a9e0cb55b"} 08:40:00 [08:40:00.382] INFO: prover-client:proving-broker Proving Broker started 08:40:00 [08:40:00.383] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d81511eac268d9da epochNumber=1 {"provingJobId":"1:BASE_PARITY:d81511eac268d9da"} 08:40:00 [08:40:00.384] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f9f473d1083f4286 epochNumber=1 {"provingJobId":"1:BASE_PARITY:f9f473d1083f4286"} 08:40:00 [08:40:00.386] INFO: prover-client:proving-broker Proving Broker started 08:40:00 [08:40:00.387] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:4d16f6d20d7837fc epochNumber=1 {"provingJobId":"1:BASE_PARITY:4d16f6d20d7837fc"} 08:40:00 [08:40:00.388] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:4d16f6d20d7837fc epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:4d16f6d20d7837fc"} 08:40:00 [08:40:00.390] INFO: prover-client:proving-broker Proving Broker started 08:40:00 [08:40:00.391] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:56a03a74774c51d2 epochNumber=1 {"provingJobId":"1:BASE_PARITY:56a03a74774c51d2"} 08:40:00 [08:40:00.392] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:56a03a74774c51d2 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:56a03a74774c51d2"} 08:40:00 [08:40:00.393] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:56a03a74774c51d2 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:56a03a74774c51d2"} 08:40:00 [08:40:00.393] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:56a03a74774c51d2 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:56a03a74774c51d2"} 08:40:00 [08:40:00.395] INFO: prover-client:proving-broker Proving Broker started 08:40:00 [08:40:00.395] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0568ece0a00ef705 epochNumber=1 {"provingJobId":"1:BASE_PARITY:0568ece0a00ef705"} 08:40:00 [08:40:00.423] INFO: prover-client:proving-broker Proving Broker started 08:40:00 [08:40:00.425] INFO: prover-client:proving-broker Proving Broker started 08:40:00 [08:40:00.425] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1694b725fcfbdf2d epochNumber=1 {"provingJobId":"1:BASE_PARITY:1694b725fcfbdf2d"} 08:40:00 [08:40:00.426] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:1694b725fcfbdf2d {"provingJobId":"1:BASE_PARITY:1694b725fcfbdf2d"} 08:40:00 [08:40:00.426] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:1694b725fcfbdf2d type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:1694b725fcfbdf2d"} 08:40:00 [08:40:00.427] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:1694b725fcfbdf2d type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:1694b725fcfbdf2d"} 08:40:00 [08:40:00.428] INFO: prover-client:proving-broker Proving Broker started 08:40:00 [08:40:00.428] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:39d85d2be6f79145 epochNumber=1 {"provingJobId":"1:BASE_PARITY:39d85d2be6f79145"} 08:40:00 [08:40:00.429] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:39d85d2be6f79145 {"provingJobId":"1:BASE_PARITY:39d85d2be6f79145"} 08:40:00 [08:40:00.429] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:39d85d2be6f79145 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:39d85d2be6f79145"} 08:40:00 [08:40:00.431] INFO: prover-client:proving-broker Proving Broker started 08:40:00 [08:40:00.431] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0319d6ed857ff895 epochNumber=1 {"provingJobId":"1:BASE_PARITY:0319d6ed857ff895"} 08:40:00 [08:40:00.432] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:0319d6ed857ff895 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:0319d6ed857ff895"} 08:40:00 [08:40:00.432] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:0319d6ed857ff895 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:0319d6ed857ff895"} 08:40:00 [08:40:00.433] INFO: prover-client:proving-broker Proving Broker started 08:40:00 [08:40:00.434] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:65d2efb210ef5e0a epochNumber=1 {"provingJobId":"1:BASE_PARITY:65d2efb210ef5e0a"} 08:40:00 [08:40:00.434] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:65d2efb210ef5e0a type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:65d2efb210ef5e0a"} 08:40:00 [08:40:00.435] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:65d2efb210ef5e0a type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:65d2efb210ef5e0a"} 08:40:00 [08:40:00.436] INFO: prover-client:proving-broker Proving Broker started 08:40:00 [08:40:00.437] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:17a86d31ea3355c9 epochNumber=0 {"provingJobId":"1:BASE_PARITY:17a86d31ea3355c9"} 08:40:00 [08:40:00.437] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:17a86d31ea3355c9 epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:17a86d31ea3355c9"} 08:40:00 [08:40:00.437] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d585b295de88b76d epochNumber=0 {"provingJobId":"1:BASE_PARITY:d585b295de88b76d"} 08:40:00 [08:40:00.437] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:17a86d31ea3355c9 epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:17a86d31ea3355c9"} 08:40:00 [08:40:00.438] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9e0f0b5d487d83db epochNumber=0 {"provingJobId":"1:BASE_PARITY:9e0f0b5d487d83db"} 08:40:00 [08:40:00.439] INFO: prover-client:proving-broker Proving Broker started 08:40:00 [08:40:00.448] INFO: prover-client:proving-broker Proving Broker started 08:40:00 [08:40:00.449] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:fe263d9afb5be7ed epochNumber=2 {"provingJobId":"1:BASE_PARITY:fe263d9afb5be7ed"} 08:40:00 [08:40:00.449] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ae9f7320bed4d3d4 epochNumber=1 {"provingJobId":"1:BASE_PARITY:ae9f7320bed4d3d4"} 08:40:00 [08:40:00.450] INFO: prover-client:proving-broker Proving Broker started 08:40:00 [08:40:00.451] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:87df01a5c3c27404 epochNumber=1 {"provingJobId":"1:BASE_PARITY:87df01a5c3c27404"} 08:40:00 [08:40:00.452] INFO: prover-client:proving-broker Proving Broker started 08:40:00 [08:40:00.452] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0fde7a19a12f42bc epochNumber=1 {"provingJobId":"1:BASE_PARITY:0fde7a19a12f42bc"} 08:40:00 [08:40:00.452] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d6e437bec9bf75c0 epochNumber=1 {"provingJobId":"1:BASE_PARITY:d6e437bec9bf75c0"} 08:40:00 [08:40:00.453] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:76a834da2d7c911d epochNumber=2 {"provingJobId":"1:BASE_PARITY:76a834da2d7c911d"} 08:40:00 [08:40:00.453] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:15f7db0b05e5afb4 epochNumber=1 {"provingJobId":"1:BASE_PARITY:15f7db0b05e5afb4"} 08:40:00 [08:40:00.454] INFO: prover-client:proving-broker Proving Broker started 08:40:00 [08:40:00.455] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a7c887c6cc1a4628 epochNumber=1 {"provingJobId":"1:BASE_PARITY:a7c887c6cc1a4628"} 08:40:00 [08:40:00.455] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:fbe74b45b5de4d45 epochNumber=1 {"provingJobId":"1:BASE_PARITY:fbe74b45b5de4d45"} 08:40:00 [08:40:00.455] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a6a3bef8ec753060 epochNumber=2 {"provingJobId":"1:BASE_PARITY:a6a3bef8ec753060"} 08:40:00 [08:40:00.455] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:108d279c66b23a23 epochNumber=1 {"provingJobId":"1:BASE_PARITY:108d279c66b23a23"} 08:40:00 [08:40:00.456] INFO: prover-client:proving-broker Proving Broker started 08:40:00 [08:40:00.457] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:5e7995bb93e93141 epochNumber=1 {"provingJobId":"1:BASE_PARITY:5e7995bb93e93141"} 08:40:00 [08:40:00.457] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:10202a768e65a743 epochNumber=1 {"provingJobId":"1:BASE_PARITY:10202a768e65a743"} 08:40:00 [08:40:00.457] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a1330de2a7ab3278 epochNumber=2 {"provingJobId":"1:BASE_PARITY:a1330de2a7ab3278"} 08:40:00 [08:40:00.458] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:257cb52ed8db6310 epochNumber=1 {"provingJobId":"1:BASE_PARITY:257cb52ed8db6310"} 08:40:00 [08:40:00.459] INFO: prover-client:proving-broker Proving Broker started 08:40:00 [08:40:00.459] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:94f2d01739b36a67 epochNumber=1 {"provingJobId":"1:BASE_PARITY:94f2d01739b36a67"} 08:40:00 [08:40:00.460] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:57ed5abb2f000eac epochNumber=1 {"provingJobId":"1:BASE_PARITY:57ed5abb2f000eac"} 08:40:00 [08:40:00.460] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:94f2d01739b36a67 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:94f2d01739b36a67"} 08:40:00 [08:40:00.461] INFO: prover-client:proving-broker Proving Broker started 08:40:00 [08:40:00.462] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b491b72f5dc5a67e epochNumber=1 {"provingJobId":"1:BASE_PARITY:b491b72f5dc5a67e"} 08:40:00 [08:40:00.462] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3b9fb9d470e6bc55 epochNumber=1 {"provingJobId":"1:BASE_PARITY:3b9fb9d470e6bc55"} 08:40:00 [08:40:00.463] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:b491b72f5dc5a67e type=BASE_PARITY totalAttempts=1 err=result {"provingJobId":"1:BASE_PARITY:b491b72f5dc5a67e"} 08:40:00 [08:40:00.464] INFO: prover-client:proving-broker Proving Broker started 08:40:00 [08:40:00.464] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:544ddbfbe04bb509 epochNumber=1 {"provingJobId":"1:BASE_PARITY:544ddbfbe04bb509"} 08:40:00 [08:40:00.465] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0d83a6d16ca5f3eb epochNumber=1 {"provingJobId":"1:BASE_PARITY:0d83a6d16ca5f3eb"} 08:40:00 [08:40:00.465] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:544ddbfbe04bb509 type=BASE_PARITY retry=1 err=result {"provingJobId":"1:BASE_PARITY:544ddbfbe04bb509"} 08:40:00 [08:40:00.467] INFO: prover-client:proving-broker Proving Broker started 08:40:00 [08:40:00.468] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:53700b22b1dbee4f epochNumber=1 {"provingJobId":"1:BASE_PARITY:53700b22b1dbee4f"} 08:40:00 [08:40:00.468] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:53700b22b1dbee4f {"provingJobId":"1:BASE_PARITY:53700b22b1dbee4f"} 08:40:00 [08:40:00.469] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:53700b22b1dbee4f type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:53700b22b1dbee4f"} 08:40:00 [08:40:00.469] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0c310a1524aa2096 epochNumber=1 {"provingJobId":"1:BASE_PARITY:0c310a1524aa2096"} 08:40:00 [08:40:00.470] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:53700b22b1dbee4f has already been completed {"provingJobId":"1:BASE_PARITY:53700b22b1dbee4f"} 08:40:00 [08:40:00.471] INFO: prover-client:proving-broker Proving Broker started 08:40:00 [08:40:00.471] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:af73e7d779759879 epochNumber=1 {"provingJobId":"1:BASE_PARITY:af73e7d779759879"} 08:40:00 [08:40:00.472] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:de3587ab5a1d72f6 epochNumber=2 {"provingJobId":"1:BASE_PARITY:de3587ab5a1d72f6"} 08:40:01 [08:40:01.524] INFO: prover-client:proving-broker Proving Broker started 08:40:01 [08:40:01.525] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:af73e7d779759879 settled=false {"provingJobId":"1:BASE_PARITY:af73e7d779759879","status":"pending"} 08:40:01 [08:40:01.525] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:de3587ab5a1d72f6 settled=false {"provingJobId":"1:BASE_PARITY:de3587ab5a1d72f6","status":"pending"} 08:40:01 [08:40:01.526] INFO: prover-client:proving-broker Proving job id=1:BASE_PARITY:af73e7d779759879 type=BASE_PARITY startedAt=1750754400472 older agent has taken job {"provingJobId":"1:BASE_PARITY:af73e7d779759879"} 08:40:01 [08:40:01.527] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:af73e7d779759879 type=BASE_PARITY already being worked on by another agent. Sending new one {"provingJobId":"1:BASE_PARITY:af73e7d779759879"} 08:40:01 [08:40:01.528] INFO: prover-client:proving-broker Proving Broker started 08:40:01 [08:40:01.529] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:8fd43f6193bd6715 epochNumber=1 {"provingJobId":"1:BASE_PARITY:8fd43f6193bd6715"} 08:40:01 [08:40:01.529] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:af33c4cd9242367a epochNumber=2 {"provingJobId":"1:BASE_PARITY:af33c4cd9242367a"} 08:40:02 [08:40:02.529] INFO: prover-client:proving-broker Proving Broker started 08:40:02 [08:40:02.530] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:8fd43f6193bd6715 settled=false {"provingJobId":"1:BASE_PARITY:8fd43f6193bd6715","status":"pending"} 08:40:02 [08:40:02.530] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:af33c4cd9242367a settled=false {"provingJobId":"1:BASE_PARITY:af33c4cd9242367a","status":"pending"} 08:40:02 [08:40:02.531] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:8fd43f6193bd6715 type=BASE_PARITY not found in the in-progress cache, adding it {"provingJobId":"1:BASE_PARITY:8fd43f6193bd6715"} 08:40:02 [08:40:02.534] INFO: prover-client:proving-broker Proving Broker started 08:40:02 [08:40:02.536] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1f0f9f363c7da9cf epochNumber=1 {"provingJobId":"1:BASE_PARITY:1f0f9f363c7da9cf"} 08:40:02 [08:40:02.536] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:aae440220b9e8095 epochNumber=2 {"provingJobId":"1:BASE_PARITY:aae440220b9e8095"} 08:40:03 [08:40:03.539] INFO: prover-client:proving-broker Proving Broker started 08:40:03 [08:40:03.540] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:1f0f9f363c7da9cf settled=false {"provingJobId":"1:BASE_PARITY:1f0f9f363c7da9cf","status":"pending"} 08:40:03 [08:40:03.540] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:aae440220b9e8095 settled=false {"provingJobId":"1:BASE_PARITY:aae440220b9e8095","status":"pending"} 08:40:03 [08:40:03.541] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:1f0f9f363c7da9cf type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:1f0f9f363c7da9cf"} 08:40:03 [08:40:03.541] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:1f0f9f363c7da9cf type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:1f0f9f363c7da9cf"} 08:40:03 [08:40:03.543] INFO: prover-client:proving-broker Proving Broker started 08:40:03 [08:40:03.544] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ceb971589bd9f67f epochNumber=1 {"provingJobId":"1:BASE_PARITY:ceb971589bd9f67f"} 08:40:03 [08:40:03.544] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9c6ebdbf4556c836 epochNumber=2 {"provingJobId":"1:BASE_PARITY:9c6ebdbf4556c836"} 08:40:03 [08:40:03.545] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:ceb971589bd9f67f type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:ceb971589bd9f67f"} 08:40:03 [08:40:03.545] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:9c6ebdbf4556c836 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:9c6ebdbf4556c836"} 08:40:03 [08:40:03.547] INFO: prover-client:proving-broker Proving Broker started 08:40:03 [08:40:03.547] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c15c55d4b27c8fa1 epochNumber=1 {"provingJobId":"1:BASE_PARITY:c15c55d4b27c8fa1"} 08:40:03 [08:40:03.548] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9309ac31794a5a47 epochNumber=2 {"provingJobId":"1:BASE_PARITY:9309ac31794a5a47"} 08:40:03 [08:40:03.548] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:c15c55d4b27c8fa1 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:c15c55d4b27c8fa1"} 08:40:03 [08:40:03.548] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:c15c55d4b27c8fa1 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:c15c55d4b27c8fa1"} 08:40:03 [08:40:03.549] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:9309ac31794a5a47 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:9309ac31794a5a47"} 08:40:03 [08:40:03.550] INFO: prover-client:proving-broker Proving Broker started 08:40:03 [08:40:03.550] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:19aceadb47405f2e err=test error {"provingJoId":"1:BASE_PARITY:19aceadb47405f2e"} 08:40:03 [08:40:03.551] INFO: prover-client:proving-broker Proving Broker started 08:40:03 [08:40:03.552] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:216a8e9c833f3f88 not found {"provingJobId":"1:BASE_PARITY:216a8e9c833f3f88"} 08:40:03 [08:40:03.553] INFO: prover-client:proving-broker Proving Broker started 08:40:03 [08:40:03.554] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:49f1c6f55b86cf89 epochNumber=1 {"provingJobId":"1:BASE_PARITY:49f1c6f55b86cf89"} 08:40:03 [08:40:03.555] INFO: prover-client:proving-broker Proving Broker started 08:40:03 [08:40:03.555] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7331c642db97433b epochNumber=1 {"provingJobId":"1:BASE_PARITY:7331c642db97433b"} 08:40:03 [08:40:03.657] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:7331c642db97433b timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:7331c642db97433b"} 08:40:03 [08:40:03.665] INFO: prover-client:proving-broker Proving Broker started 08:40:03 [08:40:03.666] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b95a1589376012c2 epochNumber=1 {"provingJobId":"1:BASE_PARITY:b95a1589376012c2"} 08:40:03 [08:40:03.767] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:b95a1589376012c2 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:b95a1589376012c2"} 08:40:03 [08:40:03.778] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e73c1c25f1a3de50 epochNumber=10 {"provingJobId":"1:BASE_PARITY:e73c1c25f1a3de50"} 08:40:03 [08:40:03.793] INFO: prover-client:proving-broker Cleaned up jobs=1 08:40:03 [08:40:03.905] INFO: prover-client:proving-broker Proving Broker started 08:40:03 [08:40:03.906] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c059f6d3876051a4 epochNumber=1 {"provingJobId":"1:BASE_PARITY:c059f6d3876051a4"} 08:40:04 [08:40:04.057] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:c059f6d3876051a4 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:c059f6d3876051a4"} 08:40:04 [08:40:04.109] INFO: prover-client:proving-broker Proving Broker started 08:40:04 [08:40:04.110] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b2e44b5c21335387 epochNumber=1 {"provingJobId":"1:BASE_PARITY:b2e44b5c21335387"} 08:40:04 [08:40:04.110] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:b2e44b5c21335387 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:b2e44b5c21335387"} 08:40:04 [08:40:04.112] INFO: prover-client:proving-broker Proving Broker started 08:40:04 [08:40:04.112] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:28e3f6910c4050e8 epochNumber=1 {"provingJobId":"1:BASE_PARITY:28e3f6910c4050e8"} 08:40:04 [08:40:04.112] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:28e3f6910c4050e8 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:28e3f6910c4050e8"} 08:40:04 [08:40:04.113] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:28e3f6910c4050e8 type=BASE_PARITY totalAttempts=2 err=test error {"provingJobId":"1:BASE_PARITY:28e3f6910c4050e8"} 08:40:04 [08:40:04.114] INFO: prover-client:proving-broker Proving Broker started 08:40:04 [08:40:04.114] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:55ec931a869e01bb epochNumber=1 {"provingJobId":"1:BASE_PARITY:55ec931a869e01bb"} 08:40:04 [08:40:04.114] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:55ec931a869e01bb type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:55ec931a869e01bb"} 08:40:04 [08:40:04.115] INFO: prover-client:proving-broker Proving Broker started 08:40:04 [08:40:04.116] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a8d479936fa32b29 epochNumber=1 {"provingJobId":"1:BASE_PARITY:a8d479936fa32b29"} 08:40:04 [08:40:04.116] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:a8d479936fa32b29 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:a8d479936fa32b29"} 08:40:04 [08:40:04.117] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c07ff32071e609de epochNumber=3 {"provingJobId":"1:BASE_PARITY:c07ff32071e609de"} 08:40:04 [08:40:04.140] INFO: prover-client:proving-broker Cleaned up jobs=1 08:40:04 [08:40:04.142] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:a8d479936fa32b29 err=test error {"provingJoId":"1:BASE_PARITY:a8d479936fa32b29"} 08:40:04 [08:40:04.145] INFO: prover-client:proving-broker Proving Broker started 08:40:04 [08:40:04.145] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:66bd05f1582f0a8f settled=false {"provingJobId":"1:BASE_PARITY:66bd05f1582f0a8f","status":"pending"} 08:40:04 [08:40:04.145] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:64ab853cb7d2814d settled=false {"provingJobId":"1:BASE_PARITY:64ab853cb7d2814d","status":"pending"} 08:40:04 [08:40:04.148] INFO: prover-client:proving-broker Proving Broker started 08:40:04 [08:40:04.148] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:9b0d1f376cb0375b settled=true {"provingJobId":"1:BASE_PARITY:9b0d1f376cb0375b","status":"fulfilled"} 08:40:04 [08:40:04.148] INFO: prover-client:proving-broker Restoring proving job id=2:BASE_PARITY:2866933417e2eea3 settled=true {"provingJobId":"2:BASE_PARITY:2866933417e2eea3","status":"fulfilled"} 08:40:04 [08:40:04.150] INFO: prover-client:proving-broker Proving Broker started 08:40:04 [08:40:04.150] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:33f47cd9073ca133 settled=true {"provingJobId":"1:BASE_PARITY:33f47cd9073ca133","status":"fulfilled"} 08:40:04 [08:40:04.150] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:d2f558684c5cd0f1 settled=false {"provingJobId":"1:BASE_PARITY:d2f558684c5cd0f1","status":"pending"} 08:40:04 [08:40:04.152] INFO: prover-client:proving-broker Proving Broker started 08:40:04 [08:40:04.153] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:abd12be0f4fae832 epochNumber=1 {"provingJobId":"1:BASE_PARITY:abd12be0f4fae832"} 08:40:04 [08:40:04.155] INFO: prover-client:proving-broker Proving Broker started 08:40:04 [08:40:04.155] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:99465ec1bc0f20bf epochNumber=1 {"provingJobId":"1:BASE_PARITY:99465ec1bc0f20bf"} 08:40:04 [08:40:04.156] ERROR: prover-client:proving-broker Failed to save proving job id=1:BASE_PARITY:99465ec1bc0f20bf: Error: db error: Error: db error 08:40:04 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1126:63) {"provingJobId":"1:BASE_PARITY:99465ec1bc0f20bf"} 08:40:04 [08:40:04.158] INFO: prover-client:proving-broker Proving Broker started 08:40:04 [08:40:04.158] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ead3786f5871ba8b epochNumber=1 {"provingJobId":"1:BASE_PARITY:ead3786f5871ba8b"} 08:40:04 [08:40:04.159] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:ead3786f5871ba8b type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:ead3786f5871ba8b"} 08:40:04 [08:40:04.162] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:ead3786f5871ba8b type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:ead3786f5871ba8b"} 08:40:04 [08:40:04.163] INFO: prover-client:proving-broker Proving Broker started 08:40:04 [08:40:04.163] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3b42992a91d54c6f epochNumber=1 {"provingJobId":"1:BASE_PARITY:3b42992a91d54c6f"} 08:40:04 [08:40:04.164] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:3b42992a91d54c6f type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:3b42992a91d54c6f"} 08:40:04 [08:40:04.164] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:3b42992a91d54c6f type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:3b42992a91d54c6f"} 08:40:04 [08:40:04.164] ERROR: prover-client:proving-broker Failed to save proving job result id=1:BASE_PARITY:3b42992a91d54c6f: Error: db error 08:40:04 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1159:69) {"provingJobId":"1:BASE_PARITY:3b42992a91d54c6f"} 08:40:04 [08:40:04.165] INFO: prover-client:proving-broker Proving Broker started 08:40:04 [08:40:04.166] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:54e1f91d0f9e7d7a epochNumber=1 {"provingJobId":"1:BASE_PARITY:54e1f91d0f9e7d7a"} 08:40:04 [08:40:04.167] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:54e1f91d0f9e7d7a type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:54e1f91d0f9e7d7a"} 08:40:04 [08:40:04.167] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:54e1f91d0f9e7d7a type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:54e1f91d0f9e7d7a"} 08:40:04 [08:40:04.171] INFO: prover-client:proving-broker Proving Broker started 08:40:04 [08:40:04.172] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9ddafae0c36481ac epochNumber=1 {"provingJobId":"1:BASE_PARITY:9ddafae0c36481ac"} 08:40:04 [08:40:04.172] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:9ddafae0c36481ac type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:9ddafae0c36481ac"} 08:40:04 [08:40:04.172] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:9ddafae0c36481ac type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:9ddafae0c36481ac"} 08:40:04 [08:40:04.173] ERROR: prover-client:proving-broker Failed to save proving job error status id=1:BASE_PARITY:9ddafae0c36481ac jobErr=test error: Error: db error 08:40:04 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1192:68) {"provingJobId":"1:BASE_PARITY:9ddafae0c36481ac"} 08:40:04 [08:40:04.174] INFO: prover-client:proving-broker Proving Broker started 08:40:04 [08:40:04.174] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:20040467a945a022 not found {"provingJobId":"1:BASE_PARITY:20040467a945a022"} 08:40:04 [08:40:04.175] INFO: prover-client:proving-broker Proving Broker started 08:40:04 [08:40:04.176] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:5cf20ba7ad780126 err=test error {"provingJoId":"1:BASE_PARITY:5cf20ba7ad780126"} 08:40:04 [08:40:04.177] INFO: prover-client:proving-broker Proving Broker started 08:40:04 [08:40:04.187] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:68b665b1760c2174 epochNumber=1 {"provingJobId":"1:BASE_PARITY:68b665b1760c2174"} 08:40:04 [08:40:04.187] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:68b665b1760c2174 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:68b665b1760c2174"} 08:40:04 [08:40:04.188] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:68b665b1760c2174 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:68b665b1760c2174"} 08:40:04 [08:40:04.199] INFO: prover-client:proving-broker New proving job id=2:BASE_PARITY:596cd852f138b8c4 epochNumber=2 {"provingJobId":"2:BASE_PARITY:596cd852f138b8c4"} 08:40:04 [08:40:04.199] WARN: prover-client:proving-broker Proving job id=2:BASE_PARITY:596cd852f138b8c4 type=BASE_PARITY not in the in-progress set {"provingJobId":"2:BASE_PARITY:596cd852f138b8c4"} 08:40:04 [08:40:04.199] INFO: prover-client:proving-broker Proving job complete id=2:BASE_PARITY:596cd852f138b8c4 type=BASE_PARITY totalAttempts=1 {"provingJobId":"2:BASE_PARITY:596cd852f138b8c4"} 08:40:04 [08:40:04.263] INFO: prover-client:proving-broker New proving job id=3:BASE_PARITY:7cd7296d115208cb epochNumber=3 {"provingJobId":"3:BASE_PARITY:7cd7296d115208cb"} 08:40:04 [08:40:04.280] INFO: prover-client:proving-broker Cleaned up jobs=1 08:40:04 [08:40:04.325] INFO: prover-client:proving-broker New proving job id=4:BASE_PARITY:b3ef4efdc17bbfe3 epochNumber=4 {"provingJobId":"4:BASE_PARITY:b3ef4efdc17bbfe3"} 08:40:04 [08:40:04.330] INFO: prover-client:proving-broker Cleaned up jobs=1 08:40:04 [08:40:04.388] INFO: prover-client:proving-broker New proving job id=5:BASE_PARITY:c1856d2c3d53c422 epochNumber=5 {"provingJobId":"5:BASE_PARITY:c1856d2c3d53c422"} 08:40:04 [08:40:04.407] INFO: prover-client:proving-broker Cleaned up jobs=1 08:40:04 [08:40:04.444] INFO: prover-client:proving-broker Proving Broker started 08:40:04 [08:40:04.445] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:4a14602267cf2622 epochNumber=42 {"provingJobId":"1:BASE_PARITY:4a14602267cf2622"} 08:40:04 [08:40:04.446] INFO: prover-client:proving-broker-database Creating broker database for epoch 42 at /tmp/proving-broker-testXqu4le/42 with map size 1073741824 08:40:04 [08:40:04.451] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:04 [08:40:04.487] WARN: prover-client:proving-broker Tried enqueueing stale proving job id=1:BASE_PARITY:acb6a6b7ec353213 epochNumber=1 {"provingJobId":"1:BASE_PARITY:acb6a6b7ec353213"} 08:40:04 [08:40:04.494] INFO: prover-client:proving-broker Proving Broker started 08:40:04 [08:40:04.495] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e0fb3f74306b6c3f epochNumber=1 {"provingJobId":"1:BASE_PARITY:e0fb3f74306b6c3f"} 08:40:04 [08:40:04.496] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testu8uCKq/1 with map size 1073741824 08:40:04 [08:40:04.498] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:04 [08:40:04.519] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:72075ee088eb68c3 epochNumber=1 {"provingJobId":"1:BASE_PARITY:72075ee088eb68c3"} 08:40:04 [08:40:04.530] INFO: prover-client:proving-broker Proving Broker started 08:40:04 [08:40:04.531] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:270fa126bba11c3e epochNumber=1 {"provingJobId":"1:BASE_PARITY:270fa126bba11c3e"} 08:40:04 [08:40:04.531] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testnhE8Cy/1 with map size 1073741824 08:40:04 [08:40:04.534] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:04 [08:40:04.557] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:270fa126bba11c3e epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:270fa126bba11c3e"} 08:40:04 [08:40:04.562] INFO: prover-client:proving-broker Proving Broker started 08:40:04 [08:40:04.563] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a2ef75481e3eab5d epochNumber=1 {"provingJobId":"1:BASE_PARITY:a2ef75481e3eab5d"} 08:40:04 [08:40:04.564] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testABMjDM/1 with map size 1073741824 08:40:04 [08:40:04.566] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:04 [08:40:04.589] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:a2ef75481e3eab5d epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:a2ef75481e3eab5d"} 08:40:04 [08:40:04.590] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:a2ef75481e3eab5d type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:a2ef75481e3eab5d"} 08:40:04 [08:40:04.596] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:a2ef75481e3eab5d epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:a2ef75481e3eab5d"} 08:40:04 [08:40:04.600] INFO: prover-client:proving-broker Proving Broker started 08:40:04 [08:40:04.601] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:dda1c7831c67a456 epochNumber=1 {"provingJobId":"1:BASE_PARITY:dda1c7831c67a456"} 08:40:04 [08:40:04.601] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testvlkveu/1 with map size 1073741824 08:40:04 [08:40:04.604] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:04 [08:40:04.630] INFO: prover-client:proving-broker Proving Broker started 08:40:04 [08:40:04.633] INFO: prover-client:proving-broker Proving Broker started 08:40:04 [08:40:04.633] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:77a856b03f06b525 epochNumber=1 {"provingJobId":"1:BASE_PARITY:77a856b03f06b525"} 08:40:04 [08:40:04.634] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testnLEfpy/1 with map size 1073741824 08:40:04 [08:40:04.637] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:04 [08:40:04.655] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:77a856b03f06b525 {"provingJobId":"1:BASE_PARITY:77a856b03f06b525"} 08:40:04 [08:40:04.656] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:77a856b03f06b525 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:77a856b03f06b525"} 08:40:04 [08:40:04.656] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:77a856b03f06b525 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:77a856b03f06b525"} 08:40:04 [08:40:04.673] INFO: prover-client:proving-broker Proving Broker started 08:40:04 [08:40:04.674] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:70b6278a7d40e38f epochNumber=1 {"provingJobId":"1:BASE_PARITY:70b6278a7d40e38f"} 08:40:04 [08:40:04.675] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testrEXkRR/1 with map size 1073741824 08:40:04 [08:40:04.682] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:04 [08:40:04.701] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:70b6278a7d40e38f {"provingJobId":"1:BASE_PARITY:70b6278a7d40e38f"} 08:40:04 [08:40:04.701] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:70b6278a7d40e38f type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:70b6278a7d40e38f"} 08:40:04 [08:40:04.709] INFO: prover-client:proving-broker Proving Broker started 08:40:04 [08:40:04.710] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a0bf437f92616dd8 epochNumber=1 {"provingJobId":"1:BASE_PARITY:a0bf437f92616dd8"} 08:40:04 [08:40:04.710] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testqpuior/1 with map size 1073741824 08:40:04 [08:40:04.716] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:04 [08:40:04.734] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:a0bf437f92616dd8 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:a0bf437f92616dd8"} 08:40:04 [08:40:04.734] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:a0bf437f92616dd8 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:a0bf437f92616dd8"} 08:40:04 [08:40:04.744] INFO: prover-client:proving-broker Proving Broker started 08:40:04 [08:40:04.745] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:8e691c78c3526575 epochNumber=1 {"provingJobId":"1:BASE_PARITY:8e691c78c3526575"} 08:40:04 [08:40:04.745] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testT8Ytpn/1 with map size 1073741824 08:40:04 [08:40:04.748] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:04 [08:40:04.768] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:8e691c78c3526575 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:8e691c78c3526575"} 08:40:04 [08:40:04.769] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:8e691c78c3526575 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:8e691c78c3526575"} 08:40:04 [08:40:04.780] INFO: prover-client:proving-broker Proving Broker started 08:40:04 [08:40:04.780] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9dd52a3e352031db epochNumber=0 {"provingJobId":"1:BASE_PARITY:9dd52a3e352031db"} 08:40:04 [08:40:04.781] INFO: prover-client:proving-broker-database Creating broker database for epoch 0 at /tmp/proving-broker-testDGjzy4/0 with map size 1073741824 08:40:04 [08:40:04.786] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:04 [08:40:04.804] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:9dd52a3e352031db epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:9dd52a3e352031db"} 08:40:04 [08:40:04.805] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:be520983efe4794e epochNumber=0 {"provingJobId":"1:BASE_PARITY:be520983efe4794e"} 08:40:04 [08:40:04.805] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:9dd52a3e352031db epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:9dd52a3e352031db"} 08:40:04 [08:40:04.806] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:69afe3929469da5f epochNumber=0 {"provingJobId":"1:BASE_PARITY:69afe3929469da5f"} 08:40:04 [08:40:04.824] INFO: prover-client:proving-broker Proving Broker started 08:40:04 [08:40:04.828] INFO: prover-client:proving-broker Proving Broker started 08:40:04 [08:40:04.829] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a2deb7977b0fa121 epochNumber=2 {"provingJobId":"1:BASE_PARITY:a2deb7977b0fa121"} 08:40:04 [08:40:04.830] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testgsFXWM/2 with map size 1073741824 08:40:04 [08:40:04.833] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:04 [08:40:04.852] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:4ec470cf6b0f12d4 epochNumber=1 {"provingJobId":"1:BASE_PARITY:4ec470cf6b0f12d4"} 08:40:04 [08:40:04.853] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testgsFXWM/1 with map size 1073741824 08:40:04 [08:40:04.857] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:04 [08:40:04.884] INFO: prover-client:proving-broker Proving Broker started 08:40:04 [08:40:04.885] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:62143a68836b1d3b epochNumber=1 {"provingJobId":"1:BASE_PARITY:62143a68836b1d3b"} 08:40:04 [08:40:04.886] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testwZyEAR/1 with map size 1073741824 08:40:04 [08:40:04.891] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:04 [08:40:04.916] INFO: prover-client:proving-broker Proving Broker started 08:40:04 [08:40:04.917] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:855555b7f28221b8 epochNumber=1 {"provingJobId":"1:BASE_PARITY:855555b7f28221b8"} 08:40:04 [08:40:04.918] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testajV6GN/1 with map size 1073741824 08:40:04 [08:40:04.920] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:04 [08:40:04.938] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:418785b29f172695 epochNumber=1 {"provingJobId":"1:BASE_PARITY:418785b29f172695"} 08:40:04 [08:40:04.944] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:704287892d09de3a epochNumber=2 {"provingJobId":"1:BASE_PARITY:704287892d09de3a"} 08:40:04 [08:40:04.945] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testajV6GN/2 with map size 1073741824 08:40:04 [08:40:04.947] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:04 [08:40:04.967] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:03200fc2f1d7f75a epochNumber=1 {"provingJobId":"1:BASE_PARITY:03200fc2f1d7f75a"} 08:40:04 [08:40:04.977] INFO: prover-client:proving-broker Proving Broker started 08:40:04 [08:40:04.978] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:be4cd66025261533 epochNumber=1 {"provingJobId":"1:BASE_PARITY:be4cd66025261533"} 08:40:04 [08:40:04.979] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testRhMZJm/1 with map size 1073741824 08:40:04 [08:40:04.983] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:05 [08:40:05.000] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f490d73216de178e epochNumber=1 {"provingJobId":"1:BASE_PARITY:f490d73216de178e"} 08:40:05 [08:40:05.006] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:956cc60028447455 epochNumber=2 {"provingJobId":"1:BASE_PARITY:956cc60028447455"} 08:40:05 [08:40:05.007] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testRhMZJm/2 with map size 1073741824 08:40:05 [08:40:05.009] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:05 [08:40:05.026] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:5498b7db5a9eb520 epochNumber=1 {"provingJobId":"1:BASE_PARITY:5498b7db5a9eb520"} 08:40:05 [08:40:05.036] INFO: prover-client:proving-broker Proving Broker started 08:40:05 [08:40:05.037] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:acc8aee6de0217a9 epochNumber=1 {"provingJobId":"1:BASE_PARITY:acc8aee6de0217a9"} 08:40:05 [08:40:05.038] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testO9vUC6/1 with map size 1073741824 08:40:05 [08:40:05.040] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:05 [08:40:05.059] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:19aa0cb7fb20c266 epochNumber=1 {"provingJobId":"1:BASE_PARITY:19aa0cb7fb20c266"} 08:40:05 [08:40:05.065] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7d62c31d96add0bd epochNumber=2 {"provingJobId":"1:BASE_PARITY:7d62c31d96add0bd"} 08:40:05 [08:40:05.067] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testO9vUC6/2 with map size 1073741824 08:40:05 [08:40:05.069] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:05 [08:40:05.086] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:5be8996b82a0428e epochNumber=1 {"provingJobId":"1:BASE_PARITY:5be8996b82a0428e"} 08:40:05 [08:40:05.096] INFO: prover-client:proving-broker Proving Broker started 08:40:05 [08:40:05.097] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:554fc4e20326c0aa epochNumber=1 {"provingJobId":"1:BASE_PARITY:554fc4e20326c0aa"} 08:40:05 [08:40:05.098] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testVbpOMB/1 with map size 1073741824 08:40:05 [08:40:05.101] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:05 [08:40:05.118] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:593c8de2387e4a18 epochNumber=1 {"provingJobId":"1:BASE_PARITY:593c8de2387e4a18"} 08:40:05 [08:40:05.127] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:554fc4e20326c0aa type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:554fc4e20326c0aa"} 08:40:05 [08:40:05.138] INFO: prover-client:proving-broker Proving Broker started 08:40:05 [08:40:05.139] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9511bfaa8d78b6fd epochNumber=1 {"provingJobId":"1:BASE_PARITY:9511bfaa8d78b6fd"} 08:40:05 [08:40:05.141] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testMl0956/1 with map size 1073741824 08:40:05 [08:40:05.146] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:05 [08:40:05.171] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3ac04c868599897c epochNumber=1 {"provingJobId":"1:BASE_PARITY:3ac04c868599897c"} 08:40:05 [08:40:05.178] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:9511bfaa8d78b6fd type=BASE_PARITY totalAttempts=1 err=result {"provingJobId":"1:BASE_PARITY:9511bfaa8d78b6fd"} 08:40:05 [08:40:05.189] INFO: prover-client:proving-broker Proving Broker started 08:40:05 [08:40:05.190] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:978bf218df4d1084 epochNumber=1 {"provingJobId":"1:BASE_PARITY:978bf218df4d1084"} 08:40:05 [08:40:05.190] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testpS0nrq/1 with map size 1073741824 08:40:05 [08:40:05.194] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:05 [08:40:05.209] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:8ad1f8bf289dd34b epochNumber=1 {"provingJobId":"1:BASE_PARITY:8ad1f8bf289dd34b"} 08:40:05 [08:40:05.216] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:978bf218df4d1084 type=BASE_PARITY retry=1 err=result {"provingJobId":"1:BASE_PARITY:978bf218df4d1084"} 08:40:05 [08:40:05.220] INFO: prover-client:proving-broker Proving Broker started 08:40:05 [08:40:05.221] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c1443121a49f8c6a epochNumber=1 {"provingJobId":"1:BASE_PARITY:c1443121a49f8c6a"} 08:40:05 [08:40:05.221] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testcGYq5P/1 with map size 1073741824 08:40:05 [08:40:05.223] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:05 [08:40:05.242] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:c1443121a49f8c6a {"provingJobId":"1:BASE_PARITY:c1443121a49f8c6a"} 08:40:05 [08:40:05.243] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:c1443121a49f8c6a type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:c1443121a49f8c6a"} 08:40:05 [08:40:05.248] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9a94d6d0d6ac048a epochNumber=1 {"provingJobId":"1:BASE_PARITY:9a94d6d0d6ac048a"} 08:40:05 [08:40:05.254] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:c1443121a49f8c6a has already been completed {"provingJobId":"1:BASE_PARITY:c1443121a49f8c6a"} 08:40:05 [08:40:05.258] INFO: prover-client:proving-broker Proving Broker started 08:40:05 [08:40:05.259] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e9b7ad353aa5f73a epochNumber=1 {"provingJobId":"1:BASE_PARITY:e9b7ad353aa5f73a"} 08:40:05 [08:40:05.264] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testEycR1m/1 with map size 1073741824 08:40:05 [08:40:05.265] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:05 [08:40:05.288] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b9f6127b91f1c5d9 epochNumber=2 {"provingJobId":"1:BASE_PARITY:b9f6127b91f1c5d9"} 08:40:05 [08:40:05.289] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testEycR1m/2 with map size 1073741824 08:40:05 [08:40:05.293] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:06 [08:40:06.363] INFO: prover-client:proving-broker Proving Broker started 08:40:06 [08:40:06.372] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:e9b7ad353aa5f73a settled=false {"provingJobId":"1:BASE_PARITY:e9b7ad353aa5f73a","status":"pending"} 08:40:06 [08:40:06.375] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:b9f6127b91f1c5d9 settled=false {"provingJobId":"1:BASE_PARITY:b9f6127b91f1c5d9","status":"pending"} 08:40:06 [08:40:06.376] INFO: prover-client:proving-broker Proving job id=1:BASE_PARITY:e9b7ad353aa5f73a type=BASE_PARITY startedAt=1750754405310 older agent has taken job {"provingJobId":"1:BASE_PARITY:e9b7ad353aa5f73a"} 08:40:06 [08:40:06.377] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:e9b7ad353aa5f73a type=BASE_PARITY already being worked on by another agent. Sending new one {"provingJobId":"1:BASE_PARITY:e9b7ad353aa5f73a"} 08:40:06 [08:40:06.383] INFO: prover-client:proving-broker Proving Broker started 08:40:06 [08:40:06.384] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:cbb80871b8446b41 epochNumber=1 {"provingJobId":"1:BASE_PARITY:cbb80871b8446b41"} 08:40:06 [08:40:06.385] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testpJP0BJ/1 with map size 1073741824 08:40:06 [08:40:06.386] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:06 [08:40:06.410] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d7e6f507e5f220ba epochNumber=2 {"provingJobId":"1:BASE_PARITY:d7e6f507e5f220ba"} 08:40:06 [08:40:06.411] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testpJP0BJ/2 with map size 1073741824 08:40:06 [08:40:06.415] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:07 [08:40:07.436] INFO: prover-client:proving-broker Proving Broker started 08:40:07 [08:40:07.439] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:cbb80871b8446b41 settled=false {"provingJobId":"1:BASE_PARITY:cbb80871b8446b41","status":"pending"} 08:40:07 [08:40:07.440] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:d7e6f507e5f220ba settled=false {"provingJobId":"1:BASE_PARITY:d7e6f507e5f220ba","status":"pending"} 08:40:07 [08:40:07.441] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:cbb80871b8446b41 type=BASE_PARITY not found in the in-progress cache, adding it {"provingJobId":"1:BASE_PARITY:cbb80871b8446b41"} 08:40:07 [08:40:07.445] INFO: prover-client:proving-broker Proving Broker started 08:40:07 [08:40:07.445] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:efaef943820fb810 epochNumber=1 {"provingJobId":"1:BASE_PARITY:efaef943820fb810"} 08:40:07 [08:40:07.446] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testGo9pIU/1 with map size 1073741824 08:40:07 [08:40:07.448] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:07 [08:40:07.478] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:018d4a8704dfca39 epochNumber=2 {"provingJobId":"1:BASE_PARITY:018d4a8704dfca39"} 08:40:07 [08:40:07.481] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testGo9pIU/2 with map size 1073741824 08:40:07 [08:40:07.485] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:08 [08:40:08.504] INFO: prover-client:proving-broker Proving Broker started 08:40:08 [08:40:08.506] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:efaef943820fb810 settled=false {"provingJobId":"1:BASE_PARITY:efaef943820fb810","status":"pending"} 08:40:08 [08:40:08.508] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:018d4a8704dfca39 settled=false {"provingJobId":"1:BASE_PARITY:018d4a8704dfca39","status":"pending"} 08:40:08 [08:40:08.509] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:efaef943820fb810 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:efaef943820fb810"} 08:40:08 [08:40:08.509] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:efaef943820fb810 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:efaef943820fb810"} 08:40:08 [08:40:08.520] INFO: prover-client:proving-broker Proving Broker started 08:40:08 [08:40:08.521] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c250fd6d0795906d epochNumber=1 {"provingJobId":"1:BASE_PARITY:c250fd6d0795906d"} 08:40:08 [08:40:08.522] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testiWOQp9/1 with map size 1073741824 08:40:08 [08:40:08.524] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:08 [08:40:08.541] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:700a3b217031e800 epochNumber=2 {"provingJobId":"1:BASE_PARITY:700a3b217031e800"} 08:40:08 [08:40:08.542] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testiWOQp9/2 with map size 1073741824 08:40:08 [08:40:08.544] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:08 [08:40:08.564] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:c250fd6d0795906d type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:c250fd6d0795906d"} 08:40:08 [08:40:08.574] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:700a3b217031e800 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:700a3b217031e800"} 08:40:08 [08:40:08.586] INFO: prover-client:proving-broker Proving Broker started 08:40:08 [08:40:08.587] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:819468c5e93ec244 epochNumber=1 {"provingJobId":"1:BASE_PARITY:819468c5e93ec244"} 08:40:08 [08:40:08.588] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testPpSlpG/1 with map size 1073741824 08:40:08 [08:40:08.591] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:08 [08:40:08.610] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ba4f9b08fe5a2372 epochNumber=2 {"provingJobId":"1:BASE_PARITY:ba4f9b08fe5a2372"} 08:40:08 [08:40:08.611] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testPpSlpG/2 with map size 1073741824 08:40:08 [08:40:08.616] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:08 [08:40:08.632] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:819468c5e93ec244 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:819468c5e93ec244"} 08:40:08 [08:40:08.633] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:819468c5e93ec244 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:819468c5e93ec244"} 08:40:08 [08:40:08.639] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:ba4f9b08fe5a2372 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:ba4f9b08fe5a2372"} 08:40:08 [08:40:08.649] INFO: prover-client:proving-broker Proving Broker started 08:40:08 [08:40:08.650] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:c6678af4e07bb7bb err=test error {"provingJoId":"1:BASE_PARITY:c6678af4e07bb7bb"} 08:40:08 [08:40:08.652] INFO: prover-client:proving-broker Proving Broker started 08:40:08 [08:40:08.653] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:1847796415661049 not found {"provingJobId":"1:BASE_PARITY:1847796415661049"} 08:40:08 [08:40:08.656] INFO: prover-client:proving-broker Proving Broker started 08:40:08 [08:40:08.657] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:cb3f342aafdf192c epochNumber=1 {"provingJobId":"1:BASE_PARITY:cb3f342aafdf192c"} 08:40:08 [08:40:08.657] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testHLmlHu/1 with map size 1073741824 08:40:08 [08:40:08.659] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:08 [08:40:08.684] INFO: prover-client:proving-broker Proving Broker started 08:40:08 [08:40:08.685] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a79786d117934439 epochNumber=1 {"provingJobId":"1:BASE_PARITY:a79786d117934439"} 08:40:08 [08:40:08.686] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testWsOz3I/1 with map size 1073741824 08:40:08 [08:40:08.688] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:08 [08:40:08.809] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:a79786d117934439 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:a79786d117934439"} 08:40:08 [08:40:08.813] INFO: prover-client:proving-broker Proving Broker started 08:40:08 [08:40:08.814] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6ba42dede333c59f epochNumber=1 {"provingJobId":"1:BASE_PARITY:6ba42dede333c59f"} 08:40:08 [08:40:08.814] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testRZ4grv/1 with map size 1073741824 08:40:08 [08:40:08.818] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:08 [08:40:08.941] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:6ba42dede333c59f timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:6ba42dede333c59f"} 08:40:08 [08:40:08.943] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c4ab552050c420dc epochNumber=10 {"provingJobId":"1:BASE_PARITY:c4ab552050c420dc"} 08:40:08 [08:40:08.944] INFO: prover-client:proving-broker-database Creating broker database for epoch 10 at /tmp/proving-broker-testRZ4grv/10 with map size 1073741824 08:40:08 [08:40:08.946] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:08 [08:40:08.991] INFO: prover-client:proving-broker Cleaned up jobs=1 08:40:08 [08:40:08.992] INFO: prover-client:proving-broker-database Deleting broker database for epoch 1 08:40:09 [08:40:09.100] INFO: prover-client:proving-broker Proving Broker started 08:40:09 [08:40:09.102] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6a2da933e45b8456 epochNumber=1 {"provingJobId":"1:BASE_PARITY:6a2da933e45b8456"} 08:40:09 [08:40:09.102] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testmLDD7N/1 with map size 1073741824 08:40:09 [08:40:09.107] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:09 [08:40:09.279] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:6a2da933e45b8456 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:6a2da933e45b8456"} 08:40:09 [08:40:09.329] INFO: prover-client:proving-broker Proving Broker started 08:40:09 [08:40:09.330] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:fef9b35b2fb22a3f epochNumber=1 {"provingJobId":"1:BASE_PARITY:fef9b35b2fb22a3f"} 08:40:09 [08:40:09.331] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test3e3N4Z/1 with map size 1073741824 08:40:09 [08:40:09.332] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:09 [08:40:09.354] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:fef9b35b2fb22a3f type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:fef9b35b2fb22a3f"} 08:40:09 [08:40:09.365] INFO: prover-client:proving-broker Proving Broker started 08:40:09 [08:40:09.366] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:442360654fe675bf epochNumber=1 {"provingJobId":"1:BASE_PARITY:442360654fe675bf"} 08:40:09 [08:40:09.368] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testKxvqu7/1 with map size 1073741824 08:40:09 [08:40:09.370] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:09 [08:40:09.390] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:442360654fe675bf type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:442360654fe675bf"} 08:40:09 [08:40:09.392] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:442360654fe675bf type=BASE_PARITY totalAttempts=2 err=test error {"provingJobId":"1:BASE_PARITY:442360654fe675bf"} 08:40:09 [08:40:09.402] INFO: prover-client:proving-broker Proving Broker started 08:40:09 [08:40:09.403] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a055e7a79d017bef epochNumber=1 {"provingJobId":"1:BASE_PARITY:a055e7a79d017bef"} 08:40:09 [08:40:09.406] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testnBIuWF/1 with map size 1073741824 08:40:09 [08:40:09.408] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:09 [08:40:09.433] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:a055e7a79d017bef type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:a055e7a79d017bef"} 08:40:09 [08:40:09.445] INFO: prover-client:proving-broker Proving Broker started 08:40:09 [08:40:09.445] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:69a1255b151312dc epochNumber=1 {"provingJobId":"1:BASE_PARITY:69a1255b151312dc"} 08:40:09 [08:40:09.446] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test1bQtzz/1 with map size 1073741824 08:40:09 [08:40:09.448] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:09 [08:40:09.472] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:69a1255b151312dc type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:69a1255b151312dc"} 08:40:09 [08:40:09.473] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:69f61ecab1a4bf4c epochNumber=3 {"provingJobId":"1:BASE_PARITY:69f61ecab1a4bf4c"} 08:40:09 [08:40:09.476] INFO: prover-client:proving-broker-database Creating broker database for epoch 3 at /tmp/proving-broker-test1bQtzz/3 with map size 1073741824 08:40:09 [08:40:09.481] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:09 [08:40:09.525] INFO: prover-client:proving-broker Cleaned up jobs=1 08:40:09 [08:40:09.526] INFO: prover-client:proving-broker-database Deleting broker database for epoch 1 08:40:09 [08:40:09.530] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:69a1255b151312dc err=test error {"provingJoId":"1:BASE_PARITY:69a1255b151312dc"} 08:40:09 [08:40:09.536] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testjlOEIL/1 with map size 1073741824 08:40:09 [08:40:09.539] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:09 [08:40:09.560] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testjlOEIL/2 with map size 1073741824 08:40:09 [08:40:09.572] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:09 [08:40:09.589] INFO: prover-client:proving-broker Proving Broker started 08:40:09 [08:40:09.591] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:540397a8121a822d settled=false {"provingJobId":"1:BASE_PARITY:540397a8121a822d","status":"pending"} 08:40:09 [08:40:09.592] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:d2578ba82a15c203 settled=false {"provingJobId":"1:BASE_PARITY:d2578ba82a15c203","status":"pending"} 08:40:09 [08:40:09.598] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testlI65fd/1 with map size 1073741824 08:40:09 [08:40:09.600] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:09 [08:40:09.627] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testlI65fd/2 with map size 1073741824 08:40:09 [08:40:09.633] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:09 [08:40:09.666] INFO: prover-client:proving-broker Proving Broker started 08:40:09 [08:40:09.675] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:4c85e1ff330dd197 settled=true {"provingJobId":"1:BASE_PARITY:4c85e1ff330dd197","status":"fulfilled"} 08:40:09 [08:40:09.677] INFO: prover-client:proving-broker Restoring proving job id=2:BASE_PARITY:19e5b180d71ca51a settled=true {"provingJobId":"2:BASE_PARITY:19e5b180d71ca51a","status":"fulfilled"} 08:40:09 [08:40:09.687] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testKo26Ih/1 with map size 1073741824 08:40:09 [08:40:09.689] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:09 [08:40:09.712] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testKo26Ih/2 with map size 1073741824 08:40:09 [08:40:09.714] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:09 [08:40:09.736] INFO: prover-client:proving-broker Proving Broker started 08:40:09 [08:40:09.738] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:9079cdb1b323ab22 settled=true {"provingJobId":"1:BASE_PARITY:9079cdb1b323ab22","status":"fulfilled"} 08:40:09 [08:40:09.740] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:030b16d91f093873 settled=false {"provingJobId":"1:BASE_PARITY:030b16d91f093873","status":"pending"} 08:40:09 [08:40:09.745] INFO: prover-client:proving-broker Proving Broker started 08:40:09 [08:40:09.746] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:475817d4eb4d80e9 epochNumber=1 {"provingJobId":"1:BASE_PARITY:475817d4eb4d80e9"} 08:40:09 [08:40:09.747] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testV9CQWF/1 with map size 1073741824 08:40:09 [08:40:09.752] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:09 [08:40:09.781] INFO: prover-client:proving-broker Proving Broker started 08:40:09 [08:40:09.782] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1b6d4ffcafb72009 epochNumber=1 {"provingJobId":"1:BASE_PARITY:1b6d4ffcafb72009"} 08:40:09 [08:40:09.783] ERROR: prover-client:proving-broker Failed to save proving job id=1:BASE_PARITY:1b6d4ffcafb72009: Error: db error: Error: db error 08:40:09 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1126:63) {"provingJobId":"1:BASE_PARITY:1b6d4ffcafb72009"} 08:40:09 [08:40:09.789] INFO: prover-client:proving-broker Proving Broker started 08:40:09 [08:40:09.790] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b86602a09f629f5a epochNumber=1 {"provingJobId":"1:BASE_PARITY:b86602a09f629f5a"} 08:40:09 [08:40:09.791] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testAsQ2ke/1 with map size 1073741824 08:40:09 [08:40:09.793] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:09 [08:40:09.814] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:b86602a09f629f5a type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:b86602a09f629f5a"} 08:40:09 [08:40:09.815] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:b86602a09f629f5a type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:b86602a09f629f5a"} 08:40:09 [08:40:09.828] INFO: prover-client:proving-broker Proving Broker started 08:40:09 [08:40:09.829] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:21894aa1487b10c7 epochNumber=1 {"provingJobId":"1:BASE_PARITY:21894aa1487b10c7"} 08:40:09 [08:40:09.831] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testkVrjnE/1 with map size 1073741824 08:40:09 [08:40:09.833] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:09 [08:40:09.855] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:21894aa1487b10c7 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:21894aa1487b10c7"} 08:40:09 [08:40:09.855] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:21894aa1487b10c7 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:21894aa1487b10c7"} 08:40:09 [08:40:09.856] ERROR: prover-client:proving-broker Failed to save proving job result id=1:BASE_PARITY:21894aa1487b10c7: Error: db error 08:40:09 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1159:69) {"provingJobId":"1:BASE_PARITY:21894aa1487b10c7"} 08:40:09 [08:40:09.865] INFO: prover-client:proving-broker Proving Broker started 08:40:09 [08:40:09.866] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1b9775787df055e1 epochNumber=1 {"provingJobId":"1:BASE_PARITY:1b9775787df055e1"} 08:40:09 [08:40:09.867] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testvbXM9L/1 with map size 1073741824 08:40:09 [08:40:09.871] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:09 [08:40:09.893] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:1b9775787df055e1 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:1b9775787df055e1"} 08:40:09 [08:40:09.894] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:1b9775787df055e1 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:1b9775787df055e1"} 08:40:09 [08:40:09.907] INFO: prover-client:proving-broker Proving Broker started 08:40:09 [08:40:09.908] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b605781f9b90ab7d epochNumber=1 {"provingJobId":"1:BASE_PARITY:b605781f9b90ab7d"} 08:40:09 [08:40:09.909] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testABVsTe/1 with map size 1073741824 08:40:09 [08:40:09.913] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:09 [08:40:09.934] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:b605781f9b90ab7d type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:b605781f9b90ab7d"} 08:40:09 [08:40:09.935] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:b605781f9b90ab7d type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:b605781f9b90ab7d"} 08:40:09 [08:40:09.936] ERROR: prover-client:proving-broker Failed to save proving job error status id=1:BASE_PARITY:b605781f9b90ab7d jobErr=test error: Error: db error 08:40:09 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1192:68) {"provingJobId":"1:BASE_PARITY:b605781f9b90ab7d"} 08:40:09 [08:40:09.945] INFO: prover-client:proving-broker Proving Broker started 08:40:09 [08:40:09.946] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:58543f74c7bb2714 not found {"provingJobId":"1:BASE_PARITY:58543f74c7bb2714"} 08:40:09 [08:40:09.951] INFO: prover-client:proving-broker Proving Broker started 08:40:09 [08:40:09.952] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:e3da733a3615ed21 err=test error {"provingJoId":"1:BASE_PARITY:e3da733a3615ed21"} 08:40:09 [08:40:09.956] INFO: prover-client:proving-broker Proving Broker started 08:40:09 [08:40:09.970] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c44903628383cb22 epochNumber=1 {"provingJobId":"1:BASE_PARITY:c44903628383cb22"} 08:40:09 [08:40:09.972] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testREQdUn/1 with map size 1073741824 08:40:09 [08:40:09.977] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:10 [08:40:10.000] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:c44903628383cb22 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:c44903628383cb22"} 08:40:10 [08:40:10.001] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:c44903628383cb22 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:c44903628383cb22"} 08:40:10 [08:40:10.024] INFO: prover-client:proving-broker New proving job id=2:BASE_PARITY:479528d30fcb5480 epochNumber=2 {"provingJobId":"2:BASE_PARITY:479528d30fcb5480"} 08:40:10 [08:40:10.025] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testREQdUn/2 with map size 1073741824 08:40:10 [08:40:10.031] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:10 [08:40:10.052] WARN: prover-client:proving-broker Proving job id=2:BASE_PARITY:479528d30fcb5480 type=BASE_PARITY not in the in-progress set {"provingJobId":"2:BASE_PARITY:479528d30fcb5480"} 08:40:10 [08:40:10.053] INFO: prover-client:proving-broker Proving job complete id=2:BASE_PARITY:479528d30fcb5480 type=BASE_PARITY totalAttempts=1 {"provingJobId":"2:BASE_PARITY:479528d30fcb5480"} 08:40:10 [08:40:10.121] INFO: prover-client:proving-broker New proving job id=3:BASE_PARITY:bf0f76d2b04a8bcc epochNumber=3 {"provingJobId":"3:BASE_PARITY:bf0f76d2b04a8bcc"} 08:40:10 [08:40:10.125] INFO: prover-client:proving-broker-database Creating broker database for epoch 3 at /tmp/proving-broker-testREQdUn/3 with map size 1073741824 08:40:10 [08:40:10.127] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:10 [08:40:10.159] INFO: prover-client:proving-broker Cleaned up jobs=1 08:40:10 [08:40:10.159] INFO: prover-client:proving-broker-database Deleting broker database for epoch 1 08:40:10 [08:40:10.207] INFO: prover-client:proving-broker New proving job id=4:BASE_PARITY:0df72d6012197f2f epochNumber=4 {"provingJobId":"4:BASE_PARITY:0df72d6012197f2f"} 08:40:10 [08:40:10.208] INFO: prover-client:proving-broker-database Creating broker database for epoch 4 at /tmp/proving-broker-testREQdUn/4 with map size 1073741824 08:40:10 [08:40:10.210] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:10 [08:40:10.238] INFO: prover-client:proving-broker Cleaned up jobs=1 08:40:10 [08:40:10.239] INFO: prover-client:proving-broker-database Deleting broker database for epoch 2 08:40:10 [08:40:10.291] INFO: prover-client:proving-broker New proving job id=5:BASE_PARITY:bb0d9a32a747ee9b epochNumber=5 {"provingJobId":"5:BASE_PARITY:bb0d9a32a747ee9b"} 08:40:10 [08:40:10.292] INFO: prover-client:proving-broker-database Creating broker database for epoch 5 at /tmp/proving-broker-testREQdUn/5 with map size 1073741824 08:40:10 [08:40:10.294] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 08:40:10 [08:40:10.318] INFO: prover-client:proving-broker Cleaned up jobs=1 08:40:10 [08:40:10.318] INFO: prover-client:proving-broker-database Deleting broker database for epoch 3 08:40:10 PASS src/proving_broker/proving_broker.test.ts (13.35 s) 08:40:10 ProvingBroker 08:40:10 Producer API 08:40:10 ✓ refuses stale jobs (51 ms) 08:40:10 ✓ enqueues jobs (4 ms) 08:40:10 ✓ ignores duplicate jobs (4 ms) 08:40:10 ✓ reports correct status when enqueuing repeat jobs (4 ms) 08:40:10 ✓ throws an error in case of duplicate job IDs (28 ms) 08:40:10 ✓ returns not-found status for non-existing jobs (1 ms) 08:40:10 ✓ cancels jobs in queue (3 ms) 08:40:10 ✓ cancels jobs in-progress (2 ms) 08:40:10 ✓ returns job result if successful (3 ms) 08:40:10 ✓ returns job error if failed (2 ms) 08:40:10 ✓ correctly returns job status for concurrent writes (2 ms) 08:40:10 ✓ refuses stale jobs (50 ms) 08:40:10 ✓ enqueues jobs (36 ms) 08:40:10 ✓ ignores duplicate jobs (32 ms) 08:40:10 ✓ reports correct status when enqueuing repeat jobs (37 ms) 08:40:10 ✓ throws an error in case of duplicate job IDs (27 ms) 08:40:10 ✓ returns not-found status for non-existing jobs (4 ms) 08:40:10 ✓ cancels jobs in queue (40 ms) 08:40:10 ✓ cancels jobs in-progress (36 ms) 08:40:10 ✓ returns job result if successful (34 ms) 08:40:10 ✓ returns job error if failed (36 ms) 08:40:10 ✓ correctly returns job status for concurrent writes (43 ms) 08:40:10 Consumer API 08:40:10 ✓ returns undefined if no jobs are available (8 ms) 08:40:10 ✓ returns jobs in priority order (3 ms) 08:40:10 ✓ returns undefined if no jobs are available for the given allowList (1 ms) 08:40:10 ✓ returns a job if it is in the allowList (3 ms) 08:40:10 ✓ returns the most important job if it is in the allowList (2 ms) 08:40:10 ✓ returns any job if filter is empty (2 ms) 08:40:10 ✓ returns a new job when reporting job success (3 ms) 08:40:10 ✓ returns a new job when reporting permanent error (2 ms) 08:40:10 ✓ returns a new job when reporting retry-able error (3 ms) 08:40:10 ✓ returns a new job when reporting progress if current one is cancelled (3 ms) 08:40:10 ✓ returns a new job if job is already in progress elsewhere (1056 ms) 08:40:10 ✓ avoids sending the same job to a new agent after a restart (1005 ms) 08:40:10 ✓ avoids sending a completed job to a new agent after a restart (1009 ms) 08:40:10 ✓ tracks job result if in progress (4 ms) 08:40:10 ✓ tracks job result even if job is in queue (3 ms) 08:40:10 ✓ ignores reported job error if unknown job (2 ms) 08:40:10 ✓ ignores job result if unknown job (1 ms) 08:40:10 ✓ returns undefined if no jobs are available (4 ms) 08:40:10 ✓ returns jobs in priority order (55 ms) 08:40:10 ✓ returns undefined if no jobs are available for the given allowList (32 ms) 08:40:10 ✓ returns a job if it is in the allowList (61 ms) 08:40:10 ✓ returns the most important job if it is in the allowList (59 ms) 08:40:10 ✓ returns any job if filter is empty (60 ms) 08:40:10 ✓ returns a new job when reporting job success (39 ms) 08:40:10 ✓ returns a new job when reporting permanent error (51 ms) 08:40:10 ✓ returns a new job when reporting retry-able error (31 ms) 08:40:10 ✓ returns a new job when reporting progress if current one is cancelled (38 ms) 08:40:10 ✓ returns a new job if job is already in progress elsewhere (1125 ms) 08:40:10 ✓ avoids sending the same job to a new agent after a restart (1061 ms) 08:40:10 ✓ avoids sending a completed job to a new agent after a restart (1074 ms) 08:40:10 ✓ tracks job result if in progress (65 ms) 08:40:10 ✓ tracks job result even if job is in queue (63 ms) 08:40:10 ✓ ignores reported job error if unknown job (4 ms) 08:40:10 ✓ ignores job result if unknown job (3 ms) 08:40:10 Timeouts 08:40:10 ✓ tracks in progress jobs (1 ms) 08:40:10 ✓ re-enqueues jobs that time out (109 ms) 08:40:10 ✓ cancel stale jobs that time out (240 ms) 08:40:10 ✓ keeps the jobs in progress while it is alive (204 ms) 08:40:10 ✓ tracks in progress jobs (27 ms) 08:40:10 ✓ re-enqueues jobs that time out (130 ms) 08:40:10 ✓ cancel stale jobs that time out (286 ms) 08:40:10 ✓ keeps the jobs in progress while it is alive (228 ms) 08:40:10 Retries 08:40:10 ✓ retries jobs (3 ms) 08:40:10 ✓ retries up to a maximum number of times (2 ms) 08:40:10 ✓ passing retry=false does not retry (2 ms) 08:40:10 ✓ does not retry if job is stale (28 ms) 08:40:10 ✓ retries jobs (29 ms) 08:40:10 ✓ retries up to a maximum number of times (43 ms) 08:40:10 ✓ passing retry=false does not retry (40 ms) 08:40:10 ✓ does not retry if job is stale (90 ms) 08:40:10 Database management 08:40:10 ✓ re-enqueues proof requests on start (3 ms) 08:40:10 ✓ restores proof results on start (2 ms) 08:40:10 ✓ only re-enqueues unfinished jobs (2 ms) 08:40:10 ✓ saves job when enqueued (3 ms) 08:40:10 ✓ does not retain job if database fails to save (3 ms) 08:40:10 ✓ saves job result (5 ms) 08:40:10 ✓ saves result even if database fails to save (2 ms) 08:40:10 ✓ saves job error (3 ms) 08:40:10 ✓ saves job error even if database fails to save (3 ms) 08:40:10 ✓ does not save job result if job is unknown (2 ms) 08:40:10 ✓ does not save job error if job is unknown (1 ms) 08:40:10 ✓ cleans up old jobs periodically (264 ms) 08:40:10 ✓ re-enqueues proof requests on start (63 ms) 08:40:10 ✓ restores proof results on start (86 ms) 08:40:10 ✓ only re-enqueues unfinished jobs (58 ms) 08:40:10 ✓ saves job when enqueued (33 ms) 08:40:10 ✓ does not retain job if database fails to save (8 ms) 08:40:10 ✓ saves job result (38 ms) 08:40:10 ✓ saves result even if database fails to save (34 ms) 08:40:10 ✓ saves job error (44 ms) 08:40:10 ✓ saves job error even if database fails to save (36 ms) 08:40:10 ✓ does not save job result if job is unknown (7 ms) 08:40:10 ✓ does not save job error if job is unknown (5 ms) 08:40:10 ✓ cleans up old jobs periodically (409 ms) 08:40:10 08:40:10 Test Suites: 1 passed, 1 total 08:40:10 Tests: 96 passed, 96 total 08:40:10 Snapshots: 0 total 08:40:10 Time: 13.455 s 08:40:10 Ran all test suites matching prover-client/src/proving_broker/proving_broker.test.ts. 08:40:10 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?