Parent Log: http://ci.aztec-labs.com/bac80ed53a95468a Command: 53e9b8d3e8ba3411 yarn-project/scripts/run_test.sh prover-client/src/proving_broker/proving_broker.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/f4ac84d7ac4041d505399edd8819840bb14d6c9d Env: REF_NAME=gh-readonly-queue/master/pr-15005-b1b65bcdbd44a49fbebe5d2265256dc9466e92be CURRENT_VERSION=0.87.8 CI_FULL=1 Date: Fri Jun 13 17:10:24 UTC 2025 System: ARCH=amd64 CPUS=128 MEM=493Gi HOSTNAME=pr-15005_amd64_x2-full Resources: CPU_LIST=0-127 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_b95296ef06707e5f_master 17:10:28 [17:10:28.387] INFO: prover-client:proving-broker Proving Broker started 17:10:28 [17:10:28.393] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:be7dca5c995f30ef epochNumber=42 {"provingJobId":"1:BASE_PARITY:be7dca5c995f30ef"} 17:10:28 [17:10:28.395] WARN: prover-client:proving-broker Tried enqueueing stale proving job id=1:BASE_PARITY:926860ab25b39b7c epochNumber=1 {"provingJobId":"1:BASE_PARITY:926860ab25b39b7c"} 17:10:28 [17:10:28.419] INFO: prover-client:proving-broker Proving Broker started 17:10:28 [17:10:28.419] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:97e98e55674f8fc7 epochNumber=1 {"provingJobId":"1:BASE_PARITY:97e98e55674f8fc7"} 17:10:28 [17:10:28.420] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0b662ecc58e8fd73 epochNumber=1 {"provingJobId":"1:BASE_PARITY:0b662ecc58e8fd73"} 17:10:28 [17:10:28.422] INFO: prover-client:proving-broker Proving Broker started 17:10:28 [17:10:28.423] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:31a24a0f33c18645 epochNumber=1 {"provingJobId":"1:BASE_PARITY:31a24a0f33c18645"} 17:10:28 [17:10:28.424] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:31a24a0f33c18645 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:31a24a0f33c18645"} 17:10:28 [17:10:28.426] INFO: prover-client:proving-broker Proving Broker started 17:10:28 [17:10:28.426] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d26b7f02290d4e61 epochNumber=1 {"provingJobId":"1:BASE_PARITY:d26b7f02290d4e61"} 17:10:28 [17:10:28.427] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:d26b7f02290d4e61 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:d26b7f02290d4e61"} 17:10:28 [17:10:28.428] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:d26b7f02290d4e61 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:d26b7f02290d4e61"} 17:10:28 [17:10:28.428] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:d26b7f02290d4e61 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:d26b7f02290d4e61"} 17:10:28 [17:10:28.429] INFO: prover-client:proving-broker Proving Broker started 17:10:28 [17:10:28.430] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f28bffa6e748b1e2 epochNumber=1 {"provingJobId":"1:BASE_PARITY:f28bffa6e748b1e2"} 17:10:28 [17:10:28.456] INFO: prover-client:proving-broker Proving Broker started 17:10:28 [17:10:28.457] INFO: prover-client:proving-broker Proving Broker started 17:10:28 [17:10:28.458] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:851e030b571a6b48 epochNumber=1 {"provingJobId":"1:BASE_PARITY:851e030b571a6b48"} 17:10:28 [17:10:28.458] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:851e030b571a6b48 {"provingJobId":"1:BASE_PARITY:851e030b571a6b48"} 17:10:28 [17:10:28.459] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:851e030b571a6b48 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:851e030b571a6b48"} 17:10:28 [17:10:28.459] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:851e030b571a6b48 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:851e030b571a6b48"} 17:10:28 [17:10:28.461] INFO: prover-client:proving-broker Proving Broker started 17:10:28 [17:10:28.462] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:55b7f75829701821 epochNumber=1 {"provingJobId":"1:BASE_PARITY:55b7f75829701821"} 17:10:28 [17:10:28.462] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:55b7f75829701821 {"provingJobId":"1:BASE_PARITY:55b7f75829701821"} 17:10:28 [17:10:28.463] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:55b7f75829701821 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:55b7f75829701821"} 17:10:28 [17:10:28.464] INFO: prover-client:proving-broker Proving Broker started 17:10:28 [17:10:28.465] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e1a991a5ef210d03 epochNumber=1 {"provingJobId":"1:BASE_PARITY:e1a991a5ef210d03"} 17:10:28 [17:10:28.465] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:e1a991a5ef210d03 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:e1a991a5ef210d03"} 17:10:28 [17:10:28.466] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:e1a991a5ef210d03 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:e1a991a5ef210d03"} 17:10:28 [17:10:28.467] INFO: prover-client:proving-broker Proving Broker started 17:10:28 [17:10:28.468] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:86ecb22aed21769d epochNumber=1 {"provingJobId":"1:BASE_PARITY:86ecb22aed21769d"} 17:10:28 [17:10:28.468] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:86ecb22aed21769d type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:86ecb22aed21769d"} 17:10:28 [17:10:28.469] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:86ecb22aed21769d type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:86ecb22aed21769d"} 17:10:28 [17:10:28.470] INFO: prover-client:proving-broker Proving Broker started 17:10:28 [17:10:28.470] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3df2b0ec934a0d66 epochNumber=0 {"provingJobId":"1:BASE_PARITY:3df2b0ec934a0d66"} 17:10:28 [17:10:28.471] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:3df2b0ec934a0d66 epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:3df2b0ec934a0d66"} 17:10:28 [17:10:28.471] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:bab9869f4ab31dad epochNumber=0 {"provingJobId":"1:BASE_PARITY:bab9869f4ab31dad"} 17:10:28 [17:10:28.471] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:3df2b0ec934a0d66 epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:3df2b0ec934a0d66"} 17:10:28 [17:10:28.472] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2ebb40d731220184 epochNumber=0 {"provingJobId":"1:BASE_PARITY:2ebb40d731220184"} 17:10:28 [17:10:28.473] INFO: prover-client:proving-broker Proving Broker started 17:10:28 [17:10:28.474] INFO: prover-client:proving-broker Proving Broker started 17:10:28 [17:10:28.475] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a062c82f15f4bfcc epochNumber=2 {"provingJobId":"1:BASE_PARITY:a062c82f15f4bfcc"} 17:10:28 [17:10:28.475] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:707cf056fa9beacd epochNumber=1 {"provingJobId":"1:BASE_PARITY:707cf056fa9beacd"} 17:10:28 [17:10:28.476] INFO: prover-client:proving-broker Proving Broker started 17:10:28 [17:10:28.477] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f0d1f5ff7829f100 epochNumber=1 {"provingJobId":"1:BASE_PARITY:f0d1f5ff7829f100"} 17:10:28 [17:10:28.478] INFO: prover-client:proving-broker Proving Broker started 17:10:28 [17:10:28.478] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d3ad6b8a2c162837 epochNumber=1 {"provingJobId":"1:BASE_PARITY:d3ad6b8a2c162837"} 17:10:28 [17:10:28.478] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c70afa578d6e8c2c epochNumber=1 {"provingJobId":"1:BASE_PARITY:c70afa578d6e8c2c"} 17:10:28 [17:10:28.479] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:af561eea4facad42 epochNumber=2 {"provingJobId":"1:BASE_PARITY:af561eea4facad42"} 17:10:28 [17:10:28.479] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7b75079ca9c45bd1 epochNumber=1 {"provingJobId":"1:BASE_PARITY:7b75079ca9c45bd1"} 17:10:28 [17:10:28.480] INFO: prover-client:proving-broker Proving Broker started 17:10:28 [17:10:28.481] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:473572f1babbcfcf epochNumber=1 {"provingJobId":"1:BASE_PARITY:473572f1babbcfcf"} 17:10:28 [17:10:28.481] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:fa4b52db8fd87b0b epochNumber=1 {"provingJobId":"1:BASE_PARITY:fa4b52db8fd87b0b"} 17:10:28 [17:10:28.481] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:480ab12b140b4957 epochNumber=2 {"provingJobId":"1:BASE_PARITY:480ab12b140b4957"} 17:10:28 [17:10:28.481] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ce48a0f74013c6a5 epochNumber=1 {"provingJobId":"1:BASE_PARITY:ce48a0f74013c6a5"} 17:10:28 [17:10:28.483] INFO: prover-client:proving-broker Proving Broker started 17:10:28 [17:10:28.483] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0293267acfccc223 epochNumber=1 {"provingJobId":"1:BASE_PARITY:0293267acfccc223"} 17:10:28 [17:10:28.483] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:80c634ba9f2721f9 epochNumber=1 {"provingJobId":"1:BASE_PARITY:80c634ba9f2721f9"} 17:10:28 [17:10:28.484] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:48a8b45605ae2e15 epochNumber=2 {"provingJobId":"1:BASE_PARITY:48a8b45605ae2e15"} 17:10:28 [17:10:28.484] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:00c940735173d580 epochNumber=1 {"provingJobId":"1:BASE_PARITY:00c940735173d580"} 17:10:28 [17:10:28.485] INFO: prover-client:proving-broker Proving Broker started 17:10:28 [17:10:28.485] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3c92d9d0a831b846 epochNumber=1 {"provingJobId":"1:BASE_PARITY:3c92d9d0a831b846"} 17:10:28 [17:10:28.486] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c715a5a7654e798b epochNumber=1 {"provingJobId":"1:BASE_PARITY:c715a5a7654e798b"} 17:10:28 [17:10:28.486] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:3c92d9d0a831b846 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:3c92d9d0a831b846"} 17:10:28 [17:10:28.488] INFO: prover-client:proving-broker Proving Broker started 17:10:28 [17:10:28.488] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:daa52885a5ca5a52 epochNumber=1 {"provingJobId":"1:BASE_PARITY:daa52885a5ca5a52"} 17:10:28 [17:10:28.488] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:5a1290e95a71f11b epochNumber=1 {"provingJobId":"1:BASE_PARITY:5a1290e95a71f11b"} 17:10:28 [17:10:28.489] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:daa52885a5ca5a52 type=BASE_PARITY totalAttempts=1 err=result {"provingJobId":"1:BASE_PARITY:daa52885a5ca5a52"} 17:10:28 [17:10:28.489] INFO: prover-client:proving-broker Proving Broker started 17:10:28 [17:10:28.490] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:20d61c6464b19ed2 epochNumber=1 {"provingJobId":"1:BASE_PARITY:20d61c6464b19ed2"} 17:10:28 [17:10:28.490] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1ebd553163420812 epochNumber=1 {"provingJobId":"1:BASE_PARITY:1ebd553163420812"} 17:10:28 [17:10:28.490] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:20d61c6464b19ed2 type=BASE_PARITY retry=1 err=result {"provingJobId":"1:BASE_PARITY:20d61c6464b19ed2"} 17:10:28 [17:10:28.491] INFO: prover-client:proving-broker Proving Broker started 17:10:28 [17:10:28.491] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c2f369d16355460d epochNumber=1 {"provingJobId":"1:BASE_PARITY:c2f369d16355460d"} 17:10:28 [17:10:28.491] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:c2f369d16355460d {"provingJobId":"1:BASE_PARITY:c2f369d16355460d"} 17:10:28 [17:10:28.492] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:c2f369d16355460d type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:c2f369d16355460d"} 17:10:28 [17:10:28.492] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a564726a44e63532 epochNumber=1 {"provingJobId":"1:BASE_PARITY:a564726a44e63532"} 17:10:28 [17:10:28.492] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:c2f369d16355460d has already been completed {"provingJobId":"1:BASE_PARITY:c2f369d16355460d"} 17:10:28 [17:10:28.493] INFO: prover-client:proving-broker Proving Broker started 17:10:28 [17:10:28.493] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:bc7ea59d55aa661c epochNumber=1 {"provingJobId":"1:BASE_PARITY:bc7ea59d55aa661c"} 17:10:28 [17:10:28.493] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ce49335ee749e17a epochNumber=2 {"provingJobId":"1:BASE_PARITY:ce49335ee749e17a"} 17:10:29 [17:10:29.546] INFO: prover-client:proving-broker Proving Broker started 17:10:29 [17:10:29.546] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:bc7ea59d55aa661c settled=false {"provingJobId":"1:BASE_PARITY:bc7ea59d55aa661c","status":"pending"} 17:10:29 [17:10:29.547] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:ce49335ee749e17a settled=false {"provingJobId":"1:BASE_PARITY:ce49335ee749e17a","status":"pending"} 17:10:29 [17:10:29.548] INFO: prover-client:proving-broker Proving job id=1:BASE_PARITY:bc7ea59d55aa661c type=BASE_PARITY startedAt=1749834628494 older agent has taken job {"provingJobId":"1:BASE_PARITY:bc7ea59d55aa661c"} 17:10:29 [17:10:29.549] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:bc7ea59d55aa661c type=BASE_PARITY already being worked on by another agent. Sending new one {"provingJobId":"1:BASE_PARITY:bc7ea59d55aa661c"} 17:10:29 [17:10:29.550] INFO: prover-client:proving-broker Proving Broker started 17:10:29 [17:10:29.551] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:60fc9f82b50598fa epochNumber=1 {"provingJobId":"1:BASE_PARITY:60fc9f82b50598fa"} 17:10:29 [17:10:29.551] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7e16eb8aa586c9e9 epochNumber=2 {"provingJobId":"1:BASE_PARITY:7e16eb8aa586c9e9"} 17:10:30 [17:10:30.552] INFO: prover-client:proving-broker Proving Broker started 17:10:30 [17:10:30.553] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:60fc9f82b50598fa settled=false {"provingJobId":"1:BASE_PARITY:60fc9f82b50598fa","status":"pending"} 17:10:30 [17:10:30.553] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:7e16eb8aa586c9e9 settled=false {"provingJobId":"1:BASE_PARITY:7e16eb8aa586c9e9","status":"pending"} 17:10:30 [17:10:30.554] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:60fc9f82b50598fa type=BASE_PARITY not found in the in-progress cache, adding it {"provingJobId":"1:BASE_PARITY:60fc9f82b50598fa"} 17:10:30 [17:10:30.556] INFO: prover-client:proving-broker Proving Broker started 17:10:30 [17:10:30.557] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2478accd22bd3022 epochNumber=1 {"provingJobId":"1:BASE_PARITY:2478accd22bd3022"} 17:10:30 [17:10:30.557] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d4f510ea3a39c949 epochNumber=2 {"provingJobId":"1:BASE_PARITY:d4f510ea3a39c949"} 17:10:31 [17:10:31.557] INFO: prover-client:proving-broker Proving Broker started 17:10:31 [17:10:31.558] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:2478accd22bd3022 settled=false {"provingJobId":"1:BASE_PARITY:2478accd22bd3022","status":"pending"} 17:10:31 [17:10:31.558] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:d4f510ea3a39c949 settled=false {"provingJobId":"1:BASE_PARITY:d4f510ea3a39c949","status":"pending"} 17:10:31 [17:10:31.559] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:2478accd22bd3022 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:2478accd22bd3022"} 17:10:31 [17:10:31.559] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:2478accd22bd3022 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:2478accd22bd3022"} 17:10:31 [17:10:31.561] INFO: prover-client:proving-broker Proving Broker started 17:10:31 [17:10:31.561] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9d30293d266485af epochNumber=1 {"provingJobId":"1:BASE_PARITY:9d30293d266485af"} 17:10:31 [17:10:31.561] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7b1f96eb9f467067 epochNumber=2 {"provingJobId":"1:BASE_PARITY:7b1f96eb9f467067"} 17:10:31 [17:10:31.562] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:9d30293d266485af type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:9d30293d266485af"} 17:10:31 [17:10:31.563] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:7b1f96eb9f467067 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:7b1f96eb9f467067"} 17:10:31 [17:10:31.564] INFO: prover-client:proving-broker Proving Broker started 17:10:31 [17:10:31.564] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:167f7991b0bc2dcc epochNumber=1 {"provingJobId":"1:BASE_PARITY:167f7991b0bc2dcc"} 17:10:31 [17:10:31.564] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f470387f005f9c31 epochNumber=2 {"provingJobId":"1:BASE_PARITY:f470387f005f9c31"} 17:10:31 [17:10:31.565] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:167f7991b0bc2dcc type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:167f7991b0bc2dcc"} 17:10:31 [17:10:31.565] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:167f7991b0bc2dcc type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:167f7991b0bc2dcc"} 17:10:31 [17:10:31.565] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:f470387f005f9c31 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:f470387f005f9c31"} 17:10:31 [17:10:31.566] INFO: prover-client:proving-broker Proving Broker started 17:10:31 [17:10:31.567] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:aed9acbe0e9ec1e1 err=test error {"provingJoId":"1:BASE_PARITY:aed9acbe0e9ec1e1"} 17:10:31 [17:10:31.567] INFO: prover-client:proving-broker Proving Broker started 17:10:31 [17:10:31.568] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:e40ffb84deb219da not found {"provingJobId":"1:BASE_PARITY:e40ffb84deb219da"} 17:10:31 [17:10:31.569] INFO: prover-client:proving-broker Proving Broker started 17:10:31 [17:10:31.569] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:123af72c1acfa184 epochNumber=1 {"provingJobId":"1:BASE_PARITY:123af72c1acfa184"} 17:10:31 [17:10:31.570] INFO: prover-client:proving-broker Proving Broker started 17:10:31 [17:10:31.571] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:abeff1a2ccbd9693 epochNumber=1 {"provingJobId":"1:BASE_PARITY:abeff1a2ccbd9693"} 17:10:31 [17:10:31.671] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:abeff1a2ccbd9693 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:abeff1a2ccbd9693"} 17:10:31 [17:10:31.673] INFO: prover-client:proving-broker Proving Broker started 17:10:31 [17:10:31.674] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:308b740b8dfd1dd5 epochNumber=1 {"provingJobId":"1:BASE_PARITY:308b740b8dfd1dd5"} 17:10:31 [17:10:31.774] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:308b740b8dfd1dd5 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:308b740b8dfd1dd5"} 17:10:31 [17:10:31.775] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f78fcee0cb7a03ba epochNumber=10 {"provingJobId":"1:BASE_PARITY:f78fcee0cb7a03ba"} 17:10:31 [17:10:31.800] INFO: prover-client:proving-broker Cleaned up jobs=1 17:10:31 [17:10:31.903] INFO: prover-client:proving-broker Proving Broker started 17:10:31 [17:10:31.904] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:62e6ff2fe47bc0cc epochNumber=1 {"provingJobId":"1:BASE_PARITY:62e6ff2fe47bc0cc"} 17:10:32 [17:10:32.055] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:62e6ff2fe47bc0cc timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:62e6ff2fe47bc0cc"} 17:10:32 [17:10:32.108] INFO: prover-client:proving-broker Proving Broker started 17:10:32 [17:10:32.109] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:55fb4bca1a18b666 epochNumber=1 {"provingJobId":"1:BASE_PARITY:55fb4bca1a18b666"} 17:10:32 [17:10:32.110] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:55fb4bca1a18b666 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:55fb4bca1a18b666"} 17:10:32 [17:10:32.111] INFO: prover-client:proving-broker Proving Broker started 17:10:32 [17:10:32.112] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:80612bc81051edd3 epochNumber=1 {"provingJobId":"1:BASE_PARITY:80612bc81051edd3"} 17:10:32 [17:10:32.113] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:80612bc81051edd3 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:80612bc81051edd3"} 17:10:32 [17:10:32.113] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:80612bc81051edd3 type=BASE_PARITY totalAttempts=2 err=test error {"provingJobId":"1:BASE_PARITY:80612bc81051edd3"} 17:10:32 [17:10:32.114] INFO: prover-client:proving-broker Proving Broker started 17:10:32 [17:10:32.115] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e49c320fffb48993 epochNumber=1 {"provingJobId":"1:BASE_PARITY:e49c320fffb48993"} 17:10:32 [17:10:32.116] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:e49c320fffb48993 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:e49c320fffb48993"} 17:10:32 [17:10:32.117] INFO: prover-client:proving-broker Proving Broker started 17:10:32 [17:10:32.117] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ef19d16e805fafc6 epochNumber=1 {"provingJobId":"1:BASE_PARITY:ef19d16e805fafc6"} 17:10:32 [17:10:32.118] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:ef19d16e805fafc6 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:ef19d16e805fafc6"} 17:10:32 [17:10:32.118] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e1b484a21464af73 epochNumber=3 {"provingJobId":"1:BASE_PARITY:e1b484a21464af73"} 17:10:32 [17:10:32.143] INFO: prover-client:proving-broker Cleaned up jobs=1 17:10:32 [17:10:32.144] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:ef19d16e805fafc6 err=test error {"provingJoId":"1:BASE_PARITY:ef19d16e805fafc6"} 17:10:32 [17:10:32.146] INFO: prover-client:proving-broker Proving Broker started 17:10:32 [17:10:32.146] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:cd0f079d15816437 settled=false {"provingJobId":"1:BASE_PARITY:cd0f079d15816437","status":"pending"} 17:10:32 [17:10:32.146] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:e1f1194fd143d0cc settled=false {"provingJobId":"1:BASE_PARITY:e1f1194fd143d0cc","status":"pending"} 17:10:32 [17:10:32.148] INFO: prover-client:proving-broker Proving Broker started 17:10:32 [17:10:32.149] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:dc93dc0cae5d0af4 settled=true {"provingJobId":"1:BASE_PARITY:dc93dc0cae5d0af4","status":"fulfilled"} 17:10:32 [17:10:32.149] INFO: prover-client:proving-broker Restoring proving job id=2:BASE_PARITY:acc1676f56dd1ed2 settled=true {"provingJobId":"2:BASE_PARITY:acc1676f56dd1ed2","status":"fulfilled"} 17:10:32 [17:10:32.150] INFO: prover-client:proving-broker Proving Broker started 17:10:32 [17:10:32.150] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:48ddffbb778d3be1 settled=true {"provingJobId":"1:BASE_PARITY:48ddffbb778d3be1","status":"fulfilled"} 17:10:32 [17:10:32.151] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:b76e89074e02fd0c settled=false {"provingJobId":"1:BASE_PARITY:b76e89074e02fd0c","status":"pending"} 17:10:32 [17:10:32.152] INFO: prover-client:proving-broker Proving Broker started 17:10:32 [17:10:32.153] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b9e021c5c71aead9 epochNumber=1 {"provingJobId":"1:BASE_PARITY:b9e021c5c71aead9"} 17:10:32 [17:10:32.155] INFO: prover-client:proving-broker Proving Broker started 17:10:32 [17:10:32.155] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b328fd5f5dd6a031 epochNumber=1 {"provingJobId":"1:BASE_PARITY:b328fd5f5dd6a031"} 17:10:32 [17:10:32.156] ERROR: prover-client:proving-broker Failed to save proving job id=1:BASE_PARITY:b328fd5f5dd6a031: Error: db error: Error: db error 17:10:32 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1126:63) {"provingJobId":"1:BASE_PARITY:b328fd5f5dd6a031"} 17:10:32 [17:10:32.157] INFO: prover-client:proving-broker Proving Broker started 17:10:32 [17:10:32.157] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:dcf8d499289618cb epochNumber=1 {"provingJobId":"1:BASE_PARITY:dcf8d499289618cb"} 17:10:32 [17:10:32.157] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:dcf8d499289618cb type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:dcf8d499289618cb"} 17:10:32 [17:10:32.158] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:dcf8d499289618cb type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:dcf8d499289618cb"} 17:10:32 [17:10:32.159] INFO: prover-client:proving-broker Proving Broker started 17:10:32 [17:10:32.159] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:4f2621a2eee9f61f epochNumber=1 {"provingJobId":"1:BASE_PARITY:4f2621a2eee9f61f"} 17:10:32 [17:10:32.159] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:4f2621a2eee9f61f type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:4f2621a2eee9f61f"} 17:10:32 [17:10:32.159] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:4f2621a2eee9f61f type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:4f2621a2eee9f61f"} 17:10:32 [17:10:32.160] ERROR: prover-client:proving-broker Failed to save proving job result id=1:BASE_PARITY:4f2621a2eee9f61f: Error: db error 17:10:32 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1159:69) {"provingJobId":"1:BASE_PARITY:4f2621a2eee9f61f"} 17:10:32 [17:10:32.161] INFO: prover-client:proving-broker Proving Broker started 17:10:32 [17:10:32.161] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f95578c08191a50f epochNumber=1 {"provingJobId":"1:BASE_PARITY:f95578c08191a50f"} 17:10:32 [17:10:32.161] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:f95578c08191a50f type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:f95578c08191a50f"} 17:10:32 [17:10:32.162] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:f95578c08191a50f type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:f95578c08191a50f"} 17:10:32 [17:10:32.163] INFO: prover-client:proving-broker Proving Broker started 17:10:32 [17:10:32.163] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:920640b21e6fe2b2 epochNumber=1 {"provingJobId":"1:BASE_PARITY:920640b21e6fe2b2"} 17:10:32 [17:10:32.163] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:920640b21e6fe2b2 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:920640b21e6fe2b2"} 17:10:32 [17:10:32.163] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:920640b21e6fe2b2 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:920640b21e6fe2b2"} 17:10:32 [17:10:32.164] ERROR: prover-client:proving-broker Failed to save proving job error status id=1:BASE_PARITY:920640b21e6fe2b2 jobErr=test error: Error: db error 17:10:32 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1192:68) {"provingJobId":"1:BASE_PARITY:920640b21e6fe2b2"} 17:10:32 [17:10:32.165] INFO: prover-client:proving-broker Proving Broker started 17:10:32 [17:10:32.165] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:6a3f7213c6dedd71 not found {"provingJobId":"1:BASE_PARITY:6a3f7213c6dedd71"} 17:10:32 [17:10:32.166] INFO: prover-client:proving-broker Proving Broker started 17:10:32 [17:10:32.167] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:e15831f2d3e461a9 err=test error {"provingJoId":"1:BASE_PARITY:e15831f2d3e461a9"} 17:10:32 [17:10:32.168] INFO: prover-client:proving-broker Proving Broker started 17:10:32 [17:10:32.178] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:42fc9a5784f3d7e9 epochNumber=1 {"provingJobId":"1:BASE_PARITY:42fc9a5784f3d7e9"} 17:10:32 [17:10:32.178] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:42fc9a5784f3d7e9 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:42fc9a5784f3d7e9"} 17:10:32 [17:10:32.179] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:42fc9a5784f3d7e9 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:42fc9a5784f3d7e9"} 17:10:32 [17:10:32.189] INFO: prover-client:proving-broker New proving job id=2:BASE_PARITY:df5b002f849aa93b epochNumber=2 {"provingJobId":"2:BASE_PARITY:df5b002f849aa93b"} 17:10:32 [17:10:32.189] WARN: prover-client:proving-broker Proving job id=2:BASE_PARITY:df5b002f849aa93b type=BASE_PARITY not in the in-progress set {"provingJobId":"2:BASE_PARITY:df5b002f849aa93b"} 17:10:32 [17:10:32.190] INFO: prover-client:proving-broker Proving job complete id=2:BASE_PARITY:df5b002f849aa93b type=BASE_PARITY totalAttempts=1 {"provingJobId":"2:BASE_PARITY:df5b002f849aa93b"} 17:10:32 [17:10:32.251] INFO: prover-client:proving-broker New proving job id=3:BASE_PARITY:72a7fa9a4d80660d epochNumber=3 {"provingJobId":"3:BASE_PARITY:72a7fa9a4d80660d"} 17:10:32 [17:10:32.269] INFO: prover-client:proving-broker Cleaned up jobs=1 17:10:32 [17:10:32.314] INFO: prover-client:proving-broker New proving job id=4:BASE_PARITY:dc16030195b5f347 epochNumber=4 {"provingJobId":"4:BASE_PARITY:dc16030195b5f347"} 17:10:32 [17:10:32.321] INFO: prover-client:proving-broker Cleaned up jobs=1 17:10:32 [17:10:32.376] INFO: prover-client:proving-broker New proving job id=5:BASE_PARITY:700e3bb869ff4599 epochNumber=5 {"provingJobId":"5:BASE_PARITY:700e3bb869ff4599"} 17:10:32 [17:10:32.397] INFO: prover-client:proving-broker Cleaned up jobs=1 17:10:32 [17:10:32.431] INFO: prover-client:proving-broker Proving Broker started 17:10:32 [17:10:32.432] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:00277914a0abfeae epochNumber=42 {"provingJobId":"1:BASE_PARITY:00277914a0abfeae"} 17:10:32 [17:10:32.433] INFO: prover-client:proving-broker-database Creating broker database for epoch 42 at /tmp/proving-broker-testkjscxL/42 with map size 1073741824 17:10:32 [17:10:32.439] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:32 [17:10:32.465] WARN: prover-client:proving-broker Tried enqueueing stale proving job id=1:BASE_PARITY:52030b6b52b897fd epochNumber=1 {"provingJobId":"1:BASE_PARITY:52030b6b52b897fd"} 17:10:32 [17:10:32.470] INFO: prover-client:proving-broker Proving Broker started 17:10:32 [17:10:32.471] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ee87c87f9ea98b21 epochNumber=1 {"provingJobId":"1:BASE_PARITY:ee87c87f9ea98b21"} 17:10:32 [17:10:32.472] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testY0mOQ8/1 with map size 1073741824 17:10:32 [17:10:32.476] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:32 [17:10:32.499] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:fc27f4d9589a7200 epochNumber=1 {"provingJobId":"1:BASE_PARITY:fc27f4d9589a7200"} 17:10:32 [17:10:32.512] INFO: prover-client:proving-broker Proving Broker started 17:10:32 [17:10:32.512] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:629c4b42270f120d epochNumber=1 {"provingJobId":"1:BASE_PARITY:629c4b42270f120d"} 17:10:32 [17:10:32.513] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testbTAYBE/1 with map size 1073741824 17:10:32 [17:10:32.518] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:32 [17:10:32.536] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:629c4b42270f120d epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:629c4b42270f120d"} 17:10:32 [17:10:32.543] INFO: prover-client:proving-broker Proving Broker started 17:10:32 [17:10:32.543] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7f62b2722364c139 epochNumber=1 {"provingJobId":"1:BASE_PARITY:7f62b2722364c139"} 17:10:32 [17:10:32.544] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testTFiaWM/1 with map size 1073741824 17:10:32 [17:10:32.548] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:32 [17:10:32.566] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:7f62b2722364c139 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:7f62b2722364c139"} 17:10:32 [17:10:32.567] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:7f62b2722364c139 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:7f62b2722364c139"} 17:10:32 [17:10:32.573] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:7f62b2722364c139 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:7f62b2722364c139"} 17:10:32 [17:10:32.576] INFO: prover-client:proving-broker Proving Broker started 17:10:32 [17:10:32.577] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:5b7d86006e42083e epochNumber=1 {"provingJobId":"1:BASE_PARITY:5b7d86006e42083e"} 17:10:32 [17:10:32.578] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testf0GWC1/1 with map size 1073741824 17:10:32 [17:10:32.591] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:32 [17:10:32.616] INFO: prover-client:proving-broker Proving Broker started 17:10:32 [17:10:32.618] INFO: prover-client:proving-broker Proving Broker started 17:10:32 [17:10:32.619] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:99ba0ea14f8db61b epochNumber=1 {"provingJobId":"1:BASE_PARITY:99ba0ea14f8db61b"} 17:10:32 [17:10:32.619] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testXXC7kC/1 with map size 1073741824 17:10:32 [17:10:32.623] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:32 [17:10:32.640] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:99ba0ea14f8db61b {"provingJobId":"1:BASE_PARITY:99ba0ea14f8db61b"} 17:10:32 [17:10:32.641] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:99ba0ea14f8db61b type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:99ba0ea14f8db61b"} 17:10:32 [17:10:32.641] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:99ba0ea14f8db61b type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:99ba0ea14f8db61b"} 17:10:32 [17:10:32.650] INFO: prover-client:proving-broker Proving Broker started 17:10:32 [17:10:32.652] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a9837eaea20ecbae epochNumber=1 {"provingJobId":"1:BASE_PARITY:a9837eaea20ecbae"} 17:10:32 [17:10:32.653] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testAkEG0s/1 with map size 1073741824 17:10:32 [17:10:32.655] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:32 [17:10:32.677] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:a9837eaea20ecbae {"provingJobId":"1:BASE_PARITY:a9837eaea20ecbae"} 17:10:32 [17:10:32.677] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:a9837eaea20ecbae type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:a9837eaea20ecbae"} 17:10:32 [17:10:32.693] INFO: prover-client:proving-broker Proving Broker started 17:10:32 [17:10:32.695] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:44bc6d13fcafc7f9 epochNumber=1 {"provingJobId":"1:BASE_PARITY:44bc6d13fcafc7f9"} 17:10:32 [17:10:32.697] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testopygOo/1 with map size 1073741824 17:10:32 [17:10:32.700] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:32 [17:10:32.719] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:44bc6d13fcafc7f9 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:44bc6d13fcafc7f9"} 17:10:32 [17:10:32.719] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:44bc6d13fcafc7f9 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:44bc6d13fcafc7f9"} 17:10:32 [17:10:32.728] INFO: prover-client:proving-broker Proving Broker started 17:10:32 [17:10:32.729] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:99f0f664ffdf1586 epochNumber=1 {"provingJobId":"1:BASE_PARITY:99f0f664ffdf1586"} 17:10:32 [17:10:32.730] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testLE7VHU/1 with map size 1073741824 17:10:32 [17:10:32.733] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:32 [17:10:32.752] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:99f0f664ffdf1586 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:99f0f664ffdf1586"} 17:10:32 [17:10:32.753] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:99f0f664ffdf1586 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:99f0f664ffdf1586"} 17:10:32 [17:10:32.762] INFO: prover-client:proving-broker Proving Broker started 17:10:32 [17:10:32.763] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:4968f84c6f9ecd4e epochNumber=0 {"provingJobId":"1:BASE_PARITY:4968f84c6f9ecd4e"} 17:10:32 [17:10:32.764] INFO: prover-client:proving-broker-database Creating broker database for epoch 0 at /tmp/proving-broker-testT5ObwI/0 with map size 1073741824 17:10:32 [17:10:32.766] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:32 [17:10:32.791] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:4968f84c6f9ecd4e epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:4968f84c6f9ecd4e"} 17:10:32 [17:10:32.792] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f2a67f135324ddc3 epochNumber=0 {"provingJobId":"1:BASE_PARITY:f2a67f135324ddc3"} 17:10:32 [17:10:32.793] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:4968f84c6f9ecd4e epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:4968f84c6f9ecd4e"} 17:10:32 [17:10:32.794] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ad53bc3b19c77f44 epochNumber=0 {"provingJobId":"1:BASE_PARITY:ad53bc3b19c77f44"} 17:10:32 [17:10:32.815] INFO: prover-client:proving-broker Proving Broker started 17:10:32 [17:10:32.818] INFO: prover-client:proving-broker Proving Broker started 17:10:32 [17:10:32.818] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d3c6b5d6f11dd7e5 epochNumber=2 {"provingJobId":"1:BASE_PARITY:d3c6b5d6f11dd7e5"} 17:10:32 [17:10:32.819] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testG9o6L5/2 with map size 1073741824 17:10:32 [17:10:32.821] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:32 [17:10:32.840] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:37df187efa5c8a0d epochNumber=1 {"provingJobId":"1:BASE_PARITY:37df187efa5c8a0d"} 17:10:32 [17:10:32.842] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testG9o6L5/1 with map size 1073741824 17:10:32 [17:10:32.844] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:32 [17:10:32.869] INFO: prover-client:proving-broker Proving Broker started 17:10:32 [17:10:32.869] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:162d35e5aee2c5ed epochNumber=1 {"provingJobId":"1:BASE_PARITY:162d35e5aee2c5ed"} 17:10:32 [17:10:32.870] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testW5lUwP/1 with map size 1073741824 17:10:32 [17:10:32.875] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:32 [17:10:32.909] INFO: prover-client:proving-broker Proving Broker started 17:10:32 [17:10:32.910] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:66d5195df05f9147 epochNumber=1 {"provingJobId":"1:BASE_PARITY:66d5195df05f9147"} 17:10:32 [17:10:32.911] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testkV0qMp/1 with map size 1073741824 17:10:32 [17:10:32.913] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:32 [17:10:32.930] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0cf21b1a2155db5f epochNumber=1 {"provingJobId":"1:BASE_PARITY:0cf21b1a2155db5f"} 17:10:32 [17:10:32.936] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ef50c05c6d2860c5 epochNumber=2 {"provingJobId":"1:BASE_PARITY:ef50c05c6d2860c5"} 17:10:32 [17:10:32.937] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testkV0qMp/2 with map size 1073741824 17:10:32 [17:10:32.940] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:32 [17:10:32.958] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:452f071d9fe5c57f epochNumber=1 {"provingJobId":"1:BASE_PARITY:452f071d9fe5c57f"} 17:10:32 [17:10:32.967] INFO: prover-client:proving-broker Proving Broker started 17:10:32 [17:10:32.967] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:56d6f2197b412e4e epochNumber=1 {"provingJobId":"1:BASE_PARITY:56d6f2197b412e4e"} 17:10:32 [17:10:32.968] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testi3bx0m/1 with map size 1073741824 17:10:32 [17:10:32.969] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:32 [17:10:32.990] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:999fafae85b9d0bd epochNumber=1 {"provingJobId":"1:BASE_PARITY:999fafae85b9d0bd"} 17:10:33 [17:10:33.000] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d007bf54caab92b5 epochNumber=2 {"provingJobId":"1:BASE_PARITY:d007bf54caab92b5"} 17:10:33 [17:10:33.002] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testi3bx0m/2 with map size 1073741824 17:10:33 [17:10:33.004] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:33 [17:10:33.028] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ba2ec8ab27804acd epochNumber=1 {"provingJobId":"1:BASE_PARITY:ba2ec8ab27804acd"} 17:10:33 [17:10:33.037] INFO: prover-client:proving-broker Proving Broker started 17:10:33 [17:10:33.037] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:453c8940aa9159d2 epochNumber=1 {"provingJobId":"1:BASE_PARITY:453c8940aa9159d2"} 17:10:33 [17:10:33.038] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testOpwoIR/1 with map size 1073741824 17:10:33 [17:10:33.039] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:33 [17:10:33.057] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:4ec17cc5258b5736 epochNumber=1 {"provingJobId":"1:BASE_PARITY:4ec17cc5258b5736"} 17:10:33 [17:10:33.064] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d77422afd7a62a6d epochNumber=2 {"provingJobId":"1:BASE_PARITY:d77422afd7a62a6d"} 17:10:33 [17:10:33.065] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testOpwoIR/2 with map size 1073741824 17:10:33 [17:10:33.067] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:33 [17:10:33.083] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:305d6407837be2ba epochNumber=1 {"provingJobId":"1:BASE_PARITY:305d6407837be2ba"} 17:10:33 [17:10:33.102] INFO: prover-client:proving-broker Proving Broker started 17:10:33 [17:10:33.103] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:bcc97fbe59a104af epochNumber=1 {"provingJobId":"1:BASE_PARITY:bcc97fbe59a104af"} 17:10:33 [17:10:33.103] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testxwM8qh/1 with map size 1073741824 17:10:33 [17:10:33.106] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:33 [17:10:33.121] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:92f2263373e6334a epochNumber=1 {"provingJobId":"1:BASE_PARITY:92f2263373e6334a"} 17:10:33 [17:10:33.126] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:bcc97fbe59a104af type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:bcc97fbe59a104af"} 17:10:33 [17:10:33.136] INFO: prover-client:proving-broker Proving Broker started 17:10:33 [17:10:33.136] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f807c0a418dc848c epochNumber=1 {"provingJobId":"1:BASE_PARITY:f807c0a418dc848c"} 17:10:33 [17:10:33.137] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testWlHZJx/1 with map size 1073741824 17:10:33 [17:10:33.139] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:33 [17:10:33.155] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a784a8176e9ae5a0 epochNumber=1 {"provingJobId":"1:BASE_PARITY:a784a8176e9ae5a0"} 17:10:33 [17:10:33.160] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:f807c0a418dc848c type=BASE_PARITY totalAttempts=1 err=result {"provingJobId":"1:BASE_PARITY:f807c0a418dc848c"} 17:10:33 [17:10:33.169] INFO: prover-client:proving-broker Proving Broker started 17:10:33 [17:10:33.169] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:652fd86b1fa484ba epochNumber=1 {"provingJobId":"1:BASE_PARITY:652fd86b1fa484ba"} 17:10:33 [17:10:33.170] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testY9WODG/1 with map size 1073741824 17:10:33 [17:10:33.171] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:33 [17:10:33.191] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:07b090df834e4b1d epochNumber=1 {"provingJobId":"1:BASE_PARITY:07b090df834e4b1d"} 17:10:33 [17:10:33.201] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:652fd86b1fa484ba type=BASE_PARITY retry=1 err=result {"provingJobId":"1:BASE_PARITY:652fd86b1fa484ba"} 17:10:33 [17:10:33.207] INFO: prover-client:proving-broker Proving Broker started 17:10:33 [17:10:33.208] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:96ce0f821b12c5d7 epochNumber=1 {"provingJobId":"1:BASE_PARITY:96ce0f821b12c5d7"} 17:10:33 [17:10:33.208] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testaUm9uy/1 with map size 1073741824 17:10:33 [17:10:33.211] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:33 [17:10:33.227] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:96ce0f821b12c5d7 {"provingJobId":"1:BASE_PARITY:96ce0f821b12c5d7"} 17:10:33 [17:10:33.228] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:96ce0f821b12c5d7 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:96ce0f821b12c5d7"} 17:10:33 [17:10:33.234] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b7a2d5112745ac80 epochNumber=1 {"provingJobId":"1:BASE_PARITY:b7a2d5112745ac80"} 17:10:33 [17:10:33.240] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:96ce0f821b12c5d7 has already been completed {"provingJobId":"1:BASE_PARITY:96ce0f821b12c5d7"} 17:10:33 [17:10:33.244] INFO: prover-client:proving-broker Proving Broker started 17:10:33 [17:10:33.245] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:fa34ac71be03b69b epochNumber=1 {"provingJobId":"1:BASE_PARITY:fa34ac71be03b69b"} 17:10:33 [17:10:33.246] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testAWwXCk/1 with map size 1073741824 17:10:33 [17:10:33.248] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:33 [17:10:33.264] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e120e352f7652a43 epochNumber=2 {"provingJobId":"1:BASE_PARITY:e120e352f7652a43"} 17:10:33 [17:10:33.265] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testAWwXCk/2 with map size 1073741824 17:10:33 [17:10:33.266] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:34 [17:10:34.344] INFO: prover-client:proving-broker Proving Broker started 17:10:34 [17:10:34.351] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:fa34ac71be03b69b settled=false {"provingJobId":"1:BASE_PARITY:fa34ac71be03b69b","status":"pending"} 17:10:34 [17:10:34.353] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:e120e352f7652a43 settled=false {"provingJobId":"1:BASE_PARITY:e120e352f7652a43","status":"pending"} 17:10:34 [17:10:34.354] INFO: prover-client:proving-broker Proving job id=1:BASE_PARITY:fa34ac71be03b69b type=BASE_PARITY startedAt=1749834633293 older agent has taken job {"provingJobId":"1:BASE_PARITY:fa34ac71be03b69b"} 17:10:34 [17:10:34.355] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:fa34ac71be03b69b type=BASE_PARITY already being worked on by another agent. Sending new one {"provingJobId":"1:BASE_PARITY:fa34ac71be03b69b"} 17:10:34 [17:10:34.359] INFO: prover-client:proving-broker Proving Broker started 17:10:34 [17:10:34.360] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:79112891e9f2646b epochNumber=1 {"provingJobId":"1:BASE_PARITY:79112891e9f2646b"} 17:10:34 [17:10:34.360] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testqEs0C6/1 with map size 1073741824 17:10:34 [17:10:34.362] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:34 [17:10:34.383] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:91eb41a56565ba20 epochNumber=2 {"provingJobId":"1:BASE_PARITY:91eb41a56565ba20"} 17:10:34 [17:10:34.384] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testqEs0C6/2 with map size 1073741824 17:10:34 [17:10:34.388] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:35 [17:10:35.408] INFO: prover-client:proving-broker Proving Broker started 17:10:35 [17:10:35.411] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:79112891e9f2646b settled=false {"provingJobId":"1:BASE_PARITY:79112891e9f2646b","status":"pending"} 17:10:35 [17:10:35.413] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:91eb41a56565ba20 settled=false {"provingJobId":"1:BASE_PARITY:91eb41a56565ba20","status":"pending"} 17:10:35 [17:10:35.414] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:79112891e9f2646b type=BASE_PARITY not found in the in-progress cache, adding it {"provingJobId":"1:BASE_PARITY:79112891e9f2646b"} 17:10:35 [17:10:35.418] INFO: prover-client:proving-broker Proving Broker started 17:10:35 [17:10:35.419] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:65dab85f13d0951d epochNumber=1 {"provingJobId":"1:BASE_PARITY:65dab85f13d0951d"} 17:10:35 [17:10:35.420] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test0OZdb5/1 with map size 1073741824 17:10:35 [17:10:35.422] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:35 [17:10:35.440] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:bb77257731e90671 epochNumber=2 {"provingJobId":"1:BASE_PARITY:bb77257731e90671"} 17:10:35 [17:10:35.441] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-test0OZdb5/2 with map size 1073741824 17:10:35 [17:10:35.443] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:36 [17:10:36.461] INFO: prover-client:proving-broker Proving Broker started 17:10:36 [17:10:36.463] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:65dab85f13d0951d settled=false {"provingJobId":"1:BASE_PARITY:65dab85f13d0951d","status":"pending"} 17:10:36 [17:10:36.465] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:bb77257731e90671 settled=false {"provingJobId":"1:BASE_PARITY:bb77257731e90671","status":"pending"} 17:10:36 [17:10:36.467] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:65dab85f13d0951d type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:65dab85f13d0951d"} 17:10:36 [17:10:36.467] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:65dab85f13d0951d type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:65dab85f13d0951d"} 17:10:36 [17:10:36.477] INFO: prover-client:proving-broker Proving Broker started 17:10:36 [17:10:36.478] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9d89112fe7bec198 epochNumber=1 {"provingJobId":"1:BASE_PARITY:9d89112fe7bec198"} 17:10:36 [17:10:36.478] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testoqfF2G/1 with map size 1073741824 17:10:36 [17:10:36.483] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:36 [17:10:36.519] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:750a87fd0d6a0bd7 epochNumber=2 {"provingJobId":"1:BASE_PARITY:750a87fd0d6a0bd7"} 17:10:36 [17:10:36.521] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testoqfF2G/2 with map size 1073741824 17:10:36 [17:10:36.525] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:36 [17:10:36.552] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:9d89112fe7bec198 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:9d89112fe7bec198"} 17:10:36 [17:10:36.558] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:750a87fd0d6a0bd7 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:750a87fd0d6a0bd7"} 17:10:36 [17:10:36.573] INFO: prover-client:proving-broker Proving Broker started 17:10:36 [17:10:36.575] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d24200c5de7fcc25 epochNumber=1 {"provingJobId":"1:BASE_PARITY:d24200c5de7fcc25"} 17:10:36 [17:10:36.578] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test6NMLgZ/1 with map size 1073741824 17:10:36 [17:10:36.583] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:36 [17:10:36.607] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:8b4f9f3295bae4f0 epochNumber=2 {"provingJobId":"1:BASE_PARITY:8b4f9f3295bae4f0"} 17:10:36 [17:10:36.608] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-test6NMLgZ/2 with map size 1073741824 17:10:36 [17:10:36.611] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:36 [17:10:36.630] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:d24200c5de7fcc25 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:d24200c5de7fcc25"} 17:10:36 [17:10:36.630] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:d24200c5de7fcc25 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:d24200c5de7fcc25"} 17:10:36 [17:10:36.637] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:8b4f9f3295bae4f0 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:8b4f9f3295bae4f0"} 17:10:36 [17:10:36.655] INFO: prover-client:proving-broker Proving Broker started 17:10:36 [17:10:36.658] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:f304ffe5f2e755d9 err=test error {"provingJoId":"1:BASE_PARITY:f304ffe5f2e755d9"} 17:10:36 [17:10:36.661] INFO: prover-client:proving-broker Proving Broker started 17:10:36 [17:10:36.662] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:e3a9209335672da4 not found {"provingJobId":"1:BASE_PARITY:e3a9209335672da4"} 17:10:36 [17:10:36.665] INFO: prover-client:proving-broker Proving Broker started 17:10:36 [17:10:36.667] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:963308efea09fbe2 epochNumber=1 {"provingJobId":"1:BASE_PARITY:963308efea09fbe2"} 17:10:36 [17:10:36.668] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test0yNlw7/1 with map size 1073741824 17:10:36 [17:10:36.670] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:36 [17:10:36.705] INFO: prover-client:proving-broker Proving Broker started 17:10:36 [17:10:36.706] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:74f6ec19d3e1ea2f epochNumber=1 {"provingJobId":"1:BASE_PARITY:74f6ec19d3e1ea2f"} 17:10:36 [17:10:36.707] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testbxWy6J/1 with map size 1073741824 17:10:36 [17:10:36.711] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:36 [17:10:36.836] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:74f6ec19d3e1ea2f timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:74f6ec19d3e1ea2f"} 17:10:36 [17:10:36.844] INFO: prover-client:proving-broker Proving Broker started 17:10:36 [17:10:36.845] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1af405b462efec57 epochNumber=1 {"provingJobId":"1:BASE_PARITY:1af405b462efec57"} 17:10:36 [17:10:36.846] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test6Uzvp0/1 with map size 1073741824 17:10:36 [17:10:36.849] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:36 [17:10:36.996] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:1af405b462efec57 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:1af405b462efec57"} 17:10:36 [17:10:37.000] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:cda292595702dccc epochNumber=10 {"provingJobId":"1:BASE_PARITY:cda292595702dccc"} 17:10:37 [17:10:37.001] INFO: prover-client:proving-broker-database Creating broker database for epoch 10 at /tmp/proving-broker-test6Uzvp0/10 with map size 1073741824 17:10:37 [17:10:37.003] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:37 [17:10:37.049] INFO: prover-client:proving-broker Cleaned up jobs=1 17:10:37 [17:10:37.049] INFO: prover-client:proving-broker-database Deleting broker database for epoch 1 17:10:37 [17:10:37.154] INFO: prover-client:proving-broker Proving Broker started 17:10:37 [17:10:37.155] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f5a660a7a6a49145 epochNumber=1 {"provingJobId":"1:BASE_PARITY:f5a660a7a6a49145"} 17:10:37 [17:10:37.157] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testyGPJX4/1 with map size 1073741824 17:10:37 [17:10:37.161] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:37 [17:10:37.334] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:f5a660a7a6a49145 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:f5a660a7a6a49145"} 17:10:37 [17:10:37.390] INFO: prover-client:proving-broker Proving Broker started 17:10:37 [17:10:37.392] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:638c47b6c1d23676 epochNumber=1 {"provingJobId":"1:BASE_PARITY:638c47b6c1d23676"} 17:10:37 [17:10:37.393] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testIujpcF/1 with map size 1073741824 17:10:37 [17:10:37.400] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:37 [17:10:37.423] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:638c47b6c1d23676 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:638c47b6c1d23676"} 17:10:37 [17:10:37.429] INFO: prover-client:proving-broker Proving Broker started 17:10:37 [17:10:37.430] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:adfd0317428b6a08 epochNumber=1 {"provingJobId":"1:BASE_PARITY:adfd0317428b6a08"} 17:10:37 [17:10:37.431] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test72Sp2K/1 with map size 1073741824 17:10:37 [17:10:37.434] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:37 [17:10:37.458] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:adfd0317428b6a08 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:adfd0317428b6a08"} 17:10:37 [17:10:37.459] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:adfd0317428b6a08 type=BASE_PARITY totalAttempts=2 err=test error {"provingJobId":"1:BASE_PARITY:adfd0317428b6a08"} 17:10:37 [17:10:37.470] INFO: prover-client:proving-broker Proving Broker started 17:10:37 [17:10:37.472] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a5c30c215395d954 epochNumber=1 {"provingJobId":"1:BASE_PARITY:a5c30c215395d954"} 17:10:37 [17:10:37.472] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testrCSvEU/1 with map size 1073741824 17:10:37 [17:10:37.474] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:37 [17:10:37.498] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:a5c30c215395d954 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:a5c30c215395d954"} 17:10:37 [17:10:37.509] INFO: prover-client:proving-broker Proving Broker started 17:10:37 [17:10:37.510] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:fccce305f9d8e881 epochNumber=1 {"provingJobId":"1:BASE_PARITY:fccce305f9d8e881"} 17:10:37 [17:10:37.511] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testv6MFR2/1 with map size 1073741824 17:10:37 [17:10:37.513] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:37 [17:10:37.532] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:fccce305f9d8e881 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:fccce305f9d8e881"} 17:10:37 [17:10:37.534] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f10afa5aa7e0de98 epochNumber=3 {"provingJobId":"1:BASE_PARITY:f10afa5aa7e0de98"} 17:10:37 [17:10:37.536] INFO: prover-client:proving-broker-database Creating broker database for epoch 3 at /tmp/proving-broker-testv6MFR2/3 with map size 1073741824 17:10:37 [17:10:37.540] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:37 [17:10:37.590] INFO: prover-client:proving-broker Cleaned up jobs=1 17:10:37 [17:10:37.590] INFO: prover-client:proving-broker-database Deleting broker database for epoch 1 17:10:37 [17:10:37.591] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:fccce305f9d8e881 err=test error {"provingJoId":"1:BASE_PARITY:fccce305f9d8e881"} 17:10:37 [17:10:37.600] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testj20B6W/1 with map size 1073741824 17:10:37 [17:10:37.605] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:37 [17:10:37.631] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testj20B6W/2 with map size 1073741824 17:10:37 [17:10:37.634] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:37 [17:10:37.661] INFO: prover-client:proving-broker Proving Broker started 17:10:37 [17:10:37.663] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:6f0d60cd4bd10cc4 settled=false {"provingJobId":"1:BASE_PARITY:6f0d60cd4bd10cc4","status":"pending"} 17:10:37 [17:10:37.665] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:acecf472906d8ae9 settled=false {"provingJobId":"1:BASE_PARITY:acecf472906d8ae9","status":"pending"} 17:10:37 [17:10:37.672] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test04AAjT/1 with map size 1073741824 17:10:37 [17:10:37.675] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:37 [17:10:37.702] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-test04AAjT/2 with map size 1073741824 17:10:37 [17:10:37.707] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:37 [17:10:37.747] INFO: prover-client:proving-broker Proving Broker started 17:10:37 [17:10:37.750] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:b9628c413cc6505a settled=true {"provingJobId":"1:BASE_PARITY:b9628c413cc6505a","status":"fulfilled"} 17:10:37 [17:10:37.753] INFO: prover-client:proving-broker Restoring proving job id=2:BASE_PARITY:da76ff7e0c3bd687 settled=true {"provingJobId":"2:BASE_PARITY:da76ff7e0c3bd687","status":"fulfilled"} 17:10:37 [17:10:37.758] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testwM7rJX/1 with map size 1073741824 17:10:37 [17:10:37.763] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:37 [17:10:37.799] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testwM7rJX/2 with map size 1073741824 17:10:37 [17:10:37.805] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:37 [17:10:37.826] INFO: prover-client:proving-broker Proving Broker started 17:10:37 [17:10:37.828] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:57c7e27969e519e6 settled=true {"provingJobId":"1:BASE_PARITY:57c7e27969e519e6","status":"fulfilled"} 17:10:37 [17:10:37.830] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:2ba2806b22954c05 settled=false {"provingJobId":"1:BASE_PARITY:2ba2806b22954c05","status":"pending"} 17:10:37 [17:10:37.836] INFO: prover-client:proving-broker Proving Broker started 17:10:37 [17:10:37.837] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:acacba4558b7e8c9 epochNumber=1 {"provingJobId":"1:BASE_PARITY:acacba4558b7e8c9"} 17:10:37 [17:10:37.838] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testBxtZ6K/1 with map size 1073741824 17:10:37 [17:10:37.842] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:37 [17:10:37.874] INFO: prover-client:proving-broker Proving Broker started 17:10:37 [17:10:37.875] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2c4279bf97e1ba8d epochNumber=1 {"provingJobId":"1:BASE_PARITY:2c4279bf97e1ba8d"} 17:10:37 [17:10:37.876] ERROR: prover-client:proving-broker Failed to save proving job id=1:BASE_PARITY:2c4279bf97e1ba8d: Error: db error: Error: db error 17:10:37 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1126:63) {"provingJobId":"1:BASE_PARITY:2c4279bf97e1ba8d"} 17:10:37 [17:10:37.883] INFO: prover-client:proving-broker Proving Broker started 17:10:37 [17:10:37.884] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b06833d9a1ea96a7 epochNumber=1 {"provingJobId":"1:BASE_PARITY:b06833d9a1ea96a7"} 17:10:37 [17:10:37.886] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testey9pQL/1 with map size 1073741824 17:10:37 [17:10:37.901] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:37 [17:10:37.925] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:b06833d9a1ea96a7 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:b06833d9a1ea96a7"} 17:10:37 [17:10:37.925] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:b06833d9a1ea96a7 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:b06833d9a1ea96a7"} 17:10:37 [17:10:37.940] INFO: prover-client:proving-broker Proving Broker started 17:10:37 [17:10:37.940] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ca4a84af2e1272cc epochNumber=1 {"provingJobId":"1:BASE_PARITY:ca4a84af2e1272cc"} 17:10:37 [17:10:37.941] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testwkaM5W/1 with map size 1073741824 17:10:37 [17:10:37.943] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:37 [17:10:37.966] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:ca4a84af2e1272cc type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:ca4a84af2e1272cc"} 17:10:37 [17:10:37.966] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:ca4a84af2e1272cc type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:ca4a84af2e1272cc"} 17:10:37 [17:10:37.967] ERROR: prover-client:proving-broker Failed to save proving job result id=1:BASE_PARITY:ca4a84af2e1272cc: Error: db error 17:10:37 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1159:69) {"provingJobId":"1:BASE_PARITY:ca4a84af2e1272cc"} 17:10:37 [17:10:37.972] INFO: prover-client:proving-broker Proving Broker started 17:10:37 [17:10:37.972] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:42f17b23d00ebaf9 epochNumber=1 {"provingJobId":"1:BASE_PARITY:42f17b23d00ebaf9"} 17:10:37 [17:10:37.973] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testAp9xuN/1 with map size 1073741824 17:10:37 [17:10:37.977] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:38 [17:10:38.006] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:42f17b23d00ebaf9 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:42f17b23d00ebaf9"} 17:10:38 [17:10:38.006] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:42f17b23d00ebaf9 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:42f17b23d00ebaf9"} 17:10:38 [17:10:38.020] INFO: prover-client:proving-broker Proving Broker started 17:10:38 [17:10:38.022] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:fae3ed2852317b70 epochNumber=1 {"provingJobId":"1:BASE_PARITY:fae3ed2852317b70"} 17:10:38 [17:10:38.024] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testRssGNe/1 with map size 1073741824 17:10:38 [17:10:38.028] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:38 [17:10:38.052] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:fae3ed2852317b70 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:fae3ed2852317b70"} 17:10:38 [17:10:38.053] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:fae3ed2852317b70 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:fae3ed2852317b70"} 17:10:38 [17:10:38.054] ERROR: prover-client:proving-broker Failed to save proving job error status id=1:BASE_PARITY:fae3ed2852317b70 jobErr=test error: Error: db error 17:10:38 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1192:68) {"provingJobId":"1:BASE_PARITY:fae3ed2852317b70"} 17:10:38 [17:10:38.058] INFO: prover-client:proving-broker Proving Broker started 17:10:38 [17:10:38.059] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:37bf13e284db335d not found {"provingJobId":"1:BASE_PARITY:37bf13e284db335d"} 17:10:38 [17:10:38.062] INFO: prover-client:proving-broker Proving Broker started 17:10:38 [17:10:38.062] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:2f1e951dd66c05ad err=test error {"provingJoId":"1:BASE_PARITY:2f1e951dd66c05ad"} 17:10:38 [17:10:38.067] INFO: prover-client:proving-broker Proving Broker started 17:10:38 [17:10:38.077] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:4c777ded2d7fa98f epochNumber=1 {"provingJobId":"1:BASE_PARITY:4c777ded2d7fa98f"} 17:10:38 [17:10:38.082] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testvMHCnP/1 with map size 1073741824 17:10:38 [17:10:38.093] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:38 [17:10:38.121] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:4c777ded2d7fa98f type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:4c777ded2d7fa98f"} 17:10:38 [17:10:38.122] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:4c777ded2d7fa98f type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:4c777ded2d7fa98f"} 17:10:38 [17:10:38.141] INFO: prover-client:proving-broker New proving job id=2:BASE_PARITY:0d6de15e8dc090f1 epochNumber=2 {"provingJobId":"2:BASE_PARITY:0d6de15e8dc090f1"} 17:10:38 [17:10:38.142] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testvMHCnP/2 with map size 1073741824 17:10:38 [17:10:38.148] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:38 [17:10:38.168] WARN: prover-client:proving-broker Proving job id=2:BASE_PARITY:0d6de15e8dc090f1 type=BASE_PARITY not in the in-progress set {"provingJobId":"2:BASE_PARITY:0d6de15e8dc090f1"} 17:10:38 [17:10:38.170] INFO: prover-client:proving-broker Proving job complete id=2:BASE_PARITY:0d6de15e8dc090f1 type=BASE_PARITY totalAttempts=1 {"provingJobId":"2:BASE_PARITY:0d6de15e8dc090f1"} 17:10:38 [17:10:38.237] INFO: prover-client:proving-broker New proving job id=3:BASE_PARITY:29b91506e05ac1a1 epochNumber=3 {"provingJobId":"3:BASE_PARITY:29b91506e05ac1a1"} 17:10:38 [17:10:38.239] INFO: prover-client:proving-broker-database Creating broker database for epoch 3 at /tmp/proving-broker-testvMHCnP/3 with map size 1073741824 17:10:38 [17:10:38.242] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:38 [17:10:38.273] INFO: prover-client:proving-broker Cleaned up jobs=1 17:10:38 [17:10:38.274] INFO: prover-client:proving-broker-database Deleting broker database for epoch 1 17:10:38 [17:10:38.326] INFO: prover-client:proving-broker New proving job id=4:BASE_PARITY:b3d79377df7bb566 epochNumber=4 {"provingJobId":"4:BASE_PARITY:b3d79377df7bb566"} 17:10:38 [17:10:38.328] INFO: prover-client:proving-broker-database Creating broker database for epoch 4 at /tmp/proving-broker-testvMHCnP/4 with map size 1073741824 17:10:38 [17:10:38.333] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:38 [17:10:38.379] INFO: prover-client:proving-broker Cleaned up jobs=1 17:10:38 [17:10:38.379] INFO: prover-client:proving-broker-database Deleting broker database for epoch 2 17:10:38 [17:10:38.416] INFO: prover-client:proving-broker New proving job id=5:BASE_PARITY:685ea57c9adbe351 epochNumber=5 {"provingJobId":"5:BASE_PARITY:685ea57c9adbe351"} 17:10:38 [17:10:38.417] INFO: prover-client:proving-broker-database Creating broker database for epoch 5 at /tmp/proving-broker-testvMHCnP/5 with map size 1073741824 17:10:38 [17:10:38.421] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:10:38 [17:10:38.464] INFO: prover-client:proving-broker Cleaned up jobs=1 17:10:38 [17:10:38.464] INFO: prover-client:proving-broker-database Deleting broker database for epoch 3 17:10:38 PASS src/proving_broker/proving_broker.test.ts (12.753 s) 17:10:38 ProvingBroker 17:10:38 Producer API 17:10:38 ✓ refuses stale jobs (34 ms) 17:10:38 ✓ enqueues jobs (3 ms) 17:10:38 ✓ ignores duplicate jobs (3 ms) 17:10:38 ✓ reports correct status when enqueuing repeat jobs (4 ms) 17:10:38 ✓ throws an error in case of duplicate job IDs (26 ms) 17:10:38 ✓ returns not-found status for non-existing jobs (1 ms) 17:10:38 ✓ cancels jobs in queue (3 ms) 17:10:38 ✓ cancels jobs in-progress (2 ms) 17:10:38 ✓ returns job result if successful (3 ms) 17:10:38 ✓ returns job error if failed (2 ms) 17:10:38 ✓ correctly returns job status for concurrent writes (3 ms) 17:10:38 ✓ refuses stale jobs (39 ms) 17:10:38 ✓ enqueues jobs (40 ms) 17:10:38 ✓ ignores duplicate jobs (29 ms) 17:10:38 ✓ reports correct status when enqueuing repeat jobs (36 ms) 17:10:38 ✓ throws an error in case of duplicate job IDs (40 ms) 17:10:38 ✓ returns not-found status for non-existing jobs (2 ms) 17:10:38 ✓ cancels jobs in queue (31 ms) 17:10:38 ✓ cancels jobs in-progress (39 ms) 17:10:38 ✓ returns job result if successful (38 ms) 17:10:38 ✓ returns job error if failed (33 ms) 17:10:38 ✓ correctly returns job status for concurrent writes (52 ms) 17:10:38 Consumer API 17:10:38 ✓ returns undefined if no jobs are available (1 ms) 17:10:38 ✓ returns jobs in priority order (2 ms) 17:10:38 ✓ returns undefined if no jobs are available for the given allowList (1 ms) 17:10:38 ✓ returns a job if it is in the allowList (3 ms) 17:10:38 ✓ returns the most important job if it is in the allowList (2 ms) 17:10:38 ✓ returns any job if filter is empty (2 ms) 17:10:38 ✓ returns a new job when reporting job success (2 ms) 17:10:38 ✓ returns a new job when reporting permanent error (2 ms) 17:10:38 ✓ returns a new job when reporting retry-able error (1 ms) 17:10:38 ✓ returns a new job when reporting progress if current one is cancelled (2 ms) 17:10:38 ✓ returns a new job if job is already in progress elsewhere (1057 ms) 17:10:38 ✓ avoids sending the same job to a new agent after a restart (1005 ms) 17:10:38 ✓ avoids sending a completed job to a new agent after a restart (1005 ms) 17:10:38 ✓ tracks job result if in progress (3 ms) 17:10:38 ✓ tracks job result even if job is in queue (3 ms) 17:10:38 ✓ ignores reported job error if unknown job (1 ms) 17:10:38 ✓ ignores job result if unknown job (1 ms) 17:10:38 ✓ returns undefined if no jobs are available (3 ms) 17:10:38 ✓ returns jobs in priority order (51 ms) 17:10:38 ✓ returns undefined if no jobs are available for the given allowList (41 ms) 17:10:38 ✓ returns a job if it is in the allowList (57 ms) 17:10:38 ✓ returns the most important job if it is in the allowList (70 ms) 17:10:38 ✓ returns any job if filter is empty (64 ms) 17:10:38 ✓ returns a new job when reporting job success (34 ms) 17:10:38 ✓ returns a new job when reporting permanent error (33 ms) 17:10:38 ✓ returns a new job when reporting retry-able error (38 ms) 17:10:38 ✓ returns a new job when reporting progress if current one is cancelled (37 ms) 17:10:38 ✓ returns a new job if job is already in progress elsewhere (1114 ms) 17:10:38 ✓ avoids sending the same job to a new agent after a restart (1059 ms) 17:10:38 ✓ avoids sending a completed job to a new agent after a restart (1058 ms) 17:10:38 ✓ tracks job result if in progress (93 ms) 17:10:38 ✓ tracks job result even if job is in queue (81 ms) 17:10:38 ✓ ignores reported job error if unknown job (7 ms) 17:10:38 ✓ ignores job result if unknown job (4 ms) 17:10:38 Timeouts 17:10:38 ✓ tracks in progress jobs (2 ms) 17:10:38 ✓ re-enqueues jobs that time out (102 ms) 17:10:38 ✓ cancel stale jobs that time out (230 ms) 17:10:38 ✓ keeps the jobs in progress while it is alive (204 ms) 17:10:38 ✓ tracks in progress jobs (36 ms) 17:10:38 ✓ re-enqueues jobs that time out (141 ms) 17:10:38 ✓ cancel stale jobs that time out (309 ms) 17:10:38 ✓ keeps the jobs in progress while it is alive (236 ms) 17:10:38 Retries 17:10:38 ✓ retries jobs (4 ms) 17:10:38 ✓ retries up to a maximum number of times (3 ms) 17:10:38 ✓ passing retry=false does not retry (2 ms) 17:10:38 ✓ does not retry if job is stale (29 ms) 17:10:38 ✓ retries jobs (37 ms) 17:10:38 ✓ retries up to a maximum number of times (43 ms) 17:10:38 ✓ passing retry=false does not retry (39 ms) 17:10:38 ✓ does not retry if job is stale (86 ms) 17:10:38 Database management 17:10:38 ✓ re-enqueues proof requests on start (3 ms) 17:10:38 ✓ restores proof results on start (1 ms) 17:10:38 ✓ only re-enqueues unfinished jobs (1 ms) 17:10:38 ✓ saves job when enqueued (2 ms) 17:10:38 ✓ does not retain job if database fails to save (2 ms) 17:10:38 ✓ saves job result (2 ms) 17:10:38 ✓ saves result even if database fails to save (2 ms) 17:10:38 ✓ saves job error (1 ms) 17:10:38 ✓ saves job error even if database fails to save (2 ms) 17:10:38 ✓ does not save job result if job is unknown (2 ms) 17:10:38 ✓ does not save job error if job is unknown (1 ms) 17:10:38 ✓ cleans up old jobs periodically (261 ms) 17:10:38 ✓ re-enqueues proof requests on start (75 ms) 17:10:38 ✓ restores proof results on start (87 ms) 17:10:38 ✓ only re-enqueues unfinished jobs (76 ms) 17:10:38 ✓ saves job when enqueued (39 ms) 17:10:38 ✓ does not retain job if database fails to save (5 ms) 17:10:38 ✓ saves job result (57 ms) 17:10:38 ✓ saves result even if database fails to save (35 ms) 17:10:38 ✓ saves job error (47 ms) 17:10:38 ✓ saves job error even if database fails to save (39 ms) 17:10:38 ✓ does not save job result if job is unknown (4 ms) 17:10:38 ✓ does not save job error if job is unknown (3 ms) 17:10:38 ✓ cleans up old jobs periodically (432 ms) 17:10:38 17:10:38 Test Suites: 1 passed, 1 total 17:10:38 Tests: 96 passed, 96 total 17:10:38 Snapshots: 0 total 17:10:38 Time: 12.821 s 17:10:38 Ran all test suites matching /prover-client\/src\/proving_broker\/proving_broker.test.ts/i. 17:10:38 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?