Parent Log: http://ci.aztec-labs.com/f200125a56fdc063 Command: ca6d19ec133d445c yarn-project/scripts/run_test.sh prover-client/src/proving_broker/proving_broker.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/99e234fe4473771b32124e0402885610a6a3f98a Env: REF_NAME=gh-readonly-queue/next/pr-15233-1c9ca312bfdace816082212846900a49694e1e50 CURRENT_VERSION=0.87.6 CI_FULL=0 Date: Tue Jun 24 09:09:23 UTC 2025 System: ARCH=arm64 CPUS=64 MEM=247Gi HOSTNAME=pr-15233_arm64_a1-fast Resources: CPU_LIST=0-63 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_b95296ef06707e5f_next 09:09:26 [09:09:26.526] INFO: prover-client:proving-broker Proving Broker started 09:09:26 [09:09:26.532] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a8493cbdc509ba96 epochNumber=42 {"provingJobId":"1:BASE_PARITY:a8493cbdc509ba96"} 09:09:26 [09:09:26.534] WARN: prover-client:proving-broker Tried enqueueing stale proving job id=1:BASE_PARITY:811ae2da6481c4cc epochNumber=1 {"provingJobId":"1:BASE_PARITY:811ae2da6481c4cc"} 09:09:26 [09:09:26.559] INFO: prover-client:proving-broker Proving Broker started 09:09:26 [09:09:26.560] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d7fe5ab4c504afbd epochNumber=1 {"provingJobId":"1:BASE_PARITY:d7fe5ab4c504afbd"} 09:09:26 [09:09:26.562] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6823c2e9beeab456 epochNumber=1 {"provingJobId":"1:BASE_PARITY:6823c2e9beeab456"} 09:09:26 [09:09:26.563] INFO: prover-client:proving-broker Proving Broker started 09:09:26 [09:09:26.564] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ea94494ac4460620 epochNumber=1 {"provingJobId":"1:BASE_PARITY:ea94494ac4460620"} 09:09:26 [09:09:26.565] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:ea94494ac4460620 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:ea94494ac4460620"} 09:09:26 [09:09:26.567] INFO: prover-client:proving-broker Proving Broker started 09:09:26 [09:09:26.568] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:545020de74bcdf5a epochNumber=1 {"provingJobId":"1:BASE_PARITY:545020de74bcdf5a"} 09:09:26 [09:09:26.569] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:545020de74bcdf5a epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:545020de74bcdf5a"} 09:09:26 [09:09:26.570] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:545020de74bcdf5a type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:545020de74bcdf5a"} 09:09:26 [09:09:26.570] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:545020de74bcdf5a epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:545020de74bcdf5a"} 09:09:26 [09:09:26.571] INFO: prover-client:proving-broker Proving Broker started 09:09:26 [09:09:26.572] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:8411a5b40c48216c epochNumber=1 {"provingJobId":"1:BASE_PARITY:8411a5b40c48216c"} 09:09:26 [09:09:26.590] INFO: prover-client:proving-broker Proving Broker started 09:09:26 [09:09:26.591] INFO: prover-client:proving-broker Proving Broker started 09:09:26 [09:09:26.592] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:98a072efb3e7f31c epochNumber=1 {"provingJobId":"1:BASE_PARITY:98a072efb3e7f31c"} 09:09:26 [09:09:26.593] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:98a072efb3e7f31c {"provingJobId":"1:BASE_PARITY:98a072efb3e7f31c"} 09:09:26 [09:09:26.593] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:98a072efb3e7f31c type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:98a072efb3e7f31c"} 09:09:26 [09:09:26.593] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:98a072efb3e7f31c type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:98a072efb3e7f31c"} 09:09:26 [09:09:26.595] INFO: prover-client:proving-broker Proving Broker started 09:09:26 [09:09:26.595] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ad494a5c6920ecae epochNumber=1 {"provingJobId":"1:BASE_PARITY:ad494a5c6920ecae"} 09:09:26 [09:09:26.596] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:ad494a5c6920ecae {"provingJobId":"1:BASE_PARITY:ad494a5c6920ecae"} 09:09:26 [09:09:26.596] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:ad494a5c6920ecae type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:ad494a5c6920ecae"} 09:09:26 [09:09:26.597] INFO: prover-client:proving-broker Proving Broker started 09:09:26 [09:09:26.598] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ff75c9081847694a epochNumber=1 {"provingJobId":"1:BASE_PARITY:ff75c9081847694a"} 09:09:26 [09:09:26.598] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:ff75c9081847694a type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:ff75c9081847694a"} 09:09:26 [09:09:26.599] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:ff75c9081847694a type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:ff75c9081847694a"} 09:09:26 [09:09:26.600] INFO: prover-client:proving-broker Proving Broker started 09:09:26 [09:09:26.601] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a2258bc04abfe095 epochNumber=1 {"provingJobId":"1:BASE_PARITY:a2258bc04abfe095"} 09:09:26 [09:09:26.601] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:a2258bc04abfe095 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:a2258bc04abfe095"} 09:09:26 [09:09:26.601] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:a2258bc04abfe095 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:a2258bc04abfe095"} 09:09:26 [09:09:26.602] INFO: prover-client:proving-broker Proving Broker started 09:09:26 [09:09:26.603] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:270c20daab15fb9a epochNumber=0 {"provingJobId":"1:BASE_PARITY:270c20daab15fb9a"} 09:09:26 [09:09:26.603] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:270c20daab15fb9a epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:270c20daab15fb9a"} 09:09:26 [09:09:26.603] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2a93ec87807e7cf5 epochNumber=0 {"provingJobId":"1:BASE_PARITY:2a93ec87807e7cf5"} 09:09:26 [09:09:26.603] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:270c20daab15fb9a epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:270c20daab15fb9a"} 09:09:26 [09:09:26.604] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:df365d7faee1a880 epochNumber=0 {"provingJobId":"1:BASE_PARITY:df365d7faee1a880"} 09:09:26 [09:09:26.605] INFO: prover-client:proving-broker Proving Broker started 09:09:26 [09:09:26.606] INFO: prover-client:proving-broker Proving Broker started 09:09:26 [09:09:26.606] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e1e0cb670190e8eb epochNumber=2 {"provingJobId":"1:BASE_PARITY:e1e0cb670190e8eb"} 09:09:26 [09:09:26.606] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:53b2f19966cf5e47 epochNumber=1 {"provingJobId":"1:BASE_PARITY:53b2f19966cf5e47"} 09:09:26 [09:09:26.607] INFO: prover-client:proving-broker Proving Broker started 09:09:26 [09:09:26.608] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:63f7f9c781ada1c8 epochNumber=1 {"provingJobId":"1:BASE_PARITY:63f7f9c781ada1c8"} 09:09:26 [09:09:26.613] INFO: prover-client:proving-broker Proving Broker started 09:09:26 [09:09:26.613] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:8591eeaaac769f69 epochNumber=1 {"provingJobId":"1:BASE_PARITY:8591eeaaac769f69"} 09:09:26 [09:09:26.614] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7b536af521c8774c epochNumber=1 {"provingJobId":"1:BASE_PARITY:7b536af521c8774c"} 09:09:26 [09:09:26.614] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6e421c2d752dec9c epochNumber=2 {"provingJobId":"1:BASE_PARITY:6e421c2d752dec9c"} 09:09:26 [09:09:26.614] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1b6d8c6a0e32041c epochNumber=1 {"provingJobId":"1:BASE_PARITY:1b6d8c6a0e32041c"} 09:09:26 [09:09:26.615] INFO: prover-client:proving-broker Proving Broker started 09:09:26 [09:09:26.616] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:98954c7bb130014f epochNumber=1 {"provingJobId":"1:BASE_PARITY:98954c7bb130014f"} 09:09:26 [09:09:26.616] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1c46425171486927 epochNumber=1 {"provingJobId":"1:BASE_PARITY:1c46425171486927"} 09:09:26 [09:09:26.616] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9f3cd186a5e07d56 epochNumber=2 {"provingJobId":"1:BASE_PARITY:9f3cd186a5e07d56"} 09:09:26 [09:09:26.616] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:699eeaa50cdd5039 epochNumber=1 {"provingJobId":"1:BASE_PARITY:699eeaa50cdd5039"} 09:09:26 [09:09:26.617] INFO: prover-client:proving-broker Proving Broker started 09:09:26 [09:09:26.618] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:aabfda43602181b4 epochNumber=1 {"provingJobId":"1:BASE_PARITY:aabfda43602181b4"} 09:09:26 [09:09:26.618] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3a9eca91604e7df8 epochNumber=1 {"provingJobId":"1:BASE_PARITY:3a9eca91604e7df8"} 09:09:26 [09:09:26.618] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1b3b2c12c0d8d1ef epochNumber=2 {"provingJobId":"1:BASE_PARITY:1b3b2c12c0d8d1ef"} 09:09:26 [09:09:26.619] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:4444b003362e4d2d epochNumber=1 {"provingJobId":"1:BASE_PARITY:4444b003362e4d2d"} 09:09:26 [09:09:26.620] INFO: prover-client:proving-broker Proving Broker started 09:09:26 [09:09:26.620] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:406764017a46c49b epochNumber=1 {"provingJobId":"1:BASE_PARITY:406764017a46c49b"} 09:09:26 [09:09:26.620] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:5ce51fdbfaa6790a epochNumber=1 {"provingJobId":"1:BASE_PARITY:5ce51fdbfaa6790a"} 09:09:26 [09:09:26.621] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:406764017a46c49b type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:406764017a46c49b"} 09:09:26 [09:09:26.622] INFO: prover-client:proving-broker Proving Broker started 09:09:26 [09:09:26.622] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:49539b7fd9baa80b epochNumber=1 {"provingJobId":"1:BASE_PARITY:49539b7fd9baa80b"} 09:09:26 [09:09:26.622] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d490ae4d2a3b843c epochNumber=1 {"provingJobId":"1:BASE_PARITY:d490ae4d2a3b843c"} 09:09:26 [09:09:26.623] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:49539b7fd9baa80b type=BASE_PARITY totalAttempts=1 err=result {"provingJobId":"1:BASE_PARITY:49539b7fd9baa80b"} 09:09:26 [09:09:26.624] INFO: prover-client:proving-broker Proving Broker started 09:09:26 [09:09:26.624] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f836b7c9ba32d8f3 epochNumber=1 {"provingJobId":"1:BASE_PARITY:f836b7c9ba32d8f3"} 09:09:26 [09:09:26.624] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b0fad09d442e374d epochNumber=1 {"provingJobId":"1:BASE_PARITY:b0fad09d442e374d"} 09:09:26 [09:09:26.625] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:f836b7c9ba32d8f3 type=BASE_PARITY retry=1 err=result {"provingJobId":"1:BASE_PARITY:f836b7c9ba32d8f3"} 09:09:26 [09:09:26.625] INFO: prover-client:proving-broker Proving Broker started 09:09:26 [09:09:26.626] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:429de41234165817 epochNumber=1 {"provingJobId":"1:BASE_PARITY:429de41234165817"} 09:09:26 [09:09:26.626] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:429de41234165817 {"provingJobId":"1:BASE_PARITY:429de41234165817"} 09:09:26 [09:09:26.626] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:429de41234165817 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:429de41234165817"} 09:09:26 [09:09:26.627] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3f3eb544ac7e5119 epochNumber=1 {"provingJobId":"1:BASE_PARITY:3f3eb544ac7e5119"} 09:09:26 [09:09:26.627] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:429de41234165817 has already been completed {"provingJobId":"1:BASE_PARITY:429de41234165817"} 09:09:26 [09:09:26.628] INFO: prover-client:proving-broker Proving Broker started 09:09:26 [09:09:26.628] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:cb925debf57beb88 epochNumber=1 {"provingJobId":"1:BASE_PARITY:cb925debf57beb88"} 09:09:26 [09:09:26.629] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:67bfbf9b5fba7940 epochNumber=2 {"provingJobId":"1:BASE_PARITY:67bfbf9b5fba7940"} 09:09:27 [09:09:27.680] INFO: prover-client:proving-broker Proving Broker started 09:09:27 [09:09:27.680] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:cb925debf57beb88 settled=false {"provingJobId":"1:BASE_PARITY:cb925debf57beb88","status":"pending"} 09:09:27 [09:09:27.680] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:67bfbf9b5fba7940 settled=false {"provingJobId":"1:BASE_PARITY:67bfbf9b5fba7940","status":"pending"} 09:09:27 [09:09:27.681] INFO: prover-client:proving-broker Proving job id=1:BASE_PARITY:cb925debf57beb88 type=BASE_PARITY startedAt=1750756166629 older agent has taken job {"provingJobId":"1:BASE_PARITY:cb925debf57beb88"} 09:09:27 [09:09:27.682] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:cb925debf57beb88 type=BASE_PARITY already being worked on by another agent. Sending new one {"provingJobId":"1:BASE_PARITY:cb925debf57beb88"} 09:09:27 [09:09:27.682] INFO: prover-client:proving-broker Proving Broker started 09:09:27 [09:09:27.683] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:8ec3f017b21866c3 epochNumber=1 {"provingJobId":"1:BASE_PARITY:8ec3f017b21866c3"} 09:09:27 [09:09:27.683] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3ea1cbc50b9d9042 epochNumber=2 {"provingJobId":"1:BASE_PARITY:3ea1cbc50b9d9042"} 09:09:28 [09:09:28.684] INFO: prover-client:proving-broker Proving Broker started 09:09:28 [09:09:28.684] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:8ec3f017b21866c3 settled=false {"provingJobId":"1:BASE_PARITY:8ec3f017b21866c3","status":"pending"} 09:09:28 [09:09:28.685] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:3ea1cbc50b9d9042 settled=false {"provingJobId":"1:BASE_PARITY:3ea1cbc50b9d9042","status":"pending"} 09:09:28 [09:09:28.685] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:8ec3f017b21866c3 type=BASE_PARITY not found in the in-progress cache, adding it {"provingJobId":"1:BASE_PARITY:8ec3f017b21866c3"} 09:09:28 [09:09:28.686] INFO: prover-client:proving-broker Proving Broker started 09:09:28 [09:09:28.687] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:36aa2dede1bc5971 epochNumber=1 {"provingJobId":"1:BASE_PARITY:36aa2dede1bc5971"} 09:09:28 [09:09:28.687] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:08c5f85b4605b5a8 epochNumber=2 {"provingJobId":"1:BASE_PARITY:08c5f85b4605b5a8"} 09:09:29 [09:09:29.687] INFO: prover-client:proving-broker Proving Broker started 09:09:29 [09:09:29.687] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:36aa2dede1bc5971 settled=false {"provingJobId":"1:BASE_PARITY:36aa2dede1bc5971","status":"pending"} 09:09:29 [09:09:29.688] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:08c5f85b4605b5a8 settled=false {"provingJobId":"1:BASE_PARITY:08c5f85b4605b5a8","status":"pending"} 09:09:29 [09:09:29.688] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:36aa2dede1bc5971 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:36aa2dede1bc5971"} 09:09:29 [09:09:29.688] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:36aa2dede1bc5971 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:36aa2dede1bc5971"} 09:09:29 [09:09:29.689] INFO: prover-client:proving-broker Proving Broker started 09:09:29 [09:09:29.690] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e453e655c494ecce epochNumber=1 {"provingJobId":"1:BASE_PARITY:e453e655c494ecce"} 09:09:29 [09:09:29.690] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:85825ef5461d4c37 epochNumber=2 {"provingJobId":"1:BASE_PARITY:85825ef5461d4c37"} 09:09:29 [09:09:29.691] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:e453e655c494ecce type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:e453e655c494ecce"} 09:09:29 [09:09:29.691] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:85825ef5461d4c37 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:85825ef5461d4c37"} 09:09:29 [09:09:29.692] INFO: prover-client:proving-broker Proving Broker started 09:09:29 [09:09:29.693] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:92c4de2c769236a0 epochNumber=1 {"provingJobId":"1:BASE_PARITY:92c4de2c769236a0"} 09:09:29 [09:09:29.693] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:cfbcf08e4f2c33e6 epochNumber=2 {"provingJobId":"1:BASE_PARITY:cfbcf08e4f2c33e6"} 09:09:29 [09:09:29.693] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:92c4de2c769236a0 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:92c4de2c769236a0"} 09:09:29 [09:09:29.693] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:92c4de2c769236a0 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:92c4de2c769236a0"} 09:09:29 [09:09:29.694] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:cfbcf08e4f2c33e6 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:cfbcf08e4f2c33e6"} 09:09:29 [09:09:29.694] INFO: prover-client:proving-broker Proving Broker started 09:09:29 [09:09:29.695] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:6eb85a161457c874 err=test error {"provingJoId":"1:BASE_PARITY:6eb85a161457c874"} 09:09:29 [09:09:29.696] INFO: prover-client:proving-broker Proving Broker started 09:09:29 [09:09:29.696] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:0d17bd51471ee96c not found {"provingJobId":"1:BASE_PARITY:0d17bd51471ee96c"} 09:09:29 [09:09:29.697] INFO: prover-client:proving-broker Proving Broker started 09:09:29 [09:09:29.698] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b67802716ddd2aab epochNumber=1 {"provingJobId":"1:BASE_PARITY:b67802716ddd2aab"} 09:09:29 [09:09:29.699] INFO: prover-client:proving-broker Proving Broker started 09:09:29 [09:09:29.699] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ca37222e595a62f2 epochNumber=1 {"provingJobId":"1:BASE_PARITY:ca37222e595a62f2"} 09:09:29 [09:09:29.800] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:ca37222e595a62f2 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:ca37222e595a62f2"} 09:09:29 [09:09:29.807] INFO: prover-client:proving-broker Proving Broker started 09:09:29 [09:09:29.807] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a0c7e3eb69f78066 epochNumber=1 {"provingJobId":"1:BASE_PARITY:a0c7e3eb69f78066"} 09:09:29 [09:09:29.908] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:a0c7e3eb69f78066 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:a0c7e3eb69f78066"} 09:09:29 [09:09:29.915] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0840a85ba2a59f1b epochNumber=10 {"provingJobId":"1:BASE_PARITY:0840a85ba2a59f1b"} 09:09:29 [09:09:29.934] INFO: prover-client:proving-broker Cleaned up jobs=1 09:09:30 [09:09:30.041] INFO: prover-client:proving-broker Proving Broker started 09:09:30 [09:09:30.042] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:87923011b5f5f98c epochNumber=1 {"provingJobId":"1:BASE_PARITY:87923011b5f5f98c"} 09:09:30 [09:09:30.192] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:87923011b5f5f98c timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:87923011b5f5f98c"} 09:09:30 [09:09:30.243] INFO: prover-client:proving-broker Proving Broker started 09:09:30 [09:09:30.244] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c03e12476044a974 epochNumber=1 {"provingJobId":"1:BASE_PARITY:c03e12476044a974"} 09:09:30 [09:09:30.244] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:c03e12476044a974 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:c03e12476044a974"} 09:09:30 [09:09:30.246] INFO: prover-client:proving-broker Proving Broker started 09:09:30 [09:09:30.246] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0eea833f623bc7f8 epochNumber=1 {"provingJobId":"1:BASE_PARITY:0eea833f623bc7f8"} 09:09:30 [09:09:30.247] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:0eea833f623bc7f8 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:0eea833f623bc7f8"} 09:09:30 [09:09:30.247] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:0eea833f623bc7f8 type=BASE_PARITY totalAttempts=2 err=test error {"provingJobId":"1:BASE_PARITY:0eea833f623bc7f8"} 09:09:30 [09:09:30.248] INFO: prover-client:proving-broker Proving Broker started 09:09:30 [09:09:30.248] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:43f40afd69e53973 epochNumber=1 {"provingJobId":"1:BASE_PARITY:43f40afd69e53973"} 09:09:30 [09:09:30.249] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:43f40afd69e53973 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:43f40afd69e53973"} 09:09:30 [09:09:30.250] INFO: prover-client:proving-broker Proving Broker started 09:09:30 [09:09:30.250] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1afc19b58914f198 epochNumber=1 {"provingJobId":"1:BASE_PARITY:1afc19b58914f198"} 09:09:30 [09:09:30.251] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:1afc19b58914f198 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:1afc19b58914f198"} 09:09:30 [09:09:30.251] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:5657f0ab28d21f44 epochNumber=3 {"provingJobId":"1:BASE_PARITY:5657f0ab28d21f44"} 09:09:30 [09:09:30.275] INFO: prover-client:proving-broker Cleaned up jobs=1 09:09:30 [09:09:30.276] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:1afc19b58914f198 err=test error {"provingJoId":"1:BASE_PARITY:1afc19b58914f198"} 09:09:30 [09:09:30.278] INFO: prover-client:proving-broker Proving Broker started 09:09:30 [09:09:30.278] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:7509283a1fab4045 settled=false {"provingJobId":"1:BASE_PARITY:7509283a1fab4045","status":"pending"} 09:09:30 [09:09:30.278] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:0ce0ab4680845ecf settled=false {"provingJobId":"1:BASE_PARITY:0ce0ab4680845ecf","status":"pending"} 09:09:30 [09:09:30.280] INFO: prover-client:proving-broker Proving Broker started 09:09:30 [09:09:30.280] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:0b9869e3e55bd195 settled=true {"provingJobId":"1:BASE_PARITY:0b9869e3e55bd195","status":"fulfilled"} 09:09:30 [09:09:30.281] INFO: prover-client:proving-broker Restoring proving job id=2:BASE_PARITY:34dbcdb366eeff6a settled=true {"provingJobId":"2:BASE_PARITY:34dbcdb366eeff6a","status":"fulfilled"} 09:09:30 [09:09:30.282] INFO: prover-client:proving-broker Proving Broker started 09:09:30 [09:09:30.282] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:f70d9ac909de30ee settled=true {"provingJobId":"1:BASE_PARITY:f70d9ac909de30ee","status":"fulfilled"} 09:09:30 [09:09:30.282] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:24716f3b7118c4bb settled=false {"provingJobId":"1:BASE_PARITY:24716f3b7118c4bb","status":"pending"} 09:09:30 [09:09:30.283] INFO: prover-client:proving-broker Proving Broker started 09:09:30 [09:09:30.284] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:729196777ddae2a7 epochNumber=1 {"provingJobId":"1:BASE_PARITY:729196777ddae2a7"} 09:09:30 [09:09:30.286] INFO: prover-client:proving-broker Proving Broker started 09:09:30 [09:09:30.286] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:8d6fd37c01c0db79 epochNumber=1 {"provingJobId":"1:BASE_PARITY:8d6fd37c01c0db79"} 09:09:30 [09:09:30.287] ERROR: prover-client:proving-broker Failed to save proving job id=1:BASE_PARITY:8d6fd37c01c0db79: Error: db error: Error: db error 09:09:30 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1126:63) {"provingJobId":"1:BASE_PARITY:8d6fd37c01c0db79"} 09:09:30 [09:09:30.288] INFO: prover-client:proving-broker Proving Broker started 09:09:30 [09:09:30.288] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:acc312ae18f365a5 epochNumber=1 {"provingJobId":"1:BASE_PARITY:acc312ae18f365a5"} 09:09:30 [09:09:30.289] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:acc312ae18f365a5 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:acc312ae18f365a5"} 09:09:30 [09:09:30.289] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:acc312ae18f365a5 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:acc312ae18f365a5"} 09:09:30 [09:09:30.290] INFO: prover-client:proving-broker Proving Broker started 09:09:30 [09:09:30.290] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2bca58480cff5653 epochNumber=1 {"provingJobId":"1:BASE_PARITY:2bca58480cff5653"} 09:09:30 [09:09:30.291] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:2bca58480cff5653 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:2bca58480cff5653"} 09:09:30 [09:09:30.291] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:2bca58480cff5653 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:2bca58480cff5653"} 09:09:30 [09:09:30.291] ERROR: prover-client:proving-broker Failed to save proving job result id=1:BASE_PARITY:2bca58480cff5653: Error: db error 09:09:30 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1159:69) {"provingJobId":"1:BASE_PARITY:2bca58480cff5653"} 09:09:30 [09:09:30.292] INFO: prover-client:proving-broker Proving Broker started 09:09:30 [09:09:30.293] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:642df1ae86e77c50 epochNumber=1 {"provingJobId":"1:BASE_PARITY:642df1ae86e77c50"} 09:09:30 [09:09:30.293] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:642df1ae86e77c50 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:642df1ae86e77c50"} 09:09:30 [09:09:30.293] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:642df1ae86e77c50 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:642df1ae86e77c50"} 09:09:30 [09:09:30.294] INFO: prover-client:proving-broker Proving Broker started 09:09:30 [09:09:30.295] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:740ecd6d113c9070 epochNumber=1 {"provingJobId":"1:BASE_PARITY:740ecd6d113c9070"} 09:09:30 [09:09:30.295] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:740ecd6d113c9070 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:740ecd6d113c9070"} 09:09:30 [09:09:30.295] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:740ecd6d113c9070 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:740ecd6d113c9070"} 09:09:30 [09:09:30.296] ERROR: prover-client:proving-broker Failed to save proving job error status id=1:BASE_PARITY:740ecd6d113c9070 jobErr=test error: Error: db error 09:09:30 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1192:68) {"provingJobId":"1:BASE_PARITY:740ecd6d113c9070"} 09:09:30 [09:09:30.299] INFO: prover-client:proving-broker Proving Broker started 09:09:30 [09:09:30.299] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:124c3fc7977fdb95 not found {"provingJobId":"1:BASE_PARITY:124c3fc7977fdb95"} 09:09:30 [09:09:30.300] INFO: prover-client:proving-broker Proving Broker started 09:09:30 [09:09:30.301] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:052b4b7f056d3d1c err=test error {"provingJoId":"1:BASE_PARITY:052b4b7f056d3d1c"} 09:09:30 [09:09:30.302] INFO: prover-client:proving-broker Proving Broker started 09:09:30 [09:09:30.312] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:991e51ef60139d9c epochNumber=1 {"provingJobId":"1:BASE_PARITY:991e51ef60139d9c"} 09:09:30 [09:09:30.312] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:991e51ef60139d9c type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:991e51ef60139d9c"} 09:09:30 [09:09:30.313] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:991e51ef60139d9c type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:991e51ef60139d9c"} 09:09:30 [09:09:30.324] INFO: prover-client:proving-broker New proving job id=2:BASE_PARITY:a4b794afcd06a466 epochNumber=2 {"provingJobId":"2:BASE_PARITY:a4b794afcd06a466"} 09:09:30 [09:09:30.324] WARN: prover-client:proving-broker Proving job id=2:BASE_PARITY:a4b794afcd06a466 type=BASE_PARITY not in the in-progress set {"provingJobId":"2:BASE_PARITY:a4b794afcd06a466"} 09:09:30 [09:09:30.324] INFO: prover-client:proving-broker Proving job complete id=2:BASE_PARITY:a4b794afcd06a466 type=BASE_PARITY totalAttempts=1 {"provingJobId":"2:BASE_PARITY:a4b794afcd06a466"} 09:09:30 [09:09:30.384] INFO: prover-client:proving-broker New proving job id=3:BASE_PARITY:d88ca80424d35033 epochNumber=3 {"provingJobId":"3:BASE_PARITY:d88ca80424d35033"} 09:09:30 [09:09:30.404] INFO: prover-client:proving-broker Cleaned up jobs=1 09:09:30 [09:09:30.445] INFO: prover-client:proving-broker New proving job id=4:BASE_PARITY:87bfc9fe3ad1eece epochNumber=4 {"provingJobId":"4:BASE_PARITY:87bfc9fe3ad1eece"} 09:09:30 [09:09:30.455] INFO: prover-client:proving-broker Cleaned up jobs=1 09:09:30 [09:09:30.507] INFO: prover-client:proving-broker New proving job id=5:BASE_PARITY:dfd4695bad4c9633 epochNumber=5 {"provingJobId":"5:BASE_PARITY:dfd4695bad4c9633"} 09:09:30 [09:09:30.530] INFO: prover-client:proving-broker Cleaned up jobs=1 09:09:30 [09:09:30.561] INFO: prover-client:proving-broker Proving Broker started 09:09:30 [09:09:30.562] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:818c17a917787828 epochNumber=42 {"provingJobId":"1:BASE_PARITY:818c17a917787828"} 09:09:30 [09:09:30.562] INFO: prover-client:proving-broker-database Creating broker database for epoch 42 at /tmp/proving-broker-testCOk6ao/42 with map size 1073741824 09:09:30 [09:09:30.565] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:30 [09:09:30.588] WARN: prover-client:proving-broker Tried enqueueing stale proving job id=1:BASE_PARITY:ca339a70efddce49 epochNumber=1 {"provingJobId":"1:BASE_PARITY:ca339a70efddce49"} 09:09:30 [09:09:30.592] INFO: prover-client:proving-broker Proving Broker started 09:09:30 [09:09:30.592] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:599a39eef27b7884 epochNumber=1 {"provingJobId":"1:BASE_PARITY:599a39eef27b7884"} 09:09:30 [09:09:30.593] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testfIbM5o/1 with map size 1073741824 09:09:30 [09:09:30.594] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:30 [09:09:30.611] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:43b9a7c9f0717717 epochNumber=1 {"provingJobId":"1:BASE_PARITY:43b9a7c9f0717717"} 09:09:30 [09:09:30.619] INFO: prover-client:proving-broker Proving Broker started 09:09:30 [09:09:30.620] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1486ede14023c493 epochNumber=1 {"provingJobId":"1:BASE_PARITY:1486ede14023c493"} 09:09:30 [09:09:30.620] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testMl4mlo/1 with map size 1073741824 09:09:30 [09:09:30.623] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:30 [09:09:30.646] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:1486ede14023c493 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:1486ede14023c493"} 09:09:30 [09:09:30.648] INFO: prover-client:proving-broker Proving Broker started 09:09:30 [09:09:30.649] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:034fdab46316a9ed epochNumber=1 {"provingJobId":"1:BASE_PARITY:034fdab46316a9ed"} 09:09:30 [09:09:30.651] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testVpaj07/1 with map size 1073741824 09:09:30 [09:09:30.652] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:30 [09:09:30.671] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:034fdab46316a9ed epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:034fdab46316a9ed"} 09:09:30 [09:09:30.672] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:034fdab46316a9ed type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:034fdab46316a9ed"} 09:09:30 [09:09:30.680] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:034fdab46316a9ed epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:034fdab46316a9ed"} 09:09:30 [09:09:30.683] INFO: prover-client:proving-broker Proving Broker started 09:09:30 [09:09:30.683] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:055275f4045ac1a7 epochNumber=1 {"provingJobId":"1:BASE_PARITY:055275f4045ac1a7"} 09:09:30 [09:09:30.684] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testSA4VQi/1 with map size 1073741824 09:09:30 [09:09:30.686] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:30 [09:09:30.706] INFO: prover-client:proving-broker Proving Broker started 09:09:30 [09:09:30.708] INFO: prover-client:proving-broker Proving Broker started 09:09:30 [09:09:30.709] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:23aa94dd09b6d8d1 epochNumber=1 {"provingJobId":"1:BASE_PARITY:23aa94dd09b6d8d1"} 09:09:30 [09:09:30.710] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test049MKU/1 with map size 1073741824 09:09:30 [09:09:30.711] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:30 [09:09:30.726] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:23aa94dd09b6d8d1 {"provingJobId":"1:BASE_PARITY:23aa94dd09b6d8d1"} 09:09:30 [09:09:30.727] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:23aa94dd09b6d8d1 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:23aa94dd09b6d8d1"} 09:09:30 [09:09:30.727] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:23aa94dd09b6d8d1 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:23aa94dd09b6d8d1"} 09:09:30 [09:09:30.735] INFO: prover-client:proving-broker Proving Broker started 09:09:30 [09:09:30.736] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e081deb497cff3bf epochNumber=1 {"provingJobId":"1:BASE_PARITY:e081deb497cff3bf"} 09:09:30 [09:09:30.737] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testtRadF4/1 with map size 1073741824 09:09:30 [09:09:30.738] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:30 [09:09:30.754] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:e081deb497cff3bf {"provingJobId":"1:BASE_PARITY:e081deb497cff3bf"} 09:09:30 [09:09:30.754] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:e081deb497cff3bf type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:e081deb497cff3bf"} 09:09:30 [09:09:30.764] INFO: prover-client:proving-broker Proving Broker started 09:09:30 [09:09:30.765] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0c959e415287ada5 epochNumber=1 {"provingJobId":"1:BASE_PARITY:0c959e415287ada5"} 09:09:30 [09:09:30.766] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testodj4mH/1 with map size 1073741824 09:09:30 [09:09:30.767] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:30 [09:09:30.785] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:0c959e415287ada5 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:0c959e415287ada5"} 09:09:30 [09:09:30.785] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:0c959e415287ada5 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:0c959e415287ada5"} 09:09:30 [09:09:30.792] INFO: prover-client:proving-broker Proving Broker started 09:09:30 [09:09:30.793] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:12ee84d22b468202 epochNumber=1 {"provingJobId":"1:BASE_PARITY:12ee84d22b468202"} 09:09:30 [09:09:30.793] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testYm5dRu/1 with map size 1073741824 09:09:30 [09:09:30.796] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:30 [09:09:30.813] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:12ee84d22b468202 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:12ee84d22b468202"} 09:09:30 [09:09:30.813] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:12ee84d22b468202 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:12ee84d22b468202"} 09:09:30 [09:09:30.820] INFO: prover-client:proving-broker Proving Broker started 09:09:30 [09:09:30.820] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b0f3b6c5571cb30c epochNumber=0 {"provingJobId":"1:BASE_PARITY:b0f3b6c5571cb30c"} 09:09:30 [09:09:30.821] INFO: prover-client:proving-broker-database Creating broker database for epoch 0 at /tmp/proving-broker-testB0y8CB/0 with map size 1073741824 09:09:30 [09:09:30.823] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:30 [09:09:30.840] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:b0f3b6c5571cb30c epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:b0f3b6c5571cb30c"} 09:09:30 [09:09:30.841] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ddfecbc74511fcf9 epochNumber=0 {"provingJobId":"1:BASE_PARITY:ddfecbc74511fcf9"} 09:09:30 [09:09:30.841] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:b0f3b6c5571cb30c epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:b0f3b6c5571cb30c"} 09:09:30 [09:09:30.842] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e471d89d13261d93 epochNumber=0 {"provingJobId":"1:BASE_PARITY:e471d89d13261d93"} 09:09:30 [09:09:30.855] INFO: prover-client:proving-broker Proving Broker started 09:09:30 [09:09:30.857] INFO: prover-client:proving-broker Proving Broker started 09:09:30 [09:09:30.857] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:8828f819e31aee41 epochNumber=2 {"provingJobId":"1:BASE_PARITY:8828f819e31aee41"} 09:09:30 [09:09:30.859] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-test5gmJGQ/2 with map size 1073741824 09:09:30 [09:09:30.861] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:30 [09:09:30.877] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:174ccb417aba0691 epochNumber=1 {"provingJobId":"1:BASE_PARITY:174ccb417aba0691"} 09:09:30 [09:09:30.878] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test5gmJGQ/1 with map size 1073741824 09:09:30 [09:09:30.880] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:30 [09:09:30.903] INFO: prover-client:proving-broker Proving Broker started 09:09:30 [09:09:30.904] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2dac679ff855647d epochNumber=1 {"provingJobId":"1:BASE_PARITY:2dac679ff855647d"} 09:09:30 [09:09:30.904] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testvp8D8P/1 with map size 1073741824 09:09:30 [09:09:30.906] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:30 [09:09:30.922] INFO: prover-client:proving-broker Proving Broker started 09:09:30 [09:09:30.922] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:eefebd158e495e1c epochNumber=1 {"provingJobId":"1:BASE_PARITY:eefebd158e495e1c"} 09:09:30 [09:09:30.923] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testWTsCmK/1 with map size 1073741824 09:09:30 [09:09:30.924] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:30 [09:09:30.939] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9d835ce333f7c5d1 epochNumber=1 {"provingJobId":"1:BASE_PARITY:9d835ce333f7c5d1"} 09:09:30 [09:09:30.944] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f506cac759b2c2ea epochNumber=2 {"provingJobId":"1:BASE_PARITY:f506cac759b2c2ea"} 09:09:30 [09:09:30.945] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testWTsCmK/2 with map size 1073741824 09:09:30 [09:09:30.946] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:30 [09:09:30.960] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c2fc8fc095bf655e epochNumber=1 {"provingJobId":"1:BASE_PARITY:c2fc8fc095bf655e"} 09:09:30 [09:09:30.967] INFO: prover-client:proving-broker Proving Broker started 09:09:30 [09:09:30.967] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:cbada3b1ce52952b epochNumber=1 {"provingJobId":"1:BASE_PARITY:cbada3b1ce52952b"} 09:09:30 [09:09:30.968] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testkaxTwQ/1 with map size 1073741824 09:09:30 [09:09:30.969] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:30 [09:09:30.987] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0bb36c35c9eed5c1 epochNumber=1 {"provingJobId":"1:BASE_PARITY:0bb36c35c9eed5c1"} 09:09:30 [09:09:30.992] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ce4342b80c0035b7 epochNumber=2 {"provingJobId":"1:BASE_PARITY:ce4342b80c0035b7"} 09:09:30 [09:09:30.993] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testkaxTwQ/2 with map size 1073741824 09:09:30 [09:09:30.995] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:31 [09:09:31.009] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:98ce89ea819ddef0 epochNumber=1 {"provingJobId":"1:BASE_PARITY:98ce89ea819ddef0"} 09:09:31 [09:09:31.017] INFO: prover-client:proving-broker Proving Broker started 09:09:31 [09:09:31.017] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:8d33a5f59a471da1 epochNumber=1 {"provingJobId":"1:BASE_PARITY:8d33a5f59a471da1"} 09:09:31 [09:09:31.018] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testwCTupm/1 with map size 1073741824 09:09:31 [09:09:31.019] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:31 [09:09:31.033] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:78d7da204e8bff73 epochNumber=1 {"provingJobId":"1:BASE_PARITY:78d7da204e8bff73"} 09:09:31 [09:09:31.038] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:092f257582271ca3 epochNumber=2 {"provingJobId":"1:BASE_PARITY:092f257582271ca3"} 09:09:31 [09:09:31.039] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testwCTupm/2 with map size 1073741824 09:09:31 [09:09:31.040] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:31 [09:09:31.055] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:288994ef7b168c4f epochNumber=1 {"provingJobId":"1:BASE_PARITY:288994ef7b168c4f"} 09:09:31 [09:09:31.062] INFO: prover-client:proving-broker Proving Broker started 09:09:31 [09:09:31.063] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:4e59ab5c73c9af82 epochNumber=1 {"provingJobId":"1:BASE_PARITY:4e59ab5c73c9af82"} 09:09:31 [09:09:31.063] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testmvgru0/1 with map size 1073741824 09:09:31 [09:09:31.064] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:31 [09:09:31.079] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:60ee2bd662f257da epochNumber=1 {"provingJobId":"1:BASE_PARITY:60ee2bd662f257da"} 09:09:31 [09:09:31.084] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:4e59ab5c73c9af82 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:4e59ab5c73c9af82"} 09:09:31 [09:09:31.092] INFO: prover-client:proving-broker Proving Broker started 09:09:31 [09:09:31.093] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:996b27f03558643a epochNumber=1 {"provingJobId":"1:BASE_PARITY:996b27f03558643a"} 09:09:31 [09:09:31.094] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testWI9xxt/1 with map size 1073741824 09:09:31 [09:09:31.095] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:31 [09:09:31.110] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:94c76db5fc1e13e0 epochNumber=1 {"provingJobId":"1:BASE_PARITY:94c76db5fc1e13e0"} 09:09:31 [09:09:31.117] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:996b27f03558643a type=BASE_PARITY totalAttempts=1 err=result {"provingJobId":"1:BASE_PARITY:996b27f03558643a"} 09:09:31 [09:09:31.126] INFO: prover-client:proving-broker Proving Broker started 09:09:31 [09:09:31.127] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:807f1c4da4a5824d epochNumber=1 {"provingJobId":"1:BASE_PARITY:807f1c4da4a5824d"} 09:09:31 [09:09:31.127] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testNbwinY/1 with map size 1073741824 09:09:31 [09:09:31.131] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:31 [09:09:31.152] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3121e6e34b4de026 epochNumber=1 {"provingJobId":"1:BASE_PARITY:3121e6e34b4de026"} 09:09:31 [09:09:31.162] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:807f1c4da4a5824d type=BASE_PARITY retry=1 err=result {"provingJobId":"1:BASE_PARITY:807f1c4da4a5824d"} 09:09:31 [09:09:31.165] INFO: prover-client:proving-broker Proving Broker started 09:09:31 [09:09:31.165] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:4af00aa33595d612 epochNumber=1 {"provingJobId":"1:BASE_PARITY:4af00aa33595d612"} 09:09:31 [09:09:31.166] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testW6sVsc/1 with map size 1073741824 09:09:31 [09:09:31.168] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:31 [09:09:31.187] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:4af00aa33595d612 {"provingJobId":"1:BASE_PARITY:4af00aa33595d612"} 09:09:31 [09:09:31.188] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:4af00aa33595d612 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:4af00aa33595d612"} 09:09:31 [09:09:31.193] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:25a27d075862f43f epochNumber=1 {"provingJobId":"1:BASE_PARITY:25a27d075862f43f"} 09:09:31 [09:09:31.200] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:4af00aa33595d612 has already been completed {"provingJobId":"1:BASE_PARITY:4af00aa33595d612"} 09:09:31 [09:09:31.203] INFO: prover-client:proving-broker Proving Broker started 09:09:31 [09:09:31.203] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ba0528f5fa34513e epochNumber=1 {"provingJobId":"1:BASE_PARITY:ba0528f5fa34513e"} 09:09:31 [09:09:31.205] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testj6A1jM/1 with map size 1073741824 09:09:31 [09:09:31.207] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:31 [09:09:31.221] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9c0b510fe455b206 epochNumber=2 {"provingJobId":"1:BASE_PARITY:9c0b510fe455b206"} 09:09:31 [09:09:31.222] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testj6A1jM/2 with map size 1073741824 09:09:31 [09:09:31.225] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:32 [09:09:32.294] INFO: prover-client:proving-broker Proving Broker started 09:09:32 [09:09:32.298] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:ba0528f5fa34513e settled=false {"provingJobId":"1:BASE_PARITY:ba0528f5fa34513e","status":"pending"} 09:09:32 [09:09:32.300] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:9c0b510fe455b206 settled=false {"provingJobId":"1:BASE_PARITY:9c0b510fe455b206","status":"pending"} 09:09:32 [09:09:32.301] INFO: prover-client:proving-broker Proving job id=1:BASE_PARITY:ba0528f5fa34513e type=BASE_PARITY startedAt=1750756171243 older agent has taken job {"provingJobId":"1:BASE_PARITY:ba0528f5fa34513e"} 09:09:32 [09:09:32.301] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:ba0528f5fa34513e type=BASE_PARITY already being worked on by another agent. Sending new one {"provingJobId":"1:BASE_PARITY:ba0528f5fa34513e"} 09:09:32 [09:09:32.304] INFO: prover-client:proving-broker Proving Broker started 09:09:32 [09:09:32.305] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9a246e9542d24c3c epochNumber=1 {"provingJobId":"1:BASE_PARITY:9a246e9542d24c3c"} 09:09:32 [09:09:32.305] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test6WvZeL/1 with map size 1073741824 09:09:32 [09:09:32.306] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:32 [09:09:32.321] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c9d335652a9757cb epochNumber=2 {"provingJobId":"1:BASE_PARITY:c9d335652a9757cb"} 09:09:32 [09:09:32.322] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-test6WvZeL/2 with map size 1073741824 09:09:32 [09:09:32.323] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:33 [09:09:33.339] INFO: prover-client:proving-broker Proving Broker started 09:09:33 [09:09:33.340] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:9a246e9542d24c3c settled=false {"provingJobId":"1:BASE_PARITY:9a246e9542d24c3c","status":"pending"} 09:09:33 [09:09:33.342] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:c9d335652a9757cb settled=false {"provingJobId":"1:BASE_PARITY:c9d335652a9757cb","status":"pending"} 09:09:33 [09:09:33.342] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:9a246e9542d24c3c type=BASE_PARITY not found in the in-progress cache, adding it {"provingJobId":"1:BASE_PARITY:9a246e9542d24c3c"} 09:09:33 [09:09:33.345] INFO: prover-client:proving-broker Proving Broker started 09:09:33 [09:09:33.346] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:72217f4e8d7d00ba epochNumber=1 {"provingJobId":"1:BASE_PARITY:72217f4e8d7d00ba"} 09:09:33 [09:09:33.347] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testXAHFig/1 with map size 1073741824 09:09:33 [09:09:33.348] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:33 [09:09:33.363] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d675e265fc625ad1 epochNumber=2 {"provingJobId":"1:BASE_PARITY:d675e265fc625ad1"} 09:09:33 [09:09:33.364] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testXAHFig/2 with map size 1073741824 09:09:33 [09:09:33.366] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:34 [09:09:34.380] INFO: prover-client:proving-broker Proving Broker started 09:09:34 [09:09:34.382] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:72217f4e8d7d00ba settled=false {"provingJobId":"1:BASE_PARITY:72217f4e8d7d00ba","status":"pending"} 09:09:34 [09:09:34.383] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:d675e265fc625ad1 settled=false {"provingJobId":"1:BASE_PARITY:d675e265fc625ad1","status":"pending"} 09:09:34 [09:09:34.384] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:72217f4e8d7d00ba type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:72217f4e8d7d00ba"} 09:09:34 [09:09:34.385] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:72217f4e8d7d00ba type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:72217f4e8d7d00ba"} 09:09:34 [09:09:34.393] INFO: prover-client:proving-broker Proving Broker started 09:09:34 [09:09:34.393] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9ab284d3d19b179a epochNumber=1 {"provingJobId":"1:BASE_PARITY:9ab284d3d19b179a"} 09:09:34 [09:09:34.394] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testGzFPlD/1 with map size 1073741824 09:09:34 [09:09:34.395] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:34 [09:09:34.410] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e33c3a72ced86d4d epochNumber=2 {"provingJobId":"1:BASE_PARITY:e33c3a72ced86d4d"} 09:09:34 [09:09:34.410] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testGzFPlD/2 with map size 1073741824 09:09:34 [09:09:34.411] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:34 [09:09:34.428] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:9ab284d3d19b179a type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:9ab284d3d19b179a"} 09:09:34 [09:09:34.433] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:e33c3a72ced86d4d type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:e33c3a72ced86d4d"} 09:09:34 [09:09:34.441] INFO: prover-client:proving-broker Proving Broker started 09:09:34 [09:09:34.442] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3abb7920b9c42f89 epochNumber=1 {"provingJobId":"1:BASE_PARITY:3abb7920b9c42f89"} 09:09:34 [09:09:34.442] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testMSvzqW/1 with map size 1073741824 09:09:34 [09:09:34.444] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:34 [09:09:34.457] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:99a9d3a77a437fe4 epochNumber=2 {"provingJobId":"1:BASE_PARITY:99a9d3a77a437fe4"} 09:09:34 [09:09:34.458] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testMSvzqW/2 with map size 1073741824 09:09:34 [09:09:34.459] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:34 [09:09:34.474] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:3abb7920b9c42f89 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:3abb7920b9c42f89"} 09:09:34 [09:09:34.474] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:3abb7920b9c42f89 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:3abb7920b9c42f89"} 09:09:34 [09:09:34.480] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:99a9d3a77a437fe4 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:99a9d3a77a437fe4"} 09:09:34 [09:09:34.487] INFO: prover-client:proving-broker Proving Broker started 09:09:34 [09:09:34.488] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:553b21a9fca13504 err=test error {"provingJoId":"1:BASE_PARITY:553b21a9fca13504"} 09:09:34 [09:09:34.491] INFO: prover-client:proving-broker Proving Broker started 09:09:34 [09:09:34.492] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:2aca0a21558937c0 not found {"provingJobId":"1:BASE_PARITY:2aca0a21558937c0"} 09:09:34 [09:09:34.496] INFO: prover-client:proving-broker Proving Broker started 09:09:34 [09:09:34.497] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:38242e1fedfccc44 epochNumber=1 {"provingJobId":"1:BASE_PARITY:38242e1fedfccc44"} 09:09:34 [09:09:34.497] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testH3jJhw/1 with map size 1073741824 09:09:34 [09:09:34.500] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:34 [09:09:34.516] INFO: prover-client:proving-broker Proving Broker started 09:09:34 [09:09:34.517] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:af618d0a8c21a84a epochNumber=1 {"provingJobId":"1:BASE_PARITY:af618d0a8c21a84a"} 09:09:34 [09:09:34.517] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test1RLty2/1 with map size 1073741824 09:09:34 [09:09:34.518] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:34 [09:09:34.641] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:af618d0a8c21a84a timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:af618d0a8c21a84a"} 09:09:34 [09:09:34.647] INFO: prover-client:proving-broker Proving Broker started 09:09:34 [09:09:34.648] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:34be05179f6c68d5 epochNumber=1 {"provingJobId":"1:BASE_PARITY:34be05179f6c68d5"} 09:09:34 [09:09:34.648] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testrp8vcD/1 with map size 1073741824 09:09:34 [09:09:34.649] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:34 [09:09:34.772] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:34be05179f6c68d5 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:34be05179f6c68d5"} 09:09:34 [09:09:34.778] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2d33e70f6a7a82b8 epochNumber=10 {"provingJobId":"1:BASE_PARITY:2d33e70f6a7a82b8"} 09:09:34 [09:09:34.779] INFO: prover-client:proving-broker-database Creating broker database for epoch 10 at /tmp/proving-broker-testrp8vcD/10 with map size 1073741824 09:09:34 [09:09:34.780] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:34 [09:09:34.797] INFO: prover-client:proving-broker Cleaned up jobs=1 09:09:34 [09:09:34.798] INFO: prover-client:proving-broker-database Deleting broker database for epoch 1 09:09:34 [09:09:34.922] INFO: prover-client:proving-broker Proving Broker started 09:09:34 [09:09:34.922] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f35ce7fa2ac7d3e7 epochNumber=1 {"provingJobId":"1:BASE_PARITY:f35ce7fa2ac7d3e7"} 09:09:34 [09:09:34.923] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testn3qVo7/1 with map size 1073741824 09:09:34 [09:09:34.924] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:35 [09:09:35.098] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:f35ce7fa2ac7d3e7 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:f35ce7fa2ac7d3e7"} 09:09:35 [09:09:35.141] INFO: prover-client:proving-broker Proving Broker started 09:09:35 [09:09:35.142] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c0a8818cf98cf90e epochNumber=1 {"provingJobId":"1:BASE_PARITY:c0a8818cf98cf90e"} 09:09:35 [09:09:35.142] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testaQXIJ3/1 with map size 1073741824 09:09:35 [09:09:35.143] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:35 [09:09:35.163] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:c0a8818cf98cf90e type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:c0a8818cf98cf90e"} 09:09:35 [09:09:35.165] INFO: prover-client:proving-broker Proving Broker started 09:09:35 [09:09:35.166] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:8f4c41a64f885c0b epochNumber=1 {"provingJobId":"1:BASE_PARITY:8f4c41a64f885c0b"} 09:09:35 [09:09:35.167] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testIzIaFD/1 with map size 1073741824 09:09:35 [09:09:35.168] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:35 [09:09:35.184] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:8f4c41a64f885c0b type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:8f4c41a64f885c0b"} 09:09:35 [09:09:35.185] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:8f4c41a64f885c0b type=BASE_PARITY totalAttempts=2 err=test error {"provingJobId":"1:BASE_PARITY:8f4c41a64f885c0b"} 09:09:35 [09:09:35.192] INFO: prover-client:proving-broker Proving Broker started 09:09:35 [09:09:35.193] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9d35bb91366e4f75 epochNumber=1 {"provingJobId":"1:BASE_PARITY:9d35bb91366e4f75"} 09:09:35 [09:09:35.194] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testfG1WRE/1 with map size 1073741824 09:09:35 [09:09:35.196] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:35 [09:09:35.211] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:9d35bb91366e4f75 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:9d35bb91366e4f75"} 09:09:35 [09:09:35.218] INFO: prover-client:proving-broker Proving Broker started 09:09:35 [09:09:35.219] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b74a33d3bbb5e812 epochNumber=1 {"provingJobId":"1:BASE_PARITY:b74a33d3bbb5e812"} 09:09:35 [09:09:35.220] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testA43SkW/1 with map size 1073741824 09:09:35 [09:09:35.221] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:35 [09:09:35.235] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:b74a33d3bbb5e812 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:b74a33d3bbb5e812"} 09:09:35 [09:09:35.236] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:155930a677723c00 epochNumber=3 {"provingJobId":"1:BASE_PARITY:155930a677723c00"} 09:09:35 [09:09:35.237] INFO: prover-client:proving-broker-database Creating broker database for epoch 3 at /tmp/proving-broker-testA43SkW/3 with map size 1073741824 09:09:35 [09:09:35.238] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:35 [09:09:35.270] INFO: prover-client:proving-broker Cleaned up jobs=1 09:09:35 [09:09:35.270] INFO: prover-client:proving-broker-database Deleting broker database for epoch 1 09:09:35 [09:09:35.277] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:b74a33d3bbb5e812 err=test error {"provingJoId":"1:BASE_PARITY:b74a33d3bbb5e812"} 09:09:35 [09:09:35.281] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testnwB5SK/1 with map size 1073741824 09:09:35 [09:09:35.282] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:35 [09:09:35.298] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testnwB5SK/2 with map size 1073741824 09:09:35 [09:09:35.299] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:35 [09:09:35.314] INFO: prover-client:proving-broker Proving Broker started 09:09:35 [09:09:35.315] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:3cb4f575423500c2 settled=false {"provingJobId":"1:BASE_PARITY:3cb4f575423500c2","status":"pending"} 09:09:35 [09:09:35.318] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:23cabd92b7879c2c settled=false {"provingJobId":"1:BASE_PARITY:23cabd92b7879c2c","status":"pending"} 09:09:35 [09:09:35.322] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testY2N7io/1 with map size 1073741824 09:09:35 [09:09:35.324] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:35 [09:09:35.343] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testY2N7io/2 with map size 1073741824 09:09:35 [09:09:35.345] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:35 [09:09:35.369] INFO: prover-client:proving-broker Proving Broker started 09:09:35 [09:09:35.371] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:4b46dd7bc1598132 settled=true {"provingJobId":"1:BASE_PARITY:4b46dd7bc1598132","status":"fulfilled"} 09:09:35 [09:09:35.373] INFO: prover-client:proving-broker Restoring proving job id=2:BASE_PARITY:a76c81c000b2dcde settled=true {"provingJobId":"2:BASE_PARITY:a76c81c000b2dcde","status":"fulfilled"} 09:09:35 [09:09:35.377] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testBa1l61/1 with map size 1073741824 09:09:35 [09:09:35.379] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:35 [09:09:35.399] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testBa1l61/2 with map size 1073741824 09:09:35 [09:09:35.400] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:35 [09:09:35.414] INFO: prover-client:proving-broker Proving Broker started 09:09:35 [09:09:35.415] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:c94306fce72b7bf9 settled=true {"provingJobId":"1:BASE_PARITY:c94306fce72b7bf9","status":"fulfilled"} 09:09:35 [09:09:35.417] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:79f4f40ba88ab3b1 settled=false {"provingJobId":"1:BASE_PARITY:79f4f40ba88ab3b1","status":"pending"} 09:09:35 [09:09:35.421] INFO: prover-client:proving-broker Proving Broker started 09:09:35 [09:09:35.422] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1a60edf265d5ac8f epochNumber=1 {"provingJobId":"1:BASE_PARITY:1a60edf265d5ac8f"} 09:09:35 [09:09:35.422] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testzac6lz/1 with map size 1073741824 09:09:35 [09:09:35.424] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:35 [09:09:35.440] INFO: prover-client:proving-broker Proving Broker started 09:09:35 [09:09:35.441] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:555684f7525885bc epochNumber=1 {"provingJobId":"1:BASE_PARITY:555684f7525885bc"} 09:09:35 [09:09:35.442] ERROR: prover-client:proving-broker Failed to save proving job id=1:BASE_PARITY:555684f7525885bc: Error: db error: Error: db error 09:09:35 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1126:63) {"provingJobId":"1:BASE_PARITY:555684f7525885bc"} 09:09:35 [09:09:35.446] INFO: prover-client:proving-broker Proving Broker started 09:09:35 [09:09:35.447] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:de58af296fe03912 epochNumber=1 {"provingJobId":"1:BASE_PARITY:de58af296fe03912"} 09:09:35 [09:09:35.447] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testotuBs8/1 with map size 1073741824 09:09:35 [09:09:35.449] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:35 [09:09:35.465] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:de58af296fe03912 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:de58af296fe03912"} 09:09:35 [09:09:35.465] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:de58af296fe03912 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:de58af296fe03912"} 09:09:35 [09:09:35.473] INFO: prover-client:proving-broker Proving Broker started 09:09:35 [09:09:35.474] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f18f036f133c98ec epochNumber=1 {"provingJobId":"1:BASE_PARITY:f18f036f133c98ec"} 09:09:35 [09:09:35.474] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testWjNShC/1 with map size 1073741824 09:09:35 [09:09:35.475] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:35 [09:09:35.490] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:f18f036f133c98ec type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:f18f036f133c98ec"} 09:09:35 [09:09:35.490] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:f18f036f133c98ec type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:f18f036f133c98ec"} 09:09:35 [09:09:35.491] ERROR: prover-client:proving-broker Failed to save proving job result id=1:BASE_PARITY:f18f036f133c98ec: Error: db error 09:09:35 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1159:69) {"provingJobId":"1:BASE_PARITY:f18f036f133c98ec"} 09:09:35 [09:09:35.494] INFO: prover-client:proving-broker Proving Broker started 09:09:35 [09:09:35.495] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e76a18f25eb2c686 epochNumber=1 {"provingJobId":"1:BASE_PARITY:e76a18f25eb2c686"} 09:09:35 [09:09:35.495] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testyWT9Nk/1 with map size 1073741824 09:09:35 [09:09:35.497] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:35 [09:09:35.510] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:e76a18f25eb2c686 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:e76a18f25eb2c686"} 09:09:35 [09:09:35.511] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:e76a18f25eb2c686 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:e76a18f25eb2c686"} 09:09:35 [09:09:35.520] INFO: prover-client:proving-broker Proving Broker started 09:09:35 [09:09:35.521] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0e60217da40b6664 epochNumber=1 {"provingJobId":"1:BASE_PARITY:0e60217da40b6664"} 09:09:35 [09:09:35.522] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testLvv2Up/1 with map size 1073741824 09:09:35 [09:09:35.523] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:35 [09:09:35.538] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:0e60217da40b6664 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:0e60217da40b6664"} 09:09:35 [09:09:35.538] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:0e60217da40b6664 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:0e60217da40b6664"} 09:09:35 [09:09:35.539] ERROR: prover-client:proving-broker Failed to save proving job error status id=1:BASE_PARITY:0e60217da40b6664 jobErr=test error: Error: db error 09:09:35 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1192:68) {"provingJobId":"1:BASE_PARITY:0e60217da40b6664"} 09:09:35 [09:09:35.542] INFO: prover-client:proving-broker Proving Broker started 09:09:35 [09:09:35.543] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:bd619d60cd36e80c not found {"provingJobId":"1:BASE_PARITY:bd619d60cd36e80c"} 09:09:35 [09:09:35.546] INFO: prover-client:proving-broker Proving Broker started 09:09:35 [09:09:35.546] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:22655a5aede4443f err=test error {"provingJoId":"1:BASE_PARITY:22655a5aede4443f"} 09:09:35 [09:09:35.550] INFO: prover-client:proving-broker Proving Broker started 09:09:35 [09:09:35.560] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:66db48ce45d37ce9 epochNumber=1 {"provingJobId":"1:BASE_PARITY:66db48ce45d37ce9"} 09:09:35 [09:09:35.561] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testF3o8bd/1 with map size 1073741824 09:09:35 [09:09:35.562] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:35 [09:09:35.578] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:66db48ce45d37ce9 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:66db48ce45d37ce9"} 09:09:35 [09:09:35.578] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:66db48ce45d37ce9 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:66db48ce45d37ce9"} 09:09:35 [09:09:35.594] INFO: prover-client:proving-broker New proving job id=2:BASE_PARITY:e2ffbf733cd38b11 epochNumber=2 {"provingJobId":"2:BASE_PARITY:e2ffbf733cd38b11"} 09:09:35 [09:09:35.594] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testF3o8bd/2 with map size 1073741824 09:09:35 [09:09:35.596] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:35 [09:09:35.611] WARN: prover-client:proving-broker Proving job id=2:BASE_PARITY:e2ffbf733cd38b11 type=BASE_PARITY not in the in-progress set {"provingJobId":"2:BASE_PARITY:e2ffbf733cd38b11"} 09:09:35 [09:09:35.612] INFO: prover-client:proving-broker Proving job complete id=2:BASE_PARITY:e2ffbf733cd38b11 type=BASE_PARITY totalAttempts=1 {"provingJobId":"2:BASE_PARITY:e2ffbf733cd38b11"} 09:09:35 [09:09:35.678] INFO: prover-client:proving-broker New proving job id=3:BASE_PARITY:d87728cf26bea705 epochNumber=3 {"provingJobId":"3:BASE_PARITY:d87728cf26bea705"} 09:09:35 [09:09:35.678] INFO: prover-client:proving-broker-database Creating broker database for epoch 3 at /tmp/proving-broker-testF3o8bd/3 with map size 1073741824 09:09:35 [09:09:35.680] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:35 [09:09:35.701] INFO: prover-client:proving-broker Cleaned up jobs=1 09:09:35 [09:09:35.702] INFO: prover-client:proving-broker-database Deleting broker database for epoch 1 09:09:35 [09:09:35.756] INFO: prover-client:proving-broker New proving job id=4:BASE_PARITY:cf896af7542e14b1 epochNumber=4 {"provingJobId":"4:BASE_PARITY:cf896af7542e14b1"} 09:09:35 [09:09:35.757] INFO: prover-client:proving-broker-database Creating broker database for epoch 4 at /tmp/proving-broker-testF3o8bd/4 with map size 1073741824 09:09:35 [09:09:35.758] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:35 [09:09:35.779] INFO: prover-client:proving-broker Cleaned up jobs=1 09:09:35 [09:09:35.780] INFO: prover-client:proving-broker-database Deleting broker database for epoch 2 09:09:35 [09:09:35.836] INFO: prover-client:proving-broker New proving job id=5:BASE_PARITY:002e21d57835fb5c epochNumber=5 {"provingJobId":"5:BASE_PARITY:002e21d57835fb5c"} 09:09:35 [09:09:35.837] INFO: prover-client:proving-broker-database Creating broker database for epoch 5 at /tmp/proving-broker-testF3o8bd/5 with map size 1073741824 09:09:35 [09:09:35.838] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 09:09:35 [09:09:35.858] INFO: prover-client:proving-broker Cleaned up jobs=1 09:09:35 [09:09:35.858] INFO: prover-client:proving-broker-database Deleting broker database for epoch 3 09:09:35 PASS src/proving_broker/proving_broker.test.ts (11.293 s) 09:09:35 ProvingBroker 09:09:35 Producer API 09:09:35 ✓ refuses stale jobs (35 ms) 09:09:35 ✓ enqueues jobs (4 ms) 09:09:35 ✓ ignores duplicate jobs (4 ms) 09:09:35 ✓ reports correct status when enqueuing repeat jobs (4 ms) 09:09:35 ✓ throws an error in case of duplicate job IDs (18 ms) 09:09:35 ✓ returns not-found status for non-existing jobs (1 ms) 09:09:35 ✓ cancels jobs in queue (3 ms) 09:09:35 ✓ cancels jobs in-progress (2 ms) 09:09:35 ✓ returns job result if successful (3 ms) 09:09:35 ✓ returns job error if failed (2 ms) 09:09:35 ✓ correctly returns job status for concurrent writes (2 ms) 09:09:35 ✓ refuses stale jobs (32 ms) 09:09:35 ✓ enqueues jobs (27 ms) 09:09:35 ✓ ignores duplicate jobs (29 ms) 09:09:35 ✓ reports correct status when enqueuing repeat jobs (34 ms) 09:09:35 ✓ throws an error in case of duplicate job IDs (24 ms) 09:09:35 ✓ returns not-found status for non-existing jobs (2 ms) 09:09:35 ✓ cancels jobs in queue (26 ms) 09:09:35 ✓ cancels jobs in-progress (29 ms) 09:09:35 ✓ returns job result if successful (29 ms) 09:09:35 ✓ returns job error if failed (26 ms) 09:09:35 ✓ correctly returns job status for concurrent writes (34 ms) 09:09:35 Consumer API 09:09:35 ✓ returns undefined if no jobs are available (1 ms) 09:09:35 ✓ returns jobs in priority order (2 ms) 09:09:35 ✓ returns undefined if no jobs are available for the given allowList (5 ms) 09:09:35 ✓ returns a job if it is in the allowList (3 ms) 09:09:35 ✓ returns the most important job if it is in the allowList (2 ms) 09:09:35 ✓ returns any job if filter is empty (2 ms) 09:09:35 ✓ returns a new job when reporting job success (2 ms) 09:09:35 ✓ returns a new job when reporting permanent error (2 ms) 09:09:35 ✓ returns a new job when reporting retry-able error (2 ms) 09:09:35 ✓ returns a new job when reporting progress if current one is cancelled (3 ms) 09:09:35 ✓ returns a new job if job is already in progress elsewhere (1054 ms) 09:09:35 ✓ avoids sending the same job to a new agent after a restart (1004 ms) 09:09:35 ✓ avoids sending a completed job to a new agent after a restart (1003 ms) 09:09:35 ✓ tracks job result if in progress (3 ms) 09:09:35 ✓ tracks job result even if job is in queue (2 ms) 09:09:35 ✓ ignores reported job error if unknown job (1 ms) 09:09:35 ✓ ignores job result if unknown job (2 ms) 09:09:35 ✓ returns undefined if no jobs are available (2 ms) 09:09:35 ✓ returns jobs in priority order (47 ms) 09:09:35 ✓ returns undefined if no jobs are available for the given allowList (19 ms) 09:09:35 ✓ returns a job if it is in the allowList (45 ms) 09:09:35 ✓ returns the most important job if it is in the allowList (50 ms) 09:09:35 ✓ returns any job if filter is empty (45 ms) 09:09:35 ✓ returns a new job when reporting job success (30 ms) 09:09:35 ✓ returns a new job when reporting permanent error (32 ms) 09:09:35 ✓ returns a new job when reporting retry-able error (40 ms) 09:09:35 ✓ returns a new job when reporting progress if current one is cancelled (38 ms) 09:09:35 ✓ returns a new job if job is already in progress elsewhere (1100 ms) 09:09:35 ✓ avoids sending the same job to a new agent after a restart (1041 ms) 09:09:35 ✓ avoids sending a completed job to a new agent after a restart (1047 ms) 09:09:35 ✓ tracks job result if in progress (48 ms) 09:09:35 ✓ tracks job result even if job is in queue (45 ms) 09:09:35 ✓ ignores reported job error if unknown job (3 ms) 09:09:35 ✓ ignores job result if unknown job (4 ms) 09:09:35 Timeouts 09:09:35 ✓ tracks in progress jobs (1 ms) 09:09:35 ✓ re-enqueues jobs that time out (107 ms) 09:09:35 ✓ cancel stale jobs that time out (235 ms) 09:09:35 ✓ keeps the jobs in progress while it is alive (202 ms) 09:09:35 ✓ tracks in progress jobs (21 ms) 09:09:35 ✓ re-enqueues jobs that time out (130 ms) 09:09:35 ✓ cancel stale jobs that time out (274 ms) 09:09:35 ✓ keeps the jobs in progress while it is alive (219 ms) 09:09:35 Retries 09:09:35 ✓ retries jobs (2 ms) 09:09:35 ✓ retries up to a maximum number of times (3 ms) 09:09:35 ✓ passing retry=false does not retry (1 ms) 09:09:35 ✓ does not retry if job is stale (28 ms) 09:09:35 ✓ retries jobs (24 ms) 09:09:35 ✓ retries up to a maximum number of times (27 ms) 09:09:35 ✓ passing retry=false does not retry (26 ms) 09:09:35 ✓ does not retry if job is stale (61 ms) 09:09:35 Database management 09:09:35 ✓ re-enqueues proof requests on start (3 ms) 09:09:35 ✓ restores proof results on start (1 ms) 09:09:35 ✓ only re-enqueues unfinished jobs (2 ms) 09:09:35 ✓ saves job when enqueued (2 ms) 09:09:35 ✓ does not retain job if database fails to save (2 ms) 09:09:35 ✓ saves job result (1 ms) 09:09:35 ✓ saves result even if database fails to save (2 ms) 09:09:35 ✓ saves job error (2 ms) 09:09:35 ✓ saves job error even if database fails to save (2 ms) 09:09:35 ✓ does not save job result if job is unknown (4 ms) 09:09:35 ✓ does not save job error if job is unknown (2 ms) 09:09:35 ✓ cleans up old jobs periodically (256 ms) 09:09:35 ✓ re-enqueues proof requests on start (41 ms) 09:09:35 ✓ restores proof results on start (54 ms) 09:09:35 ✓ only re-enqueues unfinished jobs (44 ms) 09:09:35 ✓ saves job when enqueued (20 ms) 09:09:35 ✓ does not retain job if database fails to save (4 ms) 09:09:35 ✓ saves job result (28 ms) 09:09:35 ✓ saves result even if database fails to save (21 ms) 09:09:35 ✓ saves job error (25 ms) 09:09:35 ✓ saves job error even if database fails to save (21 ms) 09:09:35 ✓ does not save job result if job is unknown (3 ms) 09:09:35 ✓ does not save job error if job is unknown (3 ms) 09:09:35 ✓ cleans up old jobs periodically (358 ms) 09:09:35 09:09:35 Test Suites: 1 passed, 1 total 09:09:35 Tests: 96 passed, 96 total 09:09:35 Snapshots: 0 total 09:09:35 Time: 11.37 s 09:09:35 Ran all test suites matching prover-client/src/proving_broker/proving_broker.test.ts. 09:09:35 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?