Parent Log: http://ci.aztec-labs.com/d447f9a13417abbf Command: d2a1f586812a792c yarn-project/scripts/run_test.sh prover-client/src/proving_broker/proving_broker.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/71fe6b444df8fafa5531226cf458dbd22d2f3ab7 Env: REF_NAME=gh-readonly-queue/master/pr-15117-c06f30929f18b85bcea93c0926a8d640a3819f00 CURRENT_VERSION=0.87.8 CI_FULL=1 Date: Tue Jun 17 19:28:34 UTC 2025 System: ARCH=amd64 CPUS=128 MEM=493Gi HOSTNAME=pr-15117_amd64_x2-full Resources: CPU_LIST=0-127 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_b95296ef06707e5f_master 19:28:38 [19:28:38.419] INFO: prover-client:proving-broker Proving Broker started 19:28:38 [19:28:38.427] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c7f4e6ef7bef545f epochNumber=42 {"provingJobId":"1:BASE_PARITY:c7f4e6ef7bef545f"} 19:28:38 [19:28:38.431] WARN: prover-client:proving-broker Tried enqueueing stale proving job id=1:BASE_PARITY:a530a273ebd33ef1 epochNumber=1 {"provingJobId":"1:BASE_PARITY:a530a273ebd33ef1"} 19:28:38 [19:28:38.472] INFO: prover-client:proving-broker Proving Broker started 19:28:38 [19:28:38.473] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2d3c6aac7446ec42 epochNumber=1 {"provingJobId":"1:BASE_PARITY:2d3c6aac7446ec42"} 19:28:38 [19:28:38.474] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:cee1849a219ec650 epochNumber=1 {"provingJobId":"1:BASE_PARITY:cee1849a219ec650"} 19:28:38 [19:28:38.475] INFO: prover-client:proving-broker Proving Broker started 19:28:38 [19:28:38.476] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:35455c7116e73b2c epochNumber=1 {"provingJobId":"1:BASE_PARITY:35455c7116e73b2c"} 19:28:38 [19:28:38.477] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:35455c7116e73b2c epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:35455c7116e73b2c"} 19:28:38 [19:28:38.478] INFO: prover-client:proving-broker Proving Broker started 19:28:38 [19:28:38.479] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ff6bb70239edc220 epochNumber=1 {"provingJobId":"1:BASE_PARITY:ff6bb70239edc220"} 19:28:38 [19:28:38.480] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:ff6bb70239edc220 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:ff6bb70239edc220"} 19:28:38 [19:28:38.480] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:ff6bb70239edc220 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:ff6bb70239edc220"} 19:28:38 [19:28:38.481] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:ff6bb70239edc220 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:ff6bb70239edc220"} 19:28:38 [19:28:38.482] INFO: prover-client:proving-broker Proving Broker started 19:28:38 [19:28:38.482] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:054641c0f236e318 epochNumber=1 {"provingJobId":"1:BASE_PARITY:054641c0f236e318"} 19:28:38 [19:28:38.504] INFO: prover-client:proving-broker Proving Broker started 19:28:38 [19:28:38.506] INFO: prover-client:proving-broker Proving Broker started 19:28:38 [19:28:38.507] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e4c316ce91315174 epochNumber=1 {"provingJobId":"1:BASE_PARITY:e4c316ce91315174"} 19:28:38 [19:28:38.508] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:e4c316ce91315174 {"provingJobId":"1:BASE_PARITY:e4c316ce91315174"} 19:28:38 [19:28:38.508] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:e4c316ce91315174 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:e4c316ce91315174"} 19:28:38 [19:28:38.509] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:e4c316ce91315174 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:e4c316ce91315174"} 19:28:38 [19:28:38.510] INFO: prover-client:proving-broker Proving Broker started 19:28:38 [19:28:38.518] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6923f4d707687291 epochNumber=1 {"provingJobId":"1:BASE_PARITY:6923f4d707687291"} 19:28:38 [19:28:38.519] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:6923f4d707687291 {"provingJobId":"1:BASE_PARITY:6923f4d707687291"} 19:28:38 [19:28:38.520] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:6923f4d707687291 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:6923f4d707687291"} 19:28:38 [19:28:38.522] INFO: prover-client:proving-broker Proving Broker started 19:28:38 [19:28:38.523] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e65e625d450f14da epochNumber=1 {"provingJobId":"1:BASE_PARITY:e65e625d450f14da"} 19:28:38 [19:28:38.523] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:e65e625d450f14da type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:e65e625d450f14da"} 19:28:38 [19:28:38.524] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:e65e625d450f14da type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:e65e625d450f14da"} 19:28:38 [19:28:38.525] INFO: prover-client:proving-broker Proving Broker started 19:28:38 [19:28:38.526] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c9dce066ef3bf947 epochNumber=1 {"provingJobId":"1:BASE_PARITY:c9dce066ef3bf947"} 19:28:38 [19:28:38.526] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:c9dce066ef3bf947 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:c9dce066ef3bf947"} 19:28:38 [19:28:38.526] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:c9dce066ef3bf947 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:c9dce066ef3bf947"} 19:28:38 [19:28:38.528] INFO: prover-client:proving-broker Proving Broker started 19:28:38 [19:28:38.528] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:5edeaacaa54af5fc epochNumber=0 {"provingJobId":"1:BASE_PARITY:5edeaacaa54af5fc"} 19:28:38 [19:28:38.529] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:5edeaacaa54af5fc epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:5edeaacaa54af5fc"} 19:28:38 [19:28:38.529] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:de8c325641716b1d epochNumber=0 {"provingJobId":"1:BASE_PARITY:de8c325641716b1d"} 19:28:38 [19:28:38.529] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:5edeaacaa54af5fc epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:5edeaacaa54af5fc"} 19:28:38 [19:28:38.530] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:512abb910ae5c249 epochNumber=0 {"provingJobId":"1:BASE_PARITY:512abb910ae5c249"} 19:28:38 [19:28:38.532] INFO: prover-client:proving-broker Proving Broker started 19:28:38 [19:28:38.537] INFO: prover-client:proving-broker Proving Broker started 19:28:38 [19:28:38.538] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e7fe2e650c5f2e7b epochNumber=2 {"provingJobId":"1:BASE_PARITY:e7fe2e650c5f2e7b"} 19:28:38 [19:28:38.538] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:20e92e99169a5385 epochNumber=1 {"provingJobId":"1:BASE_PARITY:20e92e99169a5385"} 19:28:38 [19:28:38.539] INFO: prover-client:proving-broker Proving Broker started 19:28:38 [19:28:38.540] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2292ade483c736f1 epochNumber=1 {"provingJobId":"1:BASE_PARITY:2292ade483c736f1"} 19:28:38 [19:28:38.542] INFO: prover-client:proving-broker Proving Broker started 19:28:38 [19:28:38.543] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:10106546786375cd epochNumber=1 {"provingJobId":"1:BASE_PARITY:10106546786375cd"} 19:28:38 [19:28:38.543] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2aa87a62dbed1459 epochNumber=1 {"provingJobId":"1:BASE_PARITY:2aa87a62dbed1459"} 19:28:38 [19:28:38.544] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f125e978ea1c91f4 epochNumber=2 {"provingJobId":"1:BASE_PARITY:f125e978ea1c91f4"} 19:28:38 [19:28:38.545] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6a68a5e4e71119fd epochNumber=1 {"provingJobId":"1:BASE_PARITY:6a68a5e4e71119fd"} 19:28:38 [19:28:38.546] INFO: prover-client:proving-broker Proving Broker started 19:28:38 [19:28:38.549] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:32bea56b547d9b13 epochNumber=1 {"provingJobId":"1:BASE_PARITY:32bea56b547d9b13"} 19:28:38 [19:28:38.550] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1100d6f831906d7d epochNumber=1 {"provingJobId":"1:BASE_PARITY:1100d6f831906d7d"} 19:28:38 [19:28:38.550] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a4bdf0ae50e30872 epochNumber=2 {"provingJobId":"1:BASE_PARITY:a4bdf0ae50e30872"} 19:28:38 [19:28:38.551] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7e02672b2665dfe5 epochNumber=1 {"provingJobId":"1:BASE_PARITY:7e02672b2665dfe5"} 19:28:38 [19:28:38.552] INFO: prover-client:proving-broker Proving Broker started 19:28:38 [19:28:38.553] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b2f01ba4df1d1573 epochNumber=1 {"provingJobId":"1:BASE_PARITY:b2f01ba4df1d1573"} 19:28:38 [19:28:38.553] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:001963702fbe07ce epochNumber=1 {"provingJobId":"1:BASE_PARITY:001963702fbe07ce"} 19:28:38 [19:28:38.553] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:4430889c67168ba0 epochNumber=2 {"provingJobId":"1:BASE_PARITY:4430889c67168ba0"} 19:28:38 [19:28:38.554] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:72f35ec435c5dbb6 epochNumber=1 {"provingJobId":"1:BASE_PARITY:72f35ec435c5dbb6"} 19:28:38 [19:28:38.555] INFO: prover-client:proving-broker Proving Broker started 19:28:38 [19:28:38.555] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:8c7869a7e802e357 epochNumber=1 {"provingJobId":"1:BASE_PARITY:8c7869a7e802e357"} 19:28:38 [19:28:38.557] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9a219fa1d144be1f epochNumber=1 {"provingJobId":"1:BASE_PARITY:9a219fa1d144be1f"} 19:28:38 [19:28:38.559] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:8c7869a7e802e357 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:8c7869a7e802e357"} 19:28:38 [19:28:38.561] INFO: prover-client:proving-broker Proving Broker started 19:28:38 [19:28:38.561] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:63a8dd3431fed2da epochNumber=1 {"provingJobId":"1:BASE_PARITY:63a8dd3431fed2da"} 19:28:38 [19:28:38.562] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:53f24477a3bc78e7 epochNumber=1 {"provingJobId":"1:BASE_PARITY:53f24477a3bc78e7"} 19:28:38 [19:28:38.562] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:63a8dd3431fed2da type=BASE_PARITY totalAttempts=1 err=result {"provingJobId":"1:BASE_PARITY:63a8dd3431fed2da"} 19:28:38 [19:28:38.563] INFO: prover-client:proving-broker Proving Broker started 19:28:38 [19:28:38.564] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:5cf61b173edb31b9 epochNumber=1 {"provingJobId":"1:BASE_PARITY:5cf61b173edb31b9"} 19:28:38 [19:28:38.564] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:df41d016a4e72a6f epochNumber=1 {"provingJobId":"1:BASE_PARITY:df41d016a4e72a6f"} 19:28:38 [19:28:38.565] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:5cf61b173edb31b9 type=BASE_PARITY retry=1 err=result {"provingJobId":"1:BASE_PARITY:5cf61b173edb31b9"} 19:28:38 [19:28:38.566] INFO: prover-client:proving-broker Proving Broker started 19:28:38 [19:28:38.566] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:981fba57e45b1dc8 epochNumber=1 {"provingJobId":"1:BASE_PARITY:981fba57e45b1dc8"} 19:28:38 [19:28:38.567] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:981fba57e45b1dc8 {"provingJobId":"1:BASE_PARITY:981fba57e45b1dc8"} 19:28:38 [19:28:38.567] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:981fba57e45b1dc8 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:981fba57e45b1dc8"} 19:28:38 [19:28:38.568] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2859e01f4dc0ccdb epochNumber=1 {"provingJobId":"1:BASE_PARITY:2859e01f4dc0ccdb"} 19:28:38 [19:28:38.569] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:981fba57e45b1dc8 has already been completed {"provingJobId":"1:BASE_PARITY:981fba57e45b1dc8"} 19:28:38 [19:28:38.570] INFO: prover-client:proving-broker Proving Broker started 19:28:38 [19:28:38.570] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6976c130b17cf85a epochNumber=1 {"provingJobId":"1:BASE_PARITY:6976c130b17cf85a"} 19:28:38 [19:28:38.570] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:49b03c2a7f894765 epochNumber=2 {"provingJobId":"1:BASE_PARITY:49b03c2a7f894765"} 19:28:39 [19:28:39.622] INFO: prover-client:proving-broker Proving Broker started 19:28:39 [19:28:39.623] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:6976c130b17cf85a settled=false {"provingJobId":"1:BASE_PARITY:6976c130b17cf85a","status":"pending"} 19:28:39 [19:28:39.624] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:49b03c2a7f894765 settled=false {"provingJobId":"1:BASE_PARITY:49b03c2a7f894765","status":"pending"} 19:28:39 [19:28:39.625] INFO: prover-client:proving-broker Proving job id=1:BASE_PARITY:6976c130b17cf85a type=BASE_PARITY startedAt=1750188518571 older agent has taken job {"provingJobId":"1:BASE_PARITY:6976c130b17cf85a"} 19:28:39 [19:28:39.626] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:6976c130b17cf85a type=BASE_PARITY already being worked on by another agent. Sending new one {"provingJobId":"1:BASE_PARITY:6976c130b17cf85a"} 19:28:39 [19:28:39.627] INFO: prover-client:proving-broker Proving Broker started 19:28:39 [19:28:39.628] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e594485eb24db2e7 epochNumber=1 {"provingJobId":"1:BASE_PARITY:e594485eb24db2e7"} 19:28:39 [19:28:39.628] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:49465475114e04ff epochNumber=2 {"provingJobId":"1:BASE_PARITY:49465475114e04ff"} 19:28:40 [19:28:40.630] INFO: prover-client:proving-broker Proving Broker started 19:28:40 [19:28:40.630] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:e594485eb24db2e7 settled=false {"provingJobId":"1:BASE_PARITY:e594485eb24db2e7","status":"pending"} 19:28:40 [19:28:40.630] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:49465475114e04ff settled=false {"provingJobId":"1:BASE_PARITY:49465475114e04ff","status":"pending"} 19:28:40 [19:28:40.631] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:e594485eb24db2e7 type=BASE_PARITY not found in the in-progress cache, adding it {"provingJobId":"1:BASE_PARITY:e594485eb24db2e7"} 19:28:40 [19:28:40.632] INFO: prover-client:proving-broker Proving Broker started 19:28:40 [19:28:40.632] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2e3e4be3bbb8c9dd epochNumber=1 {"provingJobId":"1:BASE_PARITY:2e3e4be3bbb8c9dd"} 19:28:40 [19:28:40.637] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0ce3473e4b83c456 epochNumber=2 {"provingJobId":"1:BASE_PARITY:0ce3473e4b83c456"} 19:28:41 [19:28:41.641] INFO: prover-client:proving-broker Proving Broker started 19:28:41 [19:28:41.641] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:2e3e4be3bbb8c9dd settled=false {"provingJobId":"1:BASE_PARITY:2e3e4be3bbb8c9dd","status":"pending"} 19:28:41 [19:28:41.642] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:0ce3473e4b83c456 settled=false {"provingJobId":"1:BASE_PARITY:0ce3473e4b83c456","status":"pending"} 19:28:41 [19:28:41.642] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:2e3e4be3bbb8c9dd type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:2e3e4be3bbb8c9dd"} 19:28:41 [19:28:41.642] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:2e3e4be3bbb8c9dd type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:2e3e4be3bbb8c9dd"} 19:28:41 [19:28:41.645] INFO: prover-client:proving-broker Proving Broker started 19:28:41 [19:28:41.646] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:8a19f9e1c0291071 epochNumber=1 {"provingJobId":"1:BASE_PARITY:8a19f9e1c0291071"} 19:28:41 [19:28:41.647] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:aecbad4944bad511 epochNumber=2 {"provingJobId":"1:BASE_PARITY:aecbad4944bad511"} 19:28:41 [19:28:41.647] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:8a19f9e1c0291071 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:8a19f9e1c0291071"} 19:28:41 [19:28:41.648] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:aecbad4944bad511 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:aecbad4944bad511"} 19:28:41 [19:28:41.651] INFO: prover-client:proving-broker Proving Broker started 19:28:41 [19:28:41.652] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6dbc89295fbcbc2f epochNumber=1 {"provingJobId":"1:BASE_PARITY:6dbc89295fbcbc2f"} 19:28:41 [19:28:41.652] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0f35549667517851 epochNumber=2 {"provingJobId":"1:BASE_PARITY:0f35549667517851"} 19:28:41 [19:28:41.653] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:6dbc89295fbcbc2f type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:6dbc89295fbcbc2f"} 19:28:41 [19:28:41.653] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:6dbc89295fbcbc2f type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:6dbc89295fbcbc2f"} 19:28:41 [19:28:41.654] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:0f35549667517851 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:0f35549667517851"} 19:28:41 [19:28:41.655] INFO: prover-client:proving-broker Proving Broker started 19:28:41 [19:28:41.656] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:fcfb2a5045dae84d err=test error {"provingJoId":"1:BASE_PARITY:fcfb2a5045dae84d"} 19:28:41 [19:28:41.656] INFO: prover-client:proving-broker Proving Broker started 19:28:41 [19:28:41.657] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:fd6f7d3e747ae81e not found {"provingJobId":"1:BASE_PARITY:fd6f7d3e747ae81e"} 19:28:41 [19:28:41.658] INFO: prover-client:proving-broker Proving Broker started 19:28:41 [19:28:41.658] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:98f723a1e16cd893 epochNumber=1 {"provingJobId":"1:BASE_PARITY:98f723a1e16cd893"} 19:28:41 [19:28:41.659] INFO: prover-client:proving-broker Proving Broker started 19:28:41 [19:28:41.660] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2e6ebdee2ed6a2a6 epochNumber=1 {"provingJobId":"1:BASE_PARITY:2e6ebdee2ed6a2a6"} 19:28:41 [19:28:41.762] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:2e6ebdee2ed6a2a6 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:2e6ebdee2ed6a2a6"} 19:28:41 [19:28:41.767] INFO: prover-client:proving-broker Proving Broker started 19:28:41 [19:28:41.768] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:efd4fc079880cc7a epochNumber=1 {"provingJobId":"1:BASE_PARITY:efd4fc079880cc7a"} 19:28:41 [19:28:41.894] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:efd4fc079880cc7a timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:efd4fc079880cc7a"} 19:28:41 [19:28:41.896] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2d1fbd3c6eb3dba7 epochNumber=10 {"provingJobId":"1:BASE_PARITY:2d1fbd3c6eb3dba7"} 19:28:41 [19:28:41.921] INFO: prover-client:proving-broker Cleaned up jobs=1 19:28:42 [19:28:42.023] INFO: prover-client:proving-broker Proving Broker started 19:28:42 [19:28:42.024] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b2868fd6c1a0fae4 epochNumber=1 {"provingJobId":"1:BASE_PARITY:b2868fd6c1a0fae4"} 19:28:42 [19:28:42.176] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:b2868fd6c1a0fae4 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:b2868fd6c1a0fae4"} 19:28:42 [19:28:42.227] INFO: prover-client:proving-broker Proving Broker started 19:28:42 [19:28:42.228] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7e2ff040f5e09803 epochNumber=1 {"provingJobId":"1:BASE_PARITY:7e2ff040f5e09803"} 19:28:42 [19:28:42.229] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:7e2ff040f5e09803 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:7e2ff040f5e09803"} 19:28:42 [19:28:42.229] INFO: prover-client:proving-broker Proving Broker started 19:28:42 [19:28:42.230] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6742f9527398767a epochNumber=1 {"provingJobId":"1:BASE_PARITY:6742f9527398767a"} 19:28:42 [19:28:42.230] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:6742f9527398767a type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:6742f9527398767a"} 19:28:42 [19:28:42.231] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:6742f9527398767a type=BASE_PARITY totalAttempts=2 err=test error {"provingJobId":"1:BASE_PARITY:6742f9527398767a"} 19:28:42 [19:28:42.231] INFO: prover-client:proving-broker Proving Broker started 19:28:42 [19:28:42.232] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2c07d17e48ee8fce epochNumber=1 {"provingJobId":"1:BASE_PARITY:2c07d17e48ee8fce"} 19:28:42 [19:28:42.232] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:2c07d17e48ee8fce type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:2c07d17e48ee8fce"} 19:28:42 [19:28:42.233] INFO: prover-client:proving-broker Proving Broker started 19:28:42 [19:28:42.233] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a3c5bd0811823854 epochNumber=1 {"provingJobId":"1:BASE_PARITY:a3c5bd0811823854"} 19:28:42 [19:28:42.234] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:a3c5bd0811823854 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:a3c5bd0811823854"} 19:28:42 [19:28:42.234] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1a0c7c02eeb4d83d epochNumber=3 {"provingJobId":"1:BASE_PARITY:1a0c7c02eeb4d83d"} 19:28:42 [19:28:42.258] INFO: prover-client:proving-broker Cleaned up jobs=1 19:28:42 [19:28:42.259] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:a3c5bd0811823854 err=test error {"provingJoId":"1:BASE_PARITY:a3c5bd0811823854"} 19:28:42 [19:28:42.262] INFO: prover-client:proving-broker Proving Broker started 19:28:42 [19:28:42.263] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:9ee126a79cff4df2 settled=false {"provingJobId":"1:BASE_PARITY:9ee126a79cff4df2","status":"pending"} 19:28:42 [19:28:42.263] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:1a51a079236da0cd settled=false {"provingJobId":"1:BASE_PARITY:1a51a079236da0cd","status":"pending"} 19:28:42 [19:28:42.266] INFO: prover-client:proving-broker Proving Broker started 19:28:42 [19:28:42.266] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:9e99b2c4bf0e1782 settled=true {"provingJobId":"1:BASE_PARITY:9e99b2c4bf0e1782","status":"fulfilled"} 19:28:42 [19:28:42.266] INFO: prover-client:proving-broker Restoring proving job id=2:BASE_PARITY:e5c42f9f40aa4751 settled=true {"provingJobId":"2:BASE_PARITY:e5c42f9f40aa4751","status":"fulfilled"} 19:28:42 [19:28:42.267] INFO: prover-client:proving-broker Proving Broker started 19:28:42 [19:28:42.268] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:a108caaa3890a820 settled=true {"provingJobId":"1:BASE_PARITY:a108caaa3890a820","status":"fulfilled"} 19:28:42 [19:28:42.268] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:048f8cf7329b535e settled=false {"provingJobId":"1:BASE_PARITY:048f8cf7329b535e","status":"pending"} 19:28:42 [19:28:42.269] INFO: prover-client:proving-broker Proving Broker started 19:28:42 [19:28:42.270] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2bdf1b3c6824631e epochNumber=1 {"provingJobId":"1:BASE_PARITY:2bdf1b3c6824631e"} 19:28:42 [19:28:42.272] INFO: prover-client:proving-broker Proving Broker started 19:28:42 [19:28:42.272] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:75a4c6148489e12c epochNumber=1 {"provingJobId":"1:BASE_PARITY:75a4c6148489e12c"} 19:28:42 [19:28:42.273] ERROR: prover-client:proving-broker Failed to save proving job id=1:BASE_PARITY:75a4c6148489e12c: Error: db error: Error: db error 19:28:42 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1126:63) {"provingJobId":"1:BASE_PARITY:75a4c6148489e12c"} 19:28:42 [19:28:42.274] INFO: prover-client:proving-broker Proving Broker started 19:28:42 [19:28:42.274] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7306c4a0f049e37b epochNumber=1 {"provingJobId":"1:BASE_PARITY:7306c4a0f049e37b"} 19:28:42 [19:28:42.275] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:7306c4a0f049e37b type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:7306c4a0f049e37b"} 19:28:42 [19:28:42.275] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:7306c4a0f049e37b type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:7306c4a0f049e37b"} 19:28:42 [19:28:42.276] INFO: prover-client:proving-broker Proving Broker started 19:28:42 [19:28:42.276] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:840cc539fa296811 epochNumber=1 {"provingJobId":"1:BASE_PARITY:840cc539fa296811"} 19:28:42 [19:28:42.277] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:840cc539fa296811 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:840cc539fa296811"} 19:28:42 [19:28:42.277] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:840cc539fa296811 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:840cc539fa296811"} 19:28:42 [19:28:42.277] ERROR: prover-client:proving-broker Failed to save proving job result id=1:BASE_PARITY:840cc539fa296811: Error: db error 19:28:42 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1159:69) {"provingJobId":"1:BASE_PARITY:840cc539fa296811"} 19:28:42 [19:28:42.278] INFO: prover-client:proving-broker Proving Broker started 19:28:42 [19:28:42.279] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:590633973ef384d2 epochNumber=1 {"provingJobId":"1:BASE_PARITY:590633973ef384d2"} 19:28:42 [19:28:42.279] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:590633973ef384d2 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:590633973ef384d2"} 19:28:42 [19:28:42.279] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:590633973ef384d2 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:590633973ef384d2"} 19:28:42 [19:28:42.280] INFO: prover-client:proving-broker Proving Broker started 19:28:42 [19:28:42.280] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ccaead35ef50576b epochNumber=1 {"provingJobId":"1:BASE_PARITY:ccaead35ef50576b"} 19:28:42 [19:28:42.280] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:ccaead35ef50576b type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:ccaead35ef50576b"} 19:28:42 [19:28:42.281] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:ccaead35ef50576b type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:ccaead35ef50576b"} 19:28:42 [19:28:42.281] ERROR: prover-client:proving-broker Failed to save proving job error status id=1:BASE_PARITY:ccaead35ef50576b jobErr=test error: Error: db error 19:28:42 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1192:68) {"provingJobId":"1:BASE_PARITY:ccaead35ef50576b"} 19:28:42 [19:28:42.282] INFO: prover-client:proving-broker Proving Broker started 19:28:42 [19:28:42.283] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:b7f1b96099f3e5f3 not found {"provingJobId":"1:BASE_PARITY:b7f1b96099f3e5f3"} 19:28:42 [19:28:42.284] INFO: prover-client:proving-broker Proving Broker started 19:28:42 [19:28:42.284] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:d1e8f484734cdc2c err=test error {"provingJoId":"1:BASE_PARITY:d1e8f484734cdc2c"} 19:28:42 [19:28:42.285] INFO: prover-client:proving-broker Proving Broker started 19:28:42 [19:28:42.295] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:315d530fb94b5666 epochNumber=1 {"provingJobId":"1:BASE_PARITY:315d530fb94b5666"} 19:28:42 [19:28:42.296] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:315d530fb94b5666 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:315d530fb94b5666"} 19:28:42 [19:28:42.296] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:315d530fb94b5666 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:315d530fb94b5666"} 19:28:42 [19:28:42.307] INFO: prover-client:proving-broker New proving job id=2:BASE_PARITY:8cd098b200786e98 epochNumber=2 {"provingJobId":"2:BASE_PARITY:8cd098b200786e98"} 19:28:42 [19:28:42.308] WARN: prover-client:proving-broker Proving job id=2:BASE_PARITY:8cd098b200786e98 type=BASE_PARITY not in the in-progress set {"provingJobId":"2:BASE_PARITY:8cd098b200786e98"} 19:28:42 [19:28:42.308] INFO: prover-client:proving-broker Proving job complete id=2:BASE_PARITY:8cd098b200786e98 type=BASE_PARITY totalAttempts=1 {"provingJobId":"2:BASE_PARITY:8cd098b200786e98"} 19:28:42 [19:28:42.370] INFO: prover-client:proving-broker New proving job id=3:BASE_PARITY:2f0cd541e7e470db epochNumber=3 {"provingJobId":"3:BASE_PARITY:2f0cd541e7e470db"} 19:28:42 [19:28:42.387] INFO: prover-client:proving-broker Cleaned up jobs=1 19:28:42 [19:28:42.434] INFO: prover-client:proving-broker New proving job id=4:BASE_PARITY:2dad78b40ff50e8f epochNumber=4 {"provingJobId":"4:BASE_PARITY:2dad78b40ff50e8f"} 19:28:42 [19:28:42.439] INFO: prover-client:proving-broker Cleaned up jobs=1 19:28:42 [19:28:42.496] INFO: prover-client:proving-broker New proving job id=5:BASE_PARITY:6a941c44ba19724b epochNumber=5 {"provingJobId":"5:BASE_PARITY:6a941c44ba19724b"} 19:28:42 [19:28:42.516] INFO: prover-client:proving-broker Cleaned up jobs=1 19:28:42 [19:28:42.553] INFO: prover-client:proving-broker Proving Broker started 19:28:42 [19:28:42.554] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7ad07927de487a57 epochNumber=42 {"provingJobId":"1:BASE_PARITY:7ad07927de487a57"} 19:28:42 [19:28:42.555] INFO: prover-client:proving-broker-database Creating broker database for epoch 42 at /tmp/proving-broker-testXB61x3/42 with map size 1073741824 19:28:42 [19:28:42.560] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:42 [19:28:42.585] WARN: prover-client:proving-broker Tried enqueueing stale proving job id=1:BASE_PARITY:bfe35ab48d8c44ef epochNumber=1 {"provingJobId":"1:BASE_PARITY:bfe35ab48d8c44ef"} 19:28:42 [19:28:42.591] INFO: prover-client:proving-broker Proving Broker started 19:28:42 [19:28:42.592] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:fcf58abcadc95ff4 epochNumber=1 {"provingJobId":"1:BASE_PARITY:fcf58abcadc95ff4"} 19:28:42 [19:28:42.595] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testRhy1nS/1 with map size 1073741824 19:28:42 [19:28:42.598] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:42 [19:28:42.626] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a742a37acb533847 epochNumber=1 {"provingJobId":"1:BASE_PARITY:a742a37acb533847"} 19:28:42 [19:28:42.643] INFO: prover-client:proving-broker Proving Broker started 19:28:42 [19:28:42.644] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e147b59669a53647 epochNumber=1 {"provingJobId":"1:BASE_PARITY:e147b59669a53647"} 19:28:42 [19:28:42.645] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testF2KzpF/1 with map size 1073741824 19:28:42 [19:28:42.648] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:42 [19:28:42.670] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:e147b59669a53647 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:e147b59669a53647"} 19:28:42 [19:28:42.675] INFO: prover-client:proving-broker Proving Broker started 19:28:42 [19:28:42.676] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3d89a78a9f2382a0 epochNumber=1 {"provingJobId":"1:BASE_PARITY:3d89a78a9f2382a0"} 19:28:42 [19:28:42.676] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testUnL7zc/1 with map size 1073741824 19:28:42 [19:28:42.679] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:42 [19:28:42.698] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:3d89a78a9f2382a0 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:3d89a78a9f2382a0"} 19:28:42 [19:28:42.699] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:3d89a78a9f2382a0 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:3d89a78a9f2382a0"} 19:28:42 [19:28:42.706] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:3d89a78a9f2382a0 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:3d89a78a9f2382a0"} 19:28:42 [19:28:42.710] INFO: prover-client:proving-broker Proving Broker started 19:28:42 [19:28:42.711] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a4104064194fc321 epochNumber=1 {"provingJobId":"1:BASE_PARITY:a4104064194fc321"} 19:28:42 [19:28:42.712] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testSJsZtL/1 with map size 1073741824 19:28:42 [19:28:42.713] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:42 [19:28:42.738] INFO: prover-client:proving-broker Proving Broker started 19:28:42 [19:28:42.745] INFO: prover-client:proving-broker Proving Broker started 19:28:42 [19:28:42.746] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7ae337f916c1bef7 epochNumber=1 {"provingJobId":"1:BASE_PARITY:7ae337f916c1bef7"} 19:28:42 [19:28:42.748] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test4ArW4c/1 with map size 1073741824 19:28:42 [19:28:42.751] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:42 [19:28:42.771] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:7ae337f916c1bef7 {"provingJobId":"1:BASE_PARITY:7ae337f916c1bef7"} 19:28:42 [19:28:42.772] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:7ae337f916c1bef7 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:7ae337f916c1bef7"} 19:28:42 [19:28:42.772] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:7ae337f916c1bef7 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:7ae337f916c1bef7"} 19:28:42 [19:28:42.783] INFO: prover-client:proving-broker Proving Broker started 19:28:42 [19:28:42.784] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e1720d4439faadf3 epochNumber=1 {"provingJobId":"1:BASE_PARITY:e1720d4439faadf3"} 19:28:42 [19:28:42.785] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testJlzM3h/1 with map size 1073741824 19:28:42 [19:28:42.787] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:42 [19:28:42.807] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:e1720d4439faadf3 {"provingJobId":"1:BASE_PARITY:e1720d4439faadf3"} 19:28:42 [19:28:42.808] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:e1720d4439faadf3 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:e1720d4439faadf3"} 19:28:42 [19:28:42.818] INFO: prover-client:proving-broker Proving Broker started 19:28:42 [19:28:42.819] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b8a4f53457fc4e25 epochNumber=1 {"provingJobId":"1:BASE_PARITY:b8a4f53457fc4e25"} 19:28:42 [19:28:42.820] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testZ3W8Vj/1 with map size 1073741824 19:28:42 [19:28:42.823] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:42 [19:28:42.851] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:b8a4f53457fc4e25 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:b8a4f53457fc4e25"} 19:28:42 [19:28:42.852] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:b8a4f53457fc4e25 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:b8a4f53457fc4e25"} 19:28:42 [19:28:42.861] INFO: prover-client:proving-broker Proving Broker started 19:28:42 [19:28:42.861] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:dccbcde9b8cc1979 epochNumber=1 {"provingJobId":"1:BASE_PARITY:dccbcde9b8cc1979"} 19:28:42 [19:28:42.862] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test4YoP22/1 with map size 1073741824 19:28:42 [19:28:42.865] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:42 [19:28:42.882] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:dccbcde9b8cc1979 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:dccbcde9b8cc1979"} 19:28:42 [19:28:42.883] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:dccbcde9b8cc1979 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:dccbcde9b8cc1979"} 19:28:42 [19:28:42.892] INFO: prover-client:proving-broker Proving Broker started 19:28:42 [19:28:42.892] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d195a47757a4fe89 epochNumber=0 {"provingJobId":"1:BASE_PARITY:d195a47757a4fe89"} 19:28:42 [19:28:42.893] INFO: prover-client:proving-broker-database Creating broker database for epoch 0 at /tmp/proving-broker-testPRr3As/0 with map size 1073741824 19:28:42 [19:28:42.896] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:42 [19:28:42.914] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:d195a47757a4fe89 epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:d195a47757a4fe89"} 19:28:42 [19:28:42.915] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:440d81e55996f965 epochNumber=0 {"provingJobId":"1:BASE_PARITY:440d81e55996f965"} 19:28:42 [19:28:42.915] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:d195a47757a4fe89 epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:d195a47757a4fe89"} 19:28:42 [19:28:42.916] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c0debecd8fd0f945 epochNumber=0 {"provingJobId":"1:BASE_PARITY:c0debecd8fd0f945"} 19:28:42 [19:28:42.929] INFO: prover-client:proving-broker Proving Broker started 19:28:42 [19:28:42.931] INFO: prover-client:proving-broker Proving Broker started 19:28:42 [19:28:42.931] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:596177d737d9e5b3 epochNumber=2 {"provingJobId":"1:BASE_PARITY:596177d737d9e5b3"} 19:28:42 [19:28:42.933] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testRfEopq/2 with map size 1073741824 19:28:42 [19:28:42.939] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:42 [19:28:42.960] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:94b3e11be78f5a53 epochNumber=1 {"provingJobId":"1:BASE_PARITY:94b3e11be78f5a53"} 19:28:42 [19:28:42.962] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testRfEopq/1 with map size 1073741824 19:28:42 [19:28:42.964] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:42 [19:28:42.985] INFO: prover-client:proving-broker Proving Broker started 19:28:42 [19:28:42.986] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d9548c0755fb5021 epochNumber=1 {"provingJobId":"1:BASE_PARITY:d9548c0755fb5021"} 19:28:42 [19:28:42.987] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testS7vUjF/1 with map size 1073741824 19:28:42 [19:28:42.989] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:43 [19:28:43.006] INFO: prover-client:proving-broker Proving Broker started 19:28:43 [19:28:43.007] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:483ddf99ef3c6087 epochNumber=1 {"provingJobId":"1:BASE_PARITY:483ddf99ef3c6087"} 19:28:43 [19:28:43.008] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testlSL34e/1 with map size 1073741824 19:28:43 [19:28:43.010] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:43 [19:28:43.026] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c00a62251984ffb1 epochNumber=1 {"provingJobId":"1:BASE_PARITY:c00a62251984ffb1"} 19:28:43 [19:28:43.033] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:165b0faa39976f8b epochNumber=2 {"provingJobId":"1:BASE_PARITY:165b0faa39976f8b"} 19:28:43 [19:28:43.036] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testlSL34e/2 with map size 1073741824 19:28:43 [19:28:43.043] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:43 [19:28:43.065] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:cbccc783517b1270 epochNumber=1 {"provingJobId":"1:BASE_PARITY:cbccc783517b1270"} 19:28:43 [19:28:43.075] INFO: prover-client:proving-broker Proving Broker started 19:28:43 [19:28:43.076] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:157078e7ce85eed1 epochNumber=1 {"provingJobId":"1:BASE_PARITY:157078e7ce85eed1"} 19:28:43 [19:28:43.076] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testnIqajJ/1 with map size 1073741824 19:28:43 [19:28:43.079] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:43 [19:28:43.096] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:959537cabab80b47 epochNumber=1 {"provingJobId":"1:BASE_PARITY:959537cabab80b47"} 19:28:43 [19:28:43.103] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a2063b26e58d27c9 epochNumber=2 {"provingJobId":"1:BASE_PARITY:a2063b26e58d27c9"} 19:28:43 [19:28:43.104] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testnIqajJ/2 with map size 1073741824 19:28:43 [19:28:43.106] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:43 [19:28:43.123] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:94f730a490cd50af epochNumber=1 {"provingJobId":"1:BASE_PARITY:94f730a490cd50af"} 19:28:43 [19:28:43.138] INFO: prover-client:proving-broker Proving Broker started 19:28:43 [19:28:43.140] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f2de2c5b7a4d1394 epochNumber=1 {"provingJobId":"1:BASE_PARITY:f2de2c5b7a4d1394"} 19:28:43 [19:28:43.141] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testJFqaBc/1 with map size 1073741824 19:28:43 [19:28:43.150] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:43 [19:28:43.168] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:53d92e9a132b8c82 epochNumber=1 {"provingJobId":"1:BASE_PARITY:53d92e9a132b8c82"} 19:28:43 [19:28:43.174] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ad4f455af1514246 epochNumber=2 {"provingJobId":"1:BASE_PARITY:ad4f455af1514246"} 19:28:43 [19:28:43.175] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testJFqaBc/2 with map size 1073741824 19:28:43 [19:28:43.177] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:43 [19:28:43.194] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:5485cff8de69cdcb epochNumber=1 {"provingJobId":"1:BASE_PARITY:5485cff8de69cdcb"} 19:28:43 [19:28:43.203] INFO: prover-client:proving-broker Proving Broker started 19:28:43 [19:28:43.204] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3716e62c86b45edd epochNumber=1 {"provingJobId":"1:BASE_PARITY:3716e62c86b45edd"} 19:28:43 [19:28:43.204] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testNFt48X/1 with map size 1073741824 19:28:43 [19:28:43.206] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:43 [19:28:43.222] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:bbf7b785f768cf14 epochNumber=1 {"provingJobId":"1:BASE_PARITY:bbf7b785f768cf14"} 19:28:43 [19:28:43.228] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:3716e62c86b45edd type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:3716e62c86b45edd"} 19:28:43 [19:28:43.248] INFO: prover-client:proving-broker Proving Broker started 19:28:43 [19:28:43.249] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:5a83c2ff2c752275 epochNumber=1 {"provingJobId":"1:BASE_PARITY:5a83c2ff2c752275"} 19:28:43 [19:28:43.249] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testI8xvdL/1 with map size 1073741824 19:28:43 [19:28:43.251] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:43 [19:28:43.267] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2d1231b060b7968b epochNumber=1 {"provingJobId":"1:BASE_PARITY:2d1231b060b7968b"} 19:28:43 [19:28:43.273] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:5a83c2ff2c752275 type=BASE_PARITY totalAttempts=1 err=result {"provingJobId":"1:BASE_PARITY:5a83c2ff2c752275"} 19:28:43 [19:28:43.282] INFO: prover-client:proving-broker Proving Broker started 19:28:43 [19:28:43.282] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:4836b8d28d064c79 epochNumber=1 {"provingJobId":"1:BASE_PARITY:4836b8d28d064c79"} 19:28:43 [19:28:43.283] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testpqmTCn/1 with map size 1073741824 19:28:43 [19:28:43.285] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:43 [19:28:43.301] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3be7a981c8a9ee56 epochNumber=1 {"provingJobId":"1:BASE_PARITY:3be7a981c8a9ee56"} 19:28:43 [19:28:43.307] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:4836b8d28d064c79 type=BASE_PARITY retry=1 err=result {"provingJobId":"1:BASE_PARITY:4836b8d28d064c79"} 19:28:43 [19:28:43.311] INFO: prover-client:proving-broker Proving Broker started 19:28:43 [19:28:43.312] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7234b99f3d0bc0b1 epochNumber=1 {"provingJobId":"1:BASE_PARITY:7234b99f3d0bc0b1"} 19:28:43 [19:28:43.313] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testGJ2zQW/1 with map size 1073741824 19:28:43 [19:28:43.315] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:43 [19:28:43.330] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:7234b99f3d0bc0b1 {"provingJobId":"1:BASE_PARITY:7234b99f3d0bc0b1"} 19:28:43 [19:28:43.331] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:7234b99f3d0bc0b1 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:7234b99f3d0bc0b1"} 19:28:43 [19:28:43.347] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:939fee1c64b522ab epochNumber=1 {"provingJobId":"1:BASE_PARITY:939fee1c64b522ab"} 19:28:43 [19:28:43.354] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:7234b99f3d0bc0b1 has already been completed {"provingJobId":"1:BASE_PARITY:7234b99f3d0bc0b1"} 19:28:43 [19:28:43.358] INFO: prover-client:proving-broker Proving Broker started 19:28:43 [19:28:43.359] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:fda56d7c415747bc epochNumber=1 {"provingJobId":"1:BASE_PARITY:fda56d7c415747bc"} 19:28:43 [19:28:43.359] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testo4P7F9/1 with map size 1073741824 19:28:43 [19:28:43.363] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:43 [19:28:43.379] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:90652461d4fd3882 epochNumber=2 {"provingJobId":"1:BASE_PARITY:90652461d4fd3882"} 19:28:43 [19:28:43.380] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testo4P7F9/2 with map size 1073741824 19:28:43 [19:28:43.382] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:44 [19:28:44.450] INFO: prover-client:proving-broker Proving Broker started 19:28:44 [19:28:44.458] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:fda56d7c415747bc settled=false {"provingJobId":"1:BASE_PARITY:fda56d7c415747bc","status":"pending"} 19:28:44 [19:28:44.460] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:90652461d4fd3882 settled=false {"provingJobId":"1:BASE_PARITY:90652461d4fd3882","status":"pending"} 19:28:44 [19:28:44.461] INFO: prover-client:proving-broker Proving job id=1:BASE_PARITY:fda56d7c415747bc type=BASE_PARITY startedAt=1750188523398 older agent has taken job {"provingJobId":"1:BASE_PARITY:fda56d7c415747bc"} 19:28:44 [19:28:44.462] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:fda56d7c415747bc type=BASE_PARITY already being worked on by another agent. Sending new one {"provingJobId":"1:BASE_PARITY:fda56d7c415747bc"} 19:28:44 [19:28:44.465] INFO: prover-client:proving-broker Proving Broker started 19:28:44 [19:28:44.466] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f1de480d22cbd002 epochNumber=1 {"provingJobId":"1:BASE_PARITY:f1de480d22cbd002"} 19:28:44 [19:28:44.468] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testMPxAt9/1 with map size 1073741824 19:28:44 [19:28:44.472] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:44 [19:28:44.492] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:13d1bb18a7365e68 epochNumber=2 {"provingJobId":"1:BASE_PARITY:13d1bb18a7365e68"} 19:28:44 [19:28:44.493] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testMPxAt9/2 with map size 1073741824 19:28:44 [19:28:44.495] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:45 [19:28:45.518] INFO: prover-client:proving-broker Proving Broker started 19:28:45 [19:28:45.520] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:f1de480d22cbd002 settled=false {"provingJobId":"1:BASE_PARITY:f1de480d22cbd002","status":"pending"} 19:28:45 [19:28:45.522] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:13d1bb18a7365e68 settled=false {"provingJobId":"1:BASE_PARITY:13d1bb18a7365e68","status":"pending"} 19:28:45 [19:28:45.522] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:f1de480d22cbd002 type=BASE_PARITY not found in the in-progress cache, adding it {"provingJobId":"1:BASE_PARITY:f1de480d22cbd002"} 19:28:45 [19:28:45.528] INFO: prover-client:proving-broker Proving Broker started 19:28:45 [19:28:45.529] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6b49eb2c87f9862a epochNumber=1 {"provingJobId":"1:BASE_PARITY:6b49eb2c87f9862a"} 19:28:45 [19:28:45.530] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testL8JBTl/1 with map size 1073741824 19:28:45 [19:28:45.531] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:45 [19:28:45.554] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:5ea2714d84ae2ef4 epochNumber=2 {"provingJobId":"1:BASE_PARITY:5ea2714d84ae2ef4"} 19:28:45 [19:28:45.555] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testL8JBTl/2 with map size 1073741824 19:28:45 [19:28:45.561] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:46 [19:28:46.580] INFO: prover-client:proving-broker Proving Broker started 19:28:46 [19:28:46.585] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:6b49eb2c87f9862a settled=false {"provingJobId":"1:BASE_PARITY:6b49eb2c87f9862a","status":"pending"} 19:28:46 [19:28:46.587] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:5ea2714d84ae2ef4 settled=false {"provingJobId":"1:BASE_PARITY:5ea2714d84ae2ef4","status":"pending"} 19:28:46 [19:28:46.589] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:6b49eb2c87f9862a type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:6b49eb2c87f9862a"} 19:28:46 [19:28:46.589] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:6b49eb2c87f9862a type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:6b49eb2c87f9862a"} 19:28:46 [19:28:46.600] INFO: prover-client:proving-broker Proving Broker started 19:28:46 [19:28:46.601] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ceab9a476fd81095 epochNumber=1 {"provingJobId":"1:BASE_PARITY:ceab9a476fd81095"} 19:28:46 [19:28:46.612] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test0C1tIJ/1 with map size 1073741824 19:28:46 [19:28:46.616] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:46 [19:28:46.633] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:91ba5d64df082f8a epochNumber=2 {"provingJobId":"1:BASE_PARITY:91ba5d64df082f8a"} 19:28:46 [19:28:46.634] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-test0C1tIJ/2 with map size 1073741824 19:28:46 [19:28:46.637] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:46 [19:28:46.660] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:ceab9a476fd81095 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:ceab9a476fd81095"} 19:28:46 [19:28:46.668] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:91ba5d64df082f8a type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:91ba5d64df082f8a"} 19:28:46 [19:28:46.681] INFO: prover-client:proving-broker Proving Broker started 19:28:46 [19:28:46.682] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:26e0ceba57350ef2 epochNumber=1 {"provingJobId":"1:BASE_PARITY:26e0ceba57350ef2"} 19:28:46 [19:28:46.683] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testP3IBl8/1 with map size 1073741824 19:28:46 [19:28:46.685] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:46 [19:28:46.705] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:526b32e7e9a0eb8d epochNumber=2 {"provingJobId":"1:BASE_PARITY:526b32e7e9a0eb8d"} 19:28:46 [19:28:46.707] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testP3IBl8/2 with map size 1073741824 19:28:46 [19:28:46.710] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:46 [19:28:46.727] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:26e0ceba57350ef2 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:26e0ceba57350ef2"} 19:28:46 [19:28:46.728] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:26e0ceba57350ef2 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:26e0ceba57350ef2"} 19:28:46 [19:28:46.734] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:526b32e7e9a0eb8d type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:526b32e7e9a0eb8d"} 19:28:46 [19:28:46.747] INFO: prover-client:proving-broker Proving Broker started 19:28:46 [19:28:46.749] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:331c69176abb1ed2 err=test error {"provingJoId":"1:BASE_PARITY:331c69176abb1ed2"} 19:28:46 [19:28:46.754] INFO: prover-client:proving-broker Proving Broker started 19:28:46 [19:28:46.756] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:7e1c6fd4b4493516 not found {"provingJobId":"1:BASE_PARITY:7e1c6fd4b4493516"} 19:28:46 [19:28:46.764] INFO: prover-client:proving-broker Proving Broker started 19:28:46 [19:28:46.766] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:eba30649066c600c epochNumber=1 {"provingJobId":"1:BASE_PARITY:eba30649066c600c"} 19:28:46 [19:28:46.768] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testue0IpO/1 with map size 1073741824 19:28:46 [19:28:46.774] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:46 [19:28:46.799] INFO: prover-client:proving-broker Proving Broker started 19:28:46 [19:28:46.800] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2a22913a2bc44cde epochNumber=1 {"provingJobId":"1:BASE_PARITY:2a22913a2bc44cde"} 19:28:46 [19:28:46.801] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testshBwwK/1 with map size 1073741824 19:28:46 [19:28:46.803] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:46 [19:28:46.950] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:2a22913a2bc44cde timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:2a22913a2bc44cde"} 19:28:46 [19:28:46.957] INFO: prover-client:proving-broker Proving Broker started 19:28:46 [19:28:46.957] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:da90f83d3cb1a000 epochNumber=1 {"provingJobId":"1:BASE_PARITY:da90f83d3cb1a000"} 19:28:46 [19:28:46.958] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testnqa3LH/1 with map size 1073741824 19:28:46 [19:28:46.961] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:47 [19:28:47.085] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:da90f83d3cb1a000 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:da90f83d3cb1a000"} 19:28:47 [19:28:47.089] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:bdb1af8996402417 epochNumber=10 {"provingJobId":"1:BASE_PARITY:bdb1af8996402417"} 19:28:47 [19:28:47.090] INFO: prover-client:proving-broker-database Creating broker database for epoch 10 at /tmp/proving-broker-testnqa3LH/10 with map size 1073741824 19:28:47 [19:28:47.092] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:47 [19:28:47.135] INFO: prover-client:proving-broker Cleaned up jobs=1 19:28:47 [19:28:47.136] INFO: prover-client:proving-broker-database Deleting broker database for epoch 1 19:28:47 [19:28:47.240] INFO: prover-client:proving-broker Proving Broker started 19:28:47 [19:28:47.241] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:4da44f223cf49fb3 epochNumber=1 {"provingJobId":"1:BASE_PARITY:4da44f223cf49fb3"} 19:28:47 [19:28:47.242] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test0DgsXR/1 with map size 1073741824 19:28:47 [19:28:47.243] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:47 [19:28:47.418] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:4da44f223cf49fb3 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:4da44f223cf49fb3"} 19:28:47 [19:28:47.473] INFO: prover-client:proving-broker Proving Broker started 19:28:47 [19:28:47.473] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2772f64e5e8d218d epochNumber=1 {"provingJobId":"1:BASE_PARITY:2772f64e5e8d218d"} 19:28:47 [19:28:47.476] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testjpJ3IQ/1 with map size 1073741824 19:28:47 [19:28:47.479] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:47 [19:28:47.502] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:2772f64e5e8d218d type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:2772f64e5e8d218d"} 19:28:47 [19:28:47.505] INFO: prover-client:proving-broker Proving Broker started 19:28:47 [19:28:47.506] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:4272dffb36b58e1d epochNumber=1 {"provingJobId":"1:BASE_PARITY:4272dffb36b58e1d"} 19:28:47 [19:28:47.508] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testGKAQwS/1 with map size 1073741824 19:28:47 [19:28:47.509] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:47 [19:28:47.530] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:4272dffb36b58e1d type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:4272dffb36b58e1d"} 19:28:47 [19:28:47.531] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:4272dffb36b58e1d type=BASE_PARITY totalAttempts=2 err=test error {"provingJobId":"1:BASE_PARITY:4272dffb36b58e1d"} 19:28:47 [19:28:47.544] INFO: prover-client:proving-broker Proving Broker started 19:28:47 [19:28:47.545] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:cd78180ab35c9a69 epochNumber=1 {"provingJobId":"1:BASE_PARITY:cd78180ab35c9a69"} 19:28:47 [19:28:47.545] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testDRmkKT/1 with map size 1073741824 19:28:47 [19:28:47.547] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:47 [19:28:47.573] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:cd78180ab35c9a69 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:cd78180ab35c9a69"} 19:28:47 [19:28:47.586] INFO: prover-client:proving-broker Proving Broker started 19:28:47 [19:28:47.587] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3f936e9eb0d8503a epochNumber=1 {"provingJobId":"1:BASE_PARITY:3f936e9eb0d8503a"} 19:28:47 [19:28:47.587] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testyv0QnT/1 with map size 1073741824 19:28:47 [19:28:47.589] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:47 [19:28:47.610] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:3f936e9eb0d8503a type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:3f936e9eb0d8503a"} 19:28:47 [19:28:47.611] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:982117562cf4ce10 epochNumber=3 {"provingJobId":"1:BASE_PARITY:982117562cf4ce10"} 19:28:47 [19:28:47.613] INFO: prover-client:proving-broker-database Creating broker database for epoch 3 at /tmp/proving-broker-testyv0QnT/3 with map size 1073741824 19:28:47 [19:28:47.615] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:47 [19:28:47.661] INFO: prover-client:proving-broker Cleaned up jobs=1 19:28:47 [19:28:47.662] INFO: prover-client:proving-broker-database Deleting broker database for epoch 1 19:28:47 [19:28:47.665] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:3f936e9eb0d8503a err=test error {"provingJoId":"1:BASE_PARITY:3f936e9eb0d8503a"} 19:28:47 [19:28:47.670] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testDG33Kd/1 with map size 1073741824 19:28:47 [19:28:47.673] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:47 [19:28:47.690] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testDG33Kd/2 with map size 1073741824 19:28:47 [19:28:47.693] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:47 [19:28:47.713] INFO: prover-client:proving-broker Proving Broker started 19:28:47 [19:28:47.715] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:41c61604006eeb81 settled=false {"provingJobId":"1:BASE_PARITY:41c61604006eeb81","status":"pending"} 19:28:47 [19:28:47.716] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:396f643fed876c18 settled=false {"provingJobId":"1:BASE_PARITY:396f643fed876c18","status":"pending"} 19:28:47 [19:28:47.721] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testyFgL3G/1 with map size 1073741824 19:28:47 [19:28:47.724] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:47 [19:28:47.746] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testyFgL3G/2 with map size 1073741824 19:28:47 [19:28:47.751] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:47 [19:28:47.793] INFO: prover-client:proving-broker Proving Broker started 19:28:47 [19:28:47.796] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:f7ba9fc23d251c1b settled=true {"provingJobId":"1:BASE_PARITY:f7ba9fc23d251c1b","status":"fulfilled"} 19:28:47 [19:28:47.798] INFO: prover-client:proving-broker Restoring proving job id=2:BASE_PARITY:70326c040f17cf4a settled=true {"provingJobId":"2:BASE_PARITY:70326c040f17cf4a","status":"fulfilled"} 19:28:47 [19:28:47.807] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testPPB6uh/1 with map size 1073741824 19:28:47 [19:28:47.810] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:47 [19:28:47.837] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testPPB6uh/2 with map size 1073741824 19:28:47 [19:28:47.841] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:47 [19:28:47.863] INFO: prover-client:proving-broker Proving Broker started 19:28:47 [19:28:47.865] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:c5b9f800606b7938 settled=true {"provingJobId":"1:BASE_PARITY:c5b9f800606b7938","status":"fulfilled"} 19:28:47 [19:28:47.867] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:5077722205b9e480 settled=false {"provingJobId":"1:BASE_PARITY:5077722205b9e480","status":"pending"} 19:28:47 [19:28:47.874] INFO: prover-client:proving-broker Proving Broker started 19:28:47 [19:28:47.874] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c0201cb01b108ad3 epochNumber=1 {"provingJobId":"1:BASE_PARITY:c0201cb01b108ad3"} 19:28:47 [19:28:47.875] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test4AZoFK/1 with map size 1073741824 19:28:47 [19:28:47.877] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:47 [19:28:47.902] INFO: prover-client:proving-broker Proving Broker started 19:28:47 [19:28:47.903] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6f43c70d38ce3033 epochNumber=1 {"provingJobId":"1:BASE_PARITY:6f43c70d38ce3033"} 19:28:47 [19:28:47.904] ERROR: prover-client:proving-broker Failed to save proving job id=1:BASE_PARITY:6f43c70d38ce3033: Error: db error: Error: db error 19:28:47 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1126:63) {"provingJobId":"1:BASE_PARITY:6f43c70d38ce3033"} 19:28:47 [19:28:47.909] INFO: prover-client:proving-broker Proving Broker started 19:28:47 [19:28:47.909] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c07262395da3516f epochNumber=1 {"provingJobId":"1:BASE_PARITY:c07262395da3516f"} 19:28:47 [19:28:47.911] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testcCNH2l/1 with map size 1073741824 19:28:47 [19:28:47.915] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:47 [19:28:47.937] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:c07262395da3516f type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:c07262395da3516f"} 19:28:47 [19:28:47.937] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:c07262395da3516f type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:c07262395da3516f"} 19:28:47 [19:28:47.947] INFO: prover-client:proving-broker Proving Broker started 19:28:47 [19:28:47.948] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6bc66a4479eb451c epochNumber=1 {"provingJobId":"1:BASE_PARITY:6bc66a4479eb451c"} 19:28:47 [19:28:47.949] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testf6tOmU/1 with map size 1073741824 19:28:47 [19:28:47.952] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:47 [19:28:47.971] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:6bc66a4479eb451c type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:6bc66a4479eb451c"} 19:28:47 [19:28:47.972] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:6bc66a4479eb451c type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:6bc66a4479eb451c"} 19:28:47 [19:28:47.973] ERROR: prover-client:proving-broker Failed to save proving job result id=1:BASE_PARITY:6bc66a4479eb451c: Error: db error 19:28:47 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1159:69) {"provingJobId":"1:BASE_PARITY:6bc66a4479eb451c"} 19:28:47 [19:28:47.978] INFO: prover-client:proving-broker Proving Broker started 19:28:47 [19:28:47.979] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:943e6a653c17515b epochNumber=1 {"provingJobId":"1:BASE_PARITY:943e6a653c17515b"} 19:28:47 [19:28:47.980] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testz5efRW/1 with map size 1073741824 19:28:47 [19:28:47.983] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:48 [19:28:48.003] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:943e6a653c17515b type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:943e6a653c17515b"} 19:28:48 [19:28:48.003] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:943e6a653c17515b type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:943e6a653c17515b"} 19:28:48 [19:28:48.014] INFO: prover-client:proving-broker Proving Broker started 19:28:48 [19:28:48.015] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a4714ef11ec19c2f epochNumber=1 {"provingJobId":"1:BASE_PARITY:a4714ef11ec19c2f"} 19:28:48 [19:28:48.016] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testkdQmlO/1 with map size 1073741824 19:28:48 [19:28:48.018] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:48 [19:28:48.040] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:a4714ef11ec19c2f type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:a4714ef11ec19c2f"} 19:28:48 [19:28:48.041] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:a4714ef11ec19c2f type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:a4714ef11ec19c2f"} 19:28:48 [19:28:48.041] ERROR: prover-client:proving-broker Failed to save proving job error status id=1:BASE_PARITY:a4714ef11ec19c2f jobErr=test error: Error: db error 19:28:48 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1192:68) {"provingJobId":"1:BASE_PARITY:a4714ef11ec19c2f"} 19:28:48 [19:28:48.046] INFO: prover-client:proving-broker Proving Broker started 19:28:48 [19:28:48.047] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:a6e10ceda9b7b6e3 not found {"provingJobId":"1:BASE_PARITY:a6e10ceda9b7b6e3"} 19:28:48 [19:28:48.051] INFO: prover-client:proving-broker Proving Broker started 19:28:48 [19:28:48.052] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:2ae860e6012296a9 err=test error {"provingJoId":"1:BASE_PARITY:2ae860e6012296a9"} 19:28:48 [19:28:48.054] INFO: prover-client:proving-broker Proving Broker started 19:28:48 [19:28:48.065] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:38a9c483df762d89 epochNumber=1 {"provingJobId":"1:BASE_PARITY:38a9c483df762d89"} 19:28:48 [19:28:48.066] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test6XuQWB/1 with map size 1073741824 19:28:48 [19:28:48.069] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:48 [19:28:48.089] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:38a9c483df762d89 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:38a9c483df762d89"} 19:28:48 [19:28:48.089] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:38a9c483df762d89 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:38a9c483df762d89"} 19:28:48 [19:28:48.106] INFO: prover-client:proving-broker New proving job id=2:BASE_PARITY:a2b31dafddd4f017 epochNumber=2 {"provingJobId":"2:BASE_PARITY:a2b31dafddd4f017"} 19:28:48 [19:28:48.106] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-test6XuQWB/2 with map size 1073741824 19:28:48 [19:28:48.109] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:48 [19:28:48.126] WARN: prover-client:proving-broker Proving job id=2:BASE_PARITY:a2b31dafddd4f017 type=BASE_PARITY not in the in-progress set {"provingJobId":"2:BASE_PARITY:a2b31dafddd4f017"} 19:28:48 [19:28:48.127] INFO: prover-client:proving-broker Proving job complete id=2:BASE_PARITY:a2b31dafddd4f017 type=BASE_PARITY totalAttempts=1 {"provingJobId":"2:BASE_PARITY:a2b31dafddd4f017"} 19:28:48 [19:28:48.195] INFO: prover-client:proving-broker New proving job id=3:BASE_PARITY:586d9e14cacf66cb epochNumber=3 {"provingJobId":"3:BASE_PARITY:586d9e14cacf66cb"} 19:28:48 [19:28:48.198] INFO: prover-client:proving-broker-database Creating broker database for epoch 3 at /tmp/proving-broker-test6XuQWB/3 with map size 1073741824 19:28:48 [19:28:48.200] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:48 [19:28:48.233] INFO: prover-client:proving-broker Cleaned up jobs=1 19:28:48 [19:28:48.234] INFO: prover-client:proving-broker-database Deleting broker database for epoch 1 19:28:48 [19:28:48.285] INFO: prover-client:proving-broker New proving job id=4:BASE_PARITY:315f46807a06653f epochNumber=4 {"provingJobId":"4:BASE_PARITY:315f46807a06653f"} 19:28:48 [19:28:48.286] INFO: prover-client:proving-broker-database Creating broker database for epoch 4 at /tmp/proving-broker-test6XuQWB/4 with map size 1073741824 19:28:48 [19:28:48.290] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:48 [19:28:48.337] INFO: prover-client:proving-broker Cleaned up jobs=1 19:28:48 [19:28:48.337] INFO: prover-client:proving-broker-database Deleting broker database for epoch 2 19:28:48 [19:28:48.376] INFO: prover-client:proving-broker New proving job id=5:BASE_PARITY:7bce00a9b4094d4c epochNumber=5 {"provingJobId":"5:BASE_PARITY:7bce00a9b4094d4c"} 19:28:48 [19:28:48.377] INFO: prover-client:proving-broker-database Creating broker database for epoch 5 at /tmp/proving-broker-test6XuQWB/5 with map size 1073741824 19:28:48 [19:28:48.380] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 19:28:48 [19:28:48.417] INFO: prover-client:proving-broker Cleaned up jobs=1 19:28:48 [19:28:48.417] INFO: prover-client:proving-broker-database Deleting broker database for epoch 3 19:28:48 PASS src/proving_broker/proving_broker.test.ts (12.608 s) 19:28:48 ProvingBroker 19:28:48 Producer API 19:28:48 ✓ refuses stale jobs (56 ms) 19:28:48 ✓ enqueues jobs (4 ms) 19:28:48 ✓ ignores duplicate jobs (3 ms) 19:28:48 ✓ reports correct status when enqueuing repeat jobs (3 ms) 19:28:48 ✓ throws an error in case of duplicate job IDs (22 ms) 19:28:48 ✓ returns not-found status for non-existing jobs (2 ms) 19:28:48 ✓ cancels jobs in queue (3 ms) 19:28:48 ✓ cancels jobs in-progress (10 ms) 19:28:48 ✓ returns job result if successful (3 ms) 19:28:48 ✓ returns job error if failed (2 ms) 19:28:48 ✓ correctly returns job status for concurrent writes (4 ms) 19:28:48 ✓ refuses stale jobs (39 ms) 19:28:48 ✓ enqueues jobs (52 ms) 19:28:48 ✓ ignores duplicate jobs (32 ms) 19:28:48 ✓ reports correct status when enqueuing repeat jobs (34 ms) 19:28:48 ✓ throws an error in case of duplicate job IDs (26 ms) 19:28:48 ✓ returns not-found status for non-existing jobs (3 ms) 19:28:48 ✓ cancels jobs in queue (42 ms) 19:28:48 ✓ cancels jobs in-progress (36 ms) 19:28:48 ✓ returns job result if successful (42 ms) 19:28:48 ✓ returns job error if failed (31 ms) 19:28:48 ✓ correctly returns job status for concurrent writes (37 ms) 19:28:48 Consumer API 19:28:48 ✓ returns undefined if no jobs are available (1 ms) 19:28:48 ✓ returns jobs in priority order (6 ms) 19:28:48 ✓ returns undefined if no jobs are available for the given allowList (1 ms) 19:28:48 ✓ returns a job if it is in the allowList (5 ms) 19:28:48 ✓ returns the most important job if it is in the allowList (5 ms) 19:28:48 ✓ returns any job if filter is empty (2 ms) 19:28:48 ✓ returns a new job when reporting job success (6 ms) 19:28:48 ✓ returns a new job when reporting permanent error (3 ms) 19:28:48 ✓ returns a new job when reporting retry-able error (2 ms) 19:28:48 ✓ returns a new job when reporting progress if current one is cancelled (3 ms) 19:28:48 ✓ returns a new job if job is already in progress elsewhere (1057 ms) 19:28:48 ✓ avoids sending the same job to a new agent after a restart (1004 ms) 19:28:48 ✓ avoids sending a completed job to a new agent after a restart (1011 ms) 19:28:48 ✓ tracks job result if in progress (6 ms) 19:28:48 ✓ tracks job result even if job is in queue (3 ms) 19:28:48 ✓ ignores reported job error if unknown job (1 ms) 19:28:48 ✓ ignores job result if unknown job (1 ms) 19:28:48 ✓ returns undefined if no jobs are available (2 ms) 19:28:48 ✓ returns jobs in priority order (53 ms) 19:28:48 ✓ returns undefined if no jobs are available for the given allowList (22 ms) 19:28:48 ✓ returns a job if it is in the allowList (68 ms) 19:28:48 ✓ returns the most important job if it is in the allowList (57 ms) 19:28:48 ✓ returns any job if filter is empty (70 ms) 19:28:48 ✓ returns a new job when reporting job success (43 ms) 19:28:48 ✓ returns a new job when reporting permanent error (34 ms) 19:28:48 ✓ returns a new job when reporting retry-able error (28 ms) 19:28:48 ✓ returns a new job when reporting progress if current one is cancelled (47 ms) 19:28:48 ✓ returns a new job if job is already in progress elsewhere (1108 ms) 19:28:48 ✓ avoids sending the same job to a new agent after a restart (1062 ms) 19:28:48 ✓ avoids sending a completed job to a new agent after a restart (1071 ms) 19:28:48 ✓ tracks job result if in progress (79 ms) 19:28:48 ✓ tracks job result even if job is in queue (66 ms) 19:28:48 ✓ ignores reported job error if unknown job (7 ms) 19:28:48 ✓ ignores job result if unknown job (6 ms) 19:28:48 Timeouts 19:28:48 ✓ tracks in progress jobs (1 ms) 19:28:48 ✓ re-enqueues jobs that time out (107 ms) 19:28:48 ✓ cancel stale jobs that time out (255 ms) 19:28:48 ✓ keeps the jobs in progress while it is alive (203 ms) 19:28:48 ✓ tracks in progress jobs (37 ms) 19:28:48 ✓ re-enqueues jobs that time out (158 ms) 19:28:48 ✓ cancel stale jobs that time out (283 ms) 19:28:48 ✓ keeps the jobs in progress while it is alive (231 ms) 19:28:48 Retries 19:28:48 ✓ retries jobs (2 ms) 19:28:48 ✓ retries up to a maximum number of times (2 ms) 19:28:48 ✓ passing retry=false does not retry (1 ms) 19:28:48 ✓ does not retry if job is stale (27 ms) 19:28:48 ✓ retries jobs (33 ms) 19:28:48 ✓ retries up to a maximum number of times (36 ms) 19:28:48 ✓ passing retry=false does not retry (44 ms) 19:28:48 ✓ does not retry if job is stale (81 ms) 19:28:48 Database management 19:28:48 ✓ re-enqueues proof requests on start (4 ms) 19:28:48 ✓ restores proof results on start (2 ms) 19:28:48 ✓ only re-enqueues unfinished jobs (2 ms) 19:28:48 ✓ saves job when enqueued (3 ms) 19:28:48 ✓ does not retain job if database fails to save (2 ms) 19:28:48 ✓ saves job result (2 ms) 19:28:48 ✓ saves result even if database fails to save (2 ms) 19:28:48 ✓ saves job error (1 ms) 19:28:48 ✓ saves job error even if database fails to save (2 ms) 19:28:48 ✓ does not save job result if job is unknown (1 ms) 19:28:48 ✓ does not save job error if job is unknown (1 ms) 19:28:48 ✓ cleans up old jobs periodically (264 ms) 19:28:48 ✓ re-enqueues proof requests on start (51 ms) 19:28:48 ✓ restores proof results on start (83 ms) 19:28:48 ✓ only re-enqueues unfinished jobs (69 ms) 19:28:48 ✓ saves job when enqueued (28 ms) 19:28:48 ✓ does not retain job if database fails to save (6 ms) 19:28:48 ✓ saves job result (38 ms) 19:28:48 ✓ saves result even if database fails to save (29 ms) 19:28:48 ✓ saves job error (35 ms) 19:28:48 ✓ saves job error even if database fails to save (32 ms) 19:28:48 ✓ does not save job result if job is unknown (4 ms) 19:28:48 ✓ does not save job error if job is unknown (5 ms) 19:28:48 ✓ cleans up old jobs periodically (405 ms) 19:28:48 19:28:48 Test Suites: 1 passed, 1 total 19:28:48 Tests: 96 passed, 96 total 19:28:48 Snapshots: 0 total 19:28:48 Time: 12.689 s 19:28:48 Ran all test suites matching /prover-client\/src\/proving_broker\/proving_broker.test.ts/i. 19:28:48 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?