Parent Log: http://ci.aztec-labs.com/f36ae8a6d7e2bbdb Command: 5523e2d7d458c27d yarn-project/scripts/run_test.sh prover-client/src/proving_broker/proving_broker.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/21a568ac0c9ef351b1923375be41d4620add2b60 Env: REF_NAME=gh-readonly-queue/next/pr-15042-b80949775e5c27908a6055ad24592f7d98bdc45a CURRENT_VERSION=0.87.6 CI_FULL=0 Date: Sun Jun 15 12:37:15 UTC 2025 System: ARCH=arm64 CPUS=64 MEM=247Gi HOSTNAME=pr-15042_arm64_a1-fast Resources: CPU_LIST=0-63 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_b95296ef06707e5f_next 12:37:18 [12:37:18.257] INFO: prover-client:proving-broker Proving Broker started 12:37:18 [12:37:18.262] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:4d83602e5dc944f3 epochNumber=42 {"provingJobId":"1:BASE_PARITY:4d83602e5dc944f3"} 12:37:18 [12:37:18.265] WARN: prover-client:proving-broker Tried enqueueing stale proving job id=1:BASE_PARITY:f698372aea4a7185 epochNumber=1 {"provingJobId":"1:BASE_PARITY:f698372aea4a7185"} 12:37:18 [12:37:18.288] INFO: prover-client:proving-broker Proving Broker started 12:37:18 [12:37:18.289] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:91c30858690d11ae epochNumber=1 {"provingJobId":"1:BASE_PARITY:91c30858690d11ae"} 12:37:18 [12:37:18.290] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:aa3e953eee19dc84 epochNumber=1 {"provingJobId":"1:BASE_PARITY:aa3e953eee19dc84"} 12:37:18 [12:37:18.292] INFO: prover-client:proving-broker Proving Broker started 12:37:18 [12:37:18.292] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:dbc2b458d464e972 epochNumber=1 {"provingJobId":"1:BASE_PARITY:dbc2b458d464e972"} 12:37:18 [12:37:18.293] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:dbc2b458d464e972 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:dbc2b458d464e972"} 12:37:18 [12:37:18.296] INFO: prover-client:proving-broker Proving Broker started 12:37:18 [12:37:18.296] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6213c12af82e3534 epochNumber=1 {"provingJobId":"1:BASE_PARITY:6213c12af82e3534"} 12:37:18 [12:37:18.297] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:6213c12af82e3534 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:6213c12af82e3534"} 12:37:18 [12:37:18.298] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:6213c12af82e3534 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:6213c12af82e3534"} 12:37:18 [12:37:18.299] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:6213c12af82e3534 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:6213c12af82e3534"} 12:37:18 [12:37:18.300] INFO: prover-client:proving-broker Proving Broker started 12:37:18 [12:37:18.300] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:12419919a9c91802 epochNumber=1 {"provingJobId":"1:BASE_PARITY:12419919a9c91802"} 12:37:18 [12:37:18.322] INFO: prover-client:proving-broker Proving Broker started 12:37:18 [12:37:18.323] INFO: prover-client:proving-broker Proving Broker started 12:37:18 [12:37:18.323] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ec3edc3faf418958 epochNumber=1 {"provingJobId":"1:BASE_PARITY:ec3edc3faf418958"} 12:37:18 [12:37:18.324] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:ec3edc3faf418958 {"provingJobId":"1:BASE_PARITY:ec3edc3faf418958"} 12:37:18 [12:37:18.324] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:ec3edc3faf418958 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:ec3edc3faf418958"} 12:37:18 [12:37:18.325] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:ec3edc3faf418958 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:ec3edc3faf418958"} 12:37:18 [12:37:18.326] INFO: prover-client:proving-broker Proving Broker started 12:37:18 [12:37:18.326] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c6e802e968aeebf7 epochNumber=1 {"provingJobId":"1:BASE_PARITY:c6e802e968aeebf7"} 12:37:18 [12:37:18.327] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:c6e802e968aeebf7 {"provingJobId":"1:BASE_PARITY:c6e802e968aeebf7"} 12:37:18 [12:37:18.327] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:c6e802e968aeebf7 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:c6e802e968aeebf7"} 12:37:18 [12:37:18.328] INFO: prover-client:proving-broker Proving Broker started 12:37:18 [12:37:18.329] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:72bba57d89094ac3 epochNumber=1 {"provingJobId":"1:BASE_PARITY:72bba57d89094ac3"} 12:37:18 [12:37:18.330] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:72bba57d89094ac3 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:72bba57d89094ac3"} 12:37:18 [12:37:18.330] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:72bba57d89094ac3 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:72bba57d89094ac3"} 12:37:18 [12:37:18.331] INFO: prover-client:proving-broker Proving Broker started 12:37:18 [12:37:18.332] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:8b5e1004f12eb578 epochNumber=1 {"provingJobId":"1:BASE_PARITY:8b5e1004f12eb578"} 12:37:18 [12:37:18.332] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:8b5e1004f12eb578 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:8b5e1004f12eb578"} 12:37:18 [12:37:18.332] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:8b5e1004f12eb578 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:8b5e1004f12eb578"} 12:37:18 [12:37:18.333] INFO: prover-client:proving-broker Proving Broker started 12:37:18 [12:37:18.334] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:4cea22ae1fbc6912 epochNumber=0 {"provingJobId":"1:BASE_PARITY:4cea22ae1fbc6912"} 12:37:18 [12:37:18.334] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:4cea22ae1fbc6912 epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:4cea22ae1fbc6912"} 12:37:18 [12:37:18.334] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f3e6b9fd8a0df908 epochNumber=0 {"provingJobId":"1:BASE_PARITY:f3e6b9fd8a0df908"} 12:37:18 [12:37:18.334] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:4cea22ae1fbc6912 epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:4cea22ae1fbc6912"} 12:37:18 [12:37:18.335] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:effa16cd2968f874 epochNumber=0 {"provingJobId":"1:BASE_PARITY:effa16cd2968f874"} 12:37:18 [12:37:18.336] INFO: prover-client:proving-broker Proving Broker started 12:37:18 [12:37:18.336] INFO: prover-client:proving-broker Proving Broker started 12:37:18 [12:37:18.337] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0784b5b418190bc9 epochNumber=2 {"provingJobId":"1:BASE_PARITY:0784b5b418190bc9"} 12:37:18 [12:37:18.337] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:5c147fd9abb827bc epochNumber=1 {"provingJobId":"1:BASE_PARITY:5c147fd9abb827bc"} 12:37:18 [12:37:18.338] INFO: prover-client:proving-broker Proving Broker started 12:37:18 [12:37:18.338] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ef6e9cb5c63b828f epochNumber=1 {"provingJobId":"1:BASE_PARITY:ef6e9cb5c63b828f"} 12:37:18 [12:37:18.339] INFO: prover-client:proving-broker Proving Broker started 12:37:18 [12:37:18.340] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:80c72e49e3fc58d3 epochNumber=1 {"provingJobId":"1:BASE_PARITY:80c72e49e3fc58d3"} 12:37:18 [12:37:18.340] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1740a356c95e00e1 epochNumber=1 {"provingJobId":"1:BASE_PARITY:1740a356c95e00e1"} 12:37:18 [12:37:18.340] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:98920707b6a9c562 epochNumber=2 {"provingJobId":"1:BASE_PARITY:98920707b6a9c562"} 12:37:18 [12:37:18.340] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:5fed400055ca35bf epochNumber=1 {"provingJobId":"1:BASE_PARITY:5fed400055ca35bf"} 12:37:18 [12:37:18.341] INFO: prover-client:proving-broker Proving Broker started 12:37:18 [12:37:18.342] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c050d8bc96941ff1 epochNumber=1 {"provingJobId":"1:BASE_PARITY:c050d8bc96941ff1"} 12:37:18 [12:37:18.342] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:bae9bf70a4a658f3 epochNumber=1 {"provingJobId":"1:BASE_PARITY:bae9bf70a4a658f3"} 12:37:18 [12:37:18.342] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:4238fa54b6824ac4 epochNumber=2 {"provingJobId":"1:BASE_PARITY:4238fa54b6824ac4"} 12:37:18 [12:37:18.342] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:290ab840c58939a5 epochNumber=1 {"provingJobId":"1:BASE_PARITY:290ab840c58939a5"} 12:37:18 [12:37:18.343] INFO: prover-client:proving-broker Proving Broker started 12:37:18 [12:37:18.344] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b5a0f2030d3cbb25 epochNumber=1 {"provingJobId":"1:BASE_PARITY:b5a0f2030d3cbb25"} 12:37:18 [12:37:18.344] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:778a6da9994c09a9 epochNumber=1 {"provingJobId":"1:BASE_PARITY:778a6da9994c09a9"} 12:37:18 [12:37:18.344] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d98676efc083ef0c epochNumber=2 {"provingJobId":"1:BASE_PARITY:d98676efc083ef0c"} 12:37:18 [12:37:18.344] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:de747a56f23351ab epochNumber=1 {"provingJobId":"1:BASE_PARITY:de747a56f23351ab"} 12:37:18 [12:37:18.345] INFO: prover-client:proving-broker Proving Broker started 12:37:18 [12:37:18.346] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:db0658e36d4be7ad epochNumber=1 {"provingJobId":"1:BASE_PARITY:db0658e36d4be7ad"} 12:37:18 [12:37:18.346] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c534209cc746cf9b epochNumber=1 {"provingJobId":"1:BASE_PARITY:c534209cc746cf9b"} 12:37:18 [12:37:18.346] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:db0658e36d4be7ad type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:db0658e36d4be7ad"} 12:37:18 [12:37:18.347] INFO: prover-client:proving-broker Proving Broker started 12:37:18 [12:37:18.348] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9d1d558872aebe75 epochNumber=1 {"provingJobId":"1:BASE_PARITY:9d1d558872aebe75"} 12:37:18 [12:37:18.348] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:cd7f85076d19125c epochNumber=1 {"provingJobId":"1:BASE_PARITY:cd7f85076d19125c"} 12:37:18 [12:37:18.348] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:9d1d558872aebe75 type=BASE_PARITY totalAttempts=1 err=result {"provingJobId":"1:BASE_PARITY:9d1d558872aebe75"} 12:37:18 [12:37:18.349] INFO: prover-client:proving-broker Proving Broker started 12:37:18 [12:37:18.349] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:808d1a2540a615c3 epochNumber=1 {"provingJobId":"1:BASE_PARITY:808d1a2540a615c3"} 12:37:18 [12:37:18.350] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0a9692e57ea8b43b epochNumber=1 {"provingJobId":"1:BASE_PARITY:0a9692e57ea8b43b"} 12:37:18 [12:37:18.350] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:808d1a2540a615c3 type=BASE_PARITY retry=1 err=result {"provingJobId":"1:BASE_PARITY:808d1a2540a615c3"} 12:37:18 [12:37:18.351] INFO: prover-client:proving-broker Proving Broker started 12:37:18 [12:37:18.351] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e8e533efa1de5b64 epochNumber=1 {"provingJobId":"1:BASE_PARITY:e8e533efa1de5b64"} 12:37:18 [12:37:18.352] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:e8e533efa1de5b64 {"provingJobId":"1:BASE_PARITY:e8e533efa1de5b64"} 12:37:18 [12:37:18.352] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:e8e533efa1de5b64 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:e8e533efa1de5b64"} 12:37:18 [12:37:18.352] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9912d74e69f3d427 epochNumber=1 {"provingJobId":"1:BASE_PARITY:9912d74e69f3d427"} 12:37:18 [12:37:18.353] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:e8e533efa1de5b64 has already been completed {"provingJobId":"1:BASE_PARITY:e8e533efa1de5b64"} 12:37:18 [12:37:18.354] INFO: prover-client:proving-broker Proving Broker started 12:37:18 [12:37:18.354] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2fec9bcf7461bce2 epochNumber=1 {"provingJobId":"1:BASE_PARITY:2fec9bcf7461bce2"} 12:37:18 [12:37:18.354] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:00bd8cc982e6b706 epochNumber=2 {"provingJobId":"1:BASE_PARITY:00bd8cc982e6b706"} 12:37:19 [12:37:19.405] INFO: prover-client:proving-broker Proving Broker started 12:37:19 [12:37:19.405] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:2fec9bcf7461bce2 settled=false {"provingJobId":"1:BASE_PARITY:2fec9bcf7461bce2","status":"pending"} 12:37:19 [12:37:19.406] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:00bd8cc982e6b706 settled=false {"provingJobId":"1:BASE_PARITY:00bd8cc982e6b706","status":"pending"} 12:37:19 [12:37:19.406] INFO: prover-client:proving-broker Proving job id=1:BASE_PARITY:2fec9bcf7461bce2 type=BASE_PARITY startedAt=1749991038354 older agent has taken job {"provingJobId":"1:BASE_PARITY:2fec9bcf7461bce2"} 12:37:19 [12:37:19.407] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:2fec9bcf7461bce2 type=BASE_PARITY already being worked on by another agent. Sending new one {"provingJobId":"1:BASE_PARITY:2fec9bcf7461bce2"} 12:37:19 [12:37:19.407] INFO: prover-client:proving-broker Proving Broker started 12:37:19 [12:37:19.408] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:06eb761ba0ee4b54 epochNumber=1 {"provingJobId":"1:BASE_PARITY:06eb761ba0ee4b54"} 12:37:19 [12:37:19.408] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d5c95d6bedc922ca epochNumber=2 {"provingJobId":"1:BASE_PARITY:d5c95d6bedc922ca"} 12:37:20 [12:37:20.409] INFO: prover-client:proving-broker Proving Broker started 12:37:20 [12:37:20.409] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:06eb761ba0ee4b54 settled=false {"provingJobId":"1:BASE_PARITY:06eb761ba0ee4b54","status":"pending"} 12:37:20 [12:37:20.410] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:d5c95d6bedc922ca settled=false {"provingJobId":"1:BASE_PARITY:d5c95d6bedc922ca","status":"pending"} 12:37:20 [12:37:20.410] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:06eb761ba0ee4b54 type=BASE_PARITY not found in the in-progress cache, adding it {"provingJobId":"1:BASE_PARITY:06eb761ba0ee4b54"} 12:37:20 [12:37:20.411] INFO: prover-client:proving-broker Proving Broker started 12:37:20 [12:37:20.412] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1bd9db188bf34aaf epochNumber=1 {"provingJobId":"1:BASE_PARITY:1bd9db188bf34aaf"} 12:37:20 [12:37:20.412] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:02245c0a19bff990 epochNumber=2 {"provingJobId":"1:BASE_PARITY:02245c0a19bff990"} 12:37:21 [12:37:21.412] INFO: prover-client:proving-broker Proving Broker started 12:37:21 [12:37:21.412] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:1bd9db188bf34aaf settled=false {"provingJobId":"1:BASE_PARITY:1bd9db188bf34aaf","status":"pending"} 12:37:21 [12:37:21.413] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:02245c0a19bff990 settled=false {"provingJobId":"1:BASE_PARITY:02245c0a19bff990","status":"pending"} 12:37:21 [12:37:21.413] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:1bd9db188bf34aaf type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:1bd9db188bf34aaf"} 12:37:21 [12:37:21.413] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:1bd9db188bf34aaf type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:1bd9db188bf34aaf"} 12:37:21 [12:37:21.414] INFO: prover-client:proving-broker Proving Broker started 12:37:21 [12:37:21.415] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ac1fc0eeedae9053 epochNumber=1 {"provingJobId":"1:BASE_PARITY:ac1fc0eeedae9053"} 12:37:21 [12:37:21.415] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:15adb444ac95befa epochNumber=2 {"provingJobId":"1:BASE_PARITY:15adb444ac95befa"} 12:37:21 [12:37:21.416] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:ac1fc0eeedae9053 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:ac1fc0eeedae9053"} 12:37:21 [12:37:21.416] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:15adb444ac95befa type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:15adb444ac95befa"} 12:37:21 [12:37:21.417] INFO: prover-client:proving-broker Proving Broker started 12:37:21 [12:37:21.418] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:8680a6fa44bba973 epochNumber=1 {"provingJobId":"1:BASE_PARITY:8680a6fa44bba973"} 12:37:21 [12:37:21.418] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:883e8fc497e85dc5 epochNumber=2 {"provingJobId":"1:BASE_PARITY:883e8fc497e85dc5"} 12:37:21 [12:37:21.418] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:8680a6fa44bba973 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:8680a6fa44bba973"} 12:37:21 [12:37:21.418] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:8680a6fa44bba973 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:8680a6fa44bba973"} 12:37:21 [12:37:21.419] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:883e8fc497e85dc5 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:883e8fc497e85dc5"} 12:37:21 [12:37:21.420] INFO: prover-client:proving-broker Proving Broker started 12:37:21 [12:37:21.420] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:d0a6af7c9b424eda err=test error {"provingJoId":"1:BASE_PARITY:d0a6af7c9b424eda"} 12:37:21 [12:37:21.421] INFO: prover-client:proving-broker Proving Broker started 12:37:21 [12:37:21.421] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:cd81654c24a86eae not found {"provingJobId":"1:BASE_PARITY:cd81654c24a86eae"} 12:37:21 [12:37:21.422] INFO: prover-client:proving-broker Proving Broker started 12:37:21 [12:37:21.423] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:91679e4428a8da3b epochNumber=1 {"provingJobId":"1:BASE_PARITY:91679e4428a8da3b"} 12:37:21 [12:37:21.424] INFO: prover-client:proving-broker Proving Broker started 12:37:21 [12:37:21.424] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:18f0f8d30f6a4e99 epochNumber=1 {"provingJobId":"1:BASE_PARITY:18f0f8d30f6a4e99"} 12:37:21 [12:37:21.525] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:18f0f8d30f6a4e99 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:18f0f8d30f6a4e99"} 12:37:21 [12:37:21.532] INFO: prover-client:proving-broker Proving Broker started 12:37:21 [12:37:21.533] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7fef559141753b89 epochNumber=1 {"provingJobId":"1:BASE_PARITY:7fef559141753b89"} 12:37:21 [12:37:21.633] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:7fef559141753b89 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:7fef559141753b89"} 12:37:21 [12:37:21.634] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a84d968bf75f85ad epochNumber=10 {"provingJobId":"1:BASE_PARITY:a84d968bf75f85ad"} 12:37:21 [12:37:21.658] INFO: prover-client:proving-broker Cleaned up jobs=1 12:37:21 [12:37:21.760] INFO: prover-client:proving-broker Proving Broker started 12:37:21 [12:37:21.761] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:fa2fb4bb2029428c epochNumber=1 {"provingJobId":"1:BASE_PARITY:fa2fb4bb2029428c"} 12:37:21 [12:37:21.912] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:fa2fb4bb2029428c timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:fa2fb4bb2029428c"} 12:37:21 [12:37:21.962] INFO: prover-client:proving-broker Proving Broker started 12:37:21 [12:37:21.963] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0ffd0fc1f63de50f epochNumber=1 {"provingJobId":"1:BASE_PARITY:0ffd0fc1f63de50f"} 12:37:21 [12:37:21.963] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:0ffd0fc1f63de50f type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:0ffd0fc1f63de50f"} 12:37:21 [12:37:21.964] INFO: prover-client:proving-broker Proving Broker started 12:37:21 [12:37:21.965] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7bc3d37eefac0b82 epochNumber=1 {"provingJobId":"1:BASE_PARITY:7bc3d37eefac0b82"} 12:37:21 [12:37:21.965] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:7bc3d37eefac0b82 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:7bc3d37eefac0b82"} 12:37:21 [12:37:21.966] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:7bc3d37eefac0b82 type=BASE_PARITY totalAttempts=2 err=test error {"provingJobId":"1:BASE_PARITY:7bc3d37eefac0b82"} 12:37:21 [12:37:21.967] INFO: prover-client:proving-broker Proving Broker started 12:37:21 [12:37:21.967] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d76244c1c58700a9 epochNumber=1 {"provingJobId":"1:BASE_PARITY:d76244c1c58700a9"} 12:37:21 [12:37:21.968] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:d76244c1c58700a9 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:d76244c1c58700a9"} 12:37:21 [12:37:21.968] INFO: prover-client:proving-broker Proving Broker started 12:37:21 [12:37:21.969] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2b93a78e6dd77fde epochNumber=1 {"provingJobId":"1:BASE_PARITY:2b93a78e6dd77fde"} 12:37:21 [12:37:21.969] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:2b93a78e6dd77fde type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:2b93a78e6dd77fde"} 12:37:21 [12:37:21.970] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d35655bbaa8c2974 epochNumber=3 {"provingJobId":"1:BASE_PARITY:d35655bbaa8c2974"} 12:37:21 [12:37:21.993] INFO: prover-client:proving-broker Cleaned up jobs=1 12:37:21 [12:37:21.995] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:2b93a78e6dd77fde err=test error {"provingJoId":"1:BASE_PARITY:2b93a78e6dd77fde"} 12:37:21 [12:37:21.996] INFO: prover-client:proving-broker Proving Broker started 12:37:21 [12:37:21.997] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:20f10a94fc2c686a settled=false {"provingJobId":"1:BASE_PARITY:20f10a94fc2c686a","status":"pending"} 12:37:21 [12:37:21.997] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:2f20f1de06890533 settled=false {"provingJobId":"1:BASE_PARITY:2f20f1de06890533","status":"pending"} 12:37:21 [12:37:21.998] INFO: prover-client:proving-broker Proving Broker started 12:37:21 [12:37:21.999] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:62ce5db5354d62de settled=true {"provingJobId":"1:BASE_PARITY:62ce5db5354d62de","status":"fulfilled"} 12:37:21 [12:37:21.999] INFO: prover-client:proving-broker Restoring proving job id=2:BASE_PARITY:e4b72ba8b052e937 settled=true {"provingJobId":"2:BASE_PARITY:e4b72ba8b052e937","status":"fulfilled"} 12:37:21 [12:37:22.000] INFO: prover-client:proving-broker Proving Broker started 12:37:21 [12:37:22.000] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:d136e1948a5548f9 settled=true {"provingJobId":"1:BASE_PARITY:d136e1948a5548f9","status":"fulfilled"} 12:37:21 [12:37:22.000] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:9888f474d1c90dba settled=false {"provingJobId":"1:BASE_PARITY:9888f474d1c90dba","status":"pending"} 12:37:22 [12:37:22.001] INFO: prover-client:proving-broker Proving Broker started 12:37:22 [12:37:22.002] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:256a10f572d59543 epochNumber=1 {"provingJobId":"1:BASE_PARITY:256a10f572d59543"} 12:37:22 [12:37:22.004] INFO: prover-client:proving-broker Proving Broker started 12:37:22 [12:37:22.004] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:677f9a6491d3dd21 epochNumber=1 {"provingJobId":"1:BASE_PARITY:677f9a6491d3dd21"} 12:37:22 [12:37:22.004] ERROR: prover-client:proving-broker Failed to save proving job id=1:BASE_PARITY:677f9a6491d3dd21: Error: db error: Error: db error 12:37:22 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1126:63) {"provingJobId":"1:BASE_PARITY:677f9a6491d3dd21"} 12:37:22 [12:37:22.005] INFO: prover-client:proving-broker Proving Broker started 12:37:22 [12:37:22.006] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:890f3e9191b0c79d epochNumber=1 {"provingJobId":"1:BASE_PARITY:890f3e9191b0c79d"} 12:37:22 [12:37:22.006] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:890f3e9191b0c79d type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:890f3e9191b0c79d"} 12:37:22 [12:37:22.006] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:890f3e9191b0c79d type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:890f3e9191b0c79d"} 12:37:22 [12:37:22.007] INFO: prover-client:proving-broker Proving Broker started 12:37:22 [12:37:22.007] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:8ff6a04681de2eaf epochNumber=1 {"provingJobId":"1:BASE_PARITY:8ff6a04681de2eaf"} 12:37:22 [12:37:22.008] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:8ff6a04681de2eaf type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:8ff6a04681de2eaf"} 12:37:22 [12:37:22.008] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:8ff6a04681de2eaf type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:8ff6a04681de2eaf"} 12:37:22 [12:37:22.008] ERROR: prover-client:proving-broker Failed to save proving job result id=1:BASE_PARITY:8ff6a04681de2eaf: Error: db error 12:37:22 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1159:69) {"provingJobId":"1:BASE_PARITY:8ff6a04681de2eaf"} 12:37:22 [12:37:22.009] INFO: prover-client:proving-broker Proving Broker started 12:37:22 [12:37:22.009] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:38f7c78cf3fbf469 epochNumber=1 {"provingJobId":"1:BASE_PARITY:38f7c78cf3fbf469"} 12:37:22 [12:37:22.010] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:38f7c78cf3fbf469 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:38f7c78cf3fbf469"} 12:37:22 [12:37:22.010] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:38f7c78cf3fbf469 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:38f7c78cf3fbf469"} 12:37:22 [12:37:22.011] INFO: prover-client:proving-broker Proving Broker started 12:37:22 [12:37:22.011] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7e685ad7507a36e7 epochNumber=1 {"provingJobId":"1:BASE_PARITY:7e685ad7507a36e7"} 12:37:22 [12:37:22.011] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:7e685ad7507a36e7 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:7e685ad7507a36e7"} 12:37:22 [12:37:22.012] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:7e685ad7507a36e7 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:7e685ad7507a36e7"} 12:37:22 [12:37:22.012] ERROR: prover-client:proving-broker Failed to save proving job error status id=1:BASE_PARITY:7e685ad7507a36e7 jobErr=test error: Error: db error 12:37:22 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1192:68) {"provingJobId":"1:BASE_PARITY:7e685ad7507a36e7"} 12:37:22 [12:37:22.013] INFO: prover-client:proving-broker Proving Broker started 12:37:22 [12:37:22.013] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:9d63066ae0464c71 not found {"provingJobId":"1:BASE_PARITY:9d63066ae0464c71"} 12:37:22 [12:37:22.015] INFO: prover-client:proving-broker Proving Broker started 12:37:22 [12:37:22.015] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:2e483109e4e49545 err=test error {"provingJoId":"1:BASE_PARITY:2e483109e4e49545"} 12:37:22 [12:37:22.016] INFO: prover-client:proving-broker Proving Broker started 12:37:22 [12:37:22.026] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6db2b74a8cda98f1 epochNumber=1 {"provingJobId":"1:BASE_PARITY:6db2b74a8cda98f1"} 12:37:22 [12:37:22.027] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:6db2b74a8cda98f1 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:6db2b74a8cda98f1"} 12:37:22 [12:37:22.027] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:6db2b74a8cda98f1 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:6db2b74a8cda98f1"} 12:37:22 [12:37:22.038] INFO: prover-client:proving-broker New proving job id=2:BASE_PARITY:e71edb8818385c6d epochNumber=2 {"provingJobId":"2:BASE_PARITY:e71edb8818385c6d"} 12:37:22 [12:37:22.038] WARN: prover-client:proving-broker Proving job id=2:BASE_PARITY:e71edb8818385c6d type=BASE_PARITY not in the in-progress set {"provingJobId":"2:BASE_PARITY:e71edb8818385c6d"} 12:37:22 [12:37:22.038] INFO: prover-client:proving-broker Proving job complete id=2:BASE_PARITY:e71edb8818385c6d type=BASE_PARITY totalAttempts=1 {"provingJobId":"2:BASE_PARITY:e71edb8818385c6d"} 12:37:22 [12:37:22.100] INFO: prover-client:proving-broker New proving job id=3:BASE_PARITY:d0184e75b6bf9e60 epochNumber=3 {"provingJobId":"3:BASE_PARITY:d0184e75b6bf9e60"} 12:37:22 [12:37:22.117] INFO: prover-client:proving-broker Cleaned up jobs=1 12:37:22 [12:37:22.161] INFO: prover-client:proving-broker New proving job id=4:BASE_PARITY:f55227c3fd284669 epochNumber=4 {"provingJobId":"4:BASE_PARITY:f55227c3fd284669"} 12:37:22 [12:37:22.168] INFO: prover-client:proving-broker Cleaned up jobs=1 12:37:22 [12:37:22.222] INFO: prover-client:proving-broker New proving job id=5:BASE_PARITY:dc5ca8f25c0efb0c epochNumber=5 {"provingJobId":"5:BASE_PARITY:dc5ca8f25c0efb0c"} 12:37:22 [12:37:22.244] INFO: prover-client:proving-broker Cleaned up jobs=1 12:37:22 [12:37:22.276] INFO: prover-client:proving-broker Proving Broker started 12:37:22 [12:37:22.277] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:aa86f847e65bd76c epochNumber=42 {"provingJobId":"1:BASE_PARITY:aa86f847e65bd76c"} 12:37:22 [12:37:22.277] INFO: prover-client:proving-broker-database Creating broker database for epoch 42 at /tmp/proving-broker-testrkoS7i/42 with map size 1073741824 12:37:22 [12:37:22.280] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:22 [12:37:22.300] WARN: prover-client:proving-broker Tried enqueueing stale proving job id=1:BASE_PARITY:eea7a4f61019563d epochNumber=1 {"provingJobId":"1:BASE_PARITY:eea7a4f61019563d"} 12:37:22 [12:37:22.304] INFO: prover-client:proving-broker Proving Broker started 12:37:22 [12:37:22.305] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b1c24c89f02373f1 epochNumber=1 {"provingJobId":"1:BASE_PARITY:b1c24c89f02373f1"} 12:37:22 [12:37:22.306] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testuKhUca/1 with map size 1073741824 12:37:22 [12:37:22.308] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:22 [12:37:22.329] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7470c5d1aabebaba epochNumber=1 {"provingJobId":"1:BASE_PARITY:7470c5d1aabebaba"} 12:37:22 [12:37:22.339] INFO: prover-client:proving-broker Proving Broker started 12:37:22 [12:37:22.339] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7d7fa1219dca56e2 epochNumber=1 {"provingJobId":"1:BASE_PARITY:7d7fa1219dca56e2"} 12:37:22 [12:37:22.340] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testRPFRI9/1 with map size 1073741824 12:37:22 [12:37:22.342] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:22 [12:37:22.364] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:7d7fa1219dca56e2 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:7d7fa1219dca56e2"} 12:37:22 [12:37:22.367] INFO: prover-client:proving-broker Proving Broker started 12:37:22 [12:37:22.367] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ef1eb266bf5009c6 epochNumber=1 {"provingJobId":"1:BASE_PARITY:ef1eb266bf5009c6"} 12:37:22 [12:37:22.368] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testrC1YCo/1 with map size 1073741824 12:37:22 [12:37:22.369] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:22 [12:37:22.387] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:ef1eb266bf5009c6 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:ef1eb266bf5009c6"} 12:37:22 [12:37:22.387] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:ef1eb266bf5009c6 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:ef1eb266bf5009c6"} 12:37:22 [12:37:22.393] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:ef1eb266bf5009c6 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:ef1eb266bf5009c6"} 12:37:22 [12:37:22.396] INFO: prover-client:proving-broker Proving Broker started 12:37:22 [12:37:22.397] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6ebbae8164c87020 epochNumber=1 {"provingJobId":"1:BASE_PARITY:6ebbae8164c87020"} 12:37:22 [12:37:22.397] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testjbdMWn/1 with map size 1073741824 12:37:22 [12:37:22.399] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:22 [12:37:22.416] INFO: prover-client:proving-broker Proving Broker started 12:37:22 [12:37:22.418] INFO: prover-client:proving-broker Proving Broker started 12:37:22 [12:37:22.419] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e363054f69f0c241 epochNumber=1 {"provingJobId":"1:BASE_PARITY:e363054f69f0c241"} 12:37:22 [12:37:22.419] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testTFA21K/1 with map size 1073741824 12:37:22 [12:37:22.420] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:22 [12:37:22.435] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:e363054f69f0c241 {"provingJobId":"1:BASE_PARITY:e363054f69f0c241"} 12:37:22 [12:37:22.435] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:e363054f69f0c241 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:e363054f69f0c241"} 12:37:22 [12:37:22.436] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:e363054f69f0c241 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:e363054f69f0c241"} 12:37:22 [12:37:22.443] INFO: prover-client:proving-broker Proving Broker started 12:37:22 [12:37:22.443] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:8d23502e08824683 epochNumber=1 {"provingJobId":"1:BASE_PARITY:8d23502e08824683"} 12:37:22 [12:37:22.444] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testqgfowv/1 with map size 1073741824 12:37:22 [12:37:22.445] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:22 [12:37:22.461] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:8d23502e08824683 {"provingJobId":"1:BASE_PARITY:8d23502e08824683"} 12:37:22 [12:37:22.461] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:8d23502e08824683 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:8d23502e08824683"} 12:37:22 [12:37:22.469] INFO: prover-client:proving-broker Proving Broker started 12:37:22 [12:37:22.470] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f5d364c4de6499fb epochNumber=1 {"provingJobId":"1:BASE_PARITY:f5d364c4de6499fb"} 12:37:22 [12:37:22.471] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testAkanna/1 with map size 1073741824 12:37:22 [12:37:22.472] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:22 [12:37:22.487] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:f5d364c4de6499fb type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:f5d364c4de6499fb"} 12:37:22 [12:37:22.488] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:f5d364c4de6499fb type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:f5d364c4de6499fb"} 12:37:22 [12:37:22.494] INFO: prover-client:proving-broker Proving Broker started 12:37:22 [12:37:22.495] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1715c98a3df69989 epochNumber=1 {"provingJobId":"1:BASE_PARITY:1715c98a3df69989"} 12:37:22 [12:37:22.495] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test0iCai5/1 with map size 1073741824 12:37:22 [12:37:22.497] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:22 [12:37:22.511] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:1715c98a3df69989 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:1715c98a3df69989"} 12:37:22 [12:37:22.512] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:1715c98a3df69989 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:1715c98a3df69989"} 12:37:22 [12:37:22.518] INFO: prover-client:proving-broker Proving Broker started 12:37:22 [12:37:22.518] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:be0fb4c6b3ef8d10 epochNumber=0 {"provingJobId":"1:BASE_PARITY:be0fb4c6b3ef8d10"} 12:37:22 [12:37:22.519] INFO: prover-client:proving-broker-database Creating broker database for epoch 0 at /tmp/proving-broker-testd9MTrz/0 with map size 1073741824 12:37:22 [12:37:22.520] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:22 [12:37:22.534] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:be0fb4c6b3ef8d10 epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:be0fb4c6b3ef8d10"} 12:37:22 [12:37:22.534] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:14805afd71f93b85 epochNumber=0 {"provingJobId":"1:BASE_PARITY:14805afd71f93b85"} 12:37:22 [12:37:22.535] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:be0fb4c6b3ef8d10 epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:be0fb4c6b3ef8d10"} 12:37:22 [12:37:22.535] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:60a62ec95ae5605c epochNumber=0 {"provingJobId":"1:BASE_PARITY:60a62ec95ae5605c"} 12:37:22 [12:37:22.548] INFO: prover-client:proving-broker Proving Broker started 12:37:22 [12:37:22.550] INFO: prover-client:proving-broker Proving Broker started 12:37:22 [12:37:22.550] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d6d7fe3ca1ad394e epochNumber=2 {"provingJobId":"1:BASE_PARITY:d6d7fe3ca1ad394e"} 12:37:22 [12:37:22.550] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testE9ugF0/2 with map size 1073741824 12:37:22 [12:37:22.552] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:22 [12:37:22.565] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:45bd448d1d6036ee epochNumber=1 {"provingJobId":"1:BASE_PARITY:45bd448d1d6036ee"} 12:37:22 [12:37:22.565] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testE9ugF0/1 with map size 1073741824 12:37:22 [12:37:22.566] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:22 [12:37:22.582] INFO: prover-client:proving-broker Proving Broker started 12:37:22 [12:37:22.582] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ee9ea485928d2d7d epochNumber=1 {"provingJobId":"1:BASE_PARITY:ee9ea485928d2d7d"} 12:37:22 [12:37:22.583] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testNA6VV3/1 with map size 1073741824 12:37:22 [12:37:22.584] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:22 [12:37:22.599] INFO: prover-client:proving-broker Proving Broker started 12:37:22 [12:37:22.599] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a01424b2164ddcde epochNumber=1 {"provingJobId":"1:BASE_PARITY:a01424b2164ddcde"} 12:37:22 [12:37:22.601] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testjycFxf/1 with map size 1073741824 12:37:22 [12:37:22.603] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:22 [12:37:22.617] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b3bb04eccbb12a10 epochNumber=1 {"provingJobId":"1:BASE_PARITY:b3bb04eccbb12a10"} 12:37:22 [12:37:22.621] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:df93562aaed412da epochNumber=2 {"provingJobId":"1:BASE_PARITY:df93562aaed412da"} 12:37:22 [12:37:22.622] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testjycFxf/2 with map size 1073741824 12:37:22 [12:37:22.623] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:22 [12:37:22.638] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:edfd38dc1e0b1d38 epochNumber=1 {"provingJobId":"1:BASE_PARITY:edfd38dc1e0b1d38"} 12:37:22 [12:37:22.645] INFO: prover-client:proving-broker Proving Broker started 12:37:22 [12:37:22.645] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ddef3b02af890ded epochNumber=1 {"provingJobId":"1:BASE_PARITY:ddef3b02af890ded"} 12:37:22 [12:37:22.646] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test9aOaZx/1 with map size 1073741824 12:37:22 [12:37:22.647] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:22 [12:37:22.660] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9851240e42ce02ea epochNumber=1 {"provingJobId":"1:BASE_PARITY:9851240e42ce02ea"} 12:37:22 [12:37:22.665] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:24ef591ca295fb9c epochNumber=2 {"provingJobId":"1:BASE_PARITY:24ef591ca295fb9c"} 12:37:22 [12:37:22.666] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-test9aOaZx/2 with map size 1073741824 12:37:22 [12:37:22.667] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:22 [12:37:22.681] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:49b74716986db18d epochNumber=1 {"provingJobId":"1:BASE_PARITY:49b74716986db18d"} 12:37:22 [12:37:22.688] INFO: prover-client:proving-broker Proving Broker started 12:37:22 [12:37:22.688] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2812818b1117968c epochNumber=1 {"provingJobId":"1:BASE_PARITY:2812818b1117968c"} 12:37:22 [12:37:22.689] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testpnqqoi/1 with map size 1073741824 12:37:22 [12:37:22.690] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:22 [12:37:22.704] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:147a1b78aa38bec1 epochNumber=1 {"provingJobId":"1:BASE_PARITY:147a1b78aa38bec1"} 12:37:22 [12:37:22.709] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:aa206f7d2ab8146d epochNumber=2 {"provingJobId":"1:BASE_PARITY:aa206f7d2ab8146d"} 12:37:22 [12:37:22.709] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testpnqqoi/2 with map size 1073741824 12:37:22 [12:37:22.711] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:22 [12:37:22.725] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f5c6449f5375e428 epochNumber=1 {"provingJobId":"1:BASE_PARITY:f5c6449f5375e428"} 12:37:22 [12:37:22.731] INFO: prover-client:proving-broker Proving Broker started 12:37:22 [12:37:22.732] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:bbcf0ca764bfdbfe epochNumber=1 {"provingJobId":"1:BASE_PARITY:bbcf0ca764bfdbfe"} 12:37:22 [12:37:22.732] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testq1wkWD/1 with map size 1073741824 12:37:22 [12:37:22.734] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:22 [12:37:22.747] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3d24ca1cc04d6a56 epochNumber=1 {"provingJobId":"1:BASE_PARITY:3d24ca1cc04d6a56"} 12:37:22 [12:37:22.752] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:bbcf0ca764bfdbfe type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:bbcf0ca764bfdbfe"} 12:37:22 [12:37:22.760] INFO: prover-client:proving-broker Proving Broker started 12:37:22 [12:37:22.760] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e6dcb78dfe6b6976 epochNumber=1 {"provingJobId":"1:BASE_PARITY:e6dcb78dfe6b6976"} 12:37:22 [12:37:22.761] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testSw398k/1 with map size 1073741824 12:37:22 [12:37:22.762] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:22 [12:37:22.776] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:75018f31e52fae57 epochNumber=1 {"provingJobId":"1:BASE_PARITY:75018f31e52fae57"} 12:37:22 [12:37:22.781] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:e6dcb78dfe6b6976 type=BASE_PARITY totalAttempts=1 err=result {"provingJobId":"1:BASE_PARITY:e6dcb78dfe6b6976"} 12:37:22 [12:37:22.787] INFO: prover-client:proving-broker Proving Broker started 12:37:22 [12:37:22.788] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1fe5acb72f938138 epochNumber=1 {"provingJobId":"1:BASE_PARITY:1fe5acb72f938138"} 12:37:22 [12:37:22.789] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testnTCOM9/1 with map size 1073741824 12:37:22 [12:37:22.790] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:22 [12:37:22.804] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:745f0c5f08b1097c epochNumber=1 {"provingJobId":"1:BASE_PARITY:745f0c5f08b1097c"} 12:37:22 [12:37:22.809] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:1fe5acb72f938138 type=BASE_PARITY retry=1 err=result {"provingJobId":"1:BASE_PARITY:1fe5acb72f938138"} 12:37:22 [12:37:22.812] INFO: prover-client:proving-broker Proving Broker started 12:37:22 [12:37:22.813] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:cea81d45a9aeedee epochNumber=1 {"provingJobId":"1:BASE_PARITY:cea81d45a9aeedee"} 12:37:22 [12:37:22.814] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testTMD3S8/1 with map size 1073741824 12:37:22 [12:37:22.815] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:22 [12:37:22.832] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:cea81d45a9aeedee {"provingJobId":"1:BASE_PARITY:cea81d45a9aeedee"} 12:37:22 [12:37:22.833] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:cea81d45a9aeedee type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:cea81d45a9aeedee"} 12:37:22 [12:37:22.840] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:70dd38f5b414c7fe epochNumber=1 {"provingJobId":"1:BASE_PARITY:70dd38f5b414c7fe"} 12:37:22 [12:37:22.846] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:cea81d45a9aeedee has already been completed {"provingJobId":"1:BASE_PARITY:cea81d45a9aeedee"} 12:37:22 [12:37:22.849] INFO: prover-client:proving-broker Proving Broker started 12:37:22 [12:37:22.850] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2427556bcd56573e epochNumber=1 {"provingJobId":"1:BASE_PARITY:2427556bcd56573e"} 12:37:22 [12:37:22.850] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testuHv5ol/1 with map size 1073741824 12:37:22 [12:37:22.851] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:22 [12:37:22.871] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:02ee7623476ed204 epochNumber=2 {"provingJobId":"1:BASE_PARITY:02ee7623476ed204"} 12:37:22 [12:37:22.871] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testuHv5ol/2 with map size 1073741824 12:37:22 [12:37:22.872] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:23 [12:37:23.938] INFO: prover-client:proving-broker Proving Broker started 12:37:23 [12:37:23.942] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:2427556bcd56573e settled=false {"provingJobId":"1:BASE_PARITY:2427556bcd56573e","status":"pending"} 12:37:23 [12:37:23.943] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:02ee7623476ed204 settled=false {"provingJobId":"1:BASE_PARITY:02ee7623476ed204","status":"pending"} 12:37:23 [12:37:23.944] INFO: prover-client:proving-broker Proving job id=1:BASE_PARITY:2427556bcd56573e type=BASE_PARITY startedAt=1749991042887 older agent has taken job {"provingJobId":"1:BASE_PARITY:2427556bcd56573e"} 12:37:23 [12:37:23.944] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:2427556bcd56573e type=BASE_PARITY already being worked on by another agent. Sending new one {"provingJobId":"1:BASE_PARITY:2427556bcd56573e"} 12:37:23 [12:37:23.947] INFO: prover-client:proving-broker Proving Broker started 12:37:23 [12:37:23.947] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d3570357a23993a6 epochNumber=1 {"provingJobId":"1:BASE_PARITY:d3570357a23993a6"} 12:37:23 [12:37:23.948] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testaGxqV9/1 with map size 1073741824 12:37:23 [12:37:23.949] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:23 [12:37:23.964] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:864efc82902d7dc2 epochNumber=2 {"provingJobId":"1:BASE_PARITY:864efc82902d7dc2"} 12:37:23 [12:37:23.965] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testaGxqV9/2 with map size 1073741824 12:37:23 [12:37:23.966] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:24 [12:37:24.982] INFO: prover-client:proving-broker Proving Broker started 12:37:24 [12:37:24.983] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:d3570357a23993a6 settled=false {"provingJobId":"1:BASE_PARITY:d3570357a23993a6","status":"pending"} 12:37:24 [12:37:24.984] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:864efc82902d7dc2 settled=false {"provingJobId":"1:BASE_PARITY:864efc82902d7dc2","status":"pending"} 12:37:24 [12:37:24.985] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:d3570357a23993a6 type=BASE_PARITY not found in the in-progress cache, adding it {"provingJobId":"1:BASE_PARITY:d3570357a23993a6"} 12:37:24 [12:37:24.988] INFO: prover-client:proving-broker Proving Broker started 12:37:24 [12:37:24.988] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:091e4482bd78db11 epochNumber=1 {"provingJobId":"1:BASE_PARITY:091e4482bd78db11"} 12:37:24 [12:37:24.989] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testhgIS8I/1 with map size 1073741824 12:37:24 [12:37:24.990] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:25 [12:37:25.005] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a36105db627aa6ac epochNumber=2 {"provingJobId":"1:BASE_PARITY:a36105db627aa6ac"} 12:37:25 [12:37:25.005] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testhgIS8I/2 with map size 1073741824 12:37:25 [12:37:25.007] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:26 [12:37:26.021] INFO: prover-client:proving-broker Proving Broker started 12:37:26 [12:37:26.023] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:091e4482bd78db11 settled=false {"provingJobId":"1:BASE_PARITY:091e4482bd78db11","status":"pending"} 12:37:26 [12:37:26.024] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:a36105db627aa6ac settled=false {"provingJobId":"1:BASE_PARITY:a36105db627aa6ac","status":"pending"} 12:37:26 [12:37:26.025] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:091e4482bd78db11 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:091e4482bd78db11"} 12:37:26 [12:37:26.025] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:091e4482bd78db11 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:091e4482bd78db11"} 12:37:26 [12:37:26.034] INFO: prover-client:proving-broker Proving Broker started 12:37:26 [12:37:26.034] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7d87ebc0613748a0 epochNumber=1 {"provingJobId":"1:BASE_PARITY:7d87ebc0613748a0"} 12:37:26 [12:37:26.035] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testvgwaUX/1 with map size 1073741824 12:37:26 [12:37:26.036] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:26 [12:37:26.051] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:44e82dcd63ff99a4 epochNumber=2 {"provingJobId":"1:BASE_PARITY:44e82dcd63ff99a4"} 12:37:26 [12:37:26.051] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testvgwaUX/2 with map size 1073741824 12:37:26 [12:37:26.053] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:26 [12:37:26.067] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:7d87ebc0613748a0 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:7d87ebc0613748a0"} 12:37:26 [12:37:26.072] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:44e82dcd63ff99a4 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:44e82dcd63ff99a4"} 12:37:26 [12:37:26.080] INFO: prover-client:proving-broker Proving Broker started 12:37:26 [12:37:26.080] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1abe09779fcc8d8d epochNumber=1 {"provingJobId":"1:BASE_PARITY:1abe09779fcc8d8d"} 12:37:26 [12:37:26.081] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testFIj8zJ/1 with map size 1073741824 12:37:26 [12:37:26.082] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:26 [12:37:26.095] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b155009e70ca25a9 epochNumber=2 {"provingJobId":"1:BASE_PARITY:b155009e70ca25a9"} 12:37:26 [12:37:26.095] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testFIj8zJ/2 with map size 1073741824 12:37:26 [12:37:26.096] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:26 [12:37:26.111] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:1abe09779fcc8d8d type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:1abe09779fcc8d8d"} 12:37:26 [12:37:26.111] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:1abe09779fcc8d8d type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:1abe09779fcc8d8d"} 12:37:26 [12:37:26.116] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:b155009e70ca25a9 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:b155009e70ca25a9"} 12:37:26 [12:37:26.123] INFO: prover-client:proving-broker Proving Broker started 12:37:26 [12:37:26.124] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:3c7feed9de8eb9dc err=test error {"provingJoId":"1:BASE_PARITY:3c7feed9de8eb9dc"} 12:37:26 [12:37:26.126] INFO: prover-client:proving-broker Proving Broker started 12:37:26 [12:37:26.127] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:055a39d4142d3b7f not found {"provingJobId":"1:BASE_PARITY:055a39d4142d3b7f"} 12:37:26 [12:37:26.129] INFO: prover-client:proving-broker Proving Broker started 12:37:26 [12:37:26.129] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:cb3743188b494d0f epochNumber=1 {"provingJobId":"1:BASE_PARITY:cb3743188b494d0f"} 12:37:26 [12:37:26.130] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testD8UOaO/1 with map size 1073741824 12:37:26 [12:37:26.131] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:26 [12:37:26.147] INFO: prover-client:proving-broker Proving Broker started 12:37:26 [12:37:26.147] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9a65f33dc5675690 epochNumber=1 {"provingJobId":"1:BASE_PARITY:9a65f33dc5675690"} 12:37:26 [12:37:26.148] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testKlTFAm/1 with map size 1073741824 12:37:26 [12:37:26.149] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:26 [12:37:26.272] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:9a65f33dc5675690 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:9a65f33dc5675690"} 12:37:26 [12:37:26.278] INFO: prover-client:proving-broker Proving Broker started 12:37:26 [12:37:26.279] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:37ad82c2c5125fc3 epochNumber=1 {"provingJobId":"1:BASE_PARITY:37ad82c2c5125fc3"} 12:37:26 [12:37:26.279] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testm04evr/1 with map size 1073741824 12:37:26 [12:37:26.280] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:26 [12:37:26.404] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:37ad82c2c5125fc3 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:37ad82c2c5125fc3"} 12:37:26 [12:37:26.407] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c2d4ea985c7a155c epochNumber=10 {"provingJobId":"1:BASE_PARITY:c2d4ea985c7a155c"} 12:37:26 [12:37:26.407] INFO: prover-client:proving-broker-database Creating broker database for epoch 10 at /tmp/proving-broker-testm04evr/10 with map size 1073741824 12:37:26 [12:37:26.409] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:26 [12:37:26.429] INFO: prover-client:proving-broker Cleaned up jobs=1 12:37:26 [12:37:26.429] INFO: prover-client:proving-broker-database Deleting broker database for epoch 1 12:37:26 [12:37:26.550] INFO: prover-client:proving-broker Proving Broker started 12:37:26 [12:37:26.550] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:4585771b0fa8ae83 epochNumber=1 {"provingJobId":"1:BASE_PARITY:4585771b0fa8ae83"} 12:37:26 [12:37:26.551] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testsubStQ/1 with map size 1073741824 12:37:26 [12:37:26.552] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:26 [12:37:26.726] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:4585771b0fa8ae83 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:4585771b0fa8ae83"} 12:37:26 [12:37:26.769] INFO: prover-client:proving-broker Proving Broker started 12:37:26 [12:37:26.770] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:4a757a326c7a59ae epochNumber=1 {"provingJobId":"1:BASE_PARITY:4a757a326c7a59ae"} 12:37:26 [12:37:26.770] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testA3AwKr/1 with map size 1073741824 12:37:26 [12:37:26.772] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:26 [12:37:26.790] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:4a757a326c7a59ae type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:4a757a326c7a59ae"} 12:37:26 [12:37:26.793] INFO: prover-client:proving-broker Proving Broker started 12:37:26 [12:37:26.793] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9d7b269c3c44bd01 epochNumber=1 {"provingJobId":"1:BASE_PARITY:9d7b269c3c44bd01"} 12:37:26 [12:37:26.794] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testCtpK4Q/1 with map size 1073741824 12:37:26 [12:37:26.795] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:26 [12:37:26.811] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:9d7b269c3c44bd01 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:9d7b269c3c44bd01"} 12:37:26 [12:37:26.812] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:9d7b269c3c44bd01 type=BASE_PARITY totalAttempts=2 err=test error {"provingJobId":"1:BASE_PARITY:9d7b269c3c44bd01"} 12:37:26 [12:37:26.819] INFO: prover-client:proving-broker Proving Broker started 12:37:26 [12:37:26.820] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3aa1fa3097c5aee0 epochNumber=1 {"provingJobId":"1:BASE_PARITY:3aa1fa3097c5aee0"} 12:37:26 [12:37:26.820] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testSRjvzb/1 with map size 1073741824 12:37:26 [12:37:26.821] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:26 [12:37:26.836] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:3aa1fa3097c5aee0 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:3aa1fa3097c5aee0"} 12:37:26 [12:37:26.843] INFO: prover-client:proving-broker Proving Broker started 12:37:26 [12:37:26.844] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f1e5b2730b57b353 epochNumber=1 {"provingJobId":"1:BASE_PARITY:f1e5b2730b57b353"} 12:37:26 [12:37:26.844] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testIYrYDK/1 with map size 1073741824 12:37:26 [12:37:26.846] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:26 [12:37:26.859] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:f1e5b2730b57b353 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:f1e5b2730b57b353"} 12:37:26 [12:37:26.860] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0793042030e82633 epochNumber=3 {"provingJobId":"1:BASE_PARITY:0793042030e82633"} 12:37:26 [12:37:26.861] INFO: prover-client:proving-broker-database Creating broker database for epoch 3 at /tmp/proving-broker-testIYrYDK/3 with map size 1073741824 12:37:26 [12:37:26.862] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:26 [12:37:26.895] INFO: prover-client:proving-broker Cleaned up jobs=1 12:37:26 [12:37:26.895] INFO: prover-client:proving-broker-database Deleting broker database for epoch 1 12:37:26 [12:37:26.902] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:f1e5b2730b57b353 err=test error {"provingJoId":"1:BASE_PARITY:f1e5b2730b57b353"} 12:37:26 [12:37:26.905] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test30022H/1 with map size 1073741824 12:37:26 [12:37:26.906] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:26 [12:37:26.923] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-test30022H/2 with map size 1073741824 12:37:26 [12:37:26.924] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:26 [12:37:26.940] INFO: prover-client:proving-broker Proving Broker started 12:37:26 [12:37:26.942] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:76721bafbc8bf1fe settled=false {"provingJobId":"1:BASE_PARITY:76721bafbc8bf1fe","status":"pending"} 12:37:26 [12:37:26.943] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:7b687fa4494ddc55 settled=false {"provingJobId":"1:BASE_PARITY:7b687fa4494ddc55","status":"pending"} 12:37:26 [12:37:26.948] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testmJeRaZ/1 with map size 1073741824 12:37:26 [12:37:26.949] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:26 [12:37:26.965] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testmJeRaZ/2 with map size 1073741824 12:37:26 [12:37:26.966] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:26 [12:37:26.990] INFO: prover-client:proving-broker Proving Broker started 12:37:26 [12:37:26.992] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:e66969dcfc0b64f4 settled=true {"provingJobId":"1:BASE_PARITY:e66969dcfc0b64f4","status":"fulfilled"} 12:37:26 [12:37:26.993] INFO: prover-client:proving-broker Restoring proving job id=2:BASE_PARITY:f07311f042f41dbc settled=true {"provingJobId":"2:BASE_PARITY:f07311f042f41dbc","status":"fulfilled"} 12:37:26 [12:37:26.997] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testZGyu8s/1 with map size 1073741824 12:37:26 [12:37:26.999] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:27 [12:37:27.022] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testZGyu8s/2 with map size 1073741824 12:37:27 [12:37:27.023] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:27 [12:37:27.041] INFO: prover-client:proving-broker Proving Broker started 12:37:27 [12:37:27.044] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:9cb0056de83973e4 settled=true {"provingJobId":"1:BASE_PARITY:9cb0056de83973e4","status":"fulfilled"} 12:37:27 [12:37:27.046] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:021e4275c9c798d4 settled=false {"provingJobId":"1:BASE_PARITY:021e4275c9c798d4","status":"pending"} 12:37:27 [12:37:27.049] INFO: prover-client:proving-broker Proving Broker started 12:37:27 [12:37:27.050] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:81fddff53a0f6186 epochNumber=1 {"provingJobId":"1:BASE_PARITY:81fddff53a0f6186"} 12:37:27 [12:37:27.051] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test63JCkg/1 with map size 1073741824 12:37:27 [12:37:27.052] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:27 [12:37:27.071] INFO: prover-client:proving-broker Proving Broker started 12:37:27 [12:37:27.072] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f09757e985d588e4 epochNumber=1 {"provingJobId":"1:BASE_PARITY:f09757e985d588e4"} 12:37:27 [12:37:27.072] ERROR: prover-client:proving-broker Failed to save proving job id=1:BASE_PARITY:f09757e985d588e4: Error: db error: Error: db error 12:37:27 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1126:63) {"provingJobId":"1:BASE_PARITY:f09757e985d588e4"} 12:37:27 [12:37:27.075] INFO: prover-client:proving-broker Proving Broker started 12:37:27 [12:37:27.076] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3fb8cb7cb4bb4b8c epochNumber=1 {"provingJobId":"1:BASE_PARITY:3fb8cb7cb4bb4b8c"} 12:37:27 [12:37:27.076] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testxFvdOo/1 with map size 1073741824 12:37:27 [12:37:27.078] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:27 [12:37:27.092] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:3fb8cb7cb4bb4b8c type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:3fb8cb7cb4bb4b8c"} 12:37:27 [12:37:27.092] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:3fb8cb7cb4bb4b8c type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:3fb8cb7cb4bb4b8c"} 12:37:27 [12:37:27.100] INFO: prover-client:proving-broker Proving Broker started 12:37:27 [12:37:27.101] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e6bdb4001d47089c epochNumber=1 {"provingJobId":"1:BASE_PARITY:e6bdb4001d47089c"} 12:37:27 [12:37:27.101] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testvzgKB0/1 with map size 1073741824 12:37:27 [12:37:27.102] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:27 [12:37:27.116] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:e6bdb4001d47089c type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:e6bdb4001d47089c"} 12:37:27 [12:37:27.117] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:e6bdb4001d47089c type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:e6bdb4001d47089c"} 12:37:27 [12:37:27.117] ERROR: prover-client:proving-broker Failed to save proving job result id=1:BASE_PARITY:e6bdb4001d47089c: Error: db error 12:37:27 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1159:69) {"provingJobId":"1:BASE_PARITY:e6bdb4001d47089c"} 12:37:27 [12:37:27.121] INFO: prover-client:proving-broker Proving Broker started 12:37:27 [12:37:27.121] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3325131d54d2a683 epochNumber=1 {"provingJobId":"1:BASE_PARITY:3325131d54d2a683"} 12:37:27 [12:37:27.122] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test2nBnVT/1 with map size 1073741824 12:37:27 [12:37:27.123] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:27 [12:37:27.139] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:3325131d54d2a683 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:3325131d54d2a683"} 12:37:27 [12:37:27.139] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:3325131d54d2a683 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:3325131d54d2a683"} 12:37:27 [12:37:27.149] INFO: prover-client:proving-broker Proving Broker started 12:37:27 [12:37:27.150] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:4d8f87c89004a194 epochNumber=1 {"provingJobId":"1:BASE_PARITY:4d8f87c89004a194"} 12:37:27 [12:37:27.150] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testwL0B7U/1 with map size 1073741824 12:37:27 [12:37:27.153] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:27 [12:37:27.170] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:4d8f87c89004a194 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:4d8f87c89004a194"} 12:37:27 [12:37:27.170] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:4d8f87c89004a194 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:4d8f87c89004a194"} 12:37:27 [12:37:27.171] ERROR: prover-client:proving-broker Failed to save proving job error status id=1:BASE_PARITY:4d8f87c89004a194 jobErr=test error: Error: db error 12:37:27 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1192:68) {"provingJobId":"1:BASE_PARITY:4d8f87c89004a194"} 12:37:27 [12:37:27.174] INFO: prover-client:proving-broker Proving Broker started 12:37:27 [12:37:27.174] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:c6df6edaf5d5ab94 not found {"provingJobId":"1:BASE_PARITY:c6df6edaf5d5ab94"} 12:37:27 [12:37:27.178] INFO: prover-client:proving-broker Proving Broker started 12:37:27 [12:37:27.178] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:8a970f033c48685a err=test error {"provingJoId":"1:BASE_PARITY:8a970f033c48685a"} 12:37:27 [12:37:27.181] INFO: prover-client:proving-broker Proving Broker started 12:37:27 [12:37:27.191] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:cad6c3b6205e3a9d epochNumber=1 {"provingJobId":"1:BASE_PARITY:cad6c3b6205e3a9d"} 12:37:27 [12:37:27.192] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testJkbr1j/1 with map size 1073741824 12:37:27 [12:37:27.193] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:27 [12:37:27.210] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:cad6c3b6205e3a9d type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:cad6c3b6205e3a9d"} 12:37:27 [12:37:27.210] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:cad6c3b6205e3a9d type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:cad6c3b6205e3a9d"} 12:37:27 [12:37:27.225] INFO: prover-client:proving-broker New proving job id=2:BASE_PARITY:91bb416d98c27f1e epochNumber=2 {"provingJobId":"2:BASE_PARITY:91bb416d98c27f1e"} 12:37:27 [12:37:27.226] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testJkbr1j/2 with map size 1073741824 12:37:27 [12:37:27.228] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:27 [12:37:27.243] WARN: prover-client:proving-broker Proving job id=2:BASE_PARITY:91bb416d98c27f1e type=BASE_PARITY not in the in-progress set {"provingJobId":"2:BASE_PARITY:91bb416d98c27f1e"} 12:37:27 [12:37:27.244] INFO: prover-client:proving-broker Proving job complete id=2:BASE_PARITY:91bb416d98c27f1e type=BASE_PARITY totalAttempts=1 {"provingJobId":"2:BASE_PARITY:91bb416d98c27f1e"} 12:37:27 [12:37:27.310] INFO: prover-client:proving-broker New proving job id=3:BASE_PARITY:1526982c9569ab29 epochNumber=3 {"provingJobId":"3:BASE_PARITY:1526982c9569ab29"} 12:37:27 [12:37:27.311] INFO: prover-client:proving-broker-database Creating broker database for epoch 3 at /tmp/proving-broker-testJkbr1j/3 with map size 1073741824 12:37:27 [12:37:27.312] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:27 [12:37:27.332] INFO: prover-client:proving-broker Cleaned up jobs=1 12:37:27 [12:37:27.332] INFO: prover-client:proving-broker-database Deleting broker database for epoch 1 12:37:27 [12:37:27.388] INFO: prover-client:proving-broker New proving job id=4:BASE_PARITY:1fc73b44d785b4f0 epochNumber=4 {"provingJobId":"4:BASE_PARITY:1fc73b44d785b4f0"} 12:37:27 [12:37:27.388] INFO: prover-client:proving-broker-database Creating broker database for epoch 4 at /tmp/proving-broker-testJkbr1j/4 with map size 1073741824 12:37:27 [12:37:27.390] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:27 [12:37:27.410] INFO: prover-client:proving-broker Cleaned up jobs=1 12:37:27 [12:37:27.410] INFO: prover-client:proving-broker-database Deleting broker database for epoch 2 12:37:27 [12:37:27.466] INFO: prover-client:proving-broker New proving job id=5:BASE_PARITY:e57c22a2eaaad030 epochNumber=5 {"provingJobId":"5:BASE_PARITY:e57c22a2eaaad030"} 12:37:27 [12:37:27.466] INFO: prover-client:proving-broker-database Creating broker database for epoch 5 at /tmp/proving-broker-testJkbr1j/5 with map size 1073741824 12:37:27 [12:37:27.468] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 12:37:27 [12:37:27.486] INFO: prover-client:proving-broker Cleaned up jobs=1 12:37:27 [12:37:27.486] INFO: prover-client:proving-broker-database Deleting broker database for epoch 3 12:37:27 PASS src/proving_broker/proving_broker.test.ts (10.952 s) 12:37:27 ProvingBroker 12:37:27 Producer API 12:37:27 ✓ refuses stale jobs (34 ms) 12:37:27 ✓ enqueues jobs (4 ms) 12:37:27 ✓ ignores duplicate jobs (4 ms) 12:37:27 ✓ reports correct status when enqueuing repeat jobs (4 ms) 12:37:27 ✓ throws an error in case of duplicate job IDs (22 ms) 12:37:27 ✓ returns not-found status for non-existing jobs (1 ms) 12:37:27 ✓ cancels jobs in queue (2 ms) 12:37:27 ✓ cancels jobs in-progress (2 ms) 12:37:27 ✓ returns job result if successful (2 ms) 12:37:27 ✓ returns job error if failed (2 ms) 12:37:27 ✓ correctly returns job status for concurrent writes (2 ms) 12:37:27 ✓ refuses stale jobs (28 ms) 12:37:27 ✓ enqueues jobs (34 ms) 12:37:27 ✓ ignores duplicate jobs (29 ms) 12:37:27 ✓ reports correct status when enqueuing repeat jobs (28 ms) 12:37:27 ✓ throws an error in case of duplicate job IDs (21 ms) 12:37:27 ✓ returns not-found status for non-existing jobs (2 ms) 12:37:27 ✓ cancels jobs in queue (25 ms) 12:37:27 ✓ cancels jobs in-progress (26 ms) 12:37:27 ✓ returns job result if successful (25 ms) 12:37:27 ✓ returns job error if failed (24 ms) 12:37:27 ✓ correctly returns job status for concurrent writes (30 ms) 12:37:27 Consumer API 12:37:27 ✓ returns undefined if no jobs are available (1 ms) 12:37:27 ✓ returns jobs in priority order (2 ms) 12:37:27 ✓ returns undefined if no jobs are available for the given allowList (1 ms) 12:37:27 ✓ returns a job if it is in the allowList (2 ms) 12:37:27 ✓ returns the most important job if it is in the allowList (2 ms) 12:37:27 ✓ returns any job if filter is empty (2 ms) 12:37:27 ✓ returns a new job when reporting job success (2 ms) 12:37:27 ✓ returns a new job when reporting permanent error (2 ms) 12:37:27 ✓ returns a new job when reporting retry-able error (2 ms) 12:37:27 ✓ returns a new job when reporting progress if current one is cancelled (2 ms) 12:37:27 ✓ returns a new job if job is already in progress elsewhere (1054 ms) 12:37:27 ✓ avoids sending the same job to a new agent after a restart (1004 ms) 12:37:27 ✓ avoids sending a completed job to a new agent after a restart (1003 ms) 12:37:27 ✓ tracks job result if in progress (3 ms) 12:37:27 ✓ tracks job result even if job is in queue (2 ms) 12:37:27 ✓ ignores reported job error if unknown job (2 ms) 12:37:27 ✓ ignores job result if unknown job (1 ms) 12:37:27 ✓ returns undefined if no jobs are available (2 ms) 12:37:27 ✓ returns jobs in priority order (32 ms) 12:37:27 ✓ returns undefined if no jobs are available for the given allowList (17 ms) 12:37:27 ✓ returns a job if it is in the allowList (45 ms) 12:37:27 ✓ returns the most important job if it is in the allowList (43 ms) 12:37:27 ✓ returns any job if filter is empty (43 ms) 12:37:27 ✓ returns a new job when reporting job success (27 ms) 12:37:27 ✓ returns a new job when reporting permanent error (28 ms) 12:37:27 ✓ returns a new job when reporting retry-able error (24 ms) 12:37:27 ✓ returns a new job when reporting progress if current one is cancelled (38 ms) 12:37:27 ✓ returns a new job if job is already in progress elsewhere (1098 ms) 12:37:27 ✓ avoids sending the same job to a new agent after a restart (1040 ms) 12:37:27 ✓ avoids sending a completed job to a new agent after a restart (1045 ms) 12:37:27 ✓ tracks job result if in progress (45 ms) 12:37:27 ✓ tracks job result even if job is in queue (43 ms) 12:37:27 ✓ ignores reported job error if unknown job (3 ms) 12:37:27 ✓ ignores job result if unknown job (2 ms) 12:37:27 Timeouts 12:37:27 ✓ tracks in progress jobs (1 ms) 12:37:27 ✓ re-enqueues jobs that time out (109 ms) 12:37:27 ✓ cancel stale jobs that time out (228 ms) 12:37:27 ✓ keeps the jobs in progress while it is alive (201 ms) 12:37:27 ✓ tracks in progress jobs (17 ms) 12:37:27 ✓ re-enqueues jobs that time out (130 ms) 12:37:27 ✓ cancel stale jobs that time out (272 ms) 12:37:27 ✓ keeps the jobs in progress while it is alive (219 ms) 12:37:27 Retries 12:37:27 ✓ retries jobs (2 ms) 12:37:27 ✓ retries up to a maximum number of times (2 ms) 12:37:27 ✓ passing retry=false does not retry (1 ms) 12:37:27 ✓ does not retry if job is stale (27 ms) 12:37:27 ✓ retries jobs (23 ms) 12:37:27 ✓ retries up to a maximum number of times (26 ms) 12:37:27 ✓ passing retry=false does not retry (24 ms) 12:37:27 ✓ does not retry if job is stale (61 ms) 12:37:27 Database management 12:37:27 ✓ re-enqueues proof requests on start (2 ms) 12:37:27 ✓ restores proof results on start (1 ms) 12:37:27 ✓ only re-enqueues unfinished jobs (2 ms) 12:37:27 ✓ saves job when enqueued (2 ms) 12:37:27 ✓ does not retain job if database fails to save (2 ms) 12:37:27 ✓ saves job result (2 ms) 12:37:27 ✓ saves result even if database fails to save (2 ms) 12:37:27 ✓ saves job error (1 ms) 12:37:27 ✓ saves job error even if database fails to save (1 ms) 12:37:27 ✓ does not save job result if job is unknown (1 ms) 12:37:27 ✓ does not save job error if job is unknown (2 ms) 12:37:27 ✓ cleans up old jobs periodically (257 ms) 12:37:27 ✓ re-enqueues proof requests on start (42 ms) 12:37:27 ✓ restores proof results on start (50 ms) 12:37:27 ✓ only re-enqueues unfinished jobs (52 ms) 12:37:27 ✓ saves job when enqueued (21 ms) 12:37:27 ✓ does not retain job if database fails to save (3 ms) 12:37:27 ✓ saves job result (24 ms) 12:37:27 ✓ saves result even if database fails to save (20 ms) 12:37:27 ✓ saves job error (28 ms) 12:37:27 ✓ saves job error even if database fails to save (24 ms) 12:37:27 ✓ does not save job result if job is unknown (3 ms) 12:37:27 ✓ does not save job error if job is unknown (3 ms) 12:37:27 ✓ cleans up old jobs periodically (356 ms) 12:37:27 12:37:27 Test Suites: 1 passed, 1 total 12:37:27 Tests: 96 passed, 96 total 12:37:27 Snapshots: 0 total 12:37:27 Time: 11.022 s 12:37:27 Ran all test suites matching /prover-client\/src\/proving_broker\/proving_broker.test.ts/i. 12:37:27 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?