Parent Log: http://ci.aztec-labs.com/7ec536495953bb64 Command: 70462c95d683706b yarn-project/scripts/run_test.sh prover-client/src/proving_broker/proving_broker.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/fa159c5d52a45358479f951a547fed37f141a6ed Env: REF_NAME=gh-readonly-queue/next/pr-15054-184d5f7d956dd7251670a2dd6728f313cfdf3caf CURRENT_VERSION=0.87.6 CI_FULL=1 Date: Fri Jun 13 22:56:25 UTC 2025 System: ARCH=amd64 CPUS=128 MEM=493Gi HOSTNAME=pr-15054_amd64_x1-full Resources: CPU_LIST=0-127 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_b95296ef06707e5f_next 22:56:29 [22:56:29.538] INFO: prover-client:proving-broker Proving Broker started 22:56:29 [22:56:29.544] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:09ee377d3b13a31d epochNumber=42 {"provingJobId":"1:BASE_PARITY:09ee377d3b13a31d"} 22:56:29 [22:56:29.548] WARN: prover-client:proving-broker Tried enqueueing stale proving job id=1:BASE_PARITY:4e0a65577f3343ce epochNumber=1 {"provingJobId":"1:BASE_PARITY:4e0a65577f3343ce"} 22:56:29 [22:56:29.580] INFO: prover-client:proving-broker Proving Broker started 22:56:29 [22:56:29.581] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:12b514300bd7e986 epochNumber=1 {"provingJobId":"1:BASE_PARITY:12b514300bd7e986"} 22:56:29 [22:56:29.583] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6a9080ffa4e619f1 epochNumber=1 {"provingJobId":"1:BASE_PARITY:6a9080ffa4e619f1"} 22:56:29 [22:56:29.584] INFO: prover-client:proving-broker Proving Broker started 22:56:29 [22:56:29.587] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b33c88c982ff6559 epochNumber=1 {"provingJobId":"1:BASE_PARITY:b33c88c982ff6559"} 22:56:29 [22:56:29.589] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:b33c88c982ff6559 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:b33c88c982ff6559"} 22:56:29 [22:56:29.592] INFO: prover-client:proving-broker Proving Broker started 22:56:29 [22:56:29.594] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2a895fd61a443f6c epochNumber=1 {"provingJobId":"1:BASE_PARITY:2a895fd61a443f6c"} 22:56:29 [22:56:29.596] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:2a895fd61a443f6c epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:2a895fd61a443f6c"} 22:56:29 [22:56:29.597] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:2a895fd61a443f6c type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:2a895fd61a443f6c"} 22:56:29 [22:56:29.598] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:2a895fd61a443f6c epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:2a895fd61a443f6c"} 22:56:29 [22:56:29.600] INFO: prover-client:proving-broker Proving Broker started 22:56:29 [22:56:29.600] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1c8a85cfb7319c84 epochNumber=1 {"provingJobId":"1:BASE_PARITY:1c8a85cfb7319c84"} 22:56:29 [22:56:29.628] INFO: prover-client:proving-broker Proving Broker started 22:56:29 [22:56:29.638] INFO: prover-client:proving-broker Proving Broker started 22:56:29 [22:56:29.639] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:53c4be675e875fd9 epochNumber=1 {"provingJobId":"1:BASE_PARITY:53c4be675e875fd9"} 22:56:29 [22:56:29.640] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:53c4be675e875fd9 {"provingJobId":"1:BASE_PARITY:53c4be675e875fd9"} 22:56:29 [22:56:29.640] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:53c4be675e875fd9 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:53c4be675e875fd9"} 22:56:29 [22:56:29.640] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:53c4be675e875fd9 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:53c4be675e875fd9"} 22:56:29 [22:56:29.642] INFO: prover-client:proving-broker Proving Broker started 22:56:29 [22:56:29.643] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:87dcc914872d9855 epochNumber=1 {"provingJobId":"1:BASE_PARITY:87dcc914872d9855"} 22:56:29 [22:56:29.644] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:87dcc914872d9855 {"provingJobId":"1:BASE_PARITY:87dcc914872d9855"} 22:56:29 [22:56:29.644] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:87dcc914872d9855 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:87dcc914872d9855"} 22:56:29 [22:56:29.646] INFO: prover-client:proving-broker Proving Broker started 22:56:29 [22:56:29.647] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:53933f9a6429c579 epochNumber=1 {"provingJobId":"1:BASE_PARITY:53933f9a6429c579"} 22:56:29 [22:56:29.647] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:53933f9a6429c579 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:53933f9a6429c579"} 22:56:29 [22:56:29.648] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:53933f9a6429c579 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:53933f9a6429c579"} 22:56:29 [22:56:29.649] INFO: prover-client:proving-broker Proving Broker started 22:56:29 [22:56:29.650] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b4084f944e76b28d epochNumber=1 {"provingJobId":"1:BASE_PARITY:b4084f944e76b28d"} 22:56:29 [22:56:29.651] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:b4084f944e76b28d type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:b4084f944e76b28d"} 22:56:29 [22:56:29.651] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:b4084f944e76b28d type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:b4084f944e76b28d"} 22:56:29 [22:56:29.652] INFO: prover-client:proving-broker Proving Broker started 22:56:29 [22:56:29.652] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:33a9e0cac8272971 epochNumber=0 {"provingJobId":"1:BASE_PARITY:33a9e0cac8272971"} 22:56:29 [22:56:29.653] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:33a9e0cac8272971 epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:33a9e0cac8272971"} 22:56:29 [22:56:29.653] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b304e52a22739d4f epochNumber=0 {"provingJobId":"1:BASE_PARITY:b304e52a22739d4f"} 22:56:29 [22:56:29.653] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:33a9e0cac8272971 epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:33a9e0cac8272971"} 22:56:29 [22:56:29.653] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0eca77bb1dede6c4 epochNumber=0 {"provingJobId":"1:BASE_PARITY:0eca77bb1dede6c4"} 22:56:29 [22:56:29.655] INFO: prover-client:proving-broker Proving Broker started 22:56:29 [22:56:29.656] INFO: prover-client:proving-broker Proving Broker started 22:56:29 [22:56:29.656] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:317ec3b46f796e22 epochNumber=2 {"provingJobId":"1:BASE_PARITY:317ec3b46f796e22"} 22:56:29 [22:56:29.657] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a6245d2e2e248588 epochNumber=1 {"provingJobId":"1:BASE_PARITY:a6245d2e2e248588"} 22:56:29 [22:56:29.658] INFO: prover-client:proving-broker Proving Broker started 22:56:29 [22:56:29.658] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2d5a8b6019ae9bad epochNumber=1 {"provingJobId":"1:BASE_PARITY:2d5a8b6019ae9bad"} 22:56:29 [22:56:29.659] INFO: prover-client:proving-broker Proving Broker started 22:56:29 [22:56:29.659] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:234385d494ee822b epochNumber=1 {"provingJobId":"1:BASE_PARITY:234385d494ee822b"} 22:56:29 [22:56:29.660] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:15b973de3b972b02 epochNumber=1 {"provingJobId":"1:BASE_PARITY:15b973de3b972b02"} 22:56:29 [22:56:29.660] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:435853387252e2a1 epochNumber=2 {"provingJobId":"1:BASE_PARITY:435853387252e2a1"} 22:56:29 [22:56:29.660] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d6e748cc23d69ecc epochNumber=1 {"provingJobId":"1:BASE_PARITY:d6e748cc23d69ecc"} 22:56:29 [22:56:29.661] INFO: prover-client:proving-broker Proving Broker started 22:56:29 [22:56:29.661] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:fd5be530926357fd epochNumber=1 {"provingJobId":"1:BASE_PARITY:fd5be530926357fd"} 22:56:29 [22:56:29.662] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:cbddf79ac5c8b00c epochNumber=1 {"provingJobId":"1:BASE_PARITY:cbddf79ac5c8b00c"} 22:56:29 [22:56:29.662] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:eacc37889db5a574 epochNumber=2 {"provingJobId":"1:BASE_PARITY:eacc37889db5a574"} 22:56:29 [22:56:29.662] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9d7e552a031f03c0 epochNumber=1 {"provingJobId":"1:BASE_PARITY:9d7e552a031f03c0"} 22:56:29 [22:56:29.663] INFO: prover-client:proving-broker Proving Broker started 22:56:29 [22:56:29.664] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a505129c8b8ee9d9 epochNumber=1 {"provingJobId":"1:BASE_PARITY:a505129c8b8ee9d9"} 22:56:29 [22:56:29.664] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6e1fae014d4eb6da epochNumber=1 {"provingJobId":"1:BASE_PARITY:6e1fae014d4eb6da"} 22:56:29 [22:56:29.664] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:793f6229800d3fa2 epochNumber=2 {"provingJobId":"1:BASE_PARITY:793f6229800d3fa2"} 22:56:29 [22:56:29.664] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:5ba1ef06aeb6f547 epochNumber=1 {"provingJobId":"1:BASE_PARITY:5ba1ef06aeb6f547"} 22:56:29 [22:56:29.665] INFO: prover-client:proving-broker Proving Broker started 22:56:29 [22:56:29.666] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:cbe65fc1365067bc epochNumber=1 {"provingJobId":"1:BASE_PARITY:cbe65fc1365067bc"} 22:56:29 [22:56:29.666] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9f9eb51c9c0ca743 epochNumber=1 {"provingJobId":"1:BASE_PARITY:9f9eb51c9c0ca743"} 22:56:29 [22:56:29.666] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:cbe65fc1365067bc type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:cbe65fc1365067bc"} 22:56:29 [22:56:29.668] INFO: prover-client:proving-broker Proving Broker started 22:56:29 [22:56:29.668] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:aa6da21e7861a5a0 epochNumber=1 {"provingJobId":"1:BASE_PARITY:aa6da21e7861a5a0"} 22:56:29 [22:56:29.669] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7d1f633f88f753b0 epochNumber=1 {"provingJobId":"1:BASE_PARITY:7d1f633f88f753b0"} 22:56:29 [22:56:29.669] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:aa6da21e7861a5a0 type=BASE_PARITY totalAttempts=1 err=result {"provingJobId":"1:BASE_PARITY:aa6da21e7861a5a0"} 22:56:29 [22:56:29.670] INFO: prover-client:proving-broker Proving Broker started 22:56:29 [22:56:29.670] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9bdac3c554ff7524 epochNumber=1 {"provingJobId":"1:BASE_PARITY:9bdac3c554ff7524"} 22:56:29 [22:56:29.671] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:70c49f28e30ff8cb epochNumber=1 {"provingJobId":"1:BASE_PARITY:70c49f28e30ff8cb"} 22:56:29 [22:56:29.671] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:9bdac3c554ff7524 type=BASE_PARITY retry=1 err=result {"provingJobId":"1:BASE_PARITY:9bdac3c554ff7524"} 22:56:29 [22:56:29.672] INFO: prover-client:proving-broker Proving Broker started 22:56:29 [22:56:29.673] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ac78c79c746d9517 epochNumber=1 {"provingJobId":"1:BASE_PARITY:ac78c79c746d9517"} 22:56:29 [22:56:29.673] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:ac78c79c746d9517 {"provingJobId":"1:BASE_PARITY:ac78c79c746d9517"} 22:56:29 [22:56:29.674] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:ac78c79c746d9517 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:ac78c79c746d9517"} 22:56:29 [22:56:29.674] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:696fab9fe912b3b1 epochNumber=1 {"provingJobId":"1:BASE_PARITY:696fab9fe912b3b1"} 22:56:29 [22:56:29.675] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:ac78c79c746d9517 has already been completed {"provingJobId":"1:BASE_PARITY:ac78c79c746d9517"} 22:56:29 [22:56:29.676] INFO: prover-client:proving-broker Proving Broker started 22:56:29 [22:56:29.676] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7066040b0c1ec0ad epochNumber=1 {"provingJobId":"1:BASE_PARITY:7066040b0c1ec0ad"} 22:56:29 [22:56:29.677] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:73795408576b0aeb epochNumber=2 {"provingJobId":"1:BASE_PARITY:73795408576b0aeb"} 22:56:30 [22:56:30.729] INFO: prover-client:proving-broker Proving Broker started 22:56:30 [22:56:30.729] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:7066040b0c1ec0ad settled=false {"provingJobId":"1:BASE_PARITY:7066040b0c1ec0ad","status":"pending"} 22:56:30 [22:56:30.730] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:73795408576b0aeb settled=false {"provingJobId":"1:BASE_PARITY:73795408576b0aeb","status":"pending"} 22:56:30 [22:56:30.730] INFO: prover-client:proving-broker Proving job id=1:BASE_PARITY:7066040b0c1ec0ad type=BASE_PARITY startedAt=1749855389677 older agent has taken job {"provingJobId":"1:BASE_PARITY:7066040b0c1ec0ad"} 22:56:30 [22:56:30.731] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:7066040b0c1ec0ad type=BASE_PARITY already being worked on by another agent. Sending new one {"provingJobId":"1:BASE_PARITY:7066040b0c1ec0ad"} 22:56:30 [22:56:30.732] INFO: prover-client:proving-broker Proving Broker started 22:56:30 [22:56:30.732] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9588b9f345902ac1 epochNumber=1 {"provingJobId":"1:BASE_PARITY:9588b9f345902ac1"} 22:56:30 [22:56:30.732] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:454638adfa8a45e1 epochNumber=2 {"provingJobId":"1:BASE_PARITY:454638adfa8a45e1"} 22:56:31 [22:56:31.734] INFO: prover-client:proving-broker Proving Broker started 22:56:31 [22:56:31.734] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:9588b9f345902ac1 settled=false {"provingJobId":"1:BASE_PARITY:9588b9f345902ac1","status":"pending"} 22:56:31 [22:56:31.734] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:454638adfa8a45e1 settled=false {"provingJobId":"1:BASE_PARITY:454638adfa8a45e1","status":"pending"} 22:56:31 [22:56:31.735] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:9588b9f345902ac1 type=BASE_PARITY not found in the in-progress cache, adding it {"provingJobId":"1:BASE_PARITY:9588b9f345902ac1"} 22:56:31 [22:56:31.737] INFO: prover-client:proving-broker Proving Broker started 22:56:31 [22:56:31.737] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:558bc21bfe0c40a2 epochNumber=1 {"provingJobId":"1:BASE_PARITY:558bc21bfe0c40a2"} 22:56:31 [22:56:31.738] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:30338c3781e8fe2d epochNumber=2 {"provingJobId":"1:BASE_PARITY:30338c3781e8fe2d"} 22:56:32 [22:56:32.739] INFO: prover-client:proving-broker Proving Broker started 22:56:32 [22:56:32.740] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:558bc21bfe0c40a2 settled=false {"provingJobId":"1:BASE_PARITY:558bc21bfe0c40a2","status":"pending"} 22:56:32 [22:56:32.740] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:30338c3781e8fe2d settled=false {"provingJobId":"1:BASE_PARITY:30338c3781e8fe2d","status":"pending"} 22:56:32 [22:56:32.740] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:558bc21bfe0c40a2 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:558bc21bfe0c40a2"} 22:56:32 [22:56:32.741] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:558bc21bfe0c40a2 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:558bc21bfe0c40a2"} 22:56:32 [22:56:32.743] INFO: prover-client:proving-broker Proving Broker started 22:56:32 [22:56:32.743] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9876b54083562acb epochNumber=1 {"provingJobId":"1:BASE_PARITY:9876b54083562acb"} 22:56:32 [22:56:32.744] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:19140718881f268a epochNumber=2 {"provingJobId":"1:BASE_PARITY:19140718881f268a"} 22:56:32 [22:56:32.745] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:9876b54083562acb type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:9876b54083562acb"} 22:56:32 [22:56:32.745] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:19140718881f268a type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:19140718881f268a"} 22:56:32 [22:56:32.746] INFO: prover-client:proving-broker Proving Broker started 22:56:32 [22:56:32.747] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7379f2d61447ec77 epochNumber=1 {"provingJobId":"1:BASE_PARITY:7379f2d61447ec77"} 22:56:32 [22:56:32.747] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:101b8299f6ec0a6b epochNumber=2 {"provingJobId":"1:BASE_PARITY:101b8299f6ec0a6b"} 22:56:32 [22:56:32.747] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:7379f2d61447ec77 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:7379f2d61447ec77"} 22:56:32 [22:56:32.748] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:7379f2d61447ec77 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:7379f2d61447ec77"} 22:56:32 [22:56:32.748] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:101b8299f6ec0a6b type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:101b8299f6ec0a6b"} 22:56:32 [22:56:32.749] INFO: prover-client:proving-broker Proving Broker started 22:56:32 [22:56:32.749] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:ce763ea54f1246c0 err=test error {"provingJoId":"1:BASE_PARITY:ce763ea54f1246c0"} 22:56:32 [22:56:32.750] INFO: prover-client:proving-broker Proving Broker started 22:56:32 [22:56:32.750] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:2e43cceb27c43eed not found {"provingJobId":"1:BASE_PARITY:2e43cceb27c43eed"} 22:56:32 [22:56:32.751] INFO: prover-client:proving-broker Proving Broker started 22:56:32 [22:56:32.751] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:da54bb85dd5d3f20 epochNumber=1 {"provingJobId":"1:BASE_PARITY:da54bb85dd5d3f20"} 22:56:32 [22:56:32.753] INFO: prover-client:proving-broker Proving Broker started 22:56:32 [22:56:32.753] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6deeb53a9380e6ca epochNumber=1 {"provingJobId":"1:BASE_PARITY:6deeb53a9380e6ca"} 22:56:32 [22:56:32.882] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:6deeb53a9380e6ca timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:6deeb53a9380e6ca"} 22:56:32 [22:56:32.889] INFO: prover-client:proving-broker Proving Broker started 22:56:32 [22:56:32.890] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:68817f45a6deafcb epochNumber=1 {"provingJobId":"1:BASE_PARITY:68817f45a6deafcb"} 22:56:32 [22:56:32.992] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:68817f45a6deafcb timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:68817f45a6deafcb"} 22:56:32 [22:56:32.994] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:aa4c3993aa916f1c epochNumber=10 {"provingJobId":"1:BASE_PARITY:aa4c3993aa916f1c"} 22:56:33 [22:56:33.019] INFO: prover-client:proving-broker Cleaned up jobs=1 22:56:33 [22:56:33.120] INFO: prover-client:proving-broker Proving Broker started 22:56:33 [22:56:33.121] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7bcf7cf5dea3b86d epochNumber=1 {"provingJobId":"1:BASE_PARITY:7bcf7cf5dea3b86d"} 22:56:33 [22:56:33.273] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:7bcf7cf5dea3b86d timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:7bcf7cf5dea3b86d"} 22:56:33 [22:56:33.324] INFO: prover-client:proving-broker Proving Broker started 22:56:33 [22:56:33.325] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9764da64ff75de43 epochNumber=1 {"provingJobId":"1:BASE_PARITY:9764da64ff75de43"} 22:56:33 [22:56:33.325] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:9764da64ff75de43 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:9764da64ff75de43"} 22:56:33 [22:56:33.327] INFO: prover-client:proving-broker Proving Broker started 22:56:33 [22:56:33.327] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6c2e417c558c7bc2 epochNumber=1 {"provingJobId":"1:BASE_PARITY:6c2e417c558c7bc2"} 22:56:33 [22:56:33.328] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:6c2e417c558c7bc2 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:6c2e417c558c7bc2"} 22:56:33 [22:56:33.328] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:6c2e417c558c7bc2 type=BASE_PARITY totalAttempts=2 err=test error {"provingJobId":"1:BASE_PARITY:6c2e417c558c7bc2"} 22:56:33 [22:56:33.329] INFO: prover-client:proving-broker Proving Broker started 22:56:33 [22:56:33.330] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ec751c3b4b7e80cc epochNumber=1 {"provingJobId":"1:BASE_PARITY:ec751c3b4b7e80cc"} 22:56:33 [22:56:33.330] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:ec751c3b4b7e80cc type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:ec751c3b4b7e80cc"} 22:56:33 [22:56:33.331] INFO: prover-client:proving-broker Proving Broker started 22:56:33 [22:56:33.331] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:cd80531f535d56f8 epochNumber=1 {"provingJobId":"1:BASE_PARITY:cd80531f535d56f8"} 22:56:33 [22:56:33.332] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:cd80531f535d56f8 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:cd80531f535d56f8"} 22:56:33 [22:56:33.332] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3e3308273dce986e epochNumber=3 {"provingJobId":"1:BASE_PARITY:3e3308273dce986e"} 22:56:33 [22:56:33.356] INFO: prover-client:proving-broker Cleaned up jobs=1 22:56:33 [22:56:33.357] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:cd80531f535d56f8 err=test error {"provingJoId":"1:BASE_PARITY:cd80531f535d56f8"} 22:56:33 [22:56:33.360] INFO: prover-client:proving-broker Proving Broker started 22:56:33 [22:56:33.360] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:2d090bdbfcb91231 settled=false {"provingJobId":"1:BASE_PARITY:2d090bdbfcb91231","status":"pending"} 22:56:33 [22:56:33.360] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:6617a7436b6329b5 settled=false {"provingJobId":"1:BASE_PARITY:6617a7436b6329b5","status":"pending"} 22:56:33 [22:56:33.363] INFO: prover-client:proving-broker Proving Broker started 22:56:33 [22:56:33.363] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:46c76a2479b9b00c settled=true {"provingJobId":"1:BASE_PARITY:46c76a2479b9b00c","status":"fulfilled"} 22:56:33 [22:56:33.363] INFO: prover-client:proving-broker Restoring proving job id=2:BASE_PARITY:ad18a8e0ed8c231e settled=true {"provingJobId":"2:BASE_PARITY:ad18a8e0ed8c231e","status":"fulfilled"} 22:56:33 [22:56:33.365] INFO: prover-client:proving-broker Proving Broker started 22:56:33 [22:56:33.365] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:b01b68a8c855bf5d settled=true {"provingJobId":"1:BASE_PARITY:b01b68a8c855bf5d","status":"fulfilled"} 22:56:33 [22:56:33.365] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:5c63fe1020ed2587 settled=false {"provingJobId":"1:BASE_PARITY:5c63fe1020ed2587","status":"pending"} 22:56:33 [22:56:33.366] INFO: prover-client:proving-broker Proving Broker started 22:56:33 [22:56:33.367] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:93dab1e2a8155747 epochNumber=1 {"provingJobId":"1:BASE_PARITY:93dab1e2a8155747"} 22:56:33 [22:56:33.369] INFO: prover-client:proving-broker Proving Broker started 22:56:33 [22:56:33.369] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f6673b46442250f6 epochNumber=1 {"provingJobId":"1:BASE_PARITY:f6673b46442250f6"} 22:56:33 [22:56:33.370] ERROR: prover-client:proving-broker Failed to save proving job id=1:BASE_PARITY:f6673b46442250f6: Error: db error: Error: db error 22:56:33 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1126:63) {"provingJobId":"1:BASE_PARITY:f6673b46442250f6"} 22:56:33 [22:56:33.371] INFO: prover-client:proving-broker Proving Broker started 22:56:33 [22:56:33.371] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2f0deca312c1a089 epochNumber=1 {"provingJobId":"1:BASE_PARITY:2f0deca312c1a089"} 22:56:33 [22:56:33.371] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:2f0deca312c1a089 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:2f0deca312c1a089"} 22:56:33 [22:56:33.372] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:2f0deca312c1a089 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:2f0deca312c1a089"} 22:56:33 [22:56:33.373] INFO: prover-client:proving-broker Proving Broker started 22:56:33 [22:56:33.373] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:50622af71e9bf8df epochNumber=1 {"provingJobId":"1:BASE_PARITY:50622af71e9bf8df"} 22:56:33 [22:56:33.373] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:50622af71e9bf8df type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:50622af71e9bf8df"} 22:56:33 [22:56:33.374] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:50622af71e9bf8df type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:50622af71e9bf8df"} 22:56:33 [22:56:33.374] ERROR: prover-client:proving-broker Failed to save proving job result id=1:BASE_PARITY:50622af71e9bf8df: Error: db error 22:56:33 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1159:69) {"provingJobId":"1:BASE_PARITY:50622af71e9bf8df"} 22:56:33 [22:56:33.375] INFO: prover-client:proving-broker Proving Broker started 22:56:33 [22:56:33.375] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6e6c7f3e6973eb84 epochNumber=1 {"provingJobId":"1:BASE_PARITY:6e6c7f3e6973eb84"} 22:56:33 [22:56:33.376] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:6e6c7f3e6973eb84 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:6e6c7f3e6973eb84"} 22:56:33 [22:56:33.376] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:6e6c7f3e6973eb84 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:6e6c7f3e6973eb84"} 22:56:33 [22:56:33.377] INFO: prover-client:proving-broker Proving Broker started 22:56:33 [22:56:33.377] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:66b9bb9b68ac13bd epochNumber=1 {"provingJobId":"1:BASE_PARITY:66b9bb9b68ac13bd"} 22:56:33 [22:56:33.377] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:66b9bb9b68ac13bd type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:66b9bb9b68ac13bd"} 22:56:33 [22:56:33.377] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:66b9bb9b68ac13bd type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:66b9bb9b68ac13bd"} 22:56:33 [22:56:33.378] ERROR: prover-client:proving-broker Failed to save proving job error status id=1:BASE_PARITY:66b9bb9b68ac13bd jobErr=test error: Error: db error 22:56:33 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1192:68) {"provingJobId":"1:BASE_PARITY:66b9bb9b68ac13bd"} 22:56:33 [22:56:33.379] INFO: prover-client:proving-broker Proving Broker started 22:56:33 [22:56:33.379] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:48f8c97de00240c9 not found {"provingJobId":"1:BASE_PARITY:48f8c97de00240c9"} 22:56:33 [22:56:33.380] INFO: prover-client:proving-broker Proving Broker started 22:56:33 [22:56:33.380] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:3de7f13b008d4a9e err=test error {"provingJoId":"1:BASE_PARITY:3de7f13b008d4a9e"} 22:56:33 [22:56:33.381] INFO: prover-client:proving-broker Proving Broker started 22:56:33 [22:56:33.391] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:4074dcdb90b77428 epochNumber=1 {"provingJobId":"1:BASE_PARITY:4074dcdb90b77428"} 22:56:33 [22:56:33.391] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:4074dcdb90b77428 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:4074dcdb90b77428"} 22:56:33 [22:56:33.392] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:4074dcdb90b77428 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:4074dcdb90b77428"} 22:56:33 [22:56:33.402] INFO: prover-client:proving-broker New proving job id=2:BASE_PARITY:1ccb10cf04a1ab1e epochNumber=2 {"provingJobId":"2:BASE_PARITY:1ccb10cf04a1ab1e"} 22:56:33 [22:56:33.402] WARN: prover-client:proving-broker Proving job id=2:BASE_PARITY:1ccb10cf04a1ab1e type=BASE_PARITY not in the in-progress set {"provingJobId":"2:BASE_PARITY:1ccb10cf04a1ab1e"} 22:56:33 [22:56:33.403] INFO: prover-client:proving-broker Proving job complete id=2:BASE_PARITY:1ccb10cf04a1ab1e type=BASE_PARITY totalAttempts=1 {"provingJobId":"2:BASE_PARITY:1ccb10cf04a1ab1e"} 22:56:33 [22:56:33.463] INFO: prover-client:proving-broker New proving job id=3:BASE_PARITY:e56d8c313f2b151c epochNumber=3 {"provingJobId":"3:BASE_PARITY:e56d8c313f2b151c"} 22:56:33 [22:56:33.482] INFO: prover-client:proving-broker Cleaned up jobs=1 22:56:33 [22:56:33.525] INFO: prover-client:proving-broker New proving job id=4:BASE_PARITY:3dd0e5f6da256d15 epochNumber=4 {"provingJobId":"4:BASE_PARITY:3dd0e5f6da256d15"} 22:56:33 [22:56:33.533] INFO: prover-client:proving-broker Cleaned up jobs=1 22:56:33 [22:56:33.587] INFO: prover-client:proving-broker New proving job id=5:BASE_PARITY:01f1db19a9e0a65a epochNumber=5 {"provingJobId":"5:BASE_PARITY:01f1db19a9e0a65a"} 22:56:33 [22:56:33.609] INFO: prover-client:proving-broker Cleaned up jobs=1 22:56:33 [22:56:33.642] INFO: prover-client:proving-broker Proving Broker started 22:56:33 [22:56:33.643] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:59c0fd9a87b8c496 epochNumber=42 {"provingJobId":"1:BASE_PARITY:59c0fd9a87b8c496"} 22:56:33 [22:56:33.646] INFO: prover-client:proving-broker-database Creating broker database for epoch 42 at /tmp/proving-broker-testNMy01M/42 with map size 1073741824 22:56:33 [22:56:33.649] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:33 [22:56:33.676] WARN: prover-client:proving-broker Tried enqueueing stale proving job id=1:BASE_PARITY:b408d53626a4dd87 epochNumber=1 {"provingJobId":"1:BASE_PARITY:b408d53626a4dd87"} 22:56:33 [22:56:33.683] INFO: prover-client:proving-broker Proving Broker started 22:56:33 [22:56:33.684] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b574b47dca8d445c epochNumber=1 {"provingJobId":"1:BASE_PARITY:b574b47dca8d445c"} 22:56:33 [22:56:33.685] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testzh7reo/1 with map size 1073741824 22:56:33 [22:56:33.689] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:33 [22:56:33.708] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:50dba7c62020c484 epochNumber=1 {"provingJobId":"1:BASE_PARITY:50dba7c62020c484"} 22:56:33 [22:56:33.720] INFO: prover-client:proving-broker Proving Broker started 22:56:33 [22:56:33.721] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f2e07c7af6a48d48 epochNumber=1 {"provingJobId":"1:BASE_PARITY:f2e07c7af6a48d48"} 22:56:33 [22:56:33.722] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testMc6xat/1 with map size 1073741824 22:56:33 [22:56:33.724] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:33 [22:56:33.746] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:f2e07c7af6a48d48 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:f2e07c7af6a48d48"} 22:56:33 [22:56:33.750] INFO: prover-client:proving-broker Proving Broker started 22:56:33 [22:56:33.750] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:437a092ded3977d8 epochNumber=1 {"provingJobId":"1:BASE_PARITY:437a092ded3977d8"} 22:56:33 [22:56:33.751] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testG53rx2/1 with map size 1073741824 22:56:33 [22:56:33.755] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:33 [22:56:33.773] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:437a092ded3977d8 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:437a092ded3977d8"} 22:56:33 [22:56:33.774] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:437a092ded3977d8 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:437a092ded3977d8"} 22:56:33 [22:56:33.782] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:437a092ded3977d8 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:437a092ded3977d8"} 22:56:33 [22:56:33.786] INFO: prover-client:proving-broker Proving Broker started 22:56:33 [22:56:33.787] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:12e3d14f80e41857 epochNumber=1 {"provingJobId":"1:BASE_PARITY:12e3d14f80e41857"} 22:56:33 [22:56:33.788] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testZ847Ba/1 with map size 1073741824 22:56:33 [22:56:33.791] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:33 [22:56:33.812] INFO: prover-client:proving-broker Proving Broker started 22:56:33 [22:56:33.815] INFO: prover-client:proving-broker Proving Broker started 22:56:33 [22:56:33.816] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:817fd7abfccd4f3c epochNumber=1 {"provingJobId":"1:BASE_PARITY:817fd7abfccd4f3c"} 22:56:33 [22:56:33.818] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test7hUrwU/1 with map size 1073741824 22:56:33 [22:56:33.820] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:33 [22:56:33.837] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:817fd7abfccd4f3c {"provingJobId":"1:BASE_PARITY:817fd7abfccd4f3c"} 22:56:33 [22:56:33.838] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:817fd7abfccd4f3c type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:817fd7abfccd4f3c"} 22:56:33 [22:56:33.838] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:817fd7abfccd4f3c type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:817fd7abfccd4f3c"} 22:56:33 [22:56:33.848] INFO: prover-client:proving-broker Proving Broker started 22:56:33 [22:56:33.848] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e623495b865e1876 epochNumber=1 {"provingJobId":"1:BASE_PARITY:e623495b865e1876"} 22:56:33 [22:56:33.849] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testRzUXYt/1 with map size 1073741824 22:56:33 [22:56:33.851] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:33 [22:56:33.869] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:e623495b865e1876 {"provingJobId":"1:BASE_PARITY:e623495b865e1876"} 22:56:33 [22:56:33.869] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:e623495b865e1876 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:e623495b865e1876"} 22:56:33 [22:56:33.888] INFO: prover-client:proving-broker Proving Broker started 22:56:33 [22:56:33.889] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9bb864ec4ebb8e40 epochNumber=1 {"provingJobId":"1:BASE_PARITY:9bb864ec4ebb8e40"} 22:56:33 [22:56:33.890] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testeLfGgz/1 with map size 1073741824 22:56:33 [22:56:33.893] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:33 [22:56:33.910] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:9bb864ec4ebb8e40 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:9bb864ec4ebb8e40"} 22:56:33 [22:56:33.911] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:9bb864ec4ebb8e40 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:9bb864ec4ebb8e40"} 22:56:33 [22:56:33.921] INFO: prover-client:proving-broker Proving Broker started 22:56:33 [22:56:33.922] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c5779bcc8a690bf8 epochNumber=1 {"provingJobId":"1:BASE_PARITY:c5779bcc8a690bf8"} 22:56:33 [22:56:33.923] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testfMvjLZ/1 with map size 1073741824 22:56:33 [22:56:33.926] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:33 [22:56:33.943] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:c5779bcc8a690bf8 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:c5779bcc8a690bf8"} 22:56:33 [22:56:33.943] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:c5779bcc8a690bf8 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:c5779bcc8a690bf8"} 22:56:33 [22:56:33.951] INFO: prover-client:proving-broker Proving Broker started 22:56:33 [22:56:33.952] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:8084e3db8ab05eb4 epochNumber=0 {"provingJobId":"1:BASE_PARITY:8084e3db8ab05eb4"} 22:56:33 [22:56:33.953] INFO: prover-client:proving-broker-database Creating broker database for epoch 0 at /tmp/proving-broker-testBIURa9/0 with map size 1073741824 22:56:33 [22:56:33.956] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:33 [22:56:33.975] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:8084e3db8ab05eb4 epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:8084e3db8ab05eb4"} 22:56:33 [22:56:33.976] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:029fe10fc1c089ee epochNumber=0 {"provingJobId":"1:BASE_PARITY:029fe10fc1c089ee"} 22:56:33 [22:56:33.976] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:8084e3db8ab05eb4 epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:8084e3db8ab05eb4"} 22:56:33 [22:56:33.976] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3504bbba9bd17d4e epochNumber=0 {"provingJobId":"1:BASE_PARITY:3504bbba9bd17d4e"} 22:56:33 [22:56:33.993] INFO: prover-client:proving-broker Proving Broker started 22:56:33 [22:56:33.996] INFO: prover-client:proving-broker Proving Broker started 22:56:33 [22:56:33.997] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:822cd8d5e618856f epochNumber=2 {"provingJobId":"1:BASE_PARITY:822cd8d5e618856f"} 22:56:33 [22:56:33.998] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testGba5nm/2 with map size 1073741824 22:56:34 [22:56:34.001] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:34 [22:56:34.018] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3b37396d575281a0 epochNumber=1 {"provingJobId":"1:BASE_PARITY:3b37396d575281a0"} 22:56:34 [22:56:34.019] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testGba5nm/1 with map size 1073741824 22:56:34 [22:56:34.021] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:34 [22:56:34.043] INFO: prover-client:proving-broker Proving Broker started 22:56:34 [22:56:34.043] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:10a61c2ce2204189 epochNumber=1 {"provingJobId":"1:BASE_PARITY:10a61c2ce2204189"} 22:56:34 [22:56:34.044] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test7tCnvc/1 with map size 1073741824 22:56:34 [22:56:34.046] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:34 [22:56:34.068] INFO: prover-client:proving-broker Proving Broker started 22:56:34 [22:56:34.069] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a9a5949eef520320 epochNumber=1 {"provingJobId":"1:BASE_PARITY:a9a5949eef520320"} 22:56:34 [22:56:34.072] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testKBuTWh/1 with map size 1073741824 22:56:34 [22:56:34.075] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:34 [22:56:34.100] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f21315ba41c0c533 epochNumber=1 {"provingJobId":"1:BASE_PARITY:f21315ba41c0c533"} 22:56:34 [22:56:34.107] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:8da6f5ebfc5cc4ef epochNumber=2 {"provingJobId":"1:BASE_PARITY:8da6f5ebfc5cc4ef"} 22:56:34 [22:56:34.108] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testKBuTWh/2 with map size 1073741824 22:56:34 [22:56:34.111] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:34 [22:56:34.130] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:5c15f1fa752cba46 epochNumber=1 {"provingJobId":"1:BASE_PARITY:5c15f1fa752cba46"} 22:56:34 [22:56:34.142] INFO: prover-client:proving-broker Proving Broker started 22:56:34 [22:56:34.143] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6434721d57e3c86b epochNumber=1 {"provingJobId":"1:BASE_PARITY:6434721d57e3c86b"} 22:56:34 [22:56:34.144] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testYEzcqT/1 with map size 1073741824 22:56:34 [22:56:34.147] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:34 [22:56:34.171] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e26f61dedca9914c epochNumber=1 {"provingJobId":"1:BASE_PARITY:e26f61dedca9914c"} 22:56:34 [22:56:34.183] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6170c91d474889d3 epochNumber=2 {"provingJobId":"1:BASE_PARITY:6170c91d474889d3"} 22:56:34 [22:56:34.184] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testYEzcqT/2 with map size 1073741824 22:56:34 [22:56:34.191] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:34 [22:56:34.212] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:03ffa42307f707c0 epochNumber=1 {"provingJobId":"1:BASE_PARITY:03ffa42307f707c0"} 22:56:34 [22:56:34.222] INFO: prover-client:proving-broker Proving Broker started 22:56:34 [22:56:34.223] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:293dfa5d5779a090 epochNumber=1 {"provingJobId":"1:BASE_PARITY:293dfa5d5779a090"} 22:56:34 [22:56:34.224] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testS2pQpB/1 with map size 1073741824 22:56:34 [22:56:34.226] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:34 [22:56:34.243] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a17a91bfffdfac07 epochNumber=1 {"provingJobId":"1:BASE_PARITY:a17a91bfffdfac07"} 22:56:34 [22:56:34.249] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:674a92dc6278f8c2 epochNumber=2 {"provingJobId":"1:BASE_PARITY:674a92dc6278f8c2"} 22:56:34 [22:56:34.250] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testS2pQpB/2 with map size 1073741824 22:56:34 [22:56:34.252] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:34 [22:56:34.269] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:39e8bdefd284dc02 epochNumber=1 {"provingJobId":"1:BASE_PARITY:39e8bdefd284dc02"} 22:56:34 [22:56:34.279] INFO: prover-client:proving-broker Proving Broker started 22:56:34 [22:56:34.279] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:21a9863ea4375897 epochNumber=1 {"provingJobId":"1:BASE_PARITY:21a9863ea4375897"} 22:56:34 [22:56:34.280] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testXNuKS3/1 with map size 1073741824 22:56:34 [22:56:34.282] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:34 [22:56:34.301] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f831e7591d7746f9 epochNumber=1 {"provingJobId":"1:BASE_PARITY:f831e7591d7746f9"} 22:56:34 [22:56:34.306] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:21a9863ea4375897 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:21a9863ea4375897"} 22:56:34 [22:56:34.316] INFO: prover-client:proving-broker Proving Broker started 22:56:34 [22:56:34.317] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3d1570e6da1ae8cf epochNumber=1 {"provingJobId":"1:BASE_PARITY:3d1570e6da1ae8cf"} 22:56:34 [22:56:34.318] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testEFbw44/1 with map size 1073741824 22:56:34 [22:56:34.319] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:34 [22:56:34.336] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c1f56d9de31798c9 epochNumber=1 {"provingJobId":"1:BASE_PARITY:c1f56d9de31798c9"} 22:56:34 [22:56:34.342] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:3d1570e6da1ae8cf type=BASE_PARITY totalAttempts=1 err=result {"provingJobId":"1:BASE_PARITY:3d1570e6da1ae8cf"} 22:56:34 [22:56:34.350] INFO: prover-client:proving-broker Proving Broker started 22:56:34 [22:56:34.352] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:02cca2e4e5acf984 epochNumber=1 {"provingJobId":"1:BASE_PARITY:02cca2e4e5acf984"} 22:56:34 [22:56:34.352] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testtxaHtt/1 with map size 1073741824 22:56:34 [22:56:34.357] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:34 [22:56:34.379] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:760c9f4fc6e2fce0 epochNumber=1 {"provingJobId":"1:BASE_PARITY:760c9f4fc6e2fce0"} 22:56:34 [22:56:34.386] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:02cca2e4e5acf984 type=BASE_PARITY retry=1 err=result {"provingJobId":"1:BASE_PARITY:02cca2e4e5acf984"} 22:56:34 [22:56:34.389] INFO: prover-client:proving-broker Proving Broker started 22:56:34 [22:56:34.390] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:33b1fa1ea250cfa0 epochNumber=1 {"provingJobId":"1:BASE_PARITY:33b1fa1ea250cfa0"} 22:56:34 [22:56:34.390] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test6F34rl/1 with map size 1073741824 22:56:34 [22:56:34.392] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:34 [22:56:34.410] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:33b1fa1ea250cfa0 {"provingJobId":"1:BASE_PARITY:33b1fa1ea250cfa0"} 22:56:34 [22:56:34.410] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:33b1fa1ea250cfa0 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:33b1fa1ea250cfa0"} 22:56:34 [22:56:34.417] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ebb79d6539cedd47 epochNumber=1 {"provingJobId":"1:BASE_PARITY:ebb79d6539cedd47"} 22:56:34 [22:56:34.423] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:33b1fa1ea250cfa0 has already been completed {"provingJobId":"1:BASE_PARITY:33b1fa1ea250cfa0"} 22:56:34 [22:56:34.427] INFO: prover-client:proving-broker Proving Broker started 22:56:34 [22:56:34.428] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e4092b993b315f1a epochNumber=1 {"provingJobId":"1:BASE_PARITY:e4092b993b315f1a"} 22:56:34 [22:56:34.429] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testPzi15C/1 with map size 1073741824 22:56:34 [22:56:34.431] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:34 [22:56:34.447] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a6cdcac346617a80 epochNumber=2 {"provingJobId":"1:BASE_PARITY:a6cdcac346617a80"} 22:56:34 [22:56:34.448] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testPzi15C/2 with map size 1073741824 22:56:34 [22:56:34.450] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:35 [22:56:35.518] INFO: prover-client:proving-broker Proving Broker started 22:56:35 [22:56:35.524] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:e4092b993b315f1a settled=false {"provingJobId":"1:BASE_PARITY:e4092b993b315f1a","status":"pending"} 22:56:35 [22:56:35.526] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:a6cdcac346617a80 settled=false {"provingJobId":"1:BASE_PARITY:a6cdcac346617a80","status":"pending"} 22:56:35 [22:56:35.527] INFO: prover-client:proving-broker Proving job id=1:BASE_PARITY:e4092b993b315f1a type=BASE_PARITY startedAt=1749855394466 older agent has taken job {"provingJobId":"1:BASE_PARITY:e4092b993b315f1a"} 22:56:35 [22:56:35.527] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:e4092b993b315f1a type=BASE_PARITY already being worked on by another agent. Sending new one {"provingJobId":"1:BASE_PARITY:e4092b993b315f1a"} 22:56:35 [22:56:35.532] INFO: prover-client:proving-broker Proving Broker started 22:56:35 [22:56:35.532] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:74a6a3bb5176385f epochNumber=1 {"provingJobId":"1:BASE_PARITY:74a6a3bb5176385f"} 22:56:35 [22:56:35.533] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testqyVWTj/1 with map size 1073741824 22:56:35 [22:56:35.534] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:35 [22:56:35.551] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:8ec56c6e009406da epochNumber=2 {"provingJobId":"1:BASE_PARITY:8ec56c6e009406da"} 22:56:35 [22:56:35.551] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testqyVWTj/2 with map size 1073741824 22:56:35 [22:56:35.553] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:36 [22:56:36.569] INFO: prover-client:proving-broker Proving Broker started 22:56:36 [22:56:36.572] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:74a6a3bb5176385f settled=false {"provingJobId":"1:BASE_PARITY:74a6a3bb5176385f","status":"pending"} 22:56:36 [22:56:36.574] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:8ec56c6e009406da settled=false {"provingJobId":"1:BASE_PARITY:8ec56c6e009406da","status":"pending"} 22:56:36 [22:56:36.575] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:74a6a3bb5176385f type=BASE_PARITY not found in the in-progress cache, adding it {"provingJobId":"1:BASE_PARITY:74a6a3bb5176385f"} 22:56:36 [22:56:36.581] INFO: prover-client:proving-broker Proving Broker started 22:56:36 [22:56:36.582] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:49780d338fc997a0 epochNumber=1 {"provingJobId":"1:BASE_PARITY:49780d338fc997a0"} 22:56:36 [22:56:36.584] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test6P3qZl/1 with map size 1073741824 22:56:36 [22:56:36.587] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:36 [22:56:36.610] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:4b1a4de0918d6a6a epochNumber=2 {"provingJobId":"1:BASE_PARITY:4b1a4de0918d6a6a"} 22:56:36 [22:56:36.611] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-test6P3qZl/2 with map size 1073741824 22:56:36 [22:56:36.615] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:37 [22:56:37.632] INFO: prover-client:proving-broker Proving Broker started 22:56:37 [22:56:37.634] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:49780d338fc997a0 settled=false {"provingJobId":"1:BASE_PARITY:49780d338fc997a0","status":"pending"} 22:56:37 [22:56:37.636] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:4b1a4de0918d6a6a settled=false {"provingJobId":"1:BASE_PARITY:4b1a4de0918d6a6a","status":"pending"} 22:56:37 [22:56:37.637] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:49780d338fc997a0 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:49780d338fc997a0"} 22:56:37 [22:56:37.637] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:49780d338fc997a0 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:49780d338fc997a0"} 22:56:37 [22:56:37.650] INFO: prover-client:proving-broker Proving Broker started 22:56:37 [22:56:37.652] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d6d412f24f89bb22 epochNumber=1 {"provingJobId":"1:BASE_PARITY:d6d412f24f89bb22"} 22:56:37 [22:56:37.652] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testdFT310/1 with map size 1073741824 22:56:37 [22:56:37.655] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:37 [22:56:37.682] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:bc0bc5587696ccfa epochNumber=2 {"provingJobId":"1:BASE_PARITY:bc0bc5587696ccfa"} 22:56:37 [22:56:37.683] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testdFT310/2 with map size 1073741824 22:56:37 [22:56:37.688] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:37 [22:56:37.714] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:d6d412f24f89bb22 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:d6d412f24f89bb22"} 22:56:37 [22:56:37.720] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:bc0bc5587696ccfa type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:bc0bc5587696ccfa"} 22:56:37 [22:56:37.731] INFO: prover-client:proving-broker Proving Broker started 22:56:37 [22:56:37.732] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ea3df12547ca0267 epochNumber=1 {"provingJobId":"1:BASE_PARITY:ea3df12547ca0267"} 22:56:37 [22:56:37.733] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test5C5oyo/1 with map size 1073741824 22:56:37 [22:56:37.737] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:37 [22:56:37.756] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1982f1047724d729 epochNumber=2 {"provingJobId":"1:BASE_PARITY:1982f1047724d729"} 22:56:37 [22:56:37.757] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-test5C5oyo/2 with map size 1073741824 22:56:37 [22:56:37.758] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:37 [22:56:37.780] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:ea3df12547ca0267 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:ea3df12547ca0267"} 22:56:37 [22:56:37.780] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:ea3df12547ca0267 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:ea3df12547ca0267"} 22:56:37 [22:56:37.786] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:1982f1047724d729 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:1982f1047724d729"} 22:56:37 [22:56:37.798] INFO: prover-client:proving-broker Proving Broker started 22:56:37 [22:56:37.799] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:f09abbe36d5a4067 err=test error {"provingJoId":"1:BASE_PARITY:f09abbe36d5a4067"} 22:56:37 [22:56:37.803] INFO: prover-client:proving-broker Proving Broker started 22:56:37 [22:56:37.804] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:a7df74242aabeb7e not found {"provingJobId":"1:BASE_PARITY:a7df74242aabeb7e"} 22:56:37 [22:56:37.808] INFO: prover-client:proving-broker Proving Broker started 22:56:37 [22:56:37.809] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ddff45b42a829d95 epochNumber=1 {"provingJobId":"1:BASE_PARITY:ddff45b42a829d95"} 22:56:37 [22:56:37.809] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testxzdfZ4/1 with map size 1073741824 22:56:37 [22:56:37.812] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:37 [22:56:37.833] INFO: prover-client:proving-broker Proving Broker started 22:56:37 [22:56:37.834] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:4b222a9a50257d8b epochNumber=1 {"provingJobId":"1:BASE_PARITY:4b222a9a50257d8b"} 22:56:37 [22:56:37.837] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testuvVE9c/1 with map size 1073741824 22:56:37 [22:56:37.839] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:37 [22:56:37.963] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:4b222a9a50257d8b timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:4b222a9a50257d8b"} 22:56:37 [22:56:37.969] INFO: prover-client:proving-broker Proving Broker started 22:56:37 [22:56:37.970] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:95cfbb4860068c36 epochNumber=1 {"provingJobId":"1:BASE_PARITY:95cfbb4860068c36"} 22:56:37 [22:56:37.971] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testBHyCYy/1 with map size 1073741824 22:56:37 [22:56:37.974] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:38 [22:56:38.096] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:95cfbb4860068c36 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:95cfbb4860068c36"} 22:56:38 [22:56:38.102] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7be6f3abe49c5155 epochNumber=10 {"provingJobId":"1:BASE_PARITY:7be6f3abe49c5155"} 22:56:38 [22:56:38.104] INFO: prover-client:proving-broker-database Creating broker database for epoch 10 at /tmp/proving-broker-testBHyCYy/10 with map size 1073741824 22:56:38 [22:56:38.108] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:38 [22:56:38.147] INFO: prover-client:proving-broker Cleaned up jobs=1 22:56:38 [22:56:38.148] INFO: prover-client:proving-broker-database Deleting broker database for epoch 1 22:56:38 [22:56:38.259] INFO: prover-client:proving-broker Proving Broker started 22:56:38 [22:56:38.260] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:694cf3907029b149 epochNumber=1 {"provingJobId":"1:BASE_PARITY:694cf3907029b149"} 22:56:38 [22:56:38.263] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test5q7stp/1 with map size 1073741824 22:56:38 [22:56:38.266] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:38 [22:56:38.461] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:694cf3907029b149 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:694cf3907029b149"} 22:56:38 [22:56:38.494] INFO: prover-client:proving-broker Proving Broker started 22:56:38 [22:56:38.495] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6578b415555afbee epochNumber=1 {"provingJobId":"1:BASE_PARITY:6578b415555afbee"} 22:56:38 [22:56:38.496] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test1Lqe8H/1 with map size 1073741824 22:56:38 [22:56:38.498] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:38 [22:56:38.516] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:6578b415555afbee type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:6578b415555afbee"} 22:56:38 [22:56:38.520] INFO: prover-client:proving-broker Proving Broker started 22:56:38 [22:56:38.521] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b30f2f33915e6463 epochNumber=1 {"provingJobId":"1:BASE_PARITY:b30f2f33915e6463"} 22:56:38 [22:56:38.522] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testOTqh2B/1 with map size 1073741824 22:56:38 [22:56:38.523] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:38 [22:56:38.541] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:b30f2f33915e6463 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:b30f2f33915e6463"} 22:56:38 [22:56:38.542] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:b30f2f33915e6463 type=BASE_PARITY totalAttempts=2 err=test error {"provingJobId":"1:BASE_PARITY:b30f2f33915e6463"} 22:56:38 [22:56:38.553] INFO: prover-client:proving-broker Proving Broker started 22:56:38 [22:56:38.554] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f8ab93ba2476fe5f epochNumber=1 {"provingJobId":"1:BASE_PARITY:f8ab93ba2476fe5f"} 22:56:38 [22:56:38.556] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test5yQapb/1 with map size 1073741824 22:56:38 [22:56:38.558] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:38 [22:56:38.576] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:f8ab93ba2476fe5f type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:f8ab93ba2476fe5f"} 22:56:38 [22:56:38.588] INFO: prover-client:proving-broker Proving Broker started 22:56:38 [22:56:38.590] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ac65239e4b060c6c epochNumber=1 {"provingJobId":"1:BASE_PARITY:ac65239e4b060c6c"} 22:56:38 [22:56:38.591] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test1hQkw7/1 with map size 1073741824 22:56:38 [22:56:38.593] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:38 [22:56:38.615] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:ac65239e4b060c6c type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:ac65239e4b060c6c"} 22:56:38 [22:56:38.617] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0c46e171854599c7 epochNumber=3 {"provingJobId":"1:BASE_PARITY:0c46e171854599c7"} 22:56:38 [22:56:38.620] INFO: prover-client:proving-broker-database Creating broker database for epoch 3 at /tmp/proving-broker-test1hQkw7/3 with map size 1073741824 22:56:38 [22:56:38.625] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:38 [22:56:38.670] INFO: prover-client:proving-broker Cleaned up jobs=1 22:56:38 [22:56:38.671] INFO: prover-client:proving-broker-database Deleting broker database for epoch 1 22:56:38 [22:56:38.673] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:ac65239e4b060c6c err=test error {"provingJoId":"1:BASE_PARITY:ac65239e4b060c6c"} 22:56:38 [22:56:38.679] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testqkvMw2/1 with map size 1073741824 22:56:38 [22:56:38.681] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:38 [22:56:38.701] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testqkvMw2/2 with map size 1073741824 22:56:38 [22:56:38.705] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:38 [22:56:38.727] INFO: prover-client:proving-broker Proving Broker started 22:56:38 [22:56:38.729] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:3a2aab924c807ec0 settled=false {"provingJobId":"1:BASE_PARITY:3a2aab924c807ec0","status":"pending"} 22:56:38 [22:56:38.731] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:acfcbb1ee62e11f9 settled=false {"provingJobId":"1:BASE_PARITY:acfcbb1ee62e11f9","status":"pending"} 22:56:38 [22:56:38.740] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test1ore5w/1 with map size 1073741824 22:56:38 [22:56:38.744] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:38 [22:56:38.764] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-test1ore5w/2 with map size 1073741824 22:56:38 [22:56:38.767] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:38 [22:56:38.800] INFO: prover-client:proving-broker Proving Broker started 22:56:38 [22:56:38.803] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:645d5e850d5b622a settled=true {"provingJobId":"1:BASE_PARITY:645d5e850d5b622a","status":"fulfilled"} 22:56:38 [22:56:38.805] INFO: prover-client:proving-broker Restoring proving job id=2:BASE_PARITY:fa121a57d7734b79 settled=true {"provingJobId":"2:BASE_PARITY:fa121a57d7734b79","status":"fulfilled"} 22:56:38 [22:56:38.812] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testRqA47M/1 with map size 1073741824 22:56:38 [22:56:38.815] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:38 [22:56:38.845] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testRqA47M/2 with map size 1073741824 22:56:38 [22:56:38.849] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:38 [22:56:38.869] INFO: prover-client:proving-broker Proving Broker started 22:56:38 [22:56:38.871] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:c68decb12fcafc70 settled=true {"provingJobId":"1:BASE_PARITY:c68decb12fcafc70","status":"fulfilled"} 22:56:38 [22:56:38.874] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:071b512b46de0535 settled=false {"provingJobId":"1:BASE_PARITY:071b512b46de0535","status":"pending"} 22:56:38 [22:56:38.880] INFO: prover-client:proving-broker Proving Broker started 22:56:38 [22:56:38.881] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6e52ff048da82bb5 epochNumber=1 {"provingJobId":"1:BASE_PARITY:6e52ff048da82bb5"} 22:56:38 [22:56:38.883] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testfzJ2EX/1 with map size 1073741824 22:56:38 [22:56:38.886] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:38 [22:56:38.909] INFO: prover-client:proving-broker Proving Broker started 22:56:38 [22:56:38.910] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d59d4e0aee385b0e epochNumber=1 {"provingJobId":"1:BASE_PARITY:d59d4e0aee385b0e"} 22:56:38 [22:56:38.910] ERROR: prover-client:proving-broker Failed to save proving job id=1:BASE_PARITY:d59d4e0aee385b0e: Error: db error: Error: db error 22:56:38 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1126:63) {"provingJobId":"1:BASE_PARITY:d59d4e0aee385b0e"} 22:56:38 [22:56:38.914] INFO: prover-client:proving-broker Proving Broker started 22:56:38 [22:56:38.914] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:558bb480cedff7bd epochNumber=1 {"provingJobId":"1:BASE_PARITY:558bb480cedff7bd"} 22:56:38 [22:56:38.917] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testTq3ZG3/1 with map size 1073741824 22:56:38 [22:56:38.922] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:38 [22:56:38.943] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:558bb480cedff7bd type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:558bb480cedff7bd"} 22:56:38 [22:56:38.943] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:558bb480cedff7bd type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:558bb480cedff7bd"} 22:56:38 [22:56:38.957] INFO: prover-client:proving-broker Proving Broker started 22:56:38 [22:56:38.958] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:efa926824daeb5aa epochNumber=1 {"provingJobId":"1:BASE_PARITY:efa926824daeb5aa"} 22:56:38 [22:56:38.959] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testuEEsJz/1 with map size 1073741824 22:56:38 [22:56:38.963] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:38 [22:56:38.985] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:efa926824daeb5aa type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:efa926824daeb5aa"} 22:56:38 [22:56:38.986] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:efa926824daeb5aa type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:efa926824daeb5aa"} 22:56:38 [22:56:38.987] ERROR: prover-client:proving-broker Failed to save proving job result id=1:BASE_PARITY:efa926824daeb5aa: Error: db error 22:56:38 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1159:69) {"provingJobId":"1:BASE_PARITY:efa926824daeb5aa"} 22:56:38 [22:56:38.990] INFO: prover-client:proving-broker Proving Broker started 22:56:38 [22:56:38.991] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3f09ff45b54c8b21 epochNumber=1 {"provingJobId":"1:BASE_PARITY:3f09ff45b54c8b21"} 22:56:38 [22:56:38.991] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testh2zt2V/1 with map size 1073741824 22:56:38 [22:56:38.993] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:39 [22:56:39.012] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:3f09ff45b54c8b21 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:3f09ff45b54c8b21"} 22:56:39 [22:56:39.013] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:3f09ff45b54c8b21 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:3f09ff45b54c8b21"} 22:56:39 [22:56:39.026] INFO: prover-client:proving-broker Proving Broker started 22:56:39 [22:56:39.027] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2acf717df3498098 epochNumber=1 {"provingJobId":"1:BASE_PARITY:2acf717df3498098"} 22:56:39 [22:56:39.027] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testqYpzgk/1 with map size 1073741824 22:56:39 [22:56:39.033] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:39 [22:56:39.057] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:2acf717df3498098 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:2acf717df3498098"} 22:56:39 [22:56:39.058] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:2acf717df3498098 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:2acf717df3498098"} 22:56:39 [22:56:39.059] ERROR: prover-client:proving-broker Failed to save proving job error status id=1:BASE_PARITY:2acf717df3498098 jobErr=test error: Error: db error 22:56:39 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1192:68) {"provingJobId":"1:BASE_PARITY:2acf717df3498098"} 22:56:39 [22:56:39.063] INFO: prover-client:proving-broker Proving Broker started 22:56:39 [22:56:39.064] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:ec55567675560fa1 not found {"provingJobId":"1:BASE_PARITY:ec55567675560fa1"} 22:56:39 [22:56:39.069] INFO: prover-client:proving-broker Proving Broker started 22:56:39 [22:56:39.069] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:91fb93495159faf3 err=test error {"provingJoId":"1:BASE_PARITY:91fb93495159faf3"} 22:56:39 [22:56:39.074] INFO: prover-client:proving-broker Proving Broker started 22:56:39 [22:56:39.085] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:36b6afb79feda629 epochNumber=1 {"provingJobId":"1:BASE_PARITY:36b6afb79feda629"} 22:56:39 [22:56:39.086] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testg2WIcg/1 with map size 1073741824 22:56:39 [22:56:39.094] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:39 [22:56:39.128] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:36b6afb79feda629 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:36b6afb79feda629"} 22:56:39 [22:56:39.129] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:36b6afb79feda629 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:36b6afb79feda629"} 22:56:39 [22:56:39.148] INFO: prover-client:proving-broker New proving job id=2:BASE_PARITY:43ff0e9ba0420c72 epochNumber=2 {"provingJobId":"2:BASE_PARITY:43ff0e9ba0420c72"} 22:56:39 [22:56:39.149] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testg2WIcg/2 with map size 1073741824 22:56:39 [22:56:39.152] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:39 [22:56:39.181] WARN: prover-client:proving-broker Proving job id=2:BASE_PARITY:43ff0e9ba0420c72 type=BASE_PARITY not in the in-progress set {"provingJobId":"2:BASE_PARITY:43ff0e9ba0420c72"} 22:56:39 [22:56:39.182] INFO: prover-client:proving-broker Proving job complete id=2:BASE_PARITY:43ff0e9ba0420c72 type=BASE_PARITY totalAttempts=1 {"provingJobId":"2:BASE_PARITY:43ff0e9ba0420c72"} 22:56:39 [22:56:39.260] INFO: prover-client:proving-broker New proving job id=3:BASE_PARITY:f3b224947c2a8915 epochNumber=3 {"provingJobId":"3:BASE_PARITY:f3b224947c2a8915"} 22:56:39 [22:56:39.262] INFO: prover-client:proving-broker-database Creating broker database for epoch 3 at /tmp/proving-broker-testg2WIcg/3 with map size 1073741824 22:56:39 [22:56:39.267] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:39 [22:56:39.306] INFO: prover-client:proving-broker Cleaned up jobs=1 22:56:39 [22:56:39.307] INFO: prover-client:proving-broker-database Deleting broker database for epoch 1 22:56:39 [22:56:39.363] INFO: prover-client:proving-broker New proving job id=4:BASE_PARITY:515cae832dbea68d epochNumber=4 {"provingJobId":"4:BASE_PARITY:515cae832dbea68d"} 22:56:39 [22:56:39.365] INFO: prover-client:proving-broker-database Creating broker database for epoch 4 at /tmp/proving-broker-testg2WIcg/4 with map size 1073741824 22:56:39 [22:56:39.367] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:39 [22:56:39.411] INFO: prover-client:proving-broker Cleaned up jobs=1 22:56:39 [22:56:39.411] INFO: prover-client:proving-broker-database Deleting broker database for epoch 2 22:56:39 [22:56:39.455] INFO: prover-client:proving-broker New proving job id=5:BASE_PARITY:78785ff1b17b5300 epochNumber=5 {"provingJobId":"5:BASE_PARITY:78785ff1b17b5300"} 22:56:39 [22:56:39.457] INFO: prover-client:proving-broker-database Creating broker database for epoch 5 at /tmp/proving-broker-testg2WIcg/5 with map size 1073741824 22:56:39 [22:56:39.461] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 22:56:39 [22:56:39.518] INFO: prover-client:proving-broker Cleaned up jobs=1 22:56:39 [22:56:39.519] INFO: prover-client:proving-broker-database Deleting broker database for epoch 3 22:56:39 PASS src/proving_broker/proving_broker.test.ts (13.104 s) 22:56:39 ProvingBroker 22:56:39 Producer API 22:56:39 ✓ refuses stale jobs (44 ms) 22:56:39 ✓ enqueues jobs (4 ms) 22:56:39 ✓ ignores duplicate jobs (7 ms) 22:56:39 ✓ reports correct status when enqueuing repeat jobs (7 ms) 22:56:39 ✓ throws an error in case of duplicate job IDs (27 ms) 22:56:39 ✓ returns not-found status for non-existing jobs (10 ms) 22:56:39 ✓ cancels jobs in queue (4 ms) 22:56:39 ✓ cancels jobs in-progress (3 ms) 22:56:39 ✓ returns job result if successful (3 ms) 22:56:39 ✓ returns job error if failed (2 ms) 22:56:39 ✓ correctly returns job status for concurrent writes (3 ms) 22:56:39 ✓ refuses stale jobs (40 ms) 22:56:39 ✓ enqueues jobs (39 ms) 22:56:39 ✓ ignores duplicate jobs (29 ms) 22:56:39 ✓ reports correct status when enqueuing repeat jobs (35 ms) 22:56:39 ✓ throws an error in case of duplicate job IDs (26 ms) 22:56:39 ✓ returns not-found status for non-existing jobs (4 ms) 22:56:39 ✓ cancels jobs in queue (32 ms) 22:56:39 ✓ cancels jobs in-progress (36 ms) 22:56:39 ✓ returns job result if successful (37 ms) 22:56:39 ✓ returns job error if failed (31 ms) 22:56:39 ✓ correctly returns job status for concurrent writes (40 ms) 22:56:39 Consumer API 22:56:39 ✓ returns undefined if no jobs are available (2 ms) 22:56:39 ✓ returns jobs in priority order (1 ms) 22:56:39 ✓ returns undefined if no jobs are available for the given allowList (2 ms) 22:56:39 ✓ returns a job if it is in the allowList (2 ms) 22:56:39 ✓ returns the most important job if it is in the allowList (2 ms) 22:56:39 ✓ returns any job if filter is empty (2 ms) 22:56:39 ✓ returns a new job when reporting job success (2 ms) 22:56:39 ✓ returns a new job when reporting permanent error (2 ms) 22:56:39 ✓ returns a new job when reporting retry-able error (2 ms) 22:56:39 ✓ returns a new job when reporting progress if current one is cancelled (3 ms) 22:56:39 ✓ returns a new job if job is already in progress elsewhere (1056 ms) 22:56:39 ✓ avoids sending the same job to a new agent after a restart (1005 ms) 22:56:39 ✓ avoids sending a completed job to a new agent after a restart (1006 ms) 22:56:39 ✓ tracks job result if in progress (4 ms) 22:56:39 ✓ tracks job result even if job is in queue (2 ms) 22:56:39 ✓ ignores reported job error if unknown job (1 ms) 22:56:39 ✓ ignores job result if unknown job 22:56:39 ✓ returns undefined if no jobs are available (3 ms) 22:56:39 ✓ returns jobs in priority order (46 ms) 22:56:39 ✓ returns undefined if no jobs are available for the given allowList (26 ms) 22:56:39 ✓ returns a job if it is in the allowList (72 ms) 22:56:39 ✓ returns the most important job if it is in the allowList (80 ms) 22:56:39 ✓ returns any job if filter is empty (56 ms) 22:56:39 ✓ returns a new job when reporting job success (37 ms) 22:56:39 ✓ returns a new job when reporting permanent error (35 ms) 22:56:39 ✓ returns a new job when reporting retry-able error (38 ms) 22:56:39 ✓ returns a new job when reporting progress if current one is cancelled (37 ms) 22:56:39 ✓ returns a new job if job is already in progress elsewhere (1105 ms) 22:56:39 ✓ avoids sending the same job to a new agent after a restart (1047 ms) 22:56:39 ✓ avoids sending a completed job to a new agent after a restart (1069 ms) 22:56:39 ✓ tracks job result if in progress (81 ms) 22:56:39 ✓ tracks job result even if job is in queue (67 ms) 22:56:39 ✓ ignores reported job error if unknown job (4 ms) 22:56:39 ✓ ignores job result if unknown job (6 ms) 22:56:39 Timeouts 22:56:39 ✓ tracks in progress jobs (1 ms) 22:56:39 ✓ re-enqueues jobs that time out (137 ms) 22:56:39 ✓ cancel stale jobs that time out (231 ms) 22:56:39 ✓ keeps the jobs in progress while it is alive (203 ms) 22:56:39 ✓ tracks in progress jobs (25 ms) 22:56:39 ✓ re-enqueues jobs that time out (135 ms) 22:56:39 ✓ cancel stale jobs that time out (290 ms) 22:56:39 ✓ keeps the jobs in progress while it is alive (234 ms) 22:56:39 Retries 22:56:39 ✓ retries jobs (3 ms) 22:56:39 ✓ retries up to a maximum number of times (3 ms) 22:56:39 ✓ passing retry=false does not retry (1 ms) 22:56:39 ✓ does not retry if job is stale (28 ms) 22:56:39 ✓ retries jobs (26 ms) 22:56:39 ✓ retries up to a maximum number of times (30 ms) 22:56:39 ✓ passing retry=false does not retry (36 ms) 22:56:39 ✓ does not retry if job is stale (89 ms) 22:56:39 Database management 22:56:39 ✓ re-enqueues proof requests on start (4 ms) 22:56:39 ✓ restores proof results on start (2 ms) 22:56:39 ✓ only re-enqueues unfinished jobs (2 ms) 22:56:39 ✓ saves job when enqueued (2 ms) 22:56:39 ✓ does not retain job if database fails to save (1 ms) 22:56:39 ✓ saves job result (1 ms) 22:56:39 ✓ saves result even if database fails to save (3 ms) 22:56:39 ✓ saves job error (1 ms) 22:56:39 ✓ saves job error even if database fails to save (1 ms) 22:56:39 ✓ does not save job result if job is unknown (1 ms) 22:56:39 ✓ does not save job error if job is unknown 22:56:39 ✓ cleans up old jobs periodically (258 ms) 22:56:39 ✓ re-enqueues proof requests on start (60 ms) 22:56:39 ✓ restores proof results on start (73 ms) 22:56:39 ✓ only re-enqueues unfinished jobs (69 ms) 22:56:39 ✓ saves job when enqueued (30 ms) 22:56:39 ✓ does not retain job if database fails to save (5 ms) 22:56:39 ✓ saves job result (43 ms) 22:56:39 ✓ saves result even if database fails to save (33 ms) 22:56:39 ✓ saves job error (34 ms) 22:56:39 ✓ saves job error even if database fails to save (37 ms) 22:56:39 ✓ does not save job result if job is unknown (4 ms) 22:56:39 ✓ does not save job error if job is unknown (5 ms) 22:56:39 ✓ cleans up old jobs periodically (478 ms) 22:56:39 22:56:39 Test Suites: 1 passed, 1 total 22:56:39 Tests: 96 passed, 96 total 22:56:39 Snapshots: 0 total 22:56:39 Time: 13.176 s 22:56:39 Ran all test suites matching /prover-client\/src\/proving_broker\/proving_broker.test.ts/i. 22:56:39 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?