ACI ·

Parent Log: http://ci.aztec-labs.com/fc1750779ccd7d53 Command: 3f1d1d87da1584d1 yarn-project/scripts/run_test.sh prover-client/src/proving_broker/proving_broker.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/aac426c9418162aeee8162ed45014b9393d605b8 Env: REF_NAME=gh-readonly-queue/next/pr-15051-92d685c3a802eb31897b6f13d28b9ee428c73744 CURRENT_VERSION=0.87.6 CI_FULL=1 Date: Fri Jun 20 06:36:32 UTC 2025 System: ARCH=amd64 CPUS=128 MEM=493Gi HOSTNAME=pr-15051_amd64_x4-full Resources: CPU_LIST=0-127 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_b95296ef06707e5f_next 06:36:36 [06:36:36.930] INFO: prover-client:proving-broker Proving Broker started 06:36:36 [06:36:36.938] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7d4e72d8a309e5ac epochNumber=42 {"provingJobId":"1:BASE_PARITY:7d4e72d8a309e5ac"} 06:36:36 [06:36:36.942] WARN: prover-client:proving-broker Tried enqueueing stale proving job id=1:BASE_PARITY:a9427e1ffc9b1871 epochNumber=1 {"provingJobId":"1:BASE_PARITY:a9427e1ffc9b1871"} 06:36:36 [06:36:36.978] INFO: prover-client:proving-broker Proving Broker started 06:36:36 [06:36:36.979] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f408f37cf8a73bc2 epochNumber=1 {"provingJobId":"1:BASE_PARITY:f408f37cf8a73bc2"} 06:36:36 [06:36:36.980] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:58f0fb4c3efbd9b6 epochNumber=1 {"provingJobId":"1:BASE_PARITY:58f0fb4c3efbd9b6"} 06:36:36 [06:36:36.982] INFO: prover-client:proving-broker Proving Broker started 06:36:36 [06:36:36.983] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e592dc58f3098e65 epochNumber=1 {"provingJobId":"1:BASE_PARITY:e592dc58f3098e65"} 06:36:36 [06:36:36.984] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:e592dc58f3098e65 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:e592dc58f3098e65"} 06:36:36 [06:36:36.986] INFO: prover-client:proving-broker Proving Broker started 06:36:36 [06:36:36.987] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3bd4aef7f045e6b7 epochNumber=1 {"provingJobId":"1:BASE_PARITY:3bd4aef7f045e6b7"} 06:36:36 [06:36:36.988] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:3bd4aef7f045e6b7 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:3bd4aef7f045e6b7"} 06:36:36 [06:36:36.989] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:3bd4aef7f045e6b7 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:3bd4aef7f045e6b7"} 06:36:36 [06:36:36.989] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:3bd4aef7f045e6b7 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:3bd4aef7f045e6b7"} 06:36:36 [06:36:36.991] INFO: prover-client:proving-broker Proving Broker started 06:36:36 [06:36:36.991] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:dc145733c6b1cda6 epochNumber=1 {"provingJobId":"1:BASE_PARITY:dc145733c6b1cda6"} 06:36:37 [06:36:37.019] INFO: prover-client:proving-broker Proving Broker started 06:36:37 [06:36:37.021] INFO: prover-client:proving-broker Proving Broker started 06:36:37 [06:36:37.022] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:829a27b71532eb6c epochNumber=1 {"provingJobId":"1:BASE_PARITY:829a27b71532eb6c"} 06:36:37 [06:36:37.022] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:829a27b71532eb6c {"provingJobId":"1:BASE_PARITY:829a27b71532eb6c"} 06:36:37 [06:36:37.023] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:829a27b71532eb6c type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:829a27b71532eb6c"} 06:36:37 [06:36:37.023] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:829a27b71532eb6c type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:829a27b71532eb6c"} 06:36:37 [06:36:37.025] INFO: prover-client:proving-broker Proving Broker started 06:36:37 [06:36:37.025] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6cc454d16c95d244 epochNumber=1 {"provingJobId":"1:BASE_PARITY:6cc454d16c95d244"} 06:36:37 [06:36:37.026] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:6cc454d16c95d244 {"provingJobId":"1:BASE_PARITY:6cc454d16c95d244"} 06:36:37 [06:36:37.026] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:6cc454d16c95d244 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:6cc454d16c95d244"} 06:36:37 [06:36:37.028] INFO: prover-client:proving-broker Proving Broker started 06:36:37 [06:36:37.029] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f39b35402e02f11e epochNumber=1 {"provingJobId":"1:BASE_PARITY:f39b35402e02f11e"} 06:36:37 [06:36:37.029] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:f39b35402e02f11e type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:f39b35402e02f11e"} 06:36:37 [06:36:37.029] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:f39b35402e02f11e type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:f39b35402e02f11e"} 06:36:37 [06:36:37.031] INFO: prover-client:proving-broker Proving Broker started 06:36:37 [06:36:37.031] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a793e464ad5b9cd5 epochNumber=1 {"provingJobId":"1:BASE_PARITY:a793e464ad5b9cd5"} 06:36:37 [06:36:37.032] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:a793e464ad5b9cd5 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:a793e464ad5b9cd5"} 06:36:37 [06:36:37.032] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:a793e464ad5b9cd5 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:a793e464ad5b9cd5"} 06:36:37 [06:36:37.033] INFO: prover-client:proving-broker Proving Broker started 06:36:37 [06:36:37.033] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b298f1b4a0b9d5fe epochNumber=0 {"provingJobId":"1:BASE_PARITY:b298f1b4a0b9d5fe"} 06:36:37 [06:36:37.034] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:b298f1b4a0b9d5fe epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:b298f1b4a0b9d5fe"} 06:36:37 [06:36:37.034] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f0a69f9dcf02745e epochNumber=0 {"provingJobId":"1:BASE_PARITY:f0a69f9dcf02745e"} 06:36:37 [06:36:37.034] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:b298f1b4a0b9d5fe epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:b298f1b4a0b9d5fe"} 06:36:37 [06:36:37.034] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ba223675860fa805 epochNumber=0 {"provingJobId":"1:BASE_PARITY:ba223675860fa805"} 06:36:37 [06:36:37.043] INFO: prover-client:proving-broker Proving Broker started 06:36:37 [06:36:37.044] INFO: prover-client:proving-broker Proving Broker started 06:36:37 [06:36:37.045] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:dbc972cf7f18032f epochNumber=2 {"provingJobId":"1:BASE_PARITY:dbc972cf7f18032f"} 06:36:37 [06:36:37.045] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:87d4d3d9eebc4a24 epochNumber=1 {"provingJobId":"1:BASE_PARITY:87d4d3d9eebc4a24"} 06:36:37 [06:36:37.046] INFO: prover-client:proving-broker Proving Broker started 06:36:37 [06:36:37.047] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7d6925aa7934e2ef epochNumber=1 {"provingJobId":"1:BASE_PARITY:7d6925aa7934e2ef"} 06:36:37 [06:36:37.049] INFO: prover-client:proving-broker Proving Broker started 06:36:37 [06:36:37.050] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0144dae730acd081 epochNumber=1 {"provingJobId":"1:BASE_PARITY:0144dae730acd081"} 06:36:37 [06:36:37.050] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:5362cc482c3fa5b6 epochNumber=1 {"provingJobId":"1:BASE_PARITY:5362cc482c3fa5b6"} 06:36:37 [06:36:37.050] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:21bdb314af549140 epochNumber=2 {"provingJobId":"1:BASE_PARITY:21bdb314af549140"} 06:36:37 [06:36:37.051] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:71cffe3d16537ca7 epochNumber=1 {"provingJobId":"1:BASE_PARITY:71cffe3d16537ca7"} 06:36:37 [06:36:37.052] INFO: prover-client:proving-broker Proving Broker started 06:36:37 [06:36:37.052] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0c714b42869bdab6 epochNumber=1 {"provingJobId":"1:BASE_PARITY:0c714b42869bdab6"} 06:36:37 [06:36:37.053] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:24c9c9e5207d7ecb epochNumber=1 {"provingJobId":"1:BASE_PARITY:24c9c9e5207d7ecb"} 06:36:37 [06:36:37.053] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:5f57c069be8295dd epochNumber=2 {"provingJobId":"1:BASE_PARITY:5f57c069be8295dd"} 06:36:37 [06:36:37.053] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d056b291bdc91c6d epochNumber=1 {"provingJobId":"1:BASE_PARITY:d056b291bdc91c6d"} 06:36:37 [06:36:37.055] INFO: prover-client:proving-broker Proving Broker started 06:36:37 [06:36:37.055] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:939446328c196f02 epochNumber=1 {"provingJobId":"1:BASE_PARITY:939446328c196f02"} 06:36:37 [06:36:37.055] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:71b5ea682561ed14 epochNumber=1 {"provingJobId":"1:BASE_PARITY:71b5ea682561ed14"} 06:36:37 [06:36:37.055] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:89b3ed6a9923d71f epochNumber=2 {"provingJobId":"1:BASE_PARITY:89b3ed6a9923d71f"} 06:36:37 [06:36:37.056] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1a840ed2fbd64a9b epochNumber=1 {"provingJobId":"1:BASE_PARITY:1a840ed2fbd64a9b"} 06:36:37 [06:36:37.056] INFO: prover-client:proving-broker Proving Broker started 06:36:37 [06:36:37.057] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:5846b70a304fc9c9 epochNumber=1 {"provingJobId":"1:BASE_PARITY:5846b70a304fc9c9"} 06:36:37 [06:36:37.057] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:aa65d325402f26a4 epochNumber=1 {"provingJobId":"1:BASE_PARITY:aa65d325402f26a4"} 06:36:37 [06:36:37.057] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:5846b70a304fc9c9 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:5846b70a304fc9c9"} 06:36:37 [06:36:37.058] INFO: prover-client:proving-broker Proving Broker started 06:36:37 [06:36:37.059] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:482487b258419950 epochNumber=1 {"provingJobId":"1:BASE_PARITY:482487b258419950"} 06:36:37 [06:36:37.059] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:8b39b25df715951a epochNumber=1 {"provingJobId":"1:BASE_PARITY:8b39b25df715951a"} 06:36:37 [06:36:37.059] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:482487b258419950 type=BASE_PARITY totalAttempts=1 err=result {"provingJobId":"1:BASE_PARITY:482487b258419950"} 06:36:37 [06:36:37.060] INFO: prover-client:proving-broker Proving Broker started 06:36:37 [06:36:37.060] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6b8b0ccbfe7827d5 epochNumber=1 {"provingJobId":"1:BASE_PARITY:6b8b0ccbfe7827d5"} 06:36:37 [06:36:37.061] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:459cda787c8d5717 epochNumber=1 {"provingJobId":"1:BASE_PARITY:459cda787c8d5717"} 06:36:37 [06:36:37.061] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:6b8b0ccbfe7827d5 type=BASE_PARITY retry=1 err=result {"provingJobId":"1:BASE_PARITY:6b8b0ccbfe7827d5"} 06:36:37 [06:36:37.062] INFO: prover-client:proving-broker Proving Broker started 06:36:37 [06:36:37.062] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:45e6b59d47efab4a epochNumber=1 {"provingJobId":"1:BASE_PARITY:45e6b59d47efab4a"} 06:36:37 [06:36:37.062] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:45e6b59d47efab4a {"provingJobId":"1:BASE_PARITY:45e6b59d47efab4a"} 06:36:37 [06:36:37.063] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:45e6b59d47efab4a type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:45e6b59d47efab4a"} 06:36:37 [06:36:37.063] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9b7469fc8c3a410b epochNumber=1 {"provingJobId":"1:BASE_PARITY:9b7469fc8c3a410b"} 06:36:37 [06:36:37.063] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:45e6b59d47efab4a has already been completed {"provingJobId":"1:BASE_PARITY:45e6b59d47efab4a"} 06:36:37 [06:36:37.064] INFO: prover-client:proving-broker Proving Broker started 06:36:37 [06:36:37.064] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d0bc40a94b6eb2a0 epochNumber=1 {"provingJobId":"1:BASE_PARITY:d0bc40a94b6eb2a0"} 06:36:37 [06:36:37.065] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2709735a0fdbb364 epochNumber=2 {"provingJobId":"1:BASE_PARITY:2709735a0fdbb364"} 06:36:38 [06:36:38.117] INFO: prover-client:proving-broker Proving Broker started 06:36:38 [06:36:38.118] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:d0bc40a94b6eb2a0 settled=false {"provingJobId":"1:BASE_PARITY:d0bc40a94b6eb2a0","status":"pending"} 06:36:38 [06:36:38.118] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:2709735a0fdbb364 settled=false {"provingJobId":"1:BASE_PARITY:2709735a0fdbb364","status":"pending"} 06:36:38 [06:36:38.119] INFO: prover-client:proving-broker Proving job id=1:BASE_PARITY:d0bc40a94b6eb2a0 type=BASE_PARITY startedAt=1750401397065 older agent has taken job {"provingJobId":"1:BASE_PARITY:d0bc40a94b6eb2a0"} 06:36:38 [06:36:38.119] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:d0bc40a94b6eb2a0 type=BASE_PARITY already being worked on by another agent. Sending new one {"provingJobId":"1:BASE_PARITY:d0bc40a94b6eb2a0"} 06:36:38 [06:36:38.121] INFO: prover-client:proving-broker Proving Broker started 06:36:38 [06:36:38.121] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:5fae430fcc1d2fd7 epochNumber=1 {"provingJobId":"1:BASE_PARITY:5fae430fcc1d2fd7"} 06:36:38 [06:36:38.122] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:4f12b72199e306ea epochNumber=2 {"provingJobId":"1:BASE_PARITY:4f12b72199e306ea"} 06:36:39 [06:36:39.126] INFO: prover-client:proving-broker Proving Broker started 06:36:39 [06:36:39.127] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:5fae430fcc1d2fd7 settled=false {"provingJobId":"1:BASE_PARITY:5fae430fcc1d2fd7","status":"pending"} 06:36:39 [06:36:39.127] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:4f12b72199e306ea settled=false {"provingJobId":"1:BASE_PARITY:4f12b72199e306ea","status":"pending"} 06:36:39 [06:36:39.128] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:5fae430fcc1d2fd7 type=BASE_PARITY not found in the in-progress cache, adding it {"provingJobId":"1:BASE_PARITY:5fae430fcc1d2fd7"} 06:36:39 [06:36:39.132] INFO: prover-client:proving-broker Proving Broker started 06:36:39 [06:36:39.133] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ddce4116c89e2209 epochNumber=1 {"provingJobId":"1:BASE_PARITY:ddce4116c89e2209"} 06:36:39 [06:36:39.133] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:86bf31f15215ad4e epochNumber=2 {"provingJobId":"1:BASE_PARITY:86bf31f15215ad4e"} 06:36:40 [06:36:40.134] INFO: prover-client:proving-broker Proving Broker started 06:36:40 [06:36:40.135] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:ddce4116c89e2209 settled=false {"provingJobId":"1:BASE_PARITY:ddce4116c89e2209","status":"pending"} 06:36:40 [06:36:40.136] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:86bf31f15215ad4e settled=false {"provingJobId":"1:BASE_PARITY:86bf31f15215ad4e","status":"pending"} 06:36:40 [06:36:40.137] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:ddce4116c89e2209 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:ddce4116c89e2209"} 06:36:40 [06:36:40.137] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:ddce4116c89e2209 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:ddce4116c89e2209"} 06:36:40 [06:36:40.138] INFO: prover-client:proving-broker Proving Broker started 06:36:40 [06:36:40.138] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:89610dbea26c06e2 epochNumber=1 {"provingJobId":"1:BASE_PARITY:89610dbea26c06e2"} 06:36:40 [06:36:40.139] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ac216f5d939063d5 epochNumber=2 {"provingJobId":"1:BASE_PARITY:ac216f5d939063d5"} 06:36:40 [06:36:40.139] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:89610dbea26c06e2 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:89610dbea26c06e2"} 06:36:40 [06:36:40.140] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:ac216f5d939063d5 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:ac216f5d939063d5"} 06:36:40 [06:36:40.141] INFO: prover-client:proving-broker Proving Broker started 06:36:40 [06:36:40.141] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0de51561d15d025d epochNumber=1 {"provingJobId":"1:BASE_PARITY:0de51561d15d025d"} 06:36:40 [06:36:40.142] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:229d9d326e16c360 epochNumber=2 {"provingJobId":"1:BASE_PARITY:229d9d326e16c360"} 06:36:40 [06:36:40.142] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:0de51561d15d025d type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:0de51561d15d025d"} 06:36:40 [06:36:40.142] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:0de51561d15d025d type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:0de51561d15d025d"} 06:36:40 [06:36:40.143] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:229d9d326e16c360 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:229d9d326e16c360"} 06:36:40 [06:36:40.143] INFO: prover-client:proving-broker Proving Broker started 06:36:40 [06:36:40.144] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:f7e16426d314214c err=test error {"provingJoId":"1:BASE_PARITY:f7e16426d314214c"} 06:36:40 [06:36:40.144] INFO: prover-client:proving-broker Proving Broker started 06:36:40 [06:36:40.145] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:892e8c0ec2129929 not found {"provingJobId":"1:BASE_PARITY:892e8c0ec2129929"} 06:36:40 [06:36:40.146] INFO: prover-client:proving-broker Proving Broker started 06:36:40 [06:36:40.146] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0fd1f1e245aa9d71 epochNumber=1 {"provingJobId":"1:BASE_PARITY:0fd1f1e245aa9d71"} 06:36:40 [06:36:40.147] INFO: prover-client:proving-broker Proving Broker started 06:36:40 [06:36:40.147] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:cf272d8457d83d78 epochNumber=1 {"provingJobId":"1:BASE_PARITY:cf272d8457d83d78"} 06:36:40 [06:36:40.248] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:cf272d8457d83d78 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:cf272d8457d83d78"} 06:36:40 [06:36:40.256] INFO: prover-client:proving-broker Proving Broker started 06:36:40 [06:36:40.257] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:74d4bda2aca86dd7 epochNumber=1 {"provingJobId":"1:BASE_PARITY:74d4bda2aca86dd7"} 06:36:40 [06:36:40.357] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:74d4bda2aca86dd7 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:74d4bda2aca86dd7"} 06:36:40 [06:36:40.359] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f21f33db3f3c76ae epochNumber=10 {"provingJobId":"1:BASE_PARITY:f21f33db3f3c76ae"} 06:36:40 [06:36:40.383] INFO: prover-client:proving-broker Cleaned up jobs=1 06:36:40 [06:36:40.486] INFO: prover-client:proving-broker Proving Broker started 06:36:40 [06:36:40.487] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:bd0dceffa696846a epochNumber=1 {"provingJobId":"1:BASE_PARITY:bd0dceffa696846a"} 06:36:40 [06:36:40.640] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:bd0dceffa696846a timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:bd0dceffa696846a"} 06:36:40 [06:36:40.689] INFO: prover-client:proving-broker Proving Broker started 06:36:40 [06:36:40.690] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:98fdde69900737e1 epochNumber=1 {"provingJobId":"1:BASE_PARITY:98fdde69900737e1"} 06:36:40 [06:36:40.691] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:98fdde69900737e1 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:98fdde69900737e1"} 06:36:40 [06:36:40.692] INFO: prover-client:proving-broker Proving Broker started 06:36:40 [06:36:40.692] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a9eaad6332db493a epochNumber=1 {"provingJobId":"1:BASE_PARITY:a9eaad6332db493a"} 06:36:40 [06:36:40.693] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:a9eaad6332db493a type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:a9eaad6332db493a"} 06:36:40 [06:36:40.693] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:a9eaad6332db493a type=BASE_PARITY totalAttempts=2 err=test error {"provingJobId":"1:BASE_PARITY:a9eaad6332db493a"} 06:36:40 [06:36:40.694] INFO: prover-client:proving-broker Proving Broker started 06:36:40 [06:36:40.695] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7ee5e7e33b0756d2 epochNumber=1 {"provingJobId":"1:BASE_PARITY:7ee5e7e33b0756d2"} 06:36:40 [06:36:40.695] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:7ee5e7e33b0756d2 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:7ee5e7e33b0756d2"} 06:36:40 [06:36:40.696] INFO: prover-client:proving-broker Proving Broker started 06:36:40 [06:36:40.696] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:501bebdb0b225353 epochNumber=1 {"provingJobId":"1:BASE_PARITY:501bebdb0b225353"} 06:36:40 [06:36:40.696] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:501bebdb0b225353 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:501bebdb0b225353"} 06:36:40 [06:36:40.697] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2a590dafed610c23 epochNumber=3 {"provingJobId":"1:BASE_PARITY:2a590dafed610c23"} 06:36:40 [06:36:40.721] INFO: prover-client:proving-broker Cleaned up jobs=1 06:36:40 [06:36:40.722] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:501bebdb0b225353 err=test error {"provingJoId":"1:BASE_PARITY:501bebdb0b225353"} 06:36:40 [06:36:40.724] INFO: prover-client:proving-broker Proving Broker started 06:36:40 [06:36:40.724] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:237c958ddf7a698e settled=false {"provingJobId":"1:BASE_PARITY:237c958ddf7a698e","status":"pending"} 06:36:40 [06:36:40.724] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:fff3536214fa607f settled=false {"provingJobId":"1:BASE_PARITY:fff3536214fa607f","status":"pending"} 06:36:40 [06:36:40.728] INFO: prover-client:proving-broker Proving Broker started 06:36:40 [06:36:40.729] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:2e53d5b1fa8a8933 settled=true {"provingJobId":"1:BASE_PARITY:2e53d5b1fa8a8933","status":"fulfilled"} 06:36:40 [06:36:40.729] INFO: prover-client:proving-broker Restoring proving job id=2:BASE_PARITY:f7a63944f0e3060d settled=true {"provingJobId":"2:BASE_PARITY:f7a63944f0e3060d","status":"fulfilled"} 06:36:40 [06:36:40.730] INFO: prover-client:proving-broker Proving Broker started 06:36:40 [06:36:40.731] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:2ed9fe98f8be6488 settled=true {"provingJobId":"1:BASE_PARITY:2ed9fe98f8be6488","status":"fulfilled"} 06:36:40 [06:36:40.731] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:b88fffe379277999 settled=false {"provingJobId":"1:BASE_PARITY:b88fffe379277999","status":"pending"} 06:36:40 [06:36:40.732] INFO: prover-client:proving-broker Proving Broker started 06:36:40 [06:36:40.733] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:cc2aa76ca795f963 epochNumber=1 {"provingJobId":"1:BASE_PARITY:cc2aa76ca795f963"} 06:36:40 [06:36:40.735] INFO: prover-client:proving-broker Proving Broker started 06:36:40 [06:36:40.735] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ed70953d48aa70a5 epochNumber=1 {"provingJobId":"1:BASE_PARITY:ed70953d48aa70a5"} 06:36:40 [06:36:40.736] ERROR: prover-client:proving-broker Failed to save proving job id=1:BASE_PARITY:ed70953d48aa70a5: Error: db error: Error: db error 06:36:40 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1126:63) {"provingJobId":"1:BASE_PARITY:ed70953d48aa70a5"} 06:36:40 [06:36:40.737] INFO: prover-client:proving-broker Proving Broker started 06:36:40 [06:36:40.738] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:35350f35f92f3210 epochNumber=1 {"provingJobId":"1:BASE_PARITY:35350f35f92f3210"} 06:36:40 [06:36:40.738] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:35350f35f92f3210 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:35350f35f92f3210"} 06:36:40 [06:36:40.738] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:35350f35f92f3210 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:35350f35f92f3210"} 06:36:40 [06:36:40.739] INFO: prover-client:proving-broker Proving Broker started 06:36:40 [06:36:40.740] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:8d357c23605daa65 epochNumber=1 {"provingJobId":"1:BASE_PARITY:8d357c23605daa65"} 06:36:40 [06:36:40.740] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:8d357c23605daa65 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:8d357c23605daa65"} 06:36:40 [06:36:40.740] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:8d357c23605daa65 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:8d357c23605daa65"} 06:36:40 [06:36:40.741] ERROR: prover-client:proving-broker Failed to save proving job result id=1:BASE_PARITY:8d357c23605daa65: Error: db error 06:36:40 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1159:69) {"provingJobId":"1:BASE_PARITY:8d357c23605daa65"} 06:36:40 [06:36:40.742] INFO: prover-client:proving-broker Proving Broker started 06:36:40 [06:36:40.742] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c8d91d60d54e7d2e epochNumber=1 {"provingJobId":"1:BASE_PARITY:c8d91d60d54e7d2e"} 06:36:40 [06:36:40.742] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:c8d91d60d54e7d2e type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:c8d91d60d54e7d2e"} 06:36:40 [06:36:40.743] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:c8d91d60d54e7d2e type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:c8d91d60d54e7d2e"} 06:36:40 [06:36:40.744] INFO: prover-client:proving-broker Proving Broker started 06:36:40 [06:36:40.744] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6237d6301dc78431 epochNumber=1 {"provingJobId":"1:BASE_PARITY:6237d6301dc78431"} 06:36:40 [06:36:40.745] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:6237d6301dc78431 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:6237d6301dc78431"} 06:36:40 [06:36:40.745] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:6237d6301dc78431 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:6237d6301dc78431"} 06:36:40 [06:36:40.745] ERROR: prover-client:proving-broker Failed to save proving job error status id=1:BASE_PARITY:6237d6301dc78431 jobErr=test error: Error: db error 06:36:40 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1192:68) {"provingJobId":"1:BASE_PARITY:6237d6301dc78431"} 06:36:40 [06:36:40.746] INFO: prover-client:proving-broker Proving Broker started 06:36:40 [06:36:40.747] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:f4abd9542eb890fb not found {"provingJobId":"1:BASE_PARITY:f4abd9542eb890fb"} 06:36:40 [06:36:40.748] INFO: prover-client:proving-broker Proving Broker started 06:36:40 [06:36:40.748] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:c1aea33351b03fdb err=test error {"provingJoId":"1:BASE_PARITY:c1aea33351b03fdb"} 06:36:40 [06:36:40.750] INFO: prover-client:proving-broker Proving Broker started 06:36:40 [06:36:40.760] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:55437759ea1445d1 epochNumber=1 {"provingJobId":"1:BASE_PARITY:55437759ea1445d1"} 06:36:40 [06:36:40.760] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:55437759ea1445d1 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:55437759ea1445d1"} 06:36:40 [06:36:40.761] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:55437759ea1445d1 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:55437759ea1445d1"} 06:36:40 [06:36:40.771] INFO: prover-client:proving-broker New proving job id=2:BASE_PARITY:e460ce00299fef4c epochNumber=2 {"provingJobId":"2:BASE_PARITY:e460ce00299fef4c"} 06:36:40 [06:36:40.771] WARN: prover-client:proving-broker Proving job id=2:BASE_PARITY:e460ce00299fef4c type=BASE_PARITY not in the in-progress set {"provingJobId":"2:BASE_PARITY:e460ce00299fef4c"} 06:36:40 [06:36:40.772] INFO: prover-client:proving-broker Proving job complete id=2:BASE_PARITY:e460ce00299fef4c type=BASE_PARITY totalAttempts=1 {"provingJobId":"2:BASE_PARITY:e460ce00299fef4c"} 06:36:40 [06:36:40.833] INFO: prover-client:proving-broker New proving job id=3:BASE_PARITY:b95073ba7724d1db epochNumber=3 {"provingJobId":"3:BASE_PARITY:b95073ba7724d1db"} 06:36:40 [06:36:40.852] INFO: prover-client:proving-broker Cleaned up jobs=1 06:36:40 [06:36:40.895] INFO: prover-client:proving-broker New proving job id=4:BASE_PARITY:d766ce9d36bd634c epochNumber=4 {"provingJobId":"4:BASE_PARITY:d766ce9d36bd634c"} 06:36:40 [06:36:40.903] INFO: prover-client:proving-broker Cleaned up jobs=1 06:36:40 [06:36:40.957] INFO: prover-client:proving-broker New proving job id=5:BASE_PARITY:6d9bbd30825647c7 epochNumber=5 {"provingJobId":"5:BASE_PARITY:6d9bbd30825647c7"} 06:36:40 [06:36:40.981] INFO: prover-client:proving-broker Cleaned up jobs=1 06:36:41 [06:36:41.012] INFO: prover-client:proving-broker Proving Broker started 06:36:41 [06:36:41.013] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:8a04566b37b6ff59 epochNumber=42 {"provingJobId":"1:BASE_PARITY:8a04566b37b6ff59"} 06:36:41 [06:36:41.014] INFO: prover-client:proving-broker-database Creating broker database for epoch 42 at /tmp/proving-broker-testL4scQm/42 with map size 1073741824 06:36:41 [06:36:41.017] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:41 [06:36:41.042] WARN: prover-client:proving-broker Tried enqueueing stale proving job id=1:BASE_PARITY:7e3a5b79517664a6 epochNumber=1 {"provingJobId":"1:BASE_PARITY:7e3a5b79517664a6"} 06:36:41 [06:36:41.046] INFO: prover-client:proving-broker Proving Broker started 06:36:41 [06:36:41.046] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:69c2b71e0668eca9 epochNumber=1 {"provingJobId":"1:BASE_PARITY:69c2b71e0668eca9"} 06:36:41 [06:36:41.047] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test3douDW/1 with map size 1073741824 06:36:41 [06:36:41.049] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:41 [06:36:41.066] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7f9ddd029e798e96 epochNumber=1 {"provingJobId":"1:BASE_PARITY:7f9ddd029e798e96"} 06:36:41 [06:36:41.075] INFO: prover-client:proving-broker Proving Broker started 06:36:41 [06:36:41.075] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3fe2b7a790260fce epochNumber=1 {"provingJobId":"1:BASE_PARITY:3fe2b7a790260fce"} 06:36:41 [06:36:41.076] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testT5V8vZ/1 with map size 1073741824 06:36:41 [06:36:41.078] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:41 [06:36:41.094] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:3fe2b7a790260fce epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:3fe2b7a790260fce"} 06:36:41 [06:36:41.098] INFO: prover-client:proving-broker Proving Broker started 06:36:41 [06:36:41.098] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:57f03e8e06f649c7 epochNumber=1 {"provingJobId":"1:BASE_PARITY:57f03e8e06f649c7"} 06:36:41 [06:36:41.099] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testOzTQbv/1 with map size 1073741824 06:36:41 [06:36:41.101] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:41 [06:36:41.119] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:57f03e8e06f649c7 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:57f03e8e06f649c7"} 06:36:41 [06:36:41.119] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:57f03e8e06f649c7 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:57f03e8e06f649c7"} 06:36:41 [06:36:41.125] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:57f03e8e06f649c7 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:57f03e8e06f649c7"} 06:36:41 [06:36:41.137] INFO: prover-client:proving-broker Proving Broker started 06:36:41 [06:36:41.138] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:cbdfc786907d57a9 epochNumber=1 {"provingJobId":"1:BASE_PARITY:cbdfc786907d57a9"} 06:36:41 [06:36:41.139] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testeIXNOE/1 with map size 1073741824 06:36:41 [06:36:41.141] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:41 [06:36:41.163] INFO: prover-client:proving-broker Proving Broker started 06:36:41 [06:36:41.166] INFO: prover-client:proving-broker Proving Broker started 06:36:41 [06:36:41.167] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7718b9afe3eb04c8 epochNumber=1 {"provingJobId":"1:BASE_PARITY:7718b9afe3eb04c8"} 06:36:41 [06:36:41.168] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testQ6H9yA/1 with map size 1073741824 06:36:41 [06:36:41.170] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:41 [06:36:41.186] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:7718b9afe3eb04c8 {"provingJobId":"1:BASE_PARITY:7718b9afe3eb04c8"} 06:36:41 [06:36:41.187] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:7718b9afe3eb04c8 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:7718b9afe3eb04c8"} 06:36:41 [06:36:41.187] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:7718b9afe3eb04c8 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:7718b9afe3eb04c8"} 06:36:41 [06:36:41.196] INFO: prover-client:proving-broker Proving Broker started 06:36:41 [06:36:41.197] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f805a588451458a6 epochNumber=1 {"provingJobId":"1:BASE_PARITY:f805a588451458a6"} 06:36:41 [06:36:41.198] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testtJSYYM/1 with map size 1073741824 06:36:41 [06:36:41.201] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:41 [06:36:41.225] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:f805a588451458a6 {"provingJobId":"1:BASE_PARITY:f805a588451458a6"} 06:36:41 [06:36:41.226] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:f805a588451458a6 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:f805a588451458a6"} 06:36:41 [06:36:41.236] INFO: prover-client:proving-broker Proving Broker started 06:36:41 [06:36:41.237] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:5da2973b9a19eef1 epochNumber=1 {"provingJobId":"1:BASE_PARITY:5da2973b9a19eef1"} 06:36:41 [06:36:41.238] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test0ttVaF/1 with map size 1073741824 06:36:41 [06:36:41.243] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:41 [06:36:41.263] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:5da2973b9a19eef1 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:5da2973b9a19eef1"} 06:36:41 [06:36:41.263] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:5da2973b9a19eef1 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:5da2973b9a19eef1"} 06:36:41 [06:36:41.273] INFO: prover-client:proving-broker Proving Broker started 06:36:41 [06:36:41.274] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:355b34507eb7a39f epochNumber=1 {"provingJobId":"1:BASE_PARITY:355b34507eb7a39f"} 06:36:41 [06:36:41.274] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testB0enoD/1 with map size 1073741824 06:36:41 [06:36:41.277] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:41 [06:36:41.295] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:355b34507eb7a39f type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:355b34507eb7a39f"} 06:36:41 [06:36:41.296] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:355b34507eb7a39f type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:355b34507eb7a39f"} 06:36:41 [06:36:41.309] INFO: prover-client:proving-broker Proving Broker started 06:36:41 [06:36:41.310] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:888ea6bdddcb672b epochNumber=0 {"provingJobId":"1:BASE_PARITY:888ea6bdddcb672b"} 06:36:41 [06:36:41.315] INFO: prover-client:proving-broker-database Creating broker database for epoch 0 at /tmp/proving-broker-testrcTDhB/0 with map size 1073741824 06:36:41 [06:36:41.318] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:41 [06:36:41.339] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:888ea6bdddcb672b epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:888ea6bdddcb672b"} 06:36:41 [06:36:41.340] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:5d2c7f132eabf9c9 epochNumber=0 {"provingJobId":"1:BASE_PARITY:5d2c7f132eabf9c9"} 06:36:41 [06:36:41.341] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:888ea6bdddcb672b epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:888ea6bdddcb672b"} 06:36:41 [06:36:41.341] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:009d4ee24f35828b epochNumber=0 {"provingJobId":"1:BASE_PARITY:009d4ee24f35828b"} 06:36:41 [06:36:41.362] INFO: prover-client:proving-broker Proving Broker started 06:36:41 [06:36:41.364] INFO: prover-client:proving-broker Proving Broker started 06:36:41 [06:36:41.365] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:10c84cb19c3ec842 epochNumber=2 {"provingJobId":"1:BASE_PARITY:10c84cb19c3ec842"} 06:36:41 [06:36:41.366] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-test8odmtc/2 with map size 1073741824 06:36:41 [06:36:41.369] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:41 [06:36:41.387] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:96f1480ce49c44e9 epochNumber=1 {"provingJobId":"1:BASE_PARITY:96f1480ce49c44e9"} 06:36:41 [06:36:41.387] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test8odmtc/1 with map size 1073741824 06:36:41 [06:36:41.389] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:41 [06:36:41.424] INFO: prover-client:proving-broker Proving Broker started 06:36:41 [06:36:41.424] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2ddfcdb72ca18a1c epochNumber=1 {"provingJobId":"1:BASE_PARITY:2ddfcdb72ca18a1c"} 06:36:41 [06:36:41.428] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testwyqWdA/1 with map size 1073741824 06:36:41 [06:36:41.430] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:41 [06:36:41.453] INFO: prover-client:proving-broker Proving Broker started 06:36:41 [06:36:41.454] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b2634325e8770f95 epochNumber=1 {"provingJobId":"1:BASE_PARITY:b2634325e8770f95"} 06:36:41 [06:36:41.455] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testzZPB8q/1 with map size 1073741824 06:36:41 [06:36:41.457] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:41 [06:36:41.475] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6284c8cc2b603aaf epochNumber=1 {"provingJobId":"1:BASE_PARITY:6284c8cc2b603aaf"} 06:36:41 [06:36:41.481] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3f94c2987708c476 epochNumber=2 {"provingJobId":"1:BASE_PARITY:3f94c2987708c476"} 06:36:41 [06:36:41.482] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testzZPB8q/2 with map size 1073741824 06:36:41 [06:36:41.484] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:41 [06:36:41.517] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ccc71de8d863b2a6 epochNumber=1 {"provingJobId":"1:BASE_PARITY:ccc71de8d863b2a6"} 06:36:41 [06:36:41.530] INFO: prover-client:proving-broker Proving Broker started 06:36:41 [06:36:41.531] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:55d4a9e823c08d13 epochNumber=1 {"provingJobId":"1:BASE_PARITY:55d4a9e823c08d13"} 06:36:41 [06:36:41.531] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testdY2vZy/1 with map size 1073741824 06:36:41 [06:36:41.536] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:41 [06:36:41.557] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1d90c9ea3832940c epochNumber=1 {"provingJobId":"1:BASE_PARITY:1d90c9ea3832940c"} 06:36:41 [06:36:41.563] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:93bf46613b51796e epochNumber=2 {"provingJobId":"1:BASE_PARITY:93bf46613b51796e"} 06:36:41 [06:36:41.563] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testdY2vZy/2 with map size 1073741824 06:36:41 [06:36:41.565] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:41 [06:36:41.581] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:36d7c6393dd5596a epochNumber=1 {"provingJobId":"1:BASE_PARITY:36d7c6393dd5596a"} 06:36:41 [06:36:41.591] INFO: prover-client:proving-broker Proving Broker started 06:36:41 [06:36:41.592] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7eb005a818a7bfa1 epochNumber=1 {"provingJobId":"1:BASE_PARITY:7eb005a818a7bfa1"} 06:36:41 [06:36:41.593] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testZ4RXr7/1 with map size 1073741824 06:36:41 [06:36:41.596] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:41 [06:36:41.628] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e5d25e5faec1a3d4 epochNumber=1 {"provingJobId":"1:BASE_PARITY:e5d25e5faec1a3d4"} 06:36:41 [06:36:41.635] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b9e41f9f6df9c7bc epochNumber=2 {"provingJobId":"1:BASE_PARITY:b9e41f9f6df9c7bc"} 06:36:41 [06:36:41.636] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testZ4RXr7/2 with map size 1073741824 06:36:41 [06:36:41.638] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:41 [06:36:41.656] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:cbe255be9c7bdb6e epochNumber=1 {"provingJobId":"1:BASE_PARITY:cbe255be9c7bdb6e"} 06:36:41 [06:36:41.668] INFO: prover-client:proving-broker Proving Broker started 06:36:41 [06:36:41.669] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d326908a8dfaa920 epochNumber=1 {"provingJobId":"1:BASE_PARITY:d326908a8dfaa920"} 06:36:41 [06:36:41.670] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test6wRr2Z/1 with map size 1073741824 06:36:41 [06:36:41.672] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:41 [06:36:41.706] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ced916e1ae9add8d epochNumber=1 {"provingJobId":"1:BASE_PARITY:ced916e1ae9add8d"} 06:36:41 [06:36:41.717] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:d326908a8dfaa920 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:d326908a8dfaa920"} 06:36:41 [06:36:41.732] INFO: prover-client:proving-broker Proving Broker started 06:36:41 [06:36:41.733] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:eaa5c98413763edb epochNumber=1 {"provingJobId":"1:BASE_PARITY:eaa5c98413763edb"} 06:36:41 [06:36:41.734] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testdpdgnW/1 with map size 1073741824 06:36:41 [06:36:41.736] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:41 [06:36:41.762] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d61fc0e7e867a22d epochNumber=1 {"provingJobId":"1:BASE_PARITY:d61fc0e7e867a22d"} 06:36:41 [06:36:41.769] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:eaa5c98413763edb type=BASE_PARITY totalAttempts=1 err=result {"provingJobId":"1:BASE_PARITY:eaa5c98413763edb"} 06:36:41 [06:36:41.777] INFO: prover-client:proving-broker Proving Broker started 06:36:41 [06:36:41.778] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:86363c7f670c868a epochNumber=1 {"provingJobId":"1:BASE_PARITY:86363c7f670c868a"} 06:36:41 [06:36:41.778] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test5qFU1k/1 with map size 1073741824 06:36:41 [06:36:41.780] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:41 [06:36:41.798] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:87e194525f0c30bc epochNumber=1 {"provingJobId":"1:BASE_PARITY:87e194525f0c30bc"} 06:36:41 [06:36:41.807] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:86363c7f670c868a type=BASE_PARITY retry=1 err=result {"provingJobId":"1:BASE_PARITY:86363c7f670c868a"} 06:36:41 [06:36:41.811] INFO: prover-client:proving-broker Proving Broker started 06:36:41 [06:36:41.812] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d56bafaf1133f88b epochNumber=1 {"provingJobId":"1:BASE_PARITY:d56bafaf1133f88b"} 06:36:41 [06:36:41.813] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testYv0Vgj/1 with map size 1073741824 06:36:41 [06:36:41.818] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:41 [06:36:41.836] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:d56bafaf1133f88b {"provingJobId":"1:BASE_PARITY:d56bafaf1133f88b"} 06:36:41 [06:36:41.836] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:d56bafaf1133f88b type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:d56bafaf1133f88b"} 06:36:41 [06:36:41.843] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a634d9aa0aefccfe epochNumber=1 {"provingJobId":"1:BASE_PARITY:a634d9aa0aefccfe"} 06:36:41 [06:36:41.849] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:d56bafaf1133f88b has already been completed {"provingJobId":"1:BASE_PARITY:d56bafaf1133f88b"} 06:36:41 [06:36:41.854] INFO: prover-client:proving-broker Proving Broker started 06:36:41 [06:36:41.855] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b1a225242925d305 epochNumber=1 {"provingJobId":"1:BASE_PARITY:b1a225242925d305"} 06:36:41 [06:36:41.855] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testkpUtY3/1 with map size 1073741824 06:36:41 [06:36:41.858] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:41 [06:36:41.877] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:727a5768cb26ea90 epochNumber=2 {"provingJobId":"1:BASE_PARITY:727a5768cb26ea90"} 06:36:41 [06:36:41.878] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testkpUtY3/2 with map size 1073741824 06:36:41 [06:36:41.882] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:42 [06:36:42.953] INFO: prover-client:proving-broker Proving Broker started 06:36:42 [06:36:42.961] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:b1a225242925d305 settled=false {"provingJobId":"1:BASE_PARITY:b1a225242925d305","status":"pending"} 06:36:42 [06:36:42.963] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:727a5768cb26ea90 settled=false {"provingJobId":"1:BASE_PARITY:727a5768cb26ea90","status":"pending"} 06:36:42 [06:36:42.965] INFO: prover-client:proving-broker Proving job id=1:BASE_PARITY:b1a225242925d305 type=BASE_PARITY startedAt=1750401401901 older agent has taken job {"provingJobId":"1:BASE_PARITY:b1a225242925d305"} 06:36:42 [06:36:42.965] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:b1a225242925d305 type=BASE_PARITY already being worked on by another agent. Sending new one {"provingJobId":"1:BASE_PARITY:b1a225242925d305"} 06:36:42 [06:36:42.970] INFO: prover-client:proving-broker Proving Broker started 06:36:42 [06:36:42.971] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0e374a7dc0821662 epochNumber=1 {"provingJobId":"1:BASE_PARITY:0e374a7dc0821662"} 06:36:42 [06:36:42.972] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testfrRcqR/1 with map size 1073741824 06:36:42 [06:36:42.974] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:42 [06:36:42.992] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0e2398abf740bed1 epochNumber=2 {"provingJobId":"1:BASE_PARITY:0e2398abf740bed1"} 06:36:42 [06:36:42.993] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testfrRcqR/2 with map size 1073741824 06:36:42 [06:36:42.995] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:44 [06:36:44.012] INFO: prover-client:proving-broker Proving Broker started 06:36:44 [06:36:44.015] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:0e374a7dc0821662 settled=false {"provingJobId":"1:BASE_PARITY:0e374a7dc0821662","status":"pending"} 06:36:44 [06:36:44.016] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:0e2398abf740bed1 settled=false {"provingJobId":"1:BASE_PARITY:0e2398abf740bed1","status":"pending"} 06:36:44 [06:36:44.017] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:0e374a7dc0821662 type=BASE_PARITY not found in the in-progress cache, adding it {"provingJobId":"1:BASE_PARITY:0e374a7dc0821662"} 06:36:44 [06:36:44.021] INFO: prover-client:proving-broker Proving Broker started 06:36:44 [06:36:44.021] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7bca5a44c0309c67 epochNumber=1 {"provingJobId":"1:BASE_PARITY:7bca5a44c0309c67"} 06:36:44 [06:36:44.022] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testLhZYCo/1 with map size 1073741824 06:36:44 [06:36:44.024] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:44 [06:36:44.040] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:db8bf3ecda2f16ca epochNumber=2 {"provingJobId":"1:BASE_PARITY:db8bf3ecda2f16ca"} 06:36:44 [06:36:44.041] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testLhZYCo/2 with map size 1073741824 06:36:44 [06:36:44.042] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:45 [06:36:45.058] INFO: prover-client:proving-broker Proving Broker started 06:36:45 [06:36:45.060] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:7bca5a44c0309c67 settled=false {"provingJobId":"1:BASE_PARITY:7bca5a44c0309c67","status":"pending"} 06:36:45 [06:36:45.061] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:db8bf3ecda2f16ca settled=false {"provingJobId":"1:BASE_PARITY:db8bf3ecda2f16ca","status":"pending"} 06:36:45 [06:36:45.062] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:7bca5a44c0309c67 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:7bca5a44c0309c67"} 06:36:45 [06:36:45.062] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:7bca5a44c0309c67 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:7bca5a44c0309c67"} 06:36:45 [06:36:45.072] INFO: prover-client:proving-broker Proving Broker started 06:36:45 [06:36:45.073] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a0c8113c81dd0959 epochNumber=1 {"provingJobId":"1:BASE_PARITY:a0c8113c81dd0959"} 06:36:45 [06:36:45.074] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testSOjux5/1 with map size 1073741824 06:36:45 [06:36:45.076] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:45 [06:36:45.093] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:193df16d136d788d epochNumber=2 {"provingJobId":"1:BASE_PARITY:193df16d136d788d"} 06:36:45 [06:36:45.094] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testSOjux5/2 with map size 1073741824 06:36:45 [06:36:45.096] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:45 [06:36:45.126] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:a0c8113c81dd0959 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:a0c8113c81dd0959"} 06:36:45 [06:36:45.133] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:193df16d136d788d type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:193df16d136d788d"} 06:36:45 [06:36:45.143] INFO: prover-client:proving-broker Proving Broker started 06:36:45 [06:36:45.144] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:46710e382f7bc508 epochNumber=1 {"provingJobId":"1:BASE_PARITY:46710e382f7bc508"} 06:36:45 [06:36:45.146] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testGdgENk/1 with map size 1073741824 06:36:45 [06:36:45.147] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:45 [06:36:45.163] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a84000be095cda38 epochNumber=2 {"provingJobId":"1:BASE_PARITY:a84000be095cda38"} 06:36:45 [06:36:45.164] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testGdgENk/2 with map size 1073741824 06:36:45 [06:36:45.166] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:45 [06:36:45.183] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:46710e382f7bc508 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:46710e382f7bc508"} 06:36:45 [06:36:45.183] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:46710e382f7bc508 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:46710e382f7bc508"} 06:36:45 [06:36:45.189] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:a84000be095cda38 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:a84000be095cda38"} 06:36:45 [06:36:45.198] INFO: prover-client:proving-broker Proving Broker started 06:36:45 [06:36:45.199] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:a2248339a7ded848 err=test error {"provingJoId":"1:BASE_PARITY:a2248339a7ded848"} 06:36:45 [06:36:45.202] INFO: prover-client:proving-broker Proving Broker started 06:36:45 [06:36:45.203] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:64221231c02f04cf not found {"provingJobId":"1:BASE_PARITY:64221231c02f04cf"} 06:36:45 [06:36:45.206] INFO: prover-client:proving-broker Proving Broker started 06:36:45 [06:36:45.206] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b8bca9900839e829 epochNumber=1 {"provingJobId":"1:BASE_PARITY:b8bca9900839e829"} 06:36:45 [06:36:45.208] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testm0ZP1e/1 with map size 1073741824 06:36:45 [06:36:45.211] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:45 [06:36:45.233] INFO: prover-client:proving-broker Proving Broker started 06:36:45 [06:36:45.234] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:324d181f3662adf3 epochNumber=1 {"provingJobId":"1:BASE_PARITY:324d181f3662adf3"} 06:36:45 [06:36:45.235] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test9Lo7TF/1 with map size 1073741824 06:36:45 [06:36:45.237] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:45 [06:36:45.360] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:324d181f3662adf3 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:324d181f3662adf3"} 06:36:45 [06:36:45.369] INFO: prover-client:proving-broker Proving Broker started 06:36:45 [06:36:45.370] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:03123c55f11dc724 epochNumber=1 {"provingJobId":"1:BASE_PARITY:03123c55f11dc724"} 06:36:45 [06:36:45.371] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testu4olZM/1 with map size 1073741824 06:36:45 [06:36:45.372] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:45 [06:36:45.496] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:03123c55f11dc724 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:03123c55f11dc724"} 06:36:45 [06:36:45.497] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e530b443e70a8050 epochNumber=10 {"provingJobId":"1:BASE_PARITY:e530b443e70a8050"} 06:36:45 [06:36:45.498] INFO: prover-client:proving-broker-database Creating broker database for epoch 10 at /tmp/proving-broker-testu4olZM/10 with map size 1073741824 06:36:45 [06:36:45.500] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:45 [06:36:45.522] INFO: prover-client:proving-broker Cleaned up jobs=1 06:36:45 [06:36:45.522] INFO: prover-client:proving-broker-database Deleting broker database for epoch 1 06:36:45 [06:36:45.650] INFO: prover-client:proving-broker Proving Broker started 06:36:45 [06:36:45.651] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:47fbb4d5192f0431 epochNumber=1 {"provingJobId":"1:BASE_PARITY:47fbb4d5192f0431"} 06:36:45 [06:36:45.652] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testL2WotF/1 with map size 1073741824 06:36:45 [06:36:45.654] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:45 [06:36:45.827] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:47fbb4d5192f0431 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:47fbb4d5192f0431"} 06:36:45 [06:36:45.878] INFO: prover-client:proving-broker Proving Broker started 06:36:45 [06:36:45.878] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:8294e06d54b91ad4 epochNumber=1 {"provingJobId":"1:BASE_PARITY:8294e06d54b91ad4"} 06:36:45 [06:36:45.879] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testtuacsL/1 with map size 1073741824 06:36:45 [06:36:45.880] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:45 [06:36:45.896] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:8294e06d54b91ad4 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:8294e06d54b91ad4"} 06:36:45 [06:36:45.900] INFO: prover-client:proving-broker Proving Broker started 06:36:45 [06:36:45.901] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c77dc8992ce38c87 epochNumber=1 {"provingJobId":"1:BASE_PARITY:c77dc8992ce38c87"} 06:36:45 [06:36:45.902] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testYq46Ia/1 with map size 1073741824 06:36:45 [06:36:45.903] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:45 [06:36:45.920] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:c77dc8992ce38c87 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:c77dc8992ce38c87"} 06:36:45 [06:36:45.921] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:c77dc8992ce38c87 type=BASE_PARITY totalAttempts=2 err=test error {"provingJobId":"1:BASE_PARITY:c77dc8992ce38c87"} 06:36:45 [06:36:45.930] INFO: prover-client:proving-broker Proving Broker started 06:36:45 [06:36:45.931] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6eb401b3a918f5ce epochNumber=1 {"provingJobId":"1:BASE_PARITY:6eb401b3a918f5ce"} 06:36:45 [06:36:45.932] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testY90k1Y/1 with map size 1073741824 06:36:45 [06:36:45.935] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:45 [06:36:45.951] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:6eb401b3a918f5ce type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:6eb401b3a918f5ce"} 06:36:45 [06:36:45.960] INFO: prover-client:proving-broker Proving Broker started 06:36:45 [06:36:45.961] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c88a06a26d042f05 epochNumber=1 {"provingJobId":"1:BASE_PARITY:c88a06a26d042f05"} 06:36:45 [06:36:45.962] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testhDW8OT/1 with map size 1073741824 06:36:45 [06:36:45.964] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:45 [06:36:45.980] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:c88a06a26d042f05 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:c88a06a26d042f05"} 06:36:45 [06:36:45.981] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d60580fb53ac5c70 epochNumber=3 {"provingJobId":"1:BASE_PARITY:d60580fb53ac5c70"} 06:36:45 [06:36:45.984] INFO: prover-client:proving-broker-database Creating broker database for epoch 3 at /tmp/proving-broker-testhDW8OT/3 with map size 1073741824 06:36:45 [06:36:45.985] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:46 [06:36:46.012] INFO: prover-client:proving-broker Cleaned up jobs=1 06:36:46 [06:36:46.013] INFO: prover-client:proving-broker-database Deleting broker database for epoch 1 06:36:46 [06:36:46.033] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:c88a06a26d042f05 err=test error {"provingJoId":"1:BASE_PARITY:c88a06a26d042f05"} 06:36:46 [06:36:46.055] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testsaOLyy/1 with map size 1073741824 06:36:46 [06:36:46.059] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:46 [06:36:46.078] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testsaOLyy/2 with map size 1073741824 06:36:46 [06:36:46.081] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:46 [06:36:46.098] INFO: prover-client:proving-broker Proving Broker started 06:36:46 [06:36:46.100] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:cede1e8a166b364f settled=false {"provingJobId":"1:BASE_PARITY:cede1e8a166b364f","status":"pending"} 06:36:46 [06:36:46.101] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:c5f5c6bff1bb9817 settled=false {"provingJobId":"1:BASE_PARITY:c5f5c6bff1bb9817","status":"pending"} 06:36:46 [06:36:46.112] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test6Vu9Gy/1 with map size 1073741824 06:36:46 [06:36:46.120] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:46 [06:36:46.141] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-test6Vu9Gy/2 with map size 1073741824 06:36:46 [06:36:46.144] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:46 [06:36:46.178] INFO: prover-client:proving-broker Proving Broker started 06:36:46 [06:36:46.180] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:7b10bd984cbb203a settled=true {"provingJobId":"1:BASE_PARITY:7b10bd984cbb203a","status":"fulfilled"} 06:36:46 [06:36:46.182] INFO: prover-client:proving-broker Restoring proving job id=2:BASE_PARITY:f57fb703cc0f6674 settled=true {"provingJobId":"2:BASE_PARITY:f57fb703cc0f6674","status":"fulfilled"} 06:36:46 [06:36:46.186] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testZxw3Sk/1 with map size 1073741824 06:36:46 [06:36:46.188] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:46 [06:36:46.220] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testZxw3Sk/2 with map size 1073741824 06:36:46 [06:36:46.225] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:46 [06:36:46.242] INFO: prover-client:proving-broker Proving Broker started 06:36:46 [06:36:46.244] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:ac1d2f1395f5a328 settled=true {"provingJobId":"1:BASE_PARITY:ac1d2f1395f5a328","status":"fulfilled"} 06:36:46 [06:36:46.246] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:112cdbf8c7e9f990 settled=false {"provingJobId":"1:BASE_PARITY:112cdbf8c7e9f990","status":"pending"} 06:36:46 [06:36:46.254] INFO: prover-client:proving-broker Proving Broker started 06:36:46 [06:36:46.254] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1f3d2fc4246dc10e epochNumber=1 {"provingJobId":"1:BASE_PARITY:1f3d2fc4246dc10e"} 06:36:46 [06:36:46.255] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test5myZes/1 with map size 1073741824 06:36:46 [06:36:46.260] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:46 [06:36:46.283] INFO: prover-client:proving-broker Proving Broker started 06:36:46 [06:36:46.284] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ca02e321e4c69574 epochNumber=1 {"provingJobId":"1:BASE_PARITY:ca02e321e4c69574"} 06:36:46 [06:36:46.285] ERROR: prover-client:proving-broker Failed to save proving job id=1:BASE_PARITY:ca02e321e4c69574: Error: db error: Error: db error 06:36:46 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1126:63) {"provingJobId":"1:BASE_PARITY:ca02e321e4c69574"} 06:36:46 [06:36:46.292] INFO: prover-client:proving-broker Proving Broker started 06:36:46 [06:36:46.293] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:660c0479470d95cd epochNumber=1 {"provingJobId":"1:BASE_PARITY:660c0479470d95cd"} 06:36:46 [06:36:46.294] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testIAB482/1 with map size 1073741824 06:36:46 [06:36:46.297] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:46 [06:36:46.325] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:660c0479470d95cd type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:660c0479470d95cd"} 06:36:46 [06:36:46.326] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:660c0479470d95cd type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:660c0479470d95cd"} 06:36:46 [06:36:46.341] INFO: prover-client:proving-broker Proving Broker started 06:36:46 [06:36:46.342] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f775bd813cdda489 epochNumber=1 {"provingJobId":"1:BASE_PARITY:f775bd813cdda489"} 06:36:46 [06:36:46.342] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test37Qe4r/1 with map size 1073741824 06:36:46 [06:36:46.347] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:46 [06:36:46.368] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:f775bd813cdda489 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:f775bd813cdda489"} 06:36:46 [06:36:46.369] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:f775bd813cdda489 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:f775bd813cdda489"} 06:36:46 [06:36:46.370] ERROR: prover-client:proving-broker Failed to save proving job result id=1:BASE_PARITY:f775bd813cdda489: Error: db error 06:36:46 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1159:69) {"provingJobId":"1:BASE_PARITY:f775bd813cdda489"} 06:36:46 [06:36:46.376] INFO: prover-client:proving-broker Proving Broker started 06:36:46 [06:36:46.376] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:423161fa3d82c7ec epochNumber=1 {"provingJobId":"1:BASE_PARITY:423161fa3d82c7ec"} 06:36:46 [06:36:46.379] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testGdJ8AK/1 with map size 1073741824 06:36:46 [06:36:46.381] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:46 [06:36:46.406] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:423161fa3d82c7ec type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:423161fa3d82c7ec"} 06:36:46 [06:36:46.407] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:423161fa3d82c7ec type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:423161fa3d82c7ec"} 06:36:46 [06:36:46.422] INFO: prover-client:proving-broker Proving Broker started 06:36:46 [06:36:46.423] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b5bff7b9918403e3 epochNumber=1 {"provingJobId":"1:BASE_PARITY:b5bff7b9918403e3"} 06:36:46 [06:36:46.425] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testifHNOx/1 with map size 1073741824 06:36:46 [06:36:46.428] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:46 [06:36:46.450] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:b5bff7b9918403e3 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:b5bff7b9918403e3"} 06:36:46 [06:36:46.451] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:b5bff7b9918403e3 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:b5bff7b9918403e3"} 06:36:46 [06:36:46.452] ERROR: prover-client:proving-broker Failed to save proving job error status id=1:BASE_PARITY:b5bff7b9918403e3 jobErr=test error: Error: db error 06:36:46 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1192:68) {"provingJobId":"1:BASE_PARITY:b5bff7b9918403e3"} 06:36:46 [06:36:46.456] INFO: prover-client:proving-broker Proving Broker started 06:36:46 [06:36:46.456] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:1da74a2cd59d3bbc not found {"provingJobId":"1:BASE_PARITY:1da74a2cd59d3bbc"} 06:36:46 [06:36:46.459] INFO: prover-client:proving-broker Proving Broker started 06:36:46 [06:36:46.460] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:2fa5eb78684b7e65 err=test error {"provingJoId":"1:BASE_PARITY:2fa5eb78684b7e65"} 06:36:46 [06:36:46.463] INFO: prover-client:proving-broker Proving Broker started 06:36:46 [06:36:46.474] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7caeb9c2eab1c72f epochNumber=1 {"provingJobId":"1:BASE_PARITY:7caeb9c2eab1c72f"} 06:36:46 [06:36:46.475] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testqL9kRo/1 with map size 1073741824 06:36:46 [06:36:46.479] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:46 [06:36:46.504] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:7caeb9c2eab1c72f type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:7caeb9c2eab1c72f"} 06:36:46 [06:36:46.505] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:7caeb9c2eab1c72f type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:7caeb9c2eab1c72f"} 06:36:46 [06:36:46.522] INFO: prover-client:proving-broker New proving job id=2:BASE_PARITY:ef0bbaf336559ff1 epochNumber=2 {"provingJobId":"2:BASE_PARITY:ef0bbaf336559ff1"} 06:36:46 [06:36:46.525] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testqL9kRo/2 with map size 1073741824 06:36:46 [06:36:46.531] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:46 [06:36:46.553] WARN: prover-client:proving-broker Proving job id=2:BASE_PARITY:ef0bbaf336559ff1 type=BASE_PARITY not in the in-progress set {"provingJobId":"2:BASE_PARITY:ef0bbaf336559ff1"} 06:36:46 [06:36:46.553] INFO: prover-client:proving-broker Proving job complete id=2:BASE_PARITY:ef0bbaf336559ff1 type=BASE_PARITY totalAttempts=1 {"provingJobId":"2:BASE_PARITY:ef0bbaf336559ff1"} 06:36:46 [06:36:46.623] INFO: prover-client:proving-broker New proving job id=3:BASE_PARITY:02ee4665440c946d epochNumber=3 {"provingJobId":"3:BASE_PARITY:02ee4665440c946d"} 06:36:46 [06:36:46.624] INFO: prover-client:proving-broker-database Creating broker database for epoch 3 at /tmp/proving-broker-testqL9kRo/3 with map size 1073741824 06:36:46 [06:36:46.627] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:46 [06:36:46.668] INFO: prover-client:proving-broker Cleaned up jobs=1 06:36:46 [06:36:46.668] INFO: prover-client:proving-broker-database Deleting broker database for epoch 1 06:36:46 [06:36:46.712] INFO: prover-client:proving-broker New proving job id=4:BASE_PARITY:054c0b8982f0c95c epochNumber=4 {"provingJobId":"4:BASE_PARITY:054c0b8982f0c95c"} 06:36:46 [06:36:46.713] INFO: prover-client:proving-broker-database Creating broker database for epoch 4 at /tmp/proving-broker-testqL9kRo/4 with map size 1073741824 06:36:46 [06:36:46.715] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:46 [06:36:46.747] INFO: prover-client:proving-broker Cleaned up jobs=1 06:36:46 [06:36:46.748] INFO: prover-client:proving-broker-database Deleting broker database for epoch 2 06:36:46 [06:36:46.796] INFO: prover-client:proving-broker New proving job id=5:BASE_PARITY:458521a73756f7fa epochNumber=5 {"provingJobId":"5:BASE_PARITY:458521a73756f7fa"} 06:36:46 [06:36:46.797] INFO: prover-client:proving-broker-database Creating broker database for epoch 5 at /tmp/proving-broker-testqL9kRo/5 with map size 1073741824 06:36:46 [06:36:46.802] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 06:36:46 [06:36:46.828] INFO: prover-client:proving-broker Cleaned up jobs=1 06:36:46 [06:36:46.828] INFO: prover-client:proving-broker-database Deleting broker database for epoch 3 06:36:46 PASS src/proving_broker/proving_broker.test.ts (13.11 s) 06:36:46 ProvingBroker 06:36:46 Producer API 06:36:46 ✓ refuses stale jobs (51 ms) 06:36:46 ✓ enqueues jobs (4 ms) 06:36:46 ✓ ignores duplicate jobs (3 ms) 06:36:46 ✓ reports correct status when enqueuing repeat jobs (4 ms) 06:36:46 ✓ throws an error in case of duplicate job IDs (28 ms) 06:36:46 ✓ returns not-found status for non-existing jobs (1 ms) 06:36:46 ✓ cancels jobs in queue (3 ms) 06:36:46 ✓ cancels jobs in-progress (3 ms) 06:36:46 ✓ returns job result if successful (3 ms) 06:36:46 ✓ returns job error if failed (2 ms) 06:36:46 ✓ correctly returns job status for concurrent writes (2 ms) 06:36:46 ✓ refuses stale jobs (34 ms) 06:36:46 ✓ enqueues jobs (29 ms) 06:36:46 ✓ ignores duplicate jobs (23 ms) 06:36:46 ✓ reports correct status when enqueuing repeat jobs (31 ms) 06:36:46 ✓ throws an error in case of duplicate job IDs (33 ms) 06:36:46 ✓ returns not-found status for non-existing jobs (3 ms) 06:36:46 ✓ cancels jobs in queue (29 ms) 06:36:46 ✓ cancels jobs in-progress (40 ms) 06:36:46 ✓ returns job result if successful (37 ms) 06:36:46 ✓ returns job error if failed (35 ms) 06:36:46 ✓ correctly returns job status for concurrent writes (54 ms) 06:36:46 Consumer API 06:36:46 ✓ returns undefined if no jobs are available (9 ms) 06:36:46 ✓ returns jobs in priority order (2 ms) 06:36:46 ✓ returns undefined if no jobs are available for the given allowList (2 ms) 06:36:46 ✓ returns a job if it is in the allowList (3 ms) 06:36:46 ✓ returns the most important job if it is in the allowList (2 ms) 06:36:46 ✓ returns any job if filter is empty (2 ms) 06:36:46 ✓ returns a new job when reporting job success (2 ms) 06:36:46 ✓ returns a new job when reporting permanent error (2 ms) 06:36:46 ✓ returns a new job when reporting retry-able error (1 ms) 06:36:46 ✓ returns a new job when reporting progress if current one is cancelled (3 ms) 06:36:46 ✓ returns a new job if job is already in progress elsewhere (1056 ms) 06:36:46 ✓ avoids sending the same job to a new agent after a restart (1011 ms) 06:36:46 ✓ avoids sending a completed job to a new agent after a restart (1005 ms) 06:36:46 ✓ tracks job result if in progress (2 ms) 06:36:46 ✓ tracks job result even if job is in queue (2 ms) 06:36:46 ✓ ignores reported job error if unknown job (1 ms) 06:36:46 ✓ ignores job result if unknown job (1 ms) 06:36:46 ✓ returns undefined if no jobs are available (3 ms) 06:36:46 ✓ returns jobs in priority order (55 ms) 06:36:46 ✓ returns undefined if no jobs are available for the given allowList (32 ms) 06:36:46 ✓ returns a job if it is in the allowList (76 ms) 06:36:46 ✓ returns the most important job if it is in the allowList (59 ms) 06:36:46 ✓ returns any job if filter is empty (77 ms) 06:36:46 ✓ returns a new job when reporting job success (64 ms) 06:36:46 ✓ returns a new job when reporting permanent error (45 ms) 06:36:46 ✓ returns a new job when reporting retry-able error (33 ms) 06:36:46 ✓ returns a new job when reporting progress if current one is cancelled (42 ms) 06:36:46 ✓ returns a new job if job is already in progress elsewhere (1115 ms) 06:36:46 ✓ avoids sending the same job to a new agent after a restart (1051 ms) 06:36:46 ✓ avoids sending a completed job to a new agent after a restart (1051 ms) 06:36:46 ✓ tracks job result if in progress (69 ms) 06:36:46 ✓ tracks job result even if job is in queue (55 ms) 06:36:46 ✓ ignores reported job error if unknown job (4 ms) 06:36:46 ✓ ignores job result if unknown job (4 ms) 06:36:46 Timeouts 06:36:46 ✓ tracks in progress jobs (2 ms) 06:36:46 ✓ re-enqueues jobs that time out (108 ms) 06:36:46 ✓ cancel stale jobs that time out (230 ms) 06:36:46 ✓ keeps the jobs in progress while it is alive (202 ms) 06:36:46 ✓ tracks in progress jobs (28 ms) 06:36:46 ✓ re-enqueues jobs that time out (134 ms) 06:36:46 ✓ cancel stale jobs that time out (280 ms) 06:36:46 ✓ keeps the jobs in progress while it is alive (228 ms) 06:36:46 Retries 06:36:46 ✓ retries jobs (2 ms) 06:36:46 ✓ retries up to a maximum number of times (2 ms) 06:36:46 ✓ passing retry=false does not retry (1 ms) 06:36:46 ✓ does not retry if job is stale (26 ms) 06:36:46 ✓ retries jobs (23 ms) 06:36:46 ✓ retries up to a maximum number of times (29 ms) 06:36:46 ✓ passing retry=false does not retry (30 ms) 06:36:46 ✓ does not retry if job is stale (85 ms) 06:36:46 Database management 06:36:46 ✓ re-enqueues proof requests on start (3 ms) 06:36:46 ✓ restores proof results on start (3 ms) 06:36:46 ✓ only re-enqueues unfinished jobs (2 ms) 06:36:46 ✓ saves job when enqueued (2 ms) 06:36:46 ✓ does not retain job if database fails to save (2 ms) 06:36:46 ✓ saves job result (2 ms) 06:36:46 ✓ saves result even if database fails to save (2 ms) 06:36:46 ✓ saves job error (2 ms) 06:36:46 ✓ saves job error even if database fails to save (2 ms) 06:36:46 ✓ does not save job result if job is unknown (1 ms) 06:36:46 ✓ does not save job error if job is unknown (1 ms) 06:36:46 ✓ cleans up old jobs periodically (261 ms) 06:36:46 ✓ re-enqueues proof requests on start (61 ms) 06:36:46 ✓ restores proof results on start (75 ms) 06:36:46 ✓ only re-enqueues unfinished jobs (65 ms) 06:36:46 ✓ saves job when enqueued (30 ms) 06:36:46 ✓ does not retain job if database fails to save (6 ms) 06:36:46 ✓ saves job result (49 ms) 06:36:46 ✓ saves result even if database fails to save (36 ms) 06:36:46 ✓ saves job error (46 ms) 06:36:46 ✓ saves job error even if database fails to save (34 ms) 06:36:46 ✓ does not save job result if job is unknown (3 ms) 06:36:46 ✓ does not save job error if job is unknown (3 ms) 06:36:46 ✓ cleans up old jobs periodically (413 ms) 06:36:46 06:36:46 Test Suites: 1 passed, 1 total 06:36:46 Tests: 96 passed, 96 total 06:36:46 Snapshots: 0 total 06:36:46 Time: 13.206 s 06:36:46 Ran all test suites matching prover-client/src/proving_broker/proving_broker.test.ts. 06:36:46 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?