Parent Log: http://ci.aztec-labs.com/963630247fdd03f4 Command: 69b6d6ef87c6fae3 yarn-project/scripts/run_test.sh prover-client/src/proving_broker/proving_broker.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/d4893155ff105399557b55c16450c39921c70d11 Env: REF_NAME=gh-readonly-queue/next/pr-15218-7edf16da6c056f9499e2dfd9c71fb9b7580f9bfc CURRENT_VERSION=0.87.6 CI_FULL=0 Date: Tue Jun 24 10:30:19 UTC 2025 System: ARCH=arm64 CPUS=64 MEM=247Gi HOSTNAME=pr-15218_arm64_a1-fast Resources: CPU_LIST=0-63 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_b95296ef06707e5f_next 10:30:21 [10:30:21.977] INFO: prover-client:proving-broker Proving Broker started 10:30:21 [10:30:21.982] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:aca927a49a51b69d epochNumber=42 {"provingJobId":"1:BASE_PARITY:aca927a49a51b69d"} 10:30:21 [10:30:21.985] WARN: prover-client:proving-broker Tried enqueueing stale proving job id=1:BASE_PARITY:773e2403ca38a891 epochNumber=1 {"provingJobId":"1:BASE_PARITY:773e2403ca38a891"} 10:30:22 [10:30:22.010] INFO: prover-client:proving-broker Proving Broker started 10:30:22 [10:30:22.011] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c98858d209cda407 epochNumber=1 {"provingJobId":"1:BASE_PARITY:c98858d209cda407"} 10:30:22 [10:30:22.012] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:4d90dd0c6b8d33f2 epochNumber=1 {"provingJobId":"1:BASE_PARITY:4d90dd0c6b8d33f2"} 10:30:22 [10:30:22.013] INFO: prover-client:proving-broker Proving Broker started 10:30:22 [10:30:22.014] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:8294c485fabdc92e epochNumber=1 {"provingJobId":"1:BASE_PARITY:8294c485fabdc92e"} 10:30:22 [10:30:22.015] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:8294c485fabdc92e epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:8294c485fabdc92e"} 10:30:22 [10:30:22.017] INFO: prover-client:proving-broker Proving Broker started 10:30:22 [10:30:22.018] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c95a1c80f3f6725c epochNumber=1 {"provingJobId":"1:BASE_PARITY:c95a1c80f3f6725c"} 10:30:22 [10:30:22.019] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:c95a1c80f3f6725c epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:c95a1c80f3f6725c"} 10:30:22 [10:30:22.020] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:c95a1c80f3f6725c type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:c95a1c80f3f6725c"} 10:30:22 [10:30:22.020] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:c95a1c80f3f6725c epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:c95a1c80f3f6725c"} 10:30:22 [10:30:22.021] INFO: prover-client:proving-broker Proving Broker started 10:30:22 [10:30:22.022] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c2273e32f9114d27 epochNumber=1 {"provingJobId":"1:BASE_PARITY:c2273e32f9114d27"} 10:30:22 [10:30:22.040] INFO: prover-client:proving-broker Proving Broker started 10:30:22 [10:30:22.042] INFO: prover-client:proving-broker Proving Broker started 10:30:22 [10:30:22.042] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1808e66c7fdb5dfe epochNumber=1 {"provingJobId":"1:BASE_PARITY:1808e66c7fdb5dfe"} 10:30:22 [10:30:22.043] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:1808e66c7fdb5dfe {"provingJobId":"1:BASE_PARITY:1808e66c7fdb5dfe"} 10:30:22 [10:30:22.043] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:1808e66c7fdb5dfe type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:1808e66c7fdb5dfe"} 10:30:22 [10:30:22.043] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:1808e66c7fdb5dfe type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:1808e66c7fdb5dfe"} 10:30:22 [10:30:22.045] INFO: prover-client:proving-broker Proving Broker started 10:30:22 [10:30:22.045] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ef816024c0a3719a epochNumber=1 {"provingJobId":"1:BASE_PARITY:ef816024c0a3719a"} 10:30:22 [10:30:22.046] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:ef816024c0a3719a {"provingJobId":"1:BASE_PARITY:ef816024c0a3719a"} 10:30:22 [10:30:22.046] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:ef816024c0a3719a type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:ef816024c0a3719a"} 10:30:22 [10:30:22.047] INFO: prover-client:proving-broker Proving Broker started 10:30:22 [10:30:22.048] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1fc915c75e3e6dc8 epochNumber=1 {"provingJobId":"1:BASE_PARITY:1fc915c75e3e6dc8"} 10:30:22 [10:30:22.049] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:1fc915c75e3e6dc8 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:1fc915c75e3e6dc8"} 10:30:22 [10:30:22.049] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:1fc915c75e3e6dc8 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:1fc915c75e3e6dc8"} 10:30:22 [10:30:22.050] INFO: prover-client:proving-broker Proving Broker started 10:30:22 [10:30:22.051] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:702a58daef792be8 epochNumber=1 {"provingJobId":"1:BASE_PARITY:702a58daef792be8"} 10:30:22 [10:30:22.051] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:702a58daef792be8 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:702a58daef792be8"} 10:30:22 [10:30:22.051] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:702a58daef792be8 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:702a58daef792be8"} 10:30:22 [10:30:22.052] INFO: prover-client:proving-broker Proving Broker started 10:30:22 [10:30:22.053] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:14c8ed9e3fd02653 epochNumber=0 {"provingJobId":"1:BASE_PARITY:14c8ed9e3fd02653"} 10:30:22 [10:30:22.053] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:14c8ed9e3fd02653 epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:14c8ed9e3fd02653"} 10:30:22 [10:30:22.053] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9f5ac18494e192e3 epochNumber=0 {"provingJobId":"1:BASE_PARITY:9f5ac18494e192e3"} 10:30:22 [10:30:22.053] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:14c8ed9e3fd02653 epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:14c8ed9e3fd02653"} 10:30:22 [10:30:22.054] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:80ac30cf9c406fb8 epochNumber=0 {"provingJobId":"1:BASE_PARITY:80ac30cf9c406fb8"} 10:30:22 [10:30:22.055] INFO: prover-client:proving-broker Proving Broker started 10:30:22 [10:30:22.056] INFO: prover-client:proving-broker Proving Broker started 10:30:22 [10:30:22.056] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:fa2d558159fbb161 epochNumber=2 {"provingJobId":"1:BASE_PARITY:fa2d558159fbb161"} 10:30:22 [10:30:22.056] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a1b71bbc39338dbf epochNumber=1 {"provingJobId":"1:BASE_PARITY:a1b71bbc39338dbf"} 10:30:22 [10:30:22.058] INFO: prover-client:proving-broker Proving Broker started 10:30:22 [10:30:22.058] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:719b8c54b1bf70ce epochNumber=1 {"provingJobId":"1:BASE_PARITY:719b8c54b1bf70ce"} 10:30:22 [10:30:22.063] INFO: prover-client:proving-broker Proving Broker started 10:30:22 [10:30:22.064] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a258e479166ce727 epochNumber=1 {"provingJobId":"1:BASE_PARITY:a258e479166ce727"} 10:30:22 [10:30:22.064] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:80c443dd38441154 epochNumber=1 {"provingJobId":"1:BASE_PARITY:80c443dd38441154"} 10:30:22 [10:30:22.064] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9c2d65fa3909ada7 epochNumber=2 {"provingJobId":"1:BASE_PARITY:9c2d65fa3909ada7"} 10:30:22 [10:30:22.065] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:29d17c1d5b207e53 epochNumber=1 {"provingJobId":"1:BASE_PARITY:29d17c1d5b207e53"} 10:30:22 [10:30:22.065] INFO: prover-client:proving-broker Proving Broker started 10:30:22 [10:30:22.066] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1f8f59a07285a7b6 epochNumber=1 {"provingJobId":"1:BASE_PARITY:1f8f59a07285a7b6"} 10:30:22 [10:30:22.066] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:602fabd88a0733dc epochNumber=1 {"provingJobId":"1:BASE_PARITY:602fabd88a0733dc"} 10:30:22 [10:30:22.067] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:56e9ec20e3d066f8 epochNumber=2 {"provingJobId":"1:BASE_PARITY:56e9ec20e3d066f8"} 10:30:22 [10:30:22.067] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:344a4b8116c3b669 epochNumber=1 {"provingJobId":"1:BASE_PARITY:344a4b8116c3b669"} 10:30:22 [10:30:22.068] INFO: prover-client:proving-broker Proving Broker started 10:30:22 [10:30:22.068] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b47f98ba7040ed90 epochNumber=1 {"provingJobId":"1:BASE_PARITY:b47f98ba7040ed90"} 10:30:22 [10:30:22.069] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:40142ee0942420f0 epochNumber=1 {"provingJobId":"1:BASE_PARITY:40142ee0942420f0"} 10:30:22 [10:30:22.069] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:46fa620b689d7707 epochNumber=2 {"provingJobId":"1:BASE_PARITY:46fa620b689d7707"} 10:30:22 [10:30:22.069] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1f580010a5ab3587 epochNumber=1 {"provingJobId":"1:BASE_PARITY:1f580010a5ab3587"} 10:30:22 [10:30:22.070] INFO: prover-client:proving-broker Proving Broker started 10:30:22 [10:30:22.071] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b26f3e309dfe5b7d epochNumber=1 {"provingJobId":"1:BASE_PARITY:b26f3e309dfe5b7d"} 10:30:22 [10:30:22.071] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b59aaf30e8f4765c epochNumber=1 {"provingJobId":"1:BASE_PARITY:b59aaf30e8f4765c"} 10:30:22 [10:30:22.071] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:b26f3e309dfe5b7d type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:b26f3e309dfe5b7d"} 10:30:22 [10:30:22.072] INFO: prover-client:proving-broker Proving Broker started 10:30:22 [10:30:22.073] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2bfc75d304e7afb2 epochNumber=1 {"provingJobId":"1:BASE_PARITY:2bfc75d304e7afb2"} 10:30:22 [10:30:22.073] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:30c934dbc7e1b4b0 epochNumber=1 {"provingJobId":"1:BASE_PARITY:30c934dbc7e1b4b0"} 10:30:22 [10:30:22.073] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:2bfc75d304e7afb2 type=BASE_PARITY totalAttempts=1 err=result {"provingJobId":"1:BASE_PARITY:2bfc75d304e7afb2"} 10:30:22 [10:30:22.074] INFO: prover-client:proving-broker Proving Broker started 10:30:22 [10:30:22.075] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9f22078a6a583064 epochNumber=1 {"provingJobId":"1:BASE_PARITY:9f22078a6a583064"} 10:30:22 [10:30:22.075] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f600072d79de4e7a epochNumber=1 {"provingJobId":"1:BASE_PARITY:f600072d79de4e7a"} 10:30:22 [10:30:22.075] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:9f22078a6a583064 type=BASE_PARITY retry=1 err=result {"provingJobId":"1:BASE_PARITY:9f22078a6a583064"} 10:30:22 [10:30:22.076] INFO: prover-client:proving-broker Proving Broker started 10:30:22 [10:30:22.077] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ecf51015fc371703 epochNumber=1 {"provingJobId":"1:BASE_PARITY:ecf51015fc371703"} 10:30:22 [10:30:22.077] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:ecf51015fc371703 {"provingJobId":"1:BASE_PARITY:ecf51015fc371703"} 10:30:22 [10:30:22.077] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:ecf51015fc371703 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:ecf51015fc371703"} 10:30:22 [10:30:22.078] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ae027f41a5a96895 epochNumber=1 {"provingJobId":"1:BASE_PARITY:ae027f41a5a96895"} 10:30:22 [10:30:22.078] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:ecf51015fc371703 has already been completed {"provingJobId":"1:BASE_PARITY:ecf51015fc371703"} 10:30:22 [10:30:22.079] INFO: prover-client:proving-broker Proving Broker started 10:30:22 [10:30:22.079] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e0213b913cc79d9b epochNumber=1 {"provingJobId":"1:BASE_PARITY:e0213b913cc79d9b"} 10:30:22 [10:30:22.080] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3bf4f902c4d54af6 epochNumber=2 {"provingJobId":"1:BASE_PARITY:3bf4f902c4d54af6"} 10:30:23 [10:30:23.131] INFO: prover-client:proving-broker Proving Broker started 10:30:23 [10:30:23.132] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:e0213b913cc79d9b settled=false {"provingJobId":"1:BASE_PARITY:e0213b913cc79d9b","status":"pending"} 10:30:23 [10:30:23.132] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:3bf4f902c4d54af6 settled=false {"provingJobId":"1:BASE_PARITY:3bf4f902c4d54af6","status":"pending"} 10:30:23 [10:30:23.133] INFO: prover-client:proving-broker Proving job id=1:BASE_PARITY:e0213b913cc79d9b type=BASE_PARITY startedAt=1750761022080 older agent has taken job {"provingJobId":"1:BASE_PARITY:e0213b913cc79d9b"} 10:30:23 [10:30:23.133] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:e0213b913cc79d9b type=BASE_PARITY already being worked on by another agent. Sending new one {"provingJobId":"1:BASE_PARITY:e0213b913cc79d9b"} 10:30:23 [10:30:23.134] INFO: prover-client:proving-broker Proving Broker started 10:30:23 [10:30:23.134] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:acb1a306a6574a07 epochNumber=1 {"provingJobId":"1:BASE_PARITY:acb1a306a6574a07"} 10:30:23 [10:30:23.135] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0748800cca76fe2c epochNumber=2 {"provingJobId":"1:BASE_PARITY:0748800cca76fe2c"} 10:30:24 [10:30:24.135] INFO: prover-client:proving-broker Proving Broker started 10:30:24 [10:30:24.135] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:acb1a306a6574a07 settled=false {"provingJobId":"1:BASE_PARITY:acb1a306a6574a07","status":"pending"} 10:30:24 [10:30:24.135] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:0748800cca76fe2c settled=false {"provingJobId":"1:BASE_PARITY:0748800cca76fe2c","status":"pending"} 10:30:24 [10:30:24.136] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:acb1a306a6574a07 type=BASE_PARITY not found in the in-progress cache, adding it {"provingJobId":"1:BASE_PARITY:acb1a306a6574a07"} 10:30:24 [10:30:24.137] INFO: prover-client:proving-broker Proving Broker started 10:30:24 [10:30:24.137] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:148c085f4b23f690 epochNumber=1 {"provingJobId":"1:BASE_PARITY:148c085f4b23f690"} 10:30:24 [10:30:24.138] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f34257ee5cbf5da4 epochNumber=2 {"provingJobId":"1:BASE_PARITY:f34257ee5cbf5da4"} 10:30:25 [10:30:25.139] INFO: prover-client:proving-broker Proving Broker started 10:30:25 [10:30:25.139] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:148c085f4b23f690 settled=false {"provingJobId":"1:BASE_PARITY:148c085f4b23f690","status":"pending"} 10:30:25 [10:30:25.139] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:f34257ee5cbf5da4 settled=false {"provingJobId":"1:BASE_PARITY:f34257ee5cbf5da4","status":"pending"} 10:30:25 [10:30:25.140] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:148c085f4b23f690 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:148c085f4b23f690"} 10:30:25 [10:30:25.140] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:148c085f4b23f690 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:148c085f4b23f690"} 10:30:25 [10:30:25.141] INFO: prover-client:proving-broker Proving Broker started 10:30:25 [10:30:25.142] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6e2f502fc83580c4 epochNumber=1 {"provingJobId":"1:BASE_PARITY:6e2f502fc83580c4"} 10:30:25 [10:30:25.142] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:04963193c1e60b45 epochNumber=2 {"provingJobId":"1:BASE_PARITY:04963193c1e60b45"} 10:30:25 [10:30:25.142] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:6e2f502fc83580c4 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:6e2f502fc83580c4"} 10:30:25 [10:30:25.143] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:04963193c1e60b45 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:04963193c1e60b45"} 10:30:25 [10:30:25.144] INFO: prover-client:proving-broker Proving Broker started 10:30:25 [10:30:25.144] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:bf9d06009985e4df epochNumber=1 {"provingJobId":"1:BASE_PARITY:bf9d06009985e4df"} 10:30:25 [10:30:25.144] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7bad27098abbeedd epochNumber=2 {"provingJobId":"1:BASE_PARITY:7bad27098abbeedd"} 10:30:25 [10:30:25.145] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:bf9d06009985e4df type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:bf9d06009985e4df"} 10:30:25 [10:30:25.145] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:bf9d06009985e4df type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:bf9d06009985e4df"} 10:30:25 [10:30:25.145] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:7bad27098abbeedd type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:7bad27098abbeedd"} 10:30:25 [10:30:25.146] INFO: prover-client:proving-broker Proving Broker started 10:30:25 [10:30:25.146] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:8c336ff0bd3b6acd err=test error {"provingJoId":"1:BASE_PARITY:8c336ff0bd3b6acd"} 10:30:25 [10:30:25.147] INFO: prover-client:proving-broker Proving Broker started 10:30:25 [10:30:25.148] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:9a39120580820fd3 not found {"provingJobId":"1:BASE_PARITY:9a39120580820fd3"} 10:30:25 [10:30:25.149] INFO: prover-client:proving-broker Proving Broker started 10:30:25 [10:30:25.149] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1d192750068a1519 epochNumber=1 {"provingJobId":"1:BASE_PARITY:1d192750068a1519"} 10:30:25 [10:30:25.150] INFO: prover-client:proving-broker Proving Broker started 10:30:25 [10:30:25.151] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:5931d320d4c368ef epochNumber=1 {"provingJobId":"1:BASE_PARITY:5931d320d4c368ef"} 10:30:25 [10:30:25.252] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:5931d320d4c368ef timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:5931d320d4c368ef"} 10:30:25 [10:30:25.259] INFO: prover-client:proving-broker Proving Broker started 10:30:25 [10:30:25.260] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:5119732bed5aba66 epochNumber=1 {"provingJobId":"1:BASE_PARITY:5119732bed5aba66"} 10:30:25 [10:30:25.385] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:5119732bed5aba66 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:5119732bed5aba66"} 10:30:25 [10:30:25.390] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:97aed0eb72abe4e9 epochNumber=10 {"provingJobId":"1:BASE_PARITY:97aed0eb72abe4e9"} 10:30:25 [10:30:25.411] INFO: prover-client:proving-broker Cleaned up jobs=1 10:30:25 [10:30:25.516] INFO: prover-client:proving-broker Proving Broker started 10:30:25 [10:30:25.517] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3089e4227ac90d91 epochNumber=1 {"provingJobId":"1:BASE_PARITY:3089e4227ac90d91"} 10:30:25 [10:30:25.669] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:3089e4227ac90d91 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:3089e4227ac90d91"} 10:30:25 [10:30:25.719] INFO: prover-client:proving-broker Proving Broker started 10:30:25 [10:30:25.720] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e6b51b75b7ebdfe6 epochNumber=1 {"provingJobId":"1:BASE_PARITY:e6b51b75b7ebdfe6"} 10:30:25 [10:30:25.720] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:e6b51b75b7ebdfe6 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:e6b51b75b7ebdfe6"} 10:30:25 [10:30:25.721] INFO: prover-client:proving-broker Proving Broker started 10:30:25 [10:30:25.722] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6971a973773708d7 epochNumber=1 {"provingJobId":"1:BASE_PARITY:6971a973773708d7"} 10:30:25 [10:30:25.722] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:6971a973773708d7 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:6971a973773708d7"} 10:30:25 [10:30:25.723] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:6971a973773708d7 type=BASE_PARITY totalAttempts=2 err=test error {"provingJobId":"1:BASE_PARITY:6971a973773708d7"} 10:30:25 [10:30:25.723] INFO: prover-client:proving-broker Proving Broker started 10:30:25 [10:30:25.724] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0f6ae92ddf308eb7 epochNumber=1 {"provingJobId":"1:BASE_PARITY:0f6ae92ddf308eb7"} 10:30:25 [10:30:25.724] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:0f6ae92ddf308eb7 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:0f6ae92ddf308eb7"} 10:30:25 [10:30:25.725] INFO: prover-client:proving-broker Proving Broker started 10:30:25 [10:30:25.725] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e30ca9479efee255 epochNumber=1 {"provingJobId":"1:BASE_PARITY:e30ca9479efee255"} 10:30:25 [10:30:25.726] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:e30ca9479efee255 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:e30ca9479efee255"} 10:30:25 [10:30:25.726] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:abecb135bcf438d7 epochNumber=3 {"provingJobId":"1:BASE_PARITY:abecb135bcf438d7"} 10:30:25 [10:30:25.750] INFO: prover-client:proving-broker Cleaned up jobs=1 10:30:25 [10:30:25.752] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:e30ca9479efee255 err=test error {"provingJoId":"1:BASE_PARITY:e30ca9479efee255"} 10:30:25 [10:30:25.753] INFO: prover-client:proving-broker Proving Broker started 10:30:25 [10:30:25.753] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:d2a38fb9ce2873c6 settled=false {"provingJobId":"1:BASE_PARITY:d2a38fb9ce2873c6","status":"pending"} 10:30:25 [10:30:25.754] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:93a9f6b2a40c6f1a settled=false {"provingJobId":"1:BASE_PARITY:93a9f6b2a40c6f1a","status":"pending"} 10:30:25 [10:30:25.756] INFO: prover-client:proving-broker Proving Broker started 10:30:25 [10:30:25.756] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:0971762532556a57 settled=true {"provingJobId":"1:BASE_PARITY:0971762532556a57","status":"fulfilled"} 10:30:25 [10:30:25.756] INFO: prover-client:proving-broker Restoring proving job id=2:BASE_PARITY:cb5bcc941ec143e5 settled=true {"provingJobId":"2:BASE_PARITY:cb5bcc941ec143e5","status":"fulfilled"} 10:30:25 [10:30:25.757] INFO: prover-client:proving-broker Proving Broker started 10:30:25 [10:30:25.758] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:964fadde0273748a settled=true {"provingJobId":"1:BASE_PARITY:964fadde0273748a","status":"fulfilled"} 10:30:25 [10:30:25.758] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:fe01b848fbc81e2c settled=false {"provingJobId":"1:BASE_PARITY:fe01b848fbc81e2c","status":"pending"} 10:30:25 [10:30:25.759] INFO: prover-client:proving-broker Proving Broker started 10:30:25 [10:30:25.760] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:4bed0b914f4cbc78 epochNumber=1 {"provingJobId":"1:BASE_PARITY:4bed0b914f4cbc78"} 10:30:25 [10:30:25.761] INFO: prover-client:proving-broker Proving Broker started 10:30:25 [10:30:25.762] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:55d78d182f75db2f epochNumber=1 {"provingJobId":"1:BASE_PARITY:55d78d182f75db2f"} 10:30:25 [10:30:25.763] ERROR: prover-client:proving-broker Failed to save proving job id=1:BASE_PARITY:55d78d182f75db2f: Error: db error: Error: db error 10:30:25 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1126:63) {"provingJobId":"1:BASE_PARITY:55d78d182f75db2f"} 10:30:25 [10:30:25.764] INFO: prover-client:proving-broker Proving Broker started 10:30:25 [10:30:25.764] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:bc5c685c93d7f287 epochNumber=1 {"provingJobId":"1:BASE_PARITY:bc5c685c93d7f287"} 10:30:25 [10:30:25.764] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:bc5c685c93d7f287 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:bc5c685c93d7f287"} 10:30:25 [10:30:25.765] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:bc5c685c93d7f287 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:bc5c685c93d7f287"} 10:30:25 [10:30:25.766] INFO: prover-client:proving-broker Proving Broker started 10:30:25 [10:30:25.766] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b6bab2a43ea61c55 epochNumber=1 {"provingJobId":"1:BASE_PARITY:b6bab2a43ea61c55"} 10:30:25 [10:30:25.766] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:b6bab2a43ea61c55 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:b6bab2a43ea61c55"} 10:30:25 [10:30:25.767] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:b6bab2a43ea61c55 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:b6bab2a43ea61c55"} 10:30:25 [10:30:25.767] ERROR: prover-client:proving-broker Failed to save proving job result id=1:BASE_PARITY:b6bab2a43ea61c55: Error: db error 10:30:25 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1159:69) {"provingJobId":"1:BASE_PARITY:b6bab2a43ea61c55"} 10:30:25 [10:30:25.768] INFO: prover-client:proving-broker Proving Broker started 10:30:25 [10:30:25.769] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:5aaf5c8c0918e188 epochNumber=1 {"provingJobId":"1:BASE_PARITY:5aaf5c8c0918e188"} 10:30:25 [10:30:25.769] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:5aaf5c8c0918e188 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:5aaf5c8c0918e188"} 10:30:25 [10:30:25.769] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:5aaf5c8c0918e188 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:5aaf5c8c0918e188"} 10:30:25 [10:30:25.770] INFO: prover-client:proving-broker Proving Broker started 10:30:25 [10:30:25.771] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:22ba1183a282267b epochNumber=1 {"provingJobId":"1:BASE_PARITY:22ba1183a282267b"} 10:30:25 [10:30:25.771] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:22ba1183a282267b type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:22ba1183a282267b"} 10:30:25 [10:30:25.771] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:22ba1183a282267b type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:22ba1183a282267b"} 10:30:25 [10:30:25.772] ERROR: prover-client:proving-broker Failed to save proving job error status id=1:BASE_PARITY:22ba1183a282267b jobErr=test error: Error: db error 10:30:25 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1192:68) {"provingJobId":"1:BASE_PARITY:22ba1183a282267b"} 10:30:25 [10:30:25.773] INFO: prover-client:proving-broker Proving Broker started 10:30:25 [10:30:25.773] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:d3ac36c178fd8dac not found {"provingJobId":"1:BASE_PARITY:d3ac36c178fd8dac"} 10:30:25 [10:30:25.777] INFO: prover-client:proving-broker Proving Broker started 10:30:25 [10:30:25.778] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:6368118e2c5593f4 err=test error {"provingJoId":"1:BASE_PARITY:6368118e2c5593f4"} 10:30:25 [10:30:25.779] INFO: prover-client:proving-broker Proving Broker started 10:30:25 [10:30:25.789] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:122a7ba4f5ee267b epochNumber=1 {"provingJobId":"1:BASE_PARITY:122a7ba4f5ee267b"} 10:30:25 [10:30:25.789] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:122a7ba4f5ee267b type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:122a7ba4f5ee267b"} 10:30:25 [10:30:25.789] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:122a7ba4f5ee267b type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:122a7ba4f5ee267b"} 10:30:25 [10:30:25.799] INFO: prover-client:proving-broker New proving job id=2:BASE_PARITY:01a53e27c8adb26c epochNumber=2 {"provingJobId":"2:BASE_PARITY:01a53e27c8adb26c"} 10:30:25 [10:30:25.799] WARN: prover-client:proving-broker Proving job id=2:BASE_PARITY:01a53e27c8adb26c type=BASE_PARITY not in the in-progress set {"provingJobId":"2:BASE_PARITY:01a53e27c8adb26c"} 10:30:25 [10:30:25.799] INFO: prover-client:proving-broker Proving job complete id=2:BASE_PARITY:01a53e27c8adb26c type=BASE_PARITY totalAttempts=1 {"provingJobId":"2:BASE_PARITY:01a53e27c8adb26c"} 10:30:25 [10:30:25.861] INFO: prover-client:proving-broker New proving job id=3:BASE_PARITY:69e27ecad746279a epochNumber=3 {"provingJobId":"3:BASE_PARITY:69e27ecad746279a"} 10:30:25 [10:30:25.880] INFO: prover-client:proving-broker Cleaned up jobs=1 10:30:25 [10:30:25.921] INFO: prover-client:proving-broker New proving job id=4:BASE_PARITY:b99265c69f0fad3b epochNumber=4 {"provingJobId":"4:BASE_PARITY:b99265c69f0fad3b"} 10:30:25 [10:30:25.931] INFO: prover-client:proving-broker Cleaned up jobs=1 10:30:25 [10:30:25.982] INFO: prover-client:proving-broker New proving job id=5:BASE_PARITY:8ad3d538079fee8a epochNumber=5 {"provingJobId":"5:BASE_PARITY:8ad3d538079fee8a"} 10:30:26 [10:30:26.007] INFO: prover-client:proving-broker Cleaned up jobs=1 10:30:26 [10:30:26.036] INFO: prover-client:proving-broker Proving Broker started 10:30:26 [10:30:26.037] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f63b10bfcca1a6f1 epochNumber=42 {"provingJobId":"1:BASE_PARITY:f63b10bfcca1a6f1"} 10:30:26 [10:30:26.037] INFO: prover-client:proving-broker-database Creating broker database for epoch 42 at /tmp/proving-broker-testpJDCka/42 with map size 1073741824 10:30:26 [10:30:26.041] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:26 [10:30:26.063] WARN: prover-client:proving-broker Tried enqueueing stale proving job id=1:BASE_PARITY:495357b12c9cac84 epochNumber=1 {"provingJobId":"1:BASE_PARITY:495357b12c9cac84"} 10:30:26 [10:30:26.066] INFO: prover-client:proving-broker Proving Broker started 10:30:26 [10:30:26.067] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a5ffc2797995c66c epochNumber=1 {"provingJobId":"1:BASE_PARITY:a5ffc2797995c66c"} 10:30:26 [10:30:26.067] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test0AIztA/1 with map size 1073741824 10:30:26 [10:30:26.068] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:26 [10:30:26.088] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a0353fc157fce143 epochNumber=1 {"provingJobId":"1:BASE_PARITY:a0353fc157fce143"} 10:30:26 [10:30:26.097] INFO: prover-client:proving-broker Proving Broker started 10:30:26 [10:30:26.097] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3d976168e35f010d epochNumber=1 {"provingJobId":"1:BASE_PARITY:3d976168e35f010d"} 10:30:26 [10:30:26.099] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test2S62Wo/1 with map size 1073741824 10:30:26 [10:30:26.100] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:26 [10:30:26.119] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:3d976168e35f010d epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:3d976168e35f010d"} 10:30:26 [10:30:26.121] INFO: prover-client:proving-broker Proving Broker started 10:30:26 [10:30:26.122] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ecae968f56b7053c epochNumber=1 {"provingJobId":"1:BASE_PARITY:ecae968f56b7053c"} 10:30:26 [10:30:26.123] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testXUaod4/1 with map size 1073741824 10:30:26 [10:30:26.124] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:26 [10:30:26.143] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:ecae968f56b7053c epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:ecae968f56b7053c"} 10:30:26 [10:30:26.144] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:ecae968f56b7053c type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:ecae968f56b7053c"} 10:30:26 [10:30:26.150] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:ecae968f56b7053c epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:ecae968f56b7053c"} 10:30:26 [10:30:26.152] INFO: prover-client:proving-broker Proving Broker started 10:30:26 [10:30:26.153] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:76362d8d853b59d8 epochNumber=1 {"provingJobId":"1:BASE_PARITY:76362d8d853b59d8"} 10:30:26 [10:30:26.154] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testygLCBj/1 with map size 1073741824 10:30:26 [10:30:26.155] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:26 [10:30:26.174] INFO: prover-client:proving-broker Proving Broker started 10:30:26 [10:30:26.176] INFO: prover-client:proving-broker Proving Broker started 10:30:26 [10:30:26.177] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:dd2e1ced42d9564e epochNumber=1 {"provingJobId":"1:BASE_PARITY:dd2e1ced42d9564e"} 10:30:26 [10:30:26.177] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testLIoaCo/1 with map size 1073741824 10:30:26 [10:30:26.178] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:26 [10:30:26.194] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:dd2e1ced42d9564e {"provingJobId":"1:BASE_PARITY:dd2e1ced42d9564e"} 10:30:26 [10:30:26.195] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:dd2e1ced42d9564e type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:dd2e1ced42d9564e"} 10:30:26 [10:30:26.195] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:dd2e1ced42d9564e type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:dd2e1ced42d9564e"} 10:30:26 [10:30:26.202] INFO: prover-client:proving-broker Proving Broker started 10:30:26 [10:30:26.202] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f037c39168e66d46 epochNumber=1 {"provingJobId":"1:BASE_PARITY:f037c39168e66d46"} 10:30:26 [10:30:26.203] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testBF9i3R/1 with map size 1073741824 10:30:26 [10:30:26.205] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:26 [10:30:26.220] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:f037c39168e66d46 {"provingJobId":"1:BASE_PARITY:f037c39168e66d46"} 10:30:26 [10:30:26.220] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:f037c39168e66d46 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:f037c39168e66d46"} 10:30:26 [10:30:26.227] INFO: prover-client:proving-broker Proving Broker started 10:30:26 [10:30:26.227] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a8ab7df663c34f7d epochNumber=1 {"provingJobId":"1:BASE_PARITY:a8ab7df663c34f7d"} 10:30:26 [10:30:26.228] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testtLpzyu/1 with map size 1073741824 10:30:26 [10:30:26.230] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:26 [10:30:26.245] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:a8ab7df663c34f7d type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:a8ab7df663c34f7d"} 10:30:26 [10:30:26.246] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:a8ab7df663c34f7d type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:a8ab7df663c34f7d"} 10:30:26 [10:30:26.254] INFO: prover-client:proving-broker Proving Broker started 10:30:26 [10:30:26.254] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a417633073ef3bcf epochNumber=1 {"provingJobId":"1:BASE_PARITY:a417633073ef3bcf"} 10:30:26 [10:30:26.255] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testof0NbF/1 with map size 1073741824 10:30:26 [10:30:26.258] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:26 [10:30:26.273] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:a417633073ef3bcf type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:a417633073ef3bcf"} 10:30:26 [10:30:26.273] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:a417633073ef3bcf type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:a417633073ef3bcf"} 10:30:26 [10:30:26.282] INFO: prover-client:proving-broker Proving Broker started 10:30:26 [10:30:26.282] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:45b6f49e7be48376 epochNumber=0 {"provingJobId":"1:BASE_PARITY:45b6f49e7be48376"} 10:30:26 [10:30:26.283] INFO: prover-client:proving-broker-database Creating broker database for epoch 0 at /tmp/proving-broker-testmvjpJn/0 with map size 1073741824 10:30:26 [10:30:26.284] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:26 [10:30:26.300] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:45b6f49e7be48376 epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:45b6f49e7be48376"} 10:30:26 [10:30:26.301] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:46f1f515af448e91 epochNumber=0 {"provingJobId":"1:BASE_PARITY:46f1f515af448e91"} 10:30:26 [10:30:26.301] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:45b6f49e7be48376 epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:45b6f49e7be48376"} 10:30:26 [10:30:26.301] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:5ade27e1f2beb1d4 epochNumber=0 {"provingJobId":"1:BASE_PARITY:5ade27e1f2beb1d4"} 10:30:26 [10:30:26.313] INFO: prover-client:proving-broker Proving Broker started 10:30:26 [10:30:26.315] INFO: prover-client:proving-broker Proving Broker started 10:30:26 [10:30:26.315] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3e10db761f1d8911 epochNumber=2 {"provingJobId":"1:BASE_PARITY:3e10db761f1d8911"} 10:30:26 [10:30:26.315] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testYfTxu3/2 with map size 1073741824 10:30:26 [10:30:26.317] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:26 [10:30:26.330] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7388e7b04421dfc4 epochNumber=1 {"provingJobId":"1:BASE_PARITY:7388e7b04421dfc4"} 10:30:26 [10:30:26.331] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testYfTxu3/1 with map size 1073741824 10:30:26 [10:30:26.333] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:26 [10:30:26.349] INFO: prover-client:proving-broker Proving Broker started 10:30:26 [10:30:26.349] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:08d90f5059fd90d7 epochNumber=1 {"provingJobId":"1:BASE_PARITY:08d90f5059fd90d7"} 10:30:26 [10:30:26.350] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testLQmURl/1 with map size 1073741824 10:30:26 [10:30:26.351] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:26 [10:30:26.367] INFO: prover-client:proving-broker Proving Broker started 10:30:26 [10:30:26.367] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:124925ff95f07b55 epochNumber=1 {"provingJobId":"1:BASE_PARITY:124925ff95f07b55"} 10:30:26 [10:30:26.368] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test3I9UTD/1 with map size 1073741824 10:30:26 [10:30:26.369] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:26 [10:30:26.384] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7d371dab84333c49 epochNumber=1 {"provingJobId":"1:BASE_PARITY:7d371dab84333c49"} 10:30:26 [10:30:26.389] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2a169c06228dd84f epochNumber=2 {"provingJobId":"1:BASE_PARITY:2a169c06228dd84f"} 10:30:26 [10:30:26.389] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-test3I9UTD/2 with map size 1073741824 10:30:26 [10:30:26.390] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:26 [10:30:26.405] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:aeca72333fd2937c epochNumber=1 {"provingJobId":"1:BASE_PARITY:aeca72333fd2937c"} 10:30:26 [10:30:26.412] INFO: prover-client:proving-broker Proving Broker started 10:30:26 [10:30:26.412] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:18cec78ad2da075a epochNumber=1 {"provingJobId":"1:BASE_PARITY:18cec78ad2da075a"} 10:30:26 [10:30:26.413] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testmb9D3n/1 with map size 1073741824 10:30:26 [10:30:26.414] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:26 [10:30:26.428] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1196d9be71cc4a61 epochNumber=1 {"provingJobId":"1:BASE_PARITY:1196d9be71cc4a61"} 10:30:26 [10:30:26.433] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6c0b82353d6ca90f epochNumber=2 {"provingJobId":"1:BASE_PARITY:6c0b82353d6ca90f"} 10:30:26 [10:30:26.433] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testmb9D3n/2 with map size 1073741824 10:30:26 [10:30:26.434] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:26 [10:30:26.448] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ea3bd26aab9b671e epochNumber=1 {"provingJobId":"1:BASE_PARITY:ea3bd26aab9b671e"} 10:30:26 [10:30:26.455] INFO: prover-client:proving-broker Proving Broker started 10:30:26 [10:30:26.456] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:24d118b6cc31834f epochNumber=1 {"provingJobId":"1:BASE_PARITY:24d118b6cc31834f"} 10:30:26 [10:30:26.456] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test7GH3BH/1 with map size 1073741824 10:30:26 [10:30:26.457] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:26 [10:30:26.470] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:bb60417e6d50a006 epochNumber=1 {"provingJobId":"1:BASE_PARITY:bb60417e6d50a006"} 10:30:26 [10:30:26.477] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:85b1261b64ed50b7 epochNumber=2 {"provingJobId":"1:BASE_PARITY:85b1261b64ed50b7"} 10:30:26 [10:30:26.477] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-test7GH3BH/2 with map size 1073741824 10:30:26 [10:30:26.478] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:26 [10:30:26.493] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7faa08d88ad2fdbd epochNumber=1 {"provingJobId":"1:BASE_PARITY:7faa08d88ad2fdbd"} 10:30:26 [10:30:26.500] INFO: prover-client:proving-broker Proving Broker started 10:30:26 [10:30:26.501] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7a92963e32926ba6 epochNumber=1 {"provingJobId":"1:BASE_PARITY:7a92963e32926ba6"} 10:30:26 [10:30:26.501] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testf0JPIf/1 with map size 1073741824 10:30:26 [10:30:26.502] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:26 [10:30:26.516] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3c80f4c588d1ada2 epochNumber=1 {"provingJobId":"1:BASE_PARITY:3c80f4c588d1ada2"} 10:30:26 [10:30:26.521] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:7a92963e32926ba6 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:7a92963e32926ba6"} 10:30:26 [10:30:26.530] INFO: prover-client:proving-broker Proving Broker started 10:30:26 [10:30:26.530] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:21ee8296e551356b epochNumber=1 {"provingJobId":"1:BASE_PARITY:21ee8296e551356b"} 10:30:26 [10:30:26.531] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testeGlMIW/1 with map size 1073741824 10:30:26 [10:30:26.534] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:26 [10:30:26.553] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a4d070dc169363a5 epochNumber=1 {"provingJobId":"1:BASE_PARITY:a4d070dc169363a5"} 10:30:26 [10:30:26.559] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:21ee8296e551356b type=BASE_PARITY totalAttempts=1 err=result {"provingJobId":"1:BASE_PARITY:21ee8296e551356b"} 10:30:26 [10:30:26.567] INFO: prover-client:proving-broker Proving Broker started 10:30:26 [10:30:26.567] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:935cfe3efc01a887 epochNumber=1 {"provingJobId":"1:BASE_PARITY:935cfe3efc01a887"} 10:30:26 [10:30:26.568] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testtLbufp/1 with map size 1073741824 10:30:26 [10:30:26.570] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:26 [10:30:26.592] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:372f5ccca5e5e5ea epochNumber=1 {"provingJobId":"1:BASE_PARITY:372f5ccca5e5e5ea"} 10:30:26 [10:30:26.598] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:935cfe3efc01a887 type=BASE_PARITY retry=1 err=result {"provingJobId":"1:BASE_PARITY:935cfe3efc01a887"} 10:30:26 [10:30:26.601] INFO: prover-client:proving-broker Proving Broker started 10:30:26 [10:30:26.601] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:8427fb82321ccfa0 epochNumber=1 {"provingJobId":"1:BASE_PARITY:8427fb82321ccfa0"} 10:30:26 [10:30:26.603] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test2JYplE/1 with map size 1073741824 10:30:26 [10:30:26.605] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:26 [10:30:26.625] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:8427fb82321ccfa0 {"provingJobId":"1:BASE_PARITY:8427fb82321ccfa0"} 10:30:26 [10:30:26.625] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:8427fb82321ccfa0 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:8427fb82321ccfa0"} 10:30:26 [10:30:26.632] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:416a70c6493e0c0f epochNumber=1 {"provingJobId":"1:BASE_PARITY:416a70c6493e0c0f"} 10:30:26 [10:30:26.639] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:8427fb82321ccfa0 has already been completed {"provingJobId":"1:BASE_PARITY:8427fb82321ccfa0"} 10:30:26 [10:30:26.642] INFO: prover-client:proving-broker Proving Broker started 10:30:26 [10:30:26.643] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:247c74f6b8df0b8f epochNumber=1 {"provingJobId":"1:BASE_PARITY:247c74f6b8df0b8f"} 10:30:26 [10:30:26.645] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testOlB04d/1 with map size 1073741824 10:30:26 [10:30:26.646] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:26 [10:30:26.665] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:21297816e8aafb75 epochNumber=2 {"provingJobId":"1:BASE_PARITY:21297816e8aafb75"} 10:30:26 [10:30:26.666] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testOlB04d/2 with map size 1073741824 10:30:26 [10:30:26.668] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:27 [10:30:27.738] INFO: prover-client:proving-broker Proving Broker started 10:30:27 [10:30:27.742] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:247c74f6b8df0b8f settled=false {"provingJobId":"1:BASE_PARITY:247c74f6b8df0b8f","status":"pending"} 10:30:27 [10:30:27.744] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:21297816e8aafb75 settled=false {"provingJobId":"1:BASE_PARITY:21297816e8aafb75","status":"pending"} 10:30:27 [10:30:27.744] INFO: prover-client:proving-broker Proving job id=1:BASE_PARITY:247c74f6b8df0b8f type=BASE_PARITY startedAt=1750761026687 older agent has taken job {"provingJobId":"1:BASE_PARITY:247c74f6b8df0b8f"} 10:30:27 [10:30:27.745] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:247c74f6b8df0b8f type=BASE_PARITY already being worked on by another agent. Sending new one {"provingJobId":"1:BASE_PARITY:247c74f6b8df0b8f"} 10:30:27 [10:30:27.747] INFO: prover-client:proving-broker Proving Broker started 10:30:27 [10:30:27.748] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:36f76ce43fcf5bba epochNumber=1 {"provingJobId":"1:BASE_PARITY:36f76ce43fcf5bba"} 10:30:27 [10:30:27.749] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testwR8cB1/1 with map size 1073741824 10:30:27 [10:30:27.750] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:27 [10:30:27.765] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:258df3a76fe74f80 epochNumber=2 {"provingJobId":"1:BASE_PARITY:258df3a76fe74f80"} 10:30:27 [10:30:27.765] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testwR8cB1/2 with map size 1073741824 10:30:27 [10:30:27.766] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:28 [10:30:28.780] INFO: prover-client:proving-broker Proving Broker started 10:30:28 [10:30:28.781] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:36f76ce43fcf5bba settled=false {"provingJobId":"1:BASE_PARITY:36f76ce43fcf5bba","status":"pending"} 10:30:28 [10:30:28.783] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:258df3a76fe74f80 settled=false {"provingJobId":"1:BASE_PARITY:258df3a76fe74f80","status":"pending"} 10:30:28 [10:30:28.783] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:36f76ce43fcf5bba type=BASE_PARITY not found in the in-progress cache, adding it {"provingJobId":"1:BASE_PARITY:36f76ce43fcf5bba"} 10:30:28 [10:30:28.786] INFO: prover-client:proving-broker Proving Broker started 10:30:28 [10:30:28.787] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:edd1bbb5db15bf0c epochNumber=1 {"provingJobId":"1:BASE_PARITY:edd1bbb5db15bf0c"} 10:30:28 [10:30:28.787] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testGciupu/1 with map size 1073741824 10:30:28 [10:30:28.789] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:28 [10:30:28.804] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6cec154d4d6258f1 epochNumber=2 {"provingJobId":"1:BASE_PARITY:6cec154d4d6258f1"} 10:30:28 [10:30:28.804] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testGciupu/2 with map size 1073741824 10:30:28 [10:30:28.806] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:29 [10:30:29.820] INFO: prover-client:proving-broker Proving Broker started 10:30:29 [10:30:29.822] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:edd1bbb5db15bf0c settled=false {"provingJobId":"1:BASE_PARITY:edd1bbb5db15bf0c","status":"pending"} 10:30:29 [10:30:29.823] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:6cec154d4d6258f1 settled=false {"provingJobId":"1:BASE_PARITY:6cec154d4d6258f1","status":"pending"} 10:30:29 [10:30:29.824] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:edd1bbb5db15bf0c type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:edd1bbb5db15bf0c"} 10:30:29 [10:30:29.825] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:edd1bbb5db15bf0c type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:edd1bbb5db15bf0c"} 10:30:29 [10:30:29.834] INFO: prover-client:proving-broker Proving Broker started 10:30:29 [10:30:29.835] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d4a506ad6d771358 epochNumber=1 {"provingJobId":"1:BASE_PARITY:d4a506ad6d771358"} 10:30:29 [10:30:29.835] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testZnBeT4/1 with map size 1073741824 10:30:29 [10:30:29.837] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:29 [10:30:29.851] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:572791a03a58d26a epochNumber=2 {"provingJobId":"1:BASE_PARITY:572791a03a58d26a"} 10:30:29 [10:30:29.852] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testZnBeT4/2 with map size 1073741824 10:30:29 [10:30:29.854] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:29 [10:30:29.869] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:d4a506ad6d771358 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:d4a506ad6d771358"} 10:30:29 [10:30:29.875] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:572791a03a58d26a type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:572791a03a58d26a"} 10:30:29 [10:30:29.885] INFO: prover-client:proving-broker Proving Broker started 10:30:29 [10:30:29.886] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:40a68f7c6163f29f epochNumber=1 {"provingJobId":"1:BASE_PARITY:40a68f7c6163f29f"} 10:30:29 [10:30:29.887] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testSxt1Rk/1 with map size 1073741824 10:30:29 [10:30:29.888] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:29 [10:30:29.902] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:500fb1a058012775 epochNumber=2 {"provingJobId":"1:BASE_PARITY:500fb1a058012775"} 10:30:29 [10:30:29.903] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testSxt1Rk/2 with map size 1073741824 10:30:29 [10:30:29.905] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:29 [10:30:29.918] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:40a68f7c6163f29f type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:40a68f7c6163f29f"} 10:30:29 [10:30:29.919] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:40a68f7c6163f29f type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:40a68f7c6163f29f"} 10:30:29 [10:30:29.924] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:500fb1a058012775 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:500fb1a058012775"} 10:30:29 [10:30:29.931] INFO: prover-client:proving-broker Proving Broker started 10:30:29 [10:30:29.932] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:dbb13c3f7b819dd7 err=test error {"provingJoId":"1:BASE_PARITY:dbb13c3f7b819dd7"} 10:30:29 [10:30:29.935] INFO: prover-client:proving-broker Proving Broker started 10:30:29 [10:30:29.936] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:ac1a51eb8df0ec2a not found {"provingJobId":"1:BASE_PARITY:ac1a51eb8df0ec2a"} 10:30:29 [10:30:29.939] INFO: prover-client:proving-broker Proving Broker started 10:30:29 [10:30:29.940] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c14880e376731cb1 epochNumber=1 {"provingJobId":"1:BASE_PARITY:c14880e376731cb1"} 10:30:29 [10:30:29.940] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testeWkivV/1 with map size 1073741824 10:30:29 [10:30:29.942] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:29 [10:30:29.960] INFO: prover-client:proving-broker Proving Broker started 10:30:29 [10:30:29.962] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3313d60495b39945 epochNumber=1 {"provingJobId":"1:BASE_PARITY:3313d60495b39945"} 10:30:29 [10:30:29.963] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test9h9uDe/1 with map size 1073741824 10:30:29 [10:30:29.966] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:30 [10:30:30.089] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:3313d60495b39945 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:3313d60495b39945"} 10:30:30 [10:30:30.095] INFO: prover-client:proving-broker Proving Broker started 10:30:30 [10:30:30.095] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:038f80c37d55b9b0 epochNumber=1 {"provingJobId":"1:BASE_PARITY:038f80c37d55b9b0"} 10:30:30 [10:30:30.096] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testfx54yR/1 with map size 1073741824 10:30:30 [10:30:30.097] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:30 [10:30:30.220] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:038f80c37d55b9b0 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:038f80c37d55b9b0"} 10:30:30 [10:30:30.224] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:18d0396ab4e30f67 epochNumber=10 {"provingJobId":"1:BASE_PARITY:18d0396ab4e30f67"} 10:30:30 [10:30:30.225] INFO: prover-client:proving-broker-database Creating broker database for epoch 10 at /tmp/proving-broker-testfx54yR/10 with map size 1073741824 10:30:30 [10:30:30.226] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:30 [10:30:30.246] INFO: prover-client:proving-broker Cleaned up jobs=1 10:30:30 [10:30:30.247] INFO: prover-client:proving-broker-database Deleting broker database for epoch 1 10:30:30 [10:30:30.370] INFO: prover-client:proving-broker Proving Broker started 10:30:30 [10:30:30.370] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:8b33f064499144a7 epochNumber=1 {"provingJobId":"1:BASE_PARITY:8b33f064499144a7"} 10:30:30 [10:30:30.372] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testyBaoZF/1 with map size 1073741824 10:30:30 [10:30:30.374] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:30 [10:30:30.547] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:8b33f064499144a7 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:8b33f064499144a7"} 10:30:30 [10:30:30.591] INFO: prover-client:proving-broker Proving Broker started 10:30:30 [10:30:30.591] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:dbf7560b23e0b44a epochNumber=1 {"provingJobId":"1:BASE_PARITY:dbf7560b23e0b44a"} 10:30:30 [10:30:30.592] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testttCfNq/1 with map size 1073741824 10:30:30 [10:30:30.593] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:30 [10:30:30.610] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:dbf7560b23e0b44a type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:dbf7560b23e0b44a"} 10:30:30 [10:30:30.613] INFO: prover-client:proving-broker Proving Broker started 10:30:30 [10:30:30.614] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:286b35385e1e6555 epochNumber=1 {"provingJobId":"1:BASE_PARITY:286b35385e1e6555"} 10:30:30 [10:30:30.616] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testuQ9gbw/1 with map size 1073741824 10:30:30 [10:30:30.617] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:30 [10:30:30.632] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:286b35385e1e6555 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:286b35385e1e6555"} 10:30:30 [10:30:30.633] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:286b35385e1e6555 type=BASE_PARITY totalAttempts=2 err=test error {"provingJobId":"1:BASE_PARITY:286b35385e1e6555"} 10:30:30 [10:30:30.640] INFO: prover-client:proving-broker Proving Broker started 10:30:30 [10:30:30.641] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:258b12fca23588c0 epochNumber=1 {"provingJobId":"1:BASE_PARITY:258b12fca23588c0"} 10:30:30 [10:30:30.641] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test55W7nC/1 with map size 1073741824 10:30:30 [10:30:30.643] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:30 [10:30:30.657] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:258b12fca23588c0 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:258b12fca23588c0"} 10:30:30 [10:30:30.665] INFO: prover-client:proving-broker Proving Broker started 10:30:30 [10:30:30.665] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:49638aa7b5f81794 epochNumber=1 {"provingJobId":"1:BASE_PARITY:49638aa7b5f81794"} 10:30:30 [10:30:30.667] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testej8wUw/1 with map size 1073741824 10:30:30 [10:30:30.668] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:30 [10:30:30.684] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:49638aa7b5f81794 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:49638aa7b5f81794"} 10:30:30 [10:30:30.685] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a0678caf6eb3da27 epochNumber=3 {"provingJobId":"1:BASE_PARITY:a0678caf6eb3da27"} 10:30:30 [10:30:30.686] INFO: prover-client:proving-broker-database Creating broker database for epoch 3 at /tmp/proving-broker-testej8wUw/3 with map size 1073741824 10:30:30 [10:30:30.687] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:30 [10:30:30.716] INFO: prover-client:proving-broker Cleaned up jobs=1 10:30:30 [10:30:30.717] INFO: prover-client:proving-broker-database Deleting broker database for epoch 1 10:30:30 [10:30:30.731] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:49638aa7b5f81794 err=test error {"provingJoId":"1:BASE_PARITY:49638aa7b5f81794"} 10:30:30 [10:30:30.734] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testJ4f2cW/1 with map size 1073741824 10:30:30 [10:30:30.736] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:30 [10:30:30.751] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testJ4f2cW/2 with map size 1073741824 10:30:30 [10:30:30.753] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:30 [10:30:30.768] INFO: prover-client:proving-broker Proving Broker started 10:30:30 [10:30:30.769] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:a00abe80ef384db3 settled=false {"provingJobId":"1:BASE_PARITY:a00abe80ef384db3","status":"pending"} 10:30:30 [10:30:30.770] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:50844bd12ddf5fde settled=false {"provingJobId":"1:BASE_PARITY:50844bd12ddf5fde","status":"pending"} 10:30:30 [10:30:30.776] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testsTGwJW/1 with map size 1073741824 10:30:30 [10:30:30.777] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:30 [10:30:30.791] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testsTGwJW/2 with map size 1073741824 10:30:30 [10:30:30.792] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:30 [10:30:30.815] INFO: prover-client:proving-broker Proving Broker started 10:30:30 [10:30:30.816] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:a244731afe772839 settled=true {"provingJobId":"1:BASE_PARITY:a244731afe772839","status":"fulfilled"} 10:30:30 [10:30:30.818] INFO: prover-client:proving-broker Restoring proving job id=2:BASE_PARITY:2326bfa1f20edd6e settled=true {"provingJobId":"2:BASE_PARITY:2326bfa1f20edd6e","status":"fulfilled"} 10:30:30 [10:30:30.822] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testSpTQpq/1 with map size 1073741824 10:30:30 [10:30:30.824] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:30 [10:30:30.842] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testSpTQpq/2 with map size 1073741824 10:30:30 [10:30:30.843] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:30 [10:30:30.858] INFO: prover-client:proving-broker Proving Broker started 10:30:30 [10:30:30.859] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:c5257cd61f56317b settled=true {"provingJobId":"1:BASE_PARITY:c5257cd61f56317b","status":"fulfilled"} 10:30:30 [10:30:30.861] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:de2d560d135cb974 settled=false {"provingJobId":"1:BASE_PARITY:de2d560d135cb974","status":"pending"} 10:30:30 [10:30:30.866] INFO: prover-client:proving-broker Proving Broker started 10:30:30 [10:30:30.867] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:927c32e380268c78 epochNumber=1 {"provingJobId":"1:BASE_PARITY:927c32e380268c78"} 10:30:30 [10:30:30.867] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testjv3IjC/1 with map size 1073741824 10:30:30 [10:30:30.871] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:30 [10:30:30.891] INFO: prover-client:proving-broker Proving Broker started 10:30:30 [10:30:30.892] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:93cb7dfd27a881eb epochNumber=1 {"provingJobId":"1:BASE_PARITY:93cb7dfd27a881eb"} 10:30:30 [10:30:30.892] ERROR: prover-client:proving-broker Failed to save proving job id=1:BASE_PARITY:93cb7dfd27a881eb: Error: db error: Error: db error 10:30:30 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1126:63) {"provingJobId":"1:BASE_PARITY:93cb7dfd27a881eb"} 10:30:30 [10:30:30.895] INFO: prover-client:proving-broker Proving Broker started 10:30:30 [10:30:30.896] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e59d307900c9aa2c epochNumber=1 {"provingJobId":"1:BASE_PARITY:e59d307900c9aa2c"} 10:30:30 [10:30:30.897] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testAr9Jgt/1 with map size 1073741824 10:30:30 [10:30:30.898] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:30 [10:30:30.914] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:e59d307900c9aa2c type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:e59d307900c9aa2c"} 10:30:30 [10:30:30.915] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:e59d307900c9aa2c type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:e59d307900c9aa2c"} 10:30:30 [10:30:30.925] INFO: prover-client:proving-broker Proving Broker started 10:30:30 [10:30:30.925] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e76fd95d3bd65d49 epochNumber=1 {"provingJobId":"1:BASE_PARITY:e76fd95d3bd65d49"} 10:30:30 [10:30:30.926] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testBqZRLq/1 with map size 1073741824 10:30:30 [10:30:30.928] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:30 [10:30:30.942] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:e76fd95d3bd65d49 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:e76fd95d3bd65d49"} 10:30:30 [10:30:30.943] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:e76fd95d3bd65d49 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:e76fd95d3bd65d49"} 10:30:30 [10:30:30.944] ERROR: prover-client:proving-broker Failed to save proving job result id=1:BASE_PARITY:e76fd95d3bd65d49: Error: db error 10:30:30 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1159:69) {"provingJobId":"1:BASE_PARITY:e76fd95d3bd65d49"} 10:30:30 [10:30:30.947] INFO: prover-client:proving-broker Proving Broker started 10:30:30 [10:30:30.948] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:5c5e86ad9c18d957 epochNumber=1 {"provingJobId":"1:BASE_PARITY:5c5e86ad9c18d957"} 10:30:30 [10:30:30.949] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testgRMbAu/1 with map size 1073741824 10:30:30 [10:30:30.950] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:30 [10:30:30.965] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:5c5e86ad9c18d957 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:5c5e86ad9c18d957"} 10:30:30 [10:30:30.966] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:5c5e86ad9c18d957 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:5c5e86ad9c18d957"} 10:30:30 [10:30:30.974] INFO: prover-client:proving-broker Proving Broker started 10:30:30 [10:30:30.975] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:cb7717673854d4f9 epochNumber=1 {"provingJobId":"1:BASE_PARITY:cb7717673854d4f9"} 10:30:30 [10:30:30.976] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testJogMBI/1 with map size 1073741824 10:30:30 [10:30:30.977] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:30 [10:30:30.992] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:cb7717673854d4f9 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:cb7717673854d4f9"} 10:30:30 [10:30:30.992] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:cb7717673854d4f9 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:cb7717673854d4f9"} 10:30:30 [10:30:30.993] ERROR: prover-client:proving-broker Failed to save proving job error status id=1:BASE_PARITY:cb7717673854d4f9 jobErr=test error: Error: db error 10:30:30 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1192:68) {"provingJobId":"1:BASE_PARITY:cb7717673854d4f9"} 10:30:30 [10:30:30.996] INFO: prover-client:proving-broker Proving Broker started 10:30:30 [10:30:30.997] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:82a4f3755569c18c not found {"provingJobId":"1:BASE_PARITY:82a4f3755569c18c"} 10:30:30 [10:30:31.000] INFO: prover-client:proving-broker Proving Broker started 10:30:31 [10:30:31.000] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:2767925bb8b1cb9f err=test error {"provingJoId":"1:BASE_PARITY:2767925bb8b1cb9f"} 10:30:31 [10:30:31.004] INFO: prover-client:proving-broker Proving Broker started 10:30:31 [10:30:31.015] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:06ffa0b5ed801d9e epochNumber=1 {"provingJobId":"1:BASE_PARITY:06ffa0b5ed801d9e"} 10:30:31 [10:30:31.016] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test3pZ91U/1 with map size 1073741824 10:30:31 [10:30:31.017] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:31 [10:30:31.032] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:06ffa0b5ed801d9e type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:06ffa0b5ed801d9e"} 10:30:31 [10:30:31.032] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:06ffa0b5ed801d9e type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:06ffa0b5ed801d9e"} 10:30:31 [10:30:31.047] INFO: prover-client:proving-broker New proving job id=2:BASE_PARITY:94d3c283597f047d epochNumber=2 {"provingJobId":"2:BASE_PARITY:94d3c283597f047d"} 10:30:31 [10:30:31.048] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-test3pZ91U/2 with map size 1073741824 10:30:31 [10:30:31.050] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:31 [10:30:31.065] WARN: prover-client:proving-broker Proving job id=2:BASE_PARITY:94d3c283597f047d type=BASE_PARITY not in the in-progress set {"provingJobId":"2:BASE_PARITY:94d3c283597f047d"} 10:30:31 [10:30:31.065] INFO: prover-client:proving-broker Proving job complete id=2:BASE_PARITY:94d3c283597f047d type=BASE_PARITY totalAttempts=1 {"provingJobId":"2:BASE_PARITY:94d3c283597f047d"} 10:30:31 [10:30:31.130] INFO: prover-client:proving-broker New proving job id=3:BASE_PARITY:0763f3c35b86eaaa epochNumber=3 {"provingJobId":"3:BASE_PARITY:0763f3c35b86eaaa"} 10:30:31 [10:30:31.132] INFO: prover-client:proving-broker-database Creating broker database for epoch 3 at /tmp/proving-broker-test3pZ91U/3 with map size 1073741824 10:30:31 [10:30:31.133] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:31 [10:30:31.157] INFO: prover-client:proving-broker Cleaned up jobs=1 10:30:31 [10:30:31.157] INFO: prover-client:proving-broker-database Deleting broker database for epoch 1 10:30:31 [10:30:31.209] INFO: prover-client:proving-broker New proving job id=4:BASE_PARITY:ed141d2a9184fc70 epochNumber=4 {"provingJobId":"4:BASE_PARITY:ed141d2a9184fc70"} 10:30:31 [10:30:31.209] INFO: prover-client:proving-broker-database Creating broker database for epoch 4 at /tmp/proving-broker-test3pZ91U/4 with map size 1073741824 10:30:31 [10:30:31.211] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:31 [10:30:31.234] INFO: prover-client:proving-broker Cleaned up jobs=1 10:30:31 [10:30:31.234] INFO: prover-client:proving-broker-database Deleting broker database for epoch 2 10:30:31 [10:30:31.287] INFO: prover-client:proving-broker New proving job id=5:BASE_PARITY:8811128af06fcdd7 epochNumber=5 {"provingJobId":"5:BASE_PARITY:8811128af06fcdd7"} 10:30:31 [10:30:31.288] INFO: prover-client:proving-broker-database Creating broker database for epoch 5 at /tmp/proving-broker-test3pZ91U/5 with map size 1073741824 10:30:31 [10:30:31.290] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 10:30:31 [10:30:31.310] INFO: prover-client:proving-broker Cleaned up jobs=1 10:30:31 [10:30:31.310] INFO: prover-client:proving-broker-database Deleting broker database for epoch 3 10:30:31 PASS src/proving_broker/proving_broker.test.ts (11.275 s) 10:30:31 ProvingBroker 10:30:31 Producer API 10:30:31 ✓ refuses stale jobs (34 ms) 10:30:31 ✓ enqueues jobs (4 ms) 10:30:31 ✓ ignores duplicate jobs (4 ms) 10:30:31 ✓ reports correct status when enqueuing repeat jobs (4 ms) 10:30:31 ✓ throws an error in case of duplicate job IDs (18 ms) 10:30:31 ✓ returns not-found status for non-existing jobs (1 ms) 10:30:31 ✓ cancels jobs in queue (3 ms) 10:30:31 ✓ cancels jobs in-progress (2 ms) 10:30:31 ✓ returns job result if successful (2 ms) 10:30:31 ✓ returns job error if failed (2 ms) 10:30:31 ✓ correctly returns job status for concurrent writes (2 ms) 10:30:31 ✓ refuses stale jobs (32 ms) 10:30:31 ✓ enqueues jobs (31 ms) 10:30:31 ✓ ignores duplicate jobs (24 ms) 10:30:31 ✓ reports correct status when enqueuing repeat jobs (31 ms) 10:30:31 ✓ throws an error in case of duplicate job IDs (22 ms) 10:30:31 ✓ returns not-found status for non-existing jobs (2 ms) 10:30:31 ✓ cancels jobs in queue (25 ms) 10:30:31 ✓ cancels jobs in-progress (24 ms) 10:30:31 ✓ returns job result if successful (27 ms) 10:30:31 ✓ returns job error if failed (27 ms) 10:30:31 ✓ correctly returns job status for concurrent writes (31 ms) 10:30:31 Consumer API 10:30:31 ✓ returns undefined if no jobs are available (1 ms) 10:30:31 ✓ returns jobs in priority order (1 ms) 10:30:31 ✓ returns undefined if no jobs are available for the given allowList (5 ms) 10:30:31 ✓ returns a job if it is in the allowList (2 ms) 10:30:31 ✓ returns the most important job if it is in the allowList (2 ms) 10:30:31 ✓ returns any job if filter is empty (2 ms) 10:30:31 ✓ returns a new job when reporting job success (2 ms) 10:30:31 ✓ returns a new job when reporting permanent error (2 ms) 10:30:31 ✓ returns a new job when reporting retry-able error (2 ms) 10:30:31 ✓ returns a new job when reporting progress if current one is cancelled (3 ms) 10:30:31 ✓ returns a new job if job is already in progress elsewhere (1054 ms) 10:30:31 ✓ avoids sending the same job to a new agent after a restart (1003 ms) 10:30:31 ✓ avoids sending a completed job to a new agent after a restart (1004 ms) 10:30:31 ✓ tracks job result if in progress (2 ms) 10:30:31 ✓ tracks job result even if job is in queue (2 ms) 10:30:31 ✓ ignores reported job error if unknown job (1 ms) 10:30:31 ✓ ignores job result if unknown job (1 ms) 10:30:31 ✓ returns undefined if no jobs are available (1 ms) 10:30:31 ✓ returns jobs in priority order (33 ms) 10:30:31 ✓ returns undefined if no jobs are available for the given allowList (19 ms) 10:30:31 ✓ returns a job if it is in the allowList (45 ms) 10:30:31 ✓ returns the most important job if it is in the allowList (43 ms) 10:30:31 ✓ returns any job if filter is empty (45 ms) 10:30:31 ✓ returns a new job when reporting job success (29 ms) 10:30:31 ✓ returns a new job when reporting permanent error (36 ms) 10:30:31 ✓ returns a new job when reporting retry-able error (34 ms) 10:30:31 ✓ returns a new job when reporting progress if current one is cancelled (41 ms) 10:30:31 ✓ returns a new job if job is already in progress elsewhere (1105 ms) 10:30:31 ✓ avoids sending the same job to a new agent after a restart (1039 ms) 10:30:31 ✓ avoids sending a completed job to a new agent after a restart (1048 ms) 10:30:31 ✓ tracks job result if in progress (51 ms) 10:30:31 ✓ tracks job result even if job is in queue (46 ms) 10:30:31 ✓ ignores reported job error if unknown job (3 ms) 10:30:31 ✓ ignores job result if unknown job (2 ms) 10:30:31 Timeouts 10:30:31 ✓ tracks in progress jobs (2 ms) 10:30:31 ✓ re-enqueues jobs that time out (109 ms) 10:30:31 ✓ cancel stale jobs that time out (257 ms) 10:30:31 ✓ keeps the jobs in progress while it is alive (203 ms) 10:30:31 ✓ tracks in progress jobs (21 ms) 10:30:31 ✓ re-enqueues jobs that time out (135 ms) 10:30:31 ✓ cancel stale jobs that time out (274 ms) 10:30:31 ✓ keeps the jobs in progress while it is alive (221 ms) 10:30:31 Retries 10:30:31 ✓ retries jobs (2 ms) 10:30:31 ✓ retries up to a maximum number of times (2 ms) 10:30:31 ✓ passing retry=false does not retry (2 ms) 10:30:31 ✓ does not retry if job is stale (27 ms) 10:30:31 ✓ retries jobs (22 ms) 10:30:31 ✓ retries up to a maximum number of times (26 ms) 10:30:31 ✓ passing retry=false does not retry (24 ms) 10:30:31 ✓ does not retry if job is stale (69 ms) 10:30:31 Database management 10:30:31 ✓ re-enqueues proof requests on start (2 ms) 10:30:31 ✓ restores proof results on start (2 ms) 10:30:31 ✓ only re-enqueues unfinished jobs (1 ms) 10:30:31 ✓ saves job when enqueued (2 ms) 10:30:31 ✓ does not retain job if database fails to save (2 ms) 10:30:31 ✓ saves job result (2 ms) 10:30:31 ✓ saves result even if database fails to save (3 ms) 10:30:31 ✓ saves job error (2 ms) 10:30:31 ✓ saves job error even if database fails to save (2 ms) 10:30:31 ✓ does not save job result if job is unknown (4 ms) 10:30:31 ✓ does not save job error if job is unknown (1 ms) 10:30:31 ✓ cleans up old jobs periodically (255 ms) 10:30:31 ✓ re-enqueues proof requests on start (40 ms) 10:30:31 ✓ restores proof results on start (47 ms) 10:30:31 ✓ only re-enqueues unfinished jobs (44 ms) 10:30:31 ✓ saves job when enqueued (25 ms) 10:30:31 ✓ does not retain job if database fails to save (4 ms) 10:30:31 ✓ saves job result (29 ms) 10:30:31 ✓ saves result even if database fails to save (22 ms) 10:30:31 ✓ saves job error (26 ms) 10:30:31 ✓ saves job error even if database fails to save (21 ms) 10:30:31 ✓ does not save job result if job is unknown (3 ms) 10:30:31 ✓ does not save job error if job is unknown (4 ms) 10:30:31 ✓ cleans up old jobs periodically (355 ms) 10:30:31 10:30:31 Test Suites: 1 passed, 1 total 10:30:31 Tests: 96 passed, 96 total 10:30:31 Snapshots: 0 total 10:30:31 Time: 11.349 s 10:30:31 Ran all test suites matching prover-client/src/proving_broker/proving_broker.test.ts. 10:30:31 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?