Parent Log: http://ci.aztec-labs.com/5b78f67da94557f7 Command: e4e37220d2336322 yarn-project/scripts/run_test.sh prover-client/src/proving_broker/proving_broker.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/282da3bd25d49b92970e6fc85f110092e8566299 Env: REF_NAME=gh-readonly-queue/next/pr-14610-ee24aac96469b4f1cb8d70e614b2dd27bf0eb134 CURRENT_VERSION=0.87.6 CI_FULL=1 Date: Tue Jun 24 14:18:05 UTC 2025 System: ARCH=amd64 CPUS=128 MEM=493Gi HOSTNAME=pr-14610_amd64_x3-full Resources: CPU_LIST=0-127 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_b95296ef06707e5f_next 14:18:10 [14:18:10.026] INFO: prover-client:proving-broker Proving Broker started 14:18:10 [14:18:10.031] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e2d7aba21f13027d epochNumber=42 {"provingJobId":"1:BASE_PARITY:e2d7aba21f13027d"} 14:18:10 [14:18:10.034] WARN: prover-client:proving-broker Tried enqueueing stale proving job id=1:BASE_PARITY:b5a0fe5c26e2bb0b epochNumber=1 {"provingJobId":"1:BASE_PARITY:b5a0fe5c26e2bb0b"} 14:18:10 [14:18:10.061] INFO: prover-client:proving-broker Proving Broker started 14:18:10 [14:18:10.062] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:90901e052a629048 epochNumber=1 {"provingJobId":"1:BASE_PARITY:90901e052a629048"} 14:18:10 [14:18:10.063] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ce8f242af766a9dd epochNumber=1 {"provingJobId":"1:BASE_PARITY:ce8f242af766a9dd"} 14:18:10 [14:18:10.065] INFO: prover-client:proving-broker Proving Broker started 14:18:10 [14:18:10.066] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:45c2d9c6310ec48f epochNumber=1 {"provingJobId":"1:BASE_PARITY:45c2d9c6310ec48f"} 14:18:10 [14:18:10.067] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:45c2d9c6310ec48f epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:45c2d9c6310ec48f"} 14:18:10 [14:18:10.070] INFO: prover-client:proving-broker Proving Broker started 14:18:10 [14:18:10.070] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b1f9dab6221841a0 epochNumber=1 {"provingJobId":"1:BASE_PARITY:b1f9dab6221841a0"} 14:18:10 [14:18:10.072] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:b1f9dab6221841a0 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:b1f9dab6221841a0"} 14:18:10 [14:18:10.072] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:b1f9dab6221841a0 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:b1f9dab6221841a0"} 14:18:10 [14:18:10.073] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:b1f9dab6221841a0 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:b1f9dab6221841a0"} 14:18:10 [14:18:10.074] INFO: prover-client:proving-broker Proving Broker started 14:18:10 [14:18:10.074] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:84bf766ec3b64938 epochNumber=1 {"provingJobId":"1:BASE_PARITY:84bf766ec3b64938"} 14:18:10 [14:18:10.096] INFO: prover-client:proving-broker Proving Broker started 14:18:10 [14:18:10.097] INFO: prover-client:proving-broker Proving Broker started 14:18:10 [14:18:10.098] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:de12c55952713909 epochNumber=1 {"provingJobId":"1:BASE_PARITY:de12c55952713909"} 14:18:10 [14:18:10.098] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:de12c55952713909 {"provingJobId":"1:BASE_PARITY:de12c55952713909"} 14:18:10 [14:18:10.099] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:de12c55952713909 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:de12c55952713909"} 14:18:10 [14:18:10.099] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:de12c55952713909 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:de12c55952713909"} 14:18:10 [14:18:10.100] INFO: prover-client:proving-broker Proving Broker started 14:18:10 [14:18:10.100] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b8a822c02588ae99 epochNumber=1 {"provingJobId":"1:BASE_PARITY:b8a822c02588ae99"} 14:18:10 [14:18:10.101] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:b8a822c02588ae99 {"provingJobId":"1:BASE_PARITY:b8a822c02588ae99"} 14:18:10 [14:18:10.101] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:b8a822c02588ae99 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:b8a822c02588ae99"} 14:18:10 [14:18:10.109] INFO: prover-client:proving-broker Proving Broker started 14:18:10 [14:18:10.109] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f80abfc78ac0d353 epochNumber=1 {"provingJobId":"1:BASE_PARITY:f80abfc78ac0d353"} 14:18:10 [14:18:10.110] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:f80abfc78ac0d353 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:f80abfc78ac0d353"} 14:18:10 [14:18:10.110] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:f80abfc78ac0d353 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:f80abfc78ac0d353"} 14:18:10 [14:18:10.111] INFO: prover-client:proving-broker Proving Broker started 14:18:10 [14:18:10.112] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:cb87129dbeb3c2d8 epochNumber=1 {"provingJobId":"1:BASE_PARITY:cb87129dbeb3c2d8"} 14:18:10 [14:18:10.112] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:cb87129dbeb3c2d8 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:cb87129dbeb3c2d8"} 14:18:10 [14:18:10.112] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:cb87129dbeb3c2d8 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:cb87129dbeb3c2d8"} 14:18:10 [14:18:10.113] INFO: prover-client:proving-broker Proving Broker started 14:18:10 [14:18:10.114] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:29dd4a97234e5ed0 epochNumber=0 {"provingJobId":"1:BASE_PARITY:29dd4a97234e5ed0"} 14:18:10 [14:18:10.114] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:29dd4a97234e5ed0 epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:29dd4a97234e5ed0"} 14:18:10 [14:18:10.114] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:dd9e3c53547342d6 epochNumber=0 {"provingJobId":"1:BASE_PARITY:dd9e3c53547342d6"} 14:18:10 [14:18:10.115] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:29dd4a97234e5ed0 epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:29dd4a97234e5ed0"} 14:18:10 [14:18:10.115] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:cf29749f8fcc8634 epochNumber=0 {"provingJobId":"1:BASE_PARITY:cf29749f8fcc8634"} 14:18:10 [14:18:10.116] INFO: prover-client:proving-broker Proving Broker started 14:18:10 [14:18:10.117] INFO: prover-client:proving-broker Proving Broker started 14:18:10 [14:18:10.117] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b399ec6b51419ee7 epochNumber=2 {"provingJobId":"1:BASE_PARITY:b399ec6b51419ee7"} 14:18:10 [14:18:10.118] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ff5b516bdc8a394a epochNumber=1 {"provingJobId":"1:BASE_PARITY:ff5b516bdc8a394a"} 14:18:10 [14:18:10.119] INFO: prover-client:proving-broker Proving Broker started 14:18:10 [14:18:10.119] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:366943c9324d251e epochNumber=1 {"provingJobId":"1:BASE_PARITY:366943c9324d251e"} 14:18:10 [14:18:10.120] INFO: prover-client:proving-broker Proving Broker started 14:18:10 [14:18:10.120] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ecadb4e02a4c0af9 epochNumber=1 {"provingJobId":"1:BASE_PARITY:ecadb4e02a4c0af9"} 14:18:10 [14:18:10.120] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:45f245ef3b8abceb epochNumber=1 {"provingJobId":"1:BASE_PARITY:45f245ef3b8abceb"} 14:18:10 [14:18:10.121] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b7055db317955665 epochNumber=2 {"provingJobId":"1:BASE_PARITY:b7055db317955665"} 14:18:10 [14:18:10.121] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:8496ae26c78105a5 epochNumber=1 {"provingJobId":"1:BASE_PARITY:8496ae26c78105a5"} 14:18:10 [14:18:10.122] INFO: prover-client:proving-broker Proving Broker started 14:18:10 [14:18:10.122] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c1ec4b957ca93a94 epochNumber=1 {"provingJobId":"1:BASE_PARITY:c1ec4b957ca93a94"} 14:18:10 [14:18:10.122] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:add8183e98678fee epochNumber=1 {"provingJobId":"1:BASE_PARITY:add8183e98678fee"} 14:18:10 [14:18:10.122] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:68412c918c2c773c epochNumber=2 {"provingJobId":"1:BASE_PARITY:68412c918c2c773c"} 14:18:10 [14:18:10.123] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3985f940df060fc4 epochNumber=1 {"provingJobId":"1:BASE_PARITY:3985f940df060fc4"} 14:18:10 [14:18:10.123] INFO: prover-client:proving-broker Proving Broker started 14:18:10 [14:18:10.124] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7e10a5d8cc0615f1 epochNumber=1 {"provingJobId":"1:BASE_PARITY:7e10a5d8cc0615f1"} 14:18:10 [14:18:10.124] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a6d23730400746d6 epochNumber=1 {"provingJobId":"1:BASE_PARITY:a6d23730400746d6"} 14:18:10 [14:18:10.124] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e0de2e7f22273210 epochNumber=2 {"provingJobId":"1:BASE_PARITY:e0de2e7f22273210"} 14:18:10 [14:18:10.125] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:31a1719d22d15411 epochNumber=1 {"provingJobId":"1:BASE_PARITY:31a1719d22d15411"} 14:18:10 [14:18:10.125] INFO: prover-client:proving-broker Proving Broker started 14:18:10 [14:18:10.126] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:80d2767fac73b433 epochNumber=1 {"provingJobId":"1:BASE_PARITY:80d2767fac73b433"} 14:18:10 [14:18:10.126] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f91a5f2956d8d24f epochNumber=1 {"provingJobId":"1:BASE_PARITY:f91a5f2956d8d24f"} 14:18:10 [14:18:10.126] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:80d2767fac73b433 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:80d2767fac73b433"} 14:18:10 [14:18:10.127] INFO: prover-client:proving-broker Proving Broker started 14:18:10 [14:18:10.128] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9881386ff3f3ef97 epochNumber=1 {"provingJobId":"1:BASE_PARITY:9881386ff3f3ef97"} 14:18:10 [14:18:10.128] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:bc4ac5f34cccac2d epochNumber=1 {"provingJobId":"1:BASE_PARITY:bc4ac5f34cccac2d"} 14:18:10 [14:18:10.128] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:9881386ff3f3ef97 type=BASE_PARITY totalAttempts=1 err=result {"provingJobId":"1:BASE_PARITY:9881386ff3f3ef97"} 14:18:10 [14:18:10.129] INFO: prover-client:proving-broker Proving Broker started 14:18:10 [14:18:10.129] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:78779b94fa092d0d epochNumber=1 {"provingJobId":"1:BASE_PARITY:78779b94fa092d0d"} 14:18:10 [14:18:10.130] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1132a00a81fdad5a epochNumber=1 {"provingJobId":"1:BASE_PARITY:1132a00a81fdad5a"} 14:18:10 [14:18:10.130] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:78779b94fa092d0d type=BASE_PARITY retry=1 err=result {"provingJobId":"1:BASE_PARITY:78779b94fa092d0d"} 14:18:10 [14:18:10.131] INFO: prover-client:proving-broker Proving Broker started 14:18:10 [14:18:10.131] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0f68c1b5f07acc8e epochNumber=1 {"provingJobId":"1:BASE_PARITY:0f68c1b5f07acc8e"} 14:18:10 [14:18:10.131] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:0f68c1b5f07acc8e {"provingJobId":"1:BASE_PARITY:0f68c1b5f07acc8e"} 14:18:10 [14:18:10.131] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:0f68c1b5f07acc8e type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:0f68c1b5f07acc8e"} 14:18:10 [14:18:10.132] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d7407ffc44ffe1b9 epochNumber=1 {"provingJobId":"1:BASE_PARITY:d7407ffc44ffe1b9"} 14:18:10 [14:18:10.132] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:0f68c1b5f07acc8e has already been completed {"provingJobId":"1:BASE_PARITY:0f68c1b5f07acc8e"} 14:18:10 [14:18:10.133] INFO: prover-client:proving-broker Proving Broker started 14:18:10 [14:18:10.133] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a3d31da351fd7978 epochNumber=1 {"provingJobId":"1:BASE_PARITY:a3d31da351fd7978"} 14:18:10 [14:18:10.134] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f5d34ce1e3bc379b epochNumber=2 {"provingJobId":"1:BASE_PARITY:f5d34ce1e3bc379b"} 14:18:11 [14:18:11.186] INFO: prover-client:proving-broker Proving Broker started 14:18:11 [14:18:11.186] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:a3d31da351fd7978 settled=false {"provingJobId":"1:BASE_PARITY:a3d31da351fd7978","status":"pending"} 14:18:11 [14:18:11.187] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:f5d34ce1e3bc379b settled=false {"provingJobId":"1:BASE_PARITY:f5d34ce1e3bc379b","status":"pending"} 14:18:11 [14:18:11.187] INFO: prover-client:proving-broker Proving job id=1:BASE_PARITY:a3d31da351fd7978 type=BASE_PARITY startedAt=1750774690134 older agent has taken job {"provingJobId":"1:BASE_PARITY:a3d31da351fd7978"} 14:18:11 [14:18:11.188] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:a3d31da351fd7978 type=BASE_PARITY already being worked on by another agent. Sending new one {"provingJobId":"1:BASE_PARITY:a3d31da351fd7978"} 14:18:11 [14:18:11.189] INFO: prover-client:proving-broker Proving Broker started 14:18:11 [14:18:11.189] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:da59ccb60234e679 epochNumber=1 {"provingJobId":"1:BASE_PARITY:da59ccb60234e679"} 14:18:11 [14:18:11.190] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:88f2ff42068dadba epochNumber=2 {"provingJobId":"1:BASE_PARITY:88f2ff42068dadba"} 14:18:12 [14:18:12.190] INFO: prover-client:proving-broker Proving Broker started 14:18:12 [14:18:12.190] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:da59ccb60234e679 settled=false {"provingJobId":"1:BASE_PARITY:da59ccb60234e679","status":"pending"} 14:18:12 [14:18:12.191] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:88f2ff42068dadba settled=false {"provingJobId":"1:BASE_PARITY:88f2ff42068dadba","status":"pending"} 14:18:12 [14:18:12.191] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:da59ccb60234e679 type=BASE_PARITY not found in the in-progress cache, adding it {"provingJobId":"1:BASE_PARITY:da59ccb60234e679"} 14:18:12 [14:18:12.193] INFO: prover-client:proving-broker Proving Broker started 14:18:12 [14:18:12.193] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:887492df41c2ada3 epochNumber=1 {"provingJobId":"1:BASE_PARITY:887492df41c2ada3"} 14:18:12 [14:18:12.194] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:fb64353630856667 epochNumber=2 {"provingJobId":"1:BASE_PARITY:fb64353630856667"} 14:18:13 [14:18:13.196] INFO: prover-client:proving-broker Proving Broker started 14:18:13 [14:18:13.196] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:887492df41c2ada3 settled=false {"provingJobId":"1:BASE_PARITY:887492df41c2ada3","status":"pending"} 14:18:13 [14:18:13.197] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:fb64353630856667 settled=false {"provingJobId":"1:BASE_PARITY:fb64353630856667","status":"pending"} 14:18:13 [14:18:13.197] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:887492df41c2ada3 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:887492df41c2ada3"} 14:18:13 [14:18:13.197] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:887492df41c2ada3 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:887492df41c2ada3"} 14:18:13 [14:18:13.199] INFO: prover-client:proving-broker Proving Broker started 14:18:13 [14:18:13.199] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f95a0351f91d8380 epochNumber=1 {"provingJobId":"1:BASE_PARITY:f95a0351f91d8380"} 14:18:13 [14:18:13.199] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a821ca8a7e569e9c epochNumber=2 {"provingJobId":"1:BASE_PARITY:a821ca8a7e569e9c"} 14:18:13 [14:18:13.200] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:f95a0351f91d8380 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:f95a0351f91d8380"} 14:18:13 [14:18:13.201] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:a821ca8a7e569e9c type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:a821ca8a7e569e9c"} 14:18:13 [14:18:13.202] INFO: prover-client:proving-broker Proving Broker started 14:18:13 [14:18:13.202] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c8dd8ac655daa076 epochNumber=1 {"provingJobId":"1:BASE_PARITY:c8dd8ac655daa076"} 14:18:13 [14:18:13.202] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:67368e5d8bd021ce epochNumber=2 {"provingJobId":"1:BASE_PARITY:67368e5d8bd021ce"} 14:18:13 [14:18:13.203] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:c8dd8ac655daa076 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:c8dd8ac655daa076"} 14:18:13 [14:18:13.203] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:c8dd8ac655daa076 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:c8dd8ac655daa076"} 14:18:13 [14:18:13.203] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:67368e5d8bd021ce type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:67368e5d8bd021ce"} 14:18:13 [14:18:13.204] INFO: prover-client:proving-broker Proving Broker started 14:18:13 [14:18:13.205] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:40ec2c48f5ea73db err=test error {"provingJoId":"1:BASE_PARITY:40ec2c48f5ea73db"} 14:18:13 [14:18:13.205] INFO: prover-client:proving-broker Proving Broker started 14:18:13 [14:18:13.206] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:bbb022145a4e9027 not found {"provingJobId":"1:BASE_PARITY:bbb022145a4e9027"} 14:18:13 [14:18:13.207] INFO: prover-client:proving-broker Proving Broker started 14:18:13 [14:18:13.207] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7006cad20f400e97 epochNumber=1 {"provingJobId":"1:BASE_PARITY:7006cad20f400e97"} 14:18:13 [14:18:13.208] INFO: prover-client:proving-broker Proving Broker started 14:18:13 [14:18:13.209] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ff079d95c230c58a epochNumber=1 {"provingJobId":"1:BASE_PARITY:ff079d95c230c58a"} 14:18:13 [14:18:13.311] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:ff079d95c230c58a timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:ff079d95c230c58a"} 14:18:13 [14:18:13.318] INFO: prover-client:proving-broker Proving Broker started 14:18:13 [14:18:13.319] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ba60b56e01524237 epochNumber=1 {"provingJobId":"1:BASE_PARITY:ba60b56e01524237"} 14:18:13 [14:18:13.420] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:ba60b56e01524237 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:ba60b56e01524237"} 14:18:13 [14:18:13.429] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:614234933f8d3e26 epochNumber=10 {"provingJobId":"1:BASE_PARITY:614234933f8d3e26"} 14:18:13 [14:18:13.447] INFO: prover-client:proving-broker Cleaned up jobs=1 14:18:13 [14:18:13.556] INFO: prover-client:proving-broker Proving Broker started 14:18:13 [14:18:13.557] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c1d40c9d6c9499e6 epochNumber=1 {"provingJobId":"1:BASE_PARITY:c1d40c9d6c9499e6"} 14:18:13 [14:18:13.709] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:c1d40c9d6c9499e6 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:c1d40c9d6c9499e6"} 14:18:13 [14:18:13.760] INFO: prover-client:proving-broker Proving Broker started 14:18:13 [14:18:13.761] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d409176cca2ce2d5 epochNumber=1 {"provingJobId":"1:BASE_PARITY:d409176cca2ce2d5"} 14:18:13 [14:18:13.762] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:d409176cca2ce2d5 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:d409176cca2ce2d5"} 14:18:13 [14:18:13.763] INFO: prover-client:proving-broker Proving Broker started 14:18:13 [14:18:13.764] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:30b29920b7884c83 epochNumber=1 {"provingJobId":"1:BASE_PARITY:30b29920b7884c83"} 14:18:13 [14:18:13.765] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:30b29920b7884c83 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:30b29920b7884c83"} 14:18:13 [14:18:13.765] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:30b29920b7884c83 type=BASE_PARITY totalAttempts=2 err=test error {"provingJobId":"1:BASE_PARITY:30b29920b7884c83"} 14:18:13 [14:18:13.766] INFO: prover-client:proving-broker Proving Broker started 14:18:13 [14:18:13.767] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:07d35d6bf34d217d epochNumber=1 {"provingJobId":"1:BASE_PARITY:07d35d6bf34d217d"} 14:18:13 [14:18:13.767] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:07d35d6bf34d217d type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:07d35d6bf34d217d"} 14:18:13 [14:18:13.768] INFO: prover-client:proving-broker Proving Broker started 14:18:13 [14:18:13.769] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:8070ffabb955d2fa epochNumber=1 {"provingJobId":"1:BASE_PARITY:8070ffabb955d2fa"} 14:18:13 [14:18:13.769] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:8070ffabb955d2fa type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:8070ffabb955d2fa"} 14:18:13 [14:18:13.770] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0637ad987797850f epochNumber=3 {"provingJobId":"1:BASE_PARITY:0637ad987797850f"} 14:18:13 [14:18:13.794] INFO: prover-client:proving-broker Cleaned up jobs=1 14:18:13 [14:18:13.795] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:8070ffabb955d2fa err=test error {"provingJoId":"1:BASE_PARITY:8070ffabb955d2fa"} 14:18:13 [14:18:13.796] INFO: prover-client:proving-broker Proving Broker started 14:18:13 [14:18:13.797] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:1b17307e868a91a8 settled=false {"provingJobId":"1:BASE_PARITY:1b17307e868a91a8","status":"pending"} 14:18:13 [14:18:13.797] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:9c08180a0063eca6 settled=false {"provingJobId":"1:BASE_PARITY:9c08180a0063eca6","status":"pending"} 14:18:13 [14:18:13.800] INFO: prover-client:proving-broker Proving Broker started 14:18:13 [14:18:13.801] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:1b7dace06576f5e5 settled=true {"provingJobId":"1:BASE_PARITY:1b7dace06576f5e5","status":"fulfilled"} 14:18:13 [14:18:13.801] INFO: prover-client:proving-broker Restoring proving job id=2:BASE_PARITY:1121eff5897fb1b7 settled=true {"provingJobId":"2:BASE_PARITY:1121eff5897fb1b7","status":"fulfilled"} 14:18:13 [14:18:13.803] INFO: prover-client:proving-broker Proving Broker started 14:18:13 [14:18:13.803] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:4eee45c1e2f22e42 settled=true {"provingJobId":"1:BASE_PARITY:4eee45c1e2f22e42","status":"fulfilled"} 14:18:13 [14:18:13.803] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:9c8a5062d969f684 settled=false {"provingJobId":"1:BASE_PARITY:9c8a5062d969f684","status":"pending"} 14:18:13 [14:18:13.805] INFO: prover-client:proving-broker Proving Broker started 14:18:13 [14:18:13.807] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3e20a862dfe16186 epochNumber=1 {"provingJobId":"1:BASE_PARITY:3e20a862dfe16186"} 14:18:13 [14:18:13.810] INFO: prover-client:proving-broker Proving Broker started 14:18:13 [14:18:13.810] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a6bfada9f571c64e epochNumber=1 {"provingJobId":"1:BASE_PARITY:a6bfada9f571c64e"} 14:18:13 [14:18:13.811] ERROR: prover-client:proving-broker Failed to save proving job id=1:BASE_PARITY:a6bfada9f571c64e: Error: db error: Error: db error 14:18:13 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1126:63) {"provingJobId":"1:BASE_PARITY:a6bfada9f571c64e"} 14:18:13 [14:18:13.813] INFO: prover-client:proving-broker Proving Broker started 14:18:13 [14:18:13.813] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e80d978bc302ce12 epochNumber=1 {"provingJobId":"1:BASE_PARITY:e80d978bc302ce12"} 14:18:13 [14:18:13.814] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:e80d978bc302ce12 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:e80d978bc302ce12"} 14:18:13 [14:18:13.814] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:e80d978bc302ce12 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:e80d978bc302ce12"} 14:18:13 [14:18:13.815] INFO: prover-client:proving-broker Proving Broker started 14:18:13 [14:18:13.816] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e09ddecfcf478bc4 epochNumber=1 {"provingJobId":"1:BASE_PARITY:e09ddecfcf478bc4"} 14:18:13 [14:18:13.816] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:e09ddecfcf478bc4 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:e09ddecfcf478bc4"} 14:18:13 [14:18:13.816] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:e09ddecfcf478bc4 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:e09ddecfcf478bc4"} 14:18:13 [14:18:13.817] ERROR: prover-client:proving-broker Failed to save proving job result id=1:BASE_PARITY:e09ddecfcf478bc4: Error: db error 14:18:13 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1159:69) {"provingJobId":"1:BASE_PARITY:e09ddecfcf478bc4"} 14:18:13 [14:18:13.818] INFO: prover-client:proving-broker Proving Broker started 14:18:13 [14:18:13.819] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3b19a2817ee7cd72 epochNumber=1 {"provingJobId":"1:BASE_PARITY:3b19a2817ee7cd72"} 14:18:13 [14:18:13.819] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:3b19a2817ee7cd72 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:3b19a2817ee7cd72"} 14:18:13 [14:18:13.819] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:3b19a2817ee7cd72 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:3b19a2817ee7cd72"} 14:18:13 [14:18:13.821] INFO: prover-client:proving-broker Proving Broker started 14:18:13 [14:18:13.821] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:5a9fc520385ac212 epochNumber=1 {"provingJobId":"1:BASE_PARITY:5a9fc520385ac212"} 14:18:13 [14:18:13.821] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:5a9fc520385ac212 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:5a9fc520385ac212"} 14:18:13 [14:18:13.822] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:5a9fc520385ac212 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:5a9fc520385ac212"} 14:18:13 [14:18:13.822] ERROR: prover-client:proving-broker Failed to save proving job error status id=1:BASE_PARITY:5a9fc520385ac212 jobErr=test error: Error: db error 14:18:13 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1192:68) {"provingJobId":"1:BASE_PARITY:5a9fc520385ac212"} 14:18:13 [14:18:13.823] INFO: prover-client:proving-broker Proving Broker started 14:18:13 [14:18:13.824] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:59892969181dbfd9 not found {"provingJobId":"1:BASE_PARITY:59892969181dbfd9"} 14:18:13 [14:18:13.825] INFO: prover-client:proving-broker Proving Broker started 14:18:13 [14:18:13.826] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:f56094c20285f177 err=test error {"provingJoId":"1:BASE_PARITY:f56094c20285f177"} 14:18:13 [14:18:13.827] INFO: prover-client:proving-broker Proving Broker started 14:18:13 [14:18:13.838] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c42732ff09ddf82c epochNumber=1 {"provingJobId":"1:BASE_PARITY:c42732ff09ddf82c"} 14:18:13 [14:18:13.839] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:c42732ff09ddf82c type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:c42732ff09ddf82c"} 14:18:13 [14:18:13.839] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:c42732ff09ddf82c type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:c42732ff09ddf82c"} 14:18:13 [14:18:13.850] INFO: prover-client:proving-broker New proving job id=2:BASE_PARITY:13145f6b3b5f201f epochNumber=2 {"provingJobId":"2:BASE_PARITY:13145f6b3b5f201f"} 14:18:13 [14:18:13.851] WARN: prover-client:proving-broker Proving job id=2:BASE_PARITY:13145f6b3b5f201f type=BASE_PARITY not in the in-progress set {"provingJobId":"2:BASE_PARITY:13145f6b3b5f201f"} 14:18:13 [14:18:13.851] INFO: prover-client:proving-broker Proving job complete id=2:BASE_PARITY:13145f6b3b5f201f type=BASE_PARITY totalAttempts=1 {"provingJobId":"2:BASE_PARITY:13145f6b3b5f201f"} 14:18:13 [14:18:13.912] INFO: prover-client:proving-broker New proving job id=3:BASE_PARITY:422bb7e773d17dd3 epochNumber=3 {"provingJobId":"3:BASE_PARITY:422bb7e773d17dd3"} 14:18:13 [14:18:13.931] INFO: prover-client:proving-broker Cleaned up jobs=1 14:18:13 [14:18:13.975] INFO: prover-client:proving-broker New proving job id=4:BASE_PARITY:d8afa30cc2f7a0b8 epochNumber=4 {"provingJobId":"4:BASE_PARITY:d8afa30cc2f7a0b8"} 14:18:13 [14:18:13.982] INFO: prover-client:proving-broker Cleaned up jobs=1 14:18:14 [14:18:14.037] INFO: prover-client:proving-broker New proving job id=5:BASE_PARITY:1d30d66c27963c3d epochNumber=5 {"provingJobId":"5:BASE_PARITY:1d30d66c27963c3d"} 14:18:14 [14:18:14.057] INFO: prover-client:proving-broker Cleaned up jobs=1 14:18:14 [14:18:14.093] INFO: prover-client:proving-broker Proving Broker started 14:18:14 [14:18:14.093] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d028b86e5e6ef497 epochNumber=42 {"provingJobId":"1:BASE_PARITY:d028b86e5e6ef497"} 14:18:14 [14:18:14.094] INFO: prover-client:proving-broker-database Creating broker database for epoch 42 at /tmp/proving-broker-testDkMABv/42 with map size 1073741824 14:18:14 [14:18:14.098] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:14 [14:18:14.123] WARN: prover-client:proving-broker Tried enqueueing stale proving job id=1:BASE_PARITY:d31f01fd7180d841 epochNumber=1 {"provingJobId":"1:BASE_PARITY:d31f01fd7180d841"} 14:18:14 [14:18:14.127] INFO: prover-client:proving-broker Proving Broker started 14:18:14 [14:18:14.128] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:559e96283ceaffa3 epochNumber=1 {"provingJobId":"1:BASE_PARITY:559e96283ceaffa3"} 14:18:14 [14:18:14.128] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test6BDMpm/1 with map size 1073741824 14:18:14 [14:18:14.130] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:14 [14:18:14.147] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7f23d186c55f84a2 epochNumber=1 {"provingJobId":"1:BASE_PARITY:7f23d186c55f84a2"} 14:18:14 [14:18:14.156] INFO: prover-client:proving-broker Proving Broker started 14:18:14 [14:18:14.157] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:24a20c48a743d655 epochNumber=1 {"provingJobId":"1:BASE_PARITY:24a20c48a743d655"} 14:18:14 [14:18:14.157] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testPhNDBO/1 with map size 1073741824 14:18:14 [14:18:14.159] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:14 [14:18:14.181] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:24a20c48a743d655 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:24a20c48a743d655"} 14:18:14 [14:18:14.188] INFO: prover-client:proving-broker Proving Broker started 14:18:14 [14:18:14.189] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:65631ee46b7143e4 epochNumber=1 {"provingJobId":"1:BASE_PARITY:65631ee46b7143e4"} 14:18:14 [14:18:14.190] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testLSyxLF/1 with map size 1073741824 14:18:14 [14:18:14.192] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:14 [14:18:14.210] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:65631ee46b7143e4 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:65631ee46b7143e4"} 14:18:14 [14:18:14.211] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:65631ee46b7143e4 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:65631ee46b7143e4"} 14:18:14 [14:18:14.217] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:65631ee46b7143e4 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:65631ee46b7143e4"} 14:18:14 [14:18:14.223] INFO: prover-client:proving-broker Proving Broker started 14:18:14 [14:18:14.224] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b8090cea9c6397ea epochNumber=1 {"provingJobId":"1:BASE_PARITY:b8090cea9c6397ea"} 14:18:14 [14:18:14.225] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testGWzgph/1 with map size 1073741824 14:18:14 [14:18:14.227] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:14 [14:18:14.247] INFO: prover-client:proving-broker Proving Broker started 14:18:14 [14:18:14.249] INFO: prover-client:proving-broker Proving Broker started 14:18:14 [14:18:14.250] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6d4e5b1cad482b9d epochNumber=1 {"provingJobId":"1:BASE_PARITY:6d4e5b1cad482b9d"} 14:18:14 [14:18:14.250] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testIOIAS1/1 with map size 1073741824 14:18:14 [14:18:14.251] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:14 [14:18:14.274] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:6d4e5b1cad482b9d {"provingJobId":"1:BASE_PARITY:6d4e5b1cad482b9d"} 14:18:14 [14:18:14.275] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:6d4e5b1cad482b9d type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:6d4e5b1cad482b9d"} 14:18:14 [14:18:14.275] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:6d4e5b1cad482b9d type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:6d4e5b1cad482b9d"} 14:18:14 [14:18:14.285] INFO: prover-client:proving-broker Proving Broker started 14:18:14 [14:18:14.286] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:bf08848d1542ff42 epochNumber=1 {"provingJobId":"1:BASE_PARITY:bf08848d1542ff42"} 14:18:14 [14:18:14.287] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testC8vue9/1 with map size 1073741824 14:18:14 [14:18:14.289] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:14 [14:18:14.309] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:bf08848d1542ff42 {"provingJobId":"1:BASE_PARITY:bf08848d1542ff42"} 14:18:14 [14:18:14.310] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:bf08848d1542ff42 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:bf08848d1542ff42"} 14:18:14 [14:18:14.321] INFO: prover-client:proving-broker Proving Broker started 14:18:14 [14:18:14.321] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:4f92bc54e7fb7599 epochNumber=1 {"provingJobId":"1:BASE_PARITY:4f92bc54e7fb7599"} 14:18:14 [14:18:14.322] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test95Du0B/1 with map size 1073741824 14:18:14 [14:18:14.324] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:14 [14:18:14.340] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:4f92bc54e7fb7599 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:4f92bc54e7fb7599"} 14:18:14 [14:18:14.341] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:4f92bc54e7fb7599 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:4f92bc54e7fb7599"} 14:18:14 [14:18:14.350] INFO: prover-client:proving-broker Proving Broker started 14:18:14 [14:18:14.351] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f09507748099a0dc epochNumber=1 {"provingJobId":"1:BASE_PARITY:f09507748099a0dc"} 14:18:14 [14:18:14.351] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test4W7bug/1 with map size 1073741824 14:18:14 [14:18:14.354] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:14 [14:18:14.372] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:f09507748099a0dc type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:f09507748099a0dc"} 14:18:14 [14:18:14.373] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:f09507748099a0dc type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:f09507748099a0dc"} 14:18:14 [14:18:14.383] INFO: prover-client:proving-broker Proving Broker started 14:18:14 [14:18:14.384] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:311e6df68132769b epochNumber=0 {"provingJobId":"1:BASE_PARITY:311e6df68132769b"} 14:18:14 [14:18:14.385] INFO: prover-client:proving-broker-database Creating broker database for epoch 0 at /tmp/proving-broker-testse6EA2/0 with map size 1073741824 14:18:14 [14:18:14.389] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:14 [14:18:14.406] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:311e6df68132769b epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:311e6df68132769b"} 14:18:14 [14:18:14.407] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:61f0682cabfc4aa0 epochNumber=0 {"provingJobId":"1:BASE_PARITY:61f0682cabfc4aa0"} 14:18:14 [14:18:14.407] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:311e6df68132769b epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:311e6df68132769b"} 14:18:14 [14:18:14.408] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d2b07264fdd8aa36 epochNumber=0 {"provingJobId":"1:BASE_PARITY:d2b07264fdd8aa36"} 14:18:14 [14:18:14.422] INFO: prover-client:proving-broker Proving Broker started 14:18:14 [14:18:14.425] INFO: prover-client:proving-broker Proving Broker started 14:18:14 [14:18:14.426] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6f87b00dbae2dc77 epochNumber=2 {"provingJobId":"1:BASE_PARITY:6f87b00dbae2dc77"} 14:18:14 [14:18:14.426] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testir1XYu/2 with map size 1073741824 14:18:14 [14:18:14.428] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:14 [14:18:14.456] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:76febfac57890cc0 epochNumber=1 {"provingJobId":"1:BASE_PARITY:76febfac57890cc0"} 14:18:14 [14:18:14.459] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testir1XYu/1 with map size 1073741824 14:18:14 [14:18:14.461] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:14 [14:18:14.485] INFO: prover-client:proving-broker Proving Broker started 14:18:14 [14:18:14.486] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:fc5a611c66fe0110 epochNumber=1 {"provingJobId":"1:BASE_PARITY:fc5a611c66fe0110"} 14:18:14 [14:18:14.487] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testjCw9KY/1 with map size 1073741824 14:18:14 [14:18:14.489] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:14 [14:18:14.510] INFO: prover-client:proving-broker Proving Broker started 14:18:14 [14:18:14.510] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:287f95dee33ebe22 epochNumber=1 {"provingJobId":"1:BASE_PARITY:287f95dee33ebe22"} 14:18:14 [14:18:14.511] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testf9rPRq/1 with map size 1073741824 14:18:14 [14:18:14.513] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:14 [14:18:14.533] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:bfac767f3b46652a epochNumber=1 {"provingJobId":"1:BASE_PARITY:bfac767f3b46652a"} 14:18:14 [14:18:14.540] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d83c4ee1d9c52dd2 epochNumber=2 {"provingJobId":"1:BASE_PARITY:d83c4ee1d9c52dd2"} 14:18:14 [14:18:14.541] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testf9rPRq/2 with map size 1073741824 14:18:14 [14:18:14.543] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:14 [14:18:14.562] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0c999fe1450ee664 epochNumber=1 {"provingJobId":"1:BASE_PARITY:0c999fe1450ee664"} 14:18:14 [14:18:14.573] INFO: prover-client:proving-broker Proving Broker started 14:18:14 [14:18:14.574] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9416c87698ed2fe5 epochNumber=1 {"provingJobId":"1:BASE_PARITY:9416c87698ed2fe5"} 14:18:14 [14:18:14.575] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testK0nrQT/1 with map size 1073741824 14:18:14 [14:18:14.578] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:14 [14:18:14.598] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e8f2cef1cd5692f0 epochNumber=1 {"provingJobId":"1:BASE_PARITY:e8f2cef1cd5692f0"} 14:18:14 [14:18:14.604] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:cd06bc3f20be741d epochNumber=2 {"provingJobId":"1:BASE_PARITY:cd06bc3f20be741d"} 14:18:14 [14:18:14.605] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testK0nrQT/2 with map size 1073741824 14:18:14 [14:18:14.608] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:14 [14:18:14.629] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:802be5c2a0ce8fce epochNumber=1 {"provingJobId":"1:BASE_PARITY:802be5c2a0ce8fce"} 14:18:14 [14:18:14.639] INFO: prover-client:proving-broker Proving Broker started 14:18:14 [14:18:14.639] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3e26e3731bc979af epochNumber=1 {"provingJobId":"1:BASE_PARITY:3e26e3731bc979af"} 14:18:14 [14:18:14.640] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testf52nqw/1 with map size 1073741824 14:18:14 [14:18:14.643] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:14 [14:18:14.657] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:03751e7f70ec4894 epochNumber=1 {"provingJobId":"1:BASE_PARITY:03751e7f70ec4894"} 14:18:14 [14:18:14.663] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:933114a498d5119f epochNumber=2 {"provingJobId":"1:BASE_PARITY:933114a498d5119f"} 14:18:14 [14:18:14.664] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testf52nqw/2 with map size 1073741824 14:18:14 [14:18:14.671] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:14 [14:18:14.693] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:af2721175a9d9557 epochNumber=1 {"provingJobId":"1:BASE_PARITY:af2721175a9d9557"} 14:18:14 [14:18:14.706] INFO: prover-client:proving-broker Proving Broker started 14:18:14 [14:18:14.707] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:518cc97387e0f108 epochNumber=1 {"provingJobId":"1:BASE_PARITY:518cc97387e0f108"} 14:18:14 [14:18:14.707] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testizob8x/1 with map size 1073741824 14:18:14 [14:18:14.710] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:14 [14:18:14.727] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:dec10ad9121cb5ee epochNumber=1 {"provingJobId":"1:BASE_PARITY:dec10ad9121cb5ee"} 14:18:14 [14:18:14.733] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:518cc97387e0f108 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:518cc97387e0f108"} 14:18:14 [14:18:14.742] INFO: prover-client:proving-broker Proving Broker started 14:18:14 [14:18:14.743] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:bd02f071f684200d epochNumber=1 {"provingJobId":"1:BASE_PARITY:bd02f071f684200d"} 14:18:14 [14:18:14.744] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testxx4AfP/1 with map size 1073741824 14:18:14 [14:18:14.746] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:14 [14:18:14.762] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:fc184b2dd49ed11a epochNumber=1 {"provingJobId":"1:BASE_PARITY:fc184b2dd49ed11a"} 14:18:14 [14:18:14.768] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:bd02f071f684200d type=BASE_PARITY totalAttempts=1 err=result {"provingJobId":"1:BASE_PARITY:bd02f071f684200d"} 14:18:14 [14:18:14.777] INFO: prover-client:proving-broker Proving Broker started 14:18:14 [14:18:14.778] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:718bc5657ed1fca5 epochNumber=1 {"provingJobId":"1:BASE_PARITY:718bc5657ed1fca5"} 14:18:14 [14:18:14.778] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testXylnxY/1 with map size 1073741824 14:18:14 [14:18:14.780] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:14 [14:18:14.796] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ceaa59c37ef0c5cc epochNumber=1 {"provingJobId":"1:BASE_PARITY:ceaa59c37ef0c5cc"} 14:18:14 [14:18:14.802] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:718bc5657ed1fca5 type=BASE_PARITY retry=1 err=result {"provingJobId":"1:BASE_PARITY:718bc5657ed1fca5"} 14:18:14 [14:18:14.806] INFO: prover-client:proving-broker Proving Broker started 14:18:14 [14:18:14.807] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:396ffbb488afb46d epochNumber=1 {"provingJobId":"1:BASE_PARITY:396ffbb488afb46d"} 14:18:14 [14:18:14.808] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-tests682El/1 with map size 1073741824 14:18:14 [14:18:14.809] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:14 [14:18:14.826] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:396ffbb488afb46d {"provingJobId":"1:BASE_PARITY:396ffbb488afb46d"} 14:18:14 [14:18:14.826] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:396ffbb488afb46d type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:396ffbb488afb46d"} 14:18:14 [14:18:14.832] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6cc24c08fb562341 epochNumber=1 {"provingJobId":"1:BASE_PARITY:6cc24c08fb562341"} 14:18:14 [14:18:14.837] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:396ffbb488afb46d has already been completed {"provingJobId":"1:BASE_PARITY:396ffbb488afb46d"} 14:18:14 [14:18:14.841] INFO: prover-client:proving-broker Proving Broker started 14:18:14 [14:18:14.841] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f4bacdfde5068169 epochNumber=1 {"provingJobId":"1:BASE_PARITY:f4bacdfde5068169"} 14:18:14 [14:18:14.843] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testCrBn6h/1 with map size 1073741824 14:18:14 [14:18:14.845] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:14 [14:18:14.862] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e52dfafbe5e4e4de epochNumber=2 {"provingJobId":"1:BASE_PARITY:e52dfafbe5e4e4de"} 14:18:14 [14:18:14.863] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testCrBn6h/2 with map size 1073741824 14:18:14 [14:18:14.866] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:15 [14:18:15.936] INFO: prover-client:proving-broker Proving Broker started 14:18:15 [14:18:15.942] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:f4bacdfde5068169 settled=false {"provingJobId":"1:BASE_PARITY:f4bacdfde5068169","status":"pending"} 14:18:15 [14:18:15.944] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:e52dfafbe5e4e4de settled=false {"provingJobId":"1:BASE_PARITY:e52dfafbe5e4e4de","status":"pending"} 14:18:15 [14:18:15.945] INFO: prover-client:proving-broker Proving job id=1:BASE_PARITY:f4bacdfde5068169 type=BASE_PARITY startedAt=1750774694884 older agent has taken job {"provingJobId":"1:BASE_PARITY:f4bacdfde5068169"} 14:18:15 [14:18:15.945] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:f4bacdfde5068169 type=BASE_PARITY already being worked on by another agent. Sending new one {"provingJobId":"1:BASE_PARITY:f4bacdfde5068169"} 14:18:15 [14:18:15.949] INFO: prover-client:proving-broker Proving Broker started 14:18:15 [14:18:15.950] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9b5d0ad5a4d6a9d6 epochNumber=1 {"provingJobId":"1:BASE_PARITY:9b5d0ad5a4d6a9d6"} 14:18:15 [14:18:15.952] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testwj5inM/1 with map size 1073741824 14:18:15 [14:18:15.954] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:15 [14:18:15.975] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:afa9c3ea20c3af27 epochNumber=2 {"provingJobId":"1:BASE_PARITY:afa9c3ea20c3af27"} 14:18:15 [14:18:15.976] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testwj5inM/2 with map size 1073741824 14:18:15 [14:18:15.983] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:16 [14:18:16.999] INFO: prover-client:proving-broker Proving Broker started 14:18:17 [14:18:17.001] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:9b5d0ad5a4d6a9d6 settled=false {"provingJobId":"1:BASE_PARITY:9b5d0ad5a4d6a9d6","status":"pending"} 14:18:17 [14:18:17.002] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:afa9c3ea20c3af27 settled=false {"provingJobId":"1:BASE_PARITY:afa9c3ea20c3af27","status":"pending"} 14:18:17 [14:18:17.003] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:9b5d0ad5a4d6a9d6 type=BASE_PARITY not found in the in-progress cache, adding it {"provingJobId":"1:BASE_PARITY:9b5d0ad5a4d6a9d6"} 14:18:17 [14:18:17.008] INFO: prover-client:proving-broker Proving Broker started 14:18:17 [14:18:17.009] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:abbe07be886e7d6c epochNumber=1 {"provingJobId":"1:BASE_PARITY:abbe07be886e7d6c"} 14:18:17 [14:18:17.009] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testAob5MA/1 with map size 1073741824 14:18:17 [14:18:17.011] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:17 [14:18:17.030] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3fefeaef313e6384 epochNumber=2 {"provingJobId":"1:BASE_PARITY:3fefeaef313e6384"} 14:18:17 [14:18:17.031] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testAob5MA/2 with map size 1073741824 14:18:17 [14:18:17.035] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:18 [14:18:18.058] INFO: prover-client:proving-broker Proving Broker started 14:18:18 [14:18:18.061] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:abbe07be886e7d6c settled=false {"provingJobId":"1:BASE_PARITY:abbe07be886e7d6c","status":"pending"} 14:18:18 [14:18:18.066] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:3fefeaef313e6384 settled=false {"provingJobId":"1:BASE_PARITY:3fefeaef313e6384","status":"pending"} 14:18:18 [14:18:18.068] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:abbe07be886e7d6c type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:abbe07be886e7d6c"} 14:18:18 [14:18:18.068] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:abbe07be886e7d6c type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:abbe07be886e7d6c"} 14:18:18 [14:18:18.083] INFO: prover-client:proving-broker Proving Broker started 14:18:18 [14:18:18.083] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c2884e6f69015ee9 epochNumber=1 {"provingJobId":"1:BASE_PARITY:c2884e6f69015ee9"} 14:18:18 [14:18:18.084] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testKynQqT/1 with map size 1073741824 14:18:18 [14:18:18.086] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:18 [14:18:18.107] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:197cb19d131f5b72 epochNumber=2 {"provingJobId":"1:BASE_PARITY:197cb19d131f5b72"} 14:18:18 [14:18:18.108] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testKynQqT/2 with map size 1073741824 14:18:18 [14:18:18.110] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:18 [14:18:18.129] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:c2884e6f69015ee9 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:c2884e6f69015ee9"} 14:18:18 [14:18:18.137] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:197cb19d131f5b72 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:197cb19d131f5b72"} 14:18:18 [14:18:18.147] INFO: prover-client:proving-broker Proving Broker started 14:18:18 [14:18:18.148] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:62e0478914af3b7f epochNumber=1 {"provingJobId":"1:BASE_PARITY:62e0478914af3b7f"} 14:18:18 [14:18:18.150] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test2hy1Th/1 with map size 1073741824 14:18:18 [14:18:18.151] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:18 [14:18:18.175] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b530a04d24d80e70 epochNumber=2 {"provingJobId":"1:BASE_PARITY:b530a04d24d80e70"} 14:18:18 [14:18:18.177] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-test2hy1Th/2 with map size 1073741824 14:18:18 [14:18:18.180] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:18 [14:18:18.197] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:62e0478914af3b7f type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:62e0478914af3b7f"} 14:18:18 [14:18:18.198] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:62e0478914af3b7f type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:62e0478914af3b7f"} 14:18:18 [14:18:18.204] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:b530a04d24d80e70 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:b530a04d24d80e70"} 14:18:18 [14:18:18.214] INFO: prover-client:proving-broker Proving Broker started 14:18:18 [14:18:18.215] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:3531969b9bc70e95 err=test error {"provingJoId":"1:BASE_PARITY:3531969b9bc70e95"} 14:18:18 [14:18:18.218] INFO: prover-client:proving-broker Proving Broker started 14:18:18 [14:18:18.219] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:e3b59aa998153042 not found {"provingJobId":"1:BASE_PARITY:e3b59aa998153042"} 14:18:18 [14:18:18.222] INFO: prover-client:proving-broker Proving Broker started 14:18:18 [14:18:18.222] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:278fb769fb7b68d1 epochNumber=1 {"provingJobId":"1:BASE_PARITY:278fb769fb7b68d1"} 14:18:18 [14:18:18.223] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testTG8m1s/1 with map size 1073741824 14:18:18 [14:18:18.225] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:18 [14:18:18.250] INFO: prover-client:proving-broker Proving Broker started 14:18:18 [14:18:18.252] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b6035ce9293cc85a epochNumber=1 {"provingJobId":"1:BASE_PARITY:b6035ce9293cc85a"} 14:18:18 [14:18:18.252] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testG19CP4/1 with map size 1073741824 14:18:18 [14:18:18.255] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:18 [14:18:18.383] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:b6035ce9293cc85a timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:b6035ce9293cc85a"} 14:18:18 [14:18:18.393] INFO: prover-client:proving-broker Proving Broker started 14:18:18 [14:18:18.394] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:05d2fdae7b72382b epochNumber=1 {"provingJobId":"1:BASE_PARITY:05d2fdae7b72382b"} 14:18:18 [14:18:18.395] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testKylPOg/1 with map size 1073741824 14:18:18 [14:18:18.397] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:18 [14:18:18.523] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:05d2fdae7b72382b timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:05d2fdae7b72382b"} 14:18:18 [14:18:18.529] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9c4ea0aa28f999cd epochNumber=10 {"provingJobId":"1:BASE_PARITY:9c4ea0aa28f999cd"} 14:18:18 [14:18:18.530] INFO: prover-client:proving-broker-database Creating broker database for epoch 10 at /tmp/proving-broker-testKylPOg/10 with map size 1073741824 14:18:18 [14:18:18.532] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:18 [14:18:18.574] INFO: prover-client:proving-broker Cleaned up jobs=1 14:18:18 [14:18:18.575] INFO: prover-client:proving-broker-database Deleting broker database for epoch 1 14:18:18 [14:18:18.685] INFO: prover-client:proving-broker Proving Broker started 14:18:18 [14:18:18.686] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f53b21806bb1b70a epochNumber=1 {"provingJobId":"1:BASE_PARITY:f53b21806bb1b70a"} 14:18:18 [14:18:18.687] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test1s1v73/1 with map size 1073741824 14:18:18 [14:18:18.689] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:18 [14:18:18.864] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:f53b21806bb1b70a timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:f53b21806bb1b70a"} 14:18:18 [14:18:18.915] INFO: prover-client:proving-broker Proving Broker started 14:18:18 [14:18:18.916] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:085b71951a6df971 epochNumber=1 {"provingJobId":"1:BASE_PARITY:085b71951a6df971"} 14:18:18 [14:18:18.917] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testSulmzT/1 with map size 1073741824 14:18:18 [14:18:18.919] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:18 [14:18:18.939] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:085b71951a6df971 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:085b71951a6df971"} 14:18:18 [14:18:18.944] INFO: prover-client:proving-broker Proving Broker started 14:18:18 [14:18:18.945] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2ef25f17214e1990 epochNumber=1 {"provingJobId":"1:BASE_PARITY:2ef25f17214e1990"} 14:18:18 [14:18:18.946] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test23eJx1/1 with map size 1073741824 14:18:18 [14:18:18.948] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:18 [14:18:18.979] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:2ef25f17214e1990 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:2ef25f17214e1990"} 14:18:18 [14:18:18.980] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:2ef25f17214e1990 type=BASE_PARITY totalAttempts=2 err=test error {"provingJobId":"1:BASE_PARITY:2ef25f17214e1990"} 14:18:18 [14:18:18.990] INFO: prover-client:proving-broker Proving Broker started 14:18:18 [14:18:18.991] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:24a0596c19ec8d8a epochNumber=1 {"provingJobId":"1:BASE_PARITY:24a0596c19ec8d8a"} 14:18:18 [14:18:18.992] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testRCNpqy/1 with map size 1073741824 14:18:18 [14:18:18.995] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:19 [14:18:19.017] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:24a0596c19ec8d8a type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:24a0596c19ec8d8a"} 14:18:19 [14:18:19.029] INFO: prover-client:proving-broker Proving Broker started 14:18:19 [14:18:19.030] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:86d83fbcf3228c97 epochNumber=1 {"provingJobId":"1:BASE_PARITY:86d83fbcf3228c97"} 14:18:19 [14:18:19.031] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test6L9i8W/1 with map size 1073741824 14:18:19 [14:18:19.033] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:19 [14:18:19.051] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:86d83fbcf3228c97 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:86d83fbcf3228c97"} 14:18:19 [14:18:19.052] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d2f969d1c0326b5b epochNumber=3 {"provingJobId":"1:BASE_PARITY:d2f969d1c0326b5b"} 14:18:19 [14:18:19.053] INFO: prover-client:proving-broker-database Creating broker database for epoch 3 at /tmp/proving-broker-test6L9i8W/3 with map size 1073741824 14:18:19 [14:18:19.057] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:19 [14:18:19.108] INFO: prover-client:proving-broker Cleaned up jobs=1 14:18:19 [14:18:19.108] INFO: prover-client:proving-broker-database Deleting broker database for epoch 1 14:18:19 [14:18:19.116] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:86d83fbcf3228c97 err=test error {"provingJoId":"1:BASE_PARITY:86d83fbcf3228c97"} 14:18:19 [14:18:19.122] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testCQvvM0/1 with map size 1073741824 14:18:19 [14:18:19.125] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:19 [14:18:19.148] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testCQvvM0/2 with map size 1073741824 14:18:19 [14:18:19.151] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:19 [14:18:19.175] INFO: prover-client:proving-broker Proving Broker started 14:18:19 [14:18:19.185] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:9ac074b33afd3dcf settled=false {"provingJobId":"1:BASE_PARITY:9ac074b33afd3dcf","status":"pending"} 14:18:19 [14:18:19.187] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:de0766c51f7cb023 settled=false {"provingJobId":"1:BASE_PARITY:de0766c51f7cb023","status":"pending"} 14:18:19 [14:18:19.196] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testS0Ic7l/1 with map size 1073741824 14:18:19 [14:18:19.200] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:19 [14:18:19.219] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testS0Ic7l/2 with map size 1073741824 14:18:19 [14:18:19.222] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:19 [14:18:19.248] INFO: prover-client:proving-broker Proving Broker started 14:18:19 [14:18:19.251] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:dc521a4a3a2df598 settled=true {"provingJobId":"1:BASE_PARITY:dc521a4a3a2df598","status":"fulfilled"} 14:18:19 [14:18:19.253] INFO: prover-client:proving-broker Restoring proving job id=2:BASE_PARITY:00ee94d2ed89df99 settled=true {"provingJobId":"2:BASE_PARITY:00ee94d2ed89df99","status":"fulfilled"} 14:18:19 [14:18:19.258] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testVupqka/1 with map size 1073741824 14:18:19 [14:18:19.260] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:19 [14:18:19.291] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testVupqka/2 with map size 1073741824 14:18:19 [14:18:19.293] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:19 [14:18:19.309] INFO: prover-client:proving-broker Proving Broker started 14:18:19 [14:18:19.311] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:66c3b0bbabd1aaac settled=true {"provingJobId":"1:BASE_PARITY:66c3b0bbabd1aaac","status":"fulfilled"} 14:18:19 [14:18:19.316] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:fe7e4255bde71e4a settled=false {"provingJobId":"1:BASE_PARITY:fe7e4255bde71e4a","status":"pending"} 14:18:19 [14:18:19.321] INFO: prover-client:proving-broker Proving Broker started 14:18:19 [14:18:19.322] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:bfdfdad7c1a294e7 epochNumber=1 {"provingJobId":"1:BASE_PARITY:bfdfdad7c1a294e7"} 14:18:19 [14:18:19.323] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testGG7hvY/1 with map size 1073741824 14:18:19 [14:18:19.327] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:19 [14:18:19.350] INFO: prover-client:proving-broker Proving Broker started 14:18:19 [14:18:19.351] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c77619f715335793 epochNumber=1 {"provingJobId":"1:BASE_PARITY:c77619f715335793"} 14:18:19 [14:18:19.352] ERROR: prover-client:proving-broker Failed to save proving job id=1:BASE_PARITY:c77619f715335793: Error: db error: Error: db error 14:18:19 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1126:63) {"provingJobId":"1:BASE_PARITY:c77619f715335793"} 14:18:19 [14:18:19.355] INFO: prover-client:proving-broker Proving Broker started 14:18:19 [14:18:19.355] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c25248b81850b834 epochNumber=1 {"provingJobId":"1:BASE_PARITY:c25248b81850b834"} 14:18:19 [14:18:19.356] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testJScfNr/1 with map size 1073741824 14:18:19 [14:18:19.358] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:19 [14:18:19.387] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:c25248b81850b834 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:c25248b81850b834"} 14:18:19 [14:18:19.388] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:c25248b81850b834 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:c25248b81850b834"} 14:18:19 [14:18:19.398] INFO: prover-client:proving-broker Proving Broker started 14:18:19 [14:18:19.399] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:fd8965c6d2f8f8e8 epochNumber=1 {"provingJobId":"1:BASE_PARITY:fd8965c6d2f8f8e8"} 14:18:19 [14:18:19.400] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testk9YT6J/1 with map size 1073741824 14:18:19 [14:18:19.404] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:19 [14:18:19.421] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:fd8965c6d2f8f8e8 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:fd8965c6d2f8f8e8"} 14:18:19 [14:18:19.421] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:fd8965c6d2f8f8e8 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:fd8965c6d2f8f8e8"} 14:18:19 [14:18:19.423] ERROR: prover-client:proving-broker Failed to save proving job result id=1:BASE_PARITY:fd8965c6d2f8f8e8: Error: db error 14:18:19 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1159:69) {"provingJobId":"1:BASE_PARITY:fd8965c6d2f8f8e8"} 14:18:19 [14:18:19.428] INFO: prover-client:proving-broker Proving Broker started 14:18:19 [14:18:19.429] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2dc5295a170084a4 epochNumber=1 {"provingJobId":"1:BASE_PARITY:2dc5295a170084a4"} 14:18:19 [14:18:19.430] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testg0PI37/1 with map size 1073741824 14:18:19 [14:18:19.432] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:19 [14:18:19.451] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:2dc5295a170084a4 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:2dc5295a170084a4"} 14:18:19 [14:18:19.452] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:2dc5295a170084a4 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:2dc5295a170084a4"} 14:18:19 [14:18:19.470] INFO: prover-client:proving-broker Proving Broker started 14:18:19 [14:18:19.471] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:767a279ea05d7715 epochNumber=1 {"provingJobId":"1:BASE_PARITY:767a279ea05d7715"} 14:18:19 [14:18:19.472] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testJqrRaH/1 with map size 1073741824 14:18:19 [14:18:19.474] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:19 [14:18:19.496] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:767a279ea05d7715 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:767a279ea05d7715"} 14:18:19 [14:18:19.497] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:767a279ea05d7715 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:767a279ea05d7715"} 14:18:19 [14:18:19.498] ERROR: prover-client:proving-broker Failed to save proving job error status id=1:BASE_PARITY:767a279ea05d7715 jobErr=test error: Error: db error 14:18:19 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1192:68) {"provingJobId":"1:BASE_PARITY:767a279ea05d7715"} 14:18:19 [14:18:19.502] INFO: prover-client:proving-broker Proving Broker started 14:18:19 [14:18:19.502] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:9a92e089353fd132 not found {"provingJobId":"1:BASE_PARITY:9a92e089353fd132"} 14:18:19 [14:18:19.507] INFO: prover-client:proving-broker Proving Broker started 14:18:19 [14:18:19.508] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:62cb7cbdc4fd2b61 err=test error {"provingJoId":"1:BASE_PARITY:62cb7cbdc4fd2b61"} 14:18:19 [14:18:19.511] INFO: prover-client:proving-broker Proving Broker started 14:18:19 [14:18:19.522] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:19b126d60f404053 epochNumber=1 {"provingJobId":"1:BASE_PARITY:19b126d60f404053"} 14:18:19 [14:18:19.523] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testx2OeYF/1 with map size 1073741824 14:18:19 [14:18:19.526] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:19 [14:18:19.545] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:19b126d60f404053 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:19b126d60f404053"} 14:18:19 [14:18:19.546] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:19b126d60f404053 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:19b126d60f404053"} 14:18:19 [14:18:19.564] INFO: prover-client:proving-broker New proving job id=2:BASE_PARITY:5d65a604138ccd6d epochNumber=2 {"provingJobId":"2:BASE_PARITY:5d65a604138ccd6d"} 14:18:19 [14:18:19.570] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testx2OeYF/2 with map size 1073741824 14:18:19 [14:18:19.576] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:19 [14:18:19.595] WARN: prover-client:proving-broker Proving job id=2:BASE_PARITY:5d65a604138ccd6d type=BASE_PARITY not in the in-progress set {"provingJobId":"2:BASE_PARITY:5d65a604138ccd6d"} 14:18:19 [14:18:19.595] INFO: prover-client:proving-broker Proving job complete id=2:BASE_PARITY:5d65a604138ccd6d type=BASE_PARITY totalAttempts=1 {"provingJobId":"2:BASE_PARITY:5d65a604138ccd6d"} 14:18:19 [14:18:19.665] INFO: prover-client:proving-broker New proving job id=3:BASE_PARITY:88c682851213560b epochNumber=3 {"provingJobId":"3:BASE_PARITY:88c682851213560b"} 14:18:19 [14:18:19.667] INFO: prover-client:proving-broker-database Creating broker database for epoch 3 at /tmp/proving-broker-testx2OeYF/3 with map size 1073741824 14:18:19 [14:18:19.670] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:19 [14:18:19.718] INFO: prover-client:proving-broker Cleaned up jobs=1 14:18:19 [14:18:19.718] INFO: prover-client:proving-broker-database Deleting broker database for epoch 1 14:18:19 [14:18:19.754] INFO: prover-client:proving-broker New proving job id=4:BASE_PARITY:32bd0cecf68cea32 epochNumber=4 {"provingJobId":"4:BASE_PARITY:32bd0cecf68cea32"} 14:18:19 [14:18:19.757] INFO: prover-client:proving-broker-database Creating broker database for epoch 4 at /tmp/proving-broker-testx2OeYF/4 with map size 1073741824 14:18:19 [14:18:19.760] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:19 [14:18:19.803] INFO: prover-client:proving-broker Cleaned up jobs=1 14:18:19 [14:18:19.804] INFO: prover-client:proving-broker-database Deleting broker database for epoch 2 14:18:19 [14:18:19.854] INFO: prover-client:proving-broker New proving job id=5:BASE_PARITY:df4e4bc3ebf3f208 epochNumber=5 {"provingJobId":"5:BASE_PARITY:df4e4bc3ebf3f208"} 14:18:19 [14:18:19.857] INFO: prover-client:proving-broker-database Creating broker database for epoch 5 at /tmp/proving-broker-testx2OeYF/5 with map size 1073741824 14:18:19 [14:18:19.860] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 14:18:19 [14:18:19.908] INFO: prover-client:proving-broker Cleaned up jobs=1 14:18:19 [14:18:19.909] INFO: prover-client:proving-broker-database Deleting broker database for epoch 3 14:18:19 PASS src/proving_broker/proving_broker.test.ts (13.13 s) 14:18:19 ProvingBroker 14:18:19 Producer API 14:18:19 ✓ refuses stale jobs (37 ms) 14:18:19 ✓ enqueues jobs (4 ms) 14:18:19 ✓ ignores duplicate jobs (4 ms) 14:18:19 ✓ reports correct status when enqueuing repeat jobs (4 ms) 14:18:19 ✓ throws an error in case of duplicate job IDs (22 ms) 14:18:19 ✓ returns not-found status for non-existing jobs (2 ms) 14:18:19 ✓ cancels jobs in queue (2 ms) 14:18:19 ✓ cancels jobs in-progress (2 ms) 14:18:19 ✓ returns job result if successful (9 ms) 14:18:19 ✓ returns job error if failed (2 ms) 14:18:19 ✓ correctly returns job status for concurrent writes (2 ms) 14:18:19 ✓ refuses stale jobs (36 ms) 14:18:19 ✓ enqueues jobs (28 ms) 14:18:19 ✓ ignores duplicate jobs (30 ms) 14:18:19 ✓ reports correct status when enqueuing repeat jobs (33 ms) 14:18:19 ✓ throws an error in case of duplicate job IDs (26 ms) 14:18:19 ✓ returns not-found status for non-existing jobs (2 ms) 14:18:19 ✓ cancels jobs in queue (35 ms) 14:18:19 ✓ cancels jobs in-progress (34 ms) 14:18:19 ✓ returns job result if successful (29 ms) 14:18:19 ✓ returns job error if failed (32 ms) 14:18:19 ✓ correctly returns job status for concurrent writes (41 ms) 14:18:19 Consumer API 14:18:19 ✓ returns undefined if no jobs are available (1 ms) 14:18:19 ✓ returns jobs in priority order (1 ms) 14:18:19 ✓ returns undefined if no jobs are available for the given allowList (1 ms) 14:18:19 ✓ returns a job if it is in the allowList (2 ms) 14:18:19 ✓ returns the most important job if it is in the allowList (2 ms) 14:18:19 ✓ returns any job if filter is empty (2 ms) 14:18:19 ✓ returns a new job when reporting job success (2 ms) 14:18:19 ✓ returns a new job when reporting permanent error (2 ms) 14:18:19 ✓ returns a new job when reporting retry-able error (1 ms) 14:18:19 ✓ returns a new job when reporting progress if current one is cancelled (3 ms) 14:18:19 ✓ returns a new job if job is already in progress elsewhere (1055 ms) 14:18:19 ✓ avoids sending the same job to a new agent after a restart (1004 ms) 14:18:19 ✓ avoids sending a completed job to a new agent after a restart (1006 ms) 14:18:19 ✓ tracks job result if in progress (3 ms) 14:18:19 ✓ tracks job result even if job is in queue (3 ms) 14:18:19 ✓ ignores reported job error if unknown job (1 ms) 14:18:19 ✓ ignores job result if unknown job (1 ms) 14:18:19 ✓ returns undefined if no jobs are available (3 ms) 14:18:19 ✓ returns jobs in priority order (58 ms) 14:18:19 ✓ returns undefined if no jobs are available for the given allowList (25 ms) 14:18:19 ✓ returns a job if it is in the allowList (63 ms) 14:18:19 ✓ returns the most important job if it is in the allowList (66 ms) 14:18:19 ✓ returns any job if filter is empty (66 ms) 14:18:19 ✓ returns a new job when reporting job success (36 ms) 14:18:19 ✓ returns a new job when reporting permanent error (35 ms) 14:18:19 ✓ returns a new job when reporting retry-able error (29 ms) 14:18:19 ✓ returns a new job when reporting progress if current one is cancelled (35 ms) 14:18:19 ✓ returns a new job if job is already in progress elsewhere (1108 ms) 14:18:19 ✓ avoids sending the same job to a new agent after a restart (1057 ms) 14:18:19 ✓ avoids sending a completed job to a new agent after a restart (1074 ms) 14:18:19 ✓ tracks job result if in progress (65 ms) 14:18:19 ✓ tracks job result even if job is in queue (66 ms) 14:18:19 ✓ ignores reported job error if unknown job (4 ms) 14:18:19 ✓ ignores job result if unknown job (3 ms) 14:18:19 Timeouts 14:18:19 ✓ tracks in progress jobs (1 ms) 14:18:19 ✓ re-enqueues jobs that time out (109 ms) 14:18:19 ✓ cancel stale jobs that time out (238 ms) 14:18:19 ✓ keeps the jobs in progress while it is alive (203 ms) 14:18:19 ✓ tracks in progress jobs (27 ms) 14:18:19 ✓ re-enqueues jobs that time out (144 ms) 14:18:19 ✓ cancel stale jobs that time out (287 ms) 14:18:19 ✓ keeps the jobs in progress while it is alive (235 ms) 14:18:19 Retries 14:18:19 ✓ retries jobs (3 ms) 14:18:19 ✓ retries up to a maximum number of times (3 ms) 14:18:19 ✓ passing retry=false does not retry (2 ms) 14:18:19 ✓ does not retry if job is stale (27 ms) 14:18:19 ✓ retries jobs (27 ms) 14:18:19 ✓ retries up to a maximum number of times (46 ms) 14:18:19 ✓ passing retry=false does not retry (37 ms) 14:18:19 ✓ does not retry if job is stale (93 ms) 14:18:19 Database management 14:18:19 ✓ re-enqueues proof requests on start (3 ms) 14:18:19 ✓ restores proof results on start (3 ms) 14:18:19 ✓ only re-enqueues unfinished jobs (2 ms) 14:18:19 ✓ saves job when enqueued (4 ms) 14:18:19 ✓ does not retain job if database fails to save (3 ms) 14:18:19 ✓ saves job result (2 ms) 14:18:19 ✓ saves result even if database fails to save (3 ms) 14:18:19 ✓ saves job error (2 ms) 14:18:19 ✓ saves job error even if database fails to save (3 ms) 14:18:19 ✓ does not save job result if job is unknown (2 ms) 14:18:19 ✓ does not save job error if job is unknown (1 ms) 14:18:19 ✓ cleans up old jobs periodically (263 ms) 14:18:19 ✓ re-enqueues proof requests on start (71 ms) 14:18:19 ✓ restores proof results on start (64 ms) 14:18:19 ✓ only re-enqueues unfinished jobs (63 ms) 14:18:19 ✓ saves job when enqueued (28 ms) 14:18:19 ✓ does not retain job if database fails to save (4 ms) 14:18:19 ✓ saves job result (42 ms) 14:18:19 ✓ saves result even if database fails to save (29 ms) 14:18:19 ✓ saves job error (34 ms) 14:18:19 ✓ saves job error even if database fails to save (39 ms) 14:18:19 ✓ does not save job result if job is unknown (4 ms) 14:18:19 ✓ does not save job error if job is unknown (5 ms) 14:18:19 ✓ cleans up old jobs periodically (433 ms) 14:18:19 14:18:19 Test Suites: 1 passed, 1 total 14:18:19 Tests: 96 passed, 96 total 14:18:19 Snapshots: 0 total 14:18:19 Time: 13.234 s 14:18:19 Ran all test suites matching prover-client/src/proving_broker/proving_broker.test.ts. 14:18:19 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?