Parent Log: http://ci.aztec-labs.com/83b16f57969d44fb Command: 71ec8227227d28e6 yarn-project/scripts/run_test.sh prover-client/src/proving_broker/proving_broker.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/a45107e7f95b675cb2768b6bcb06483b511141f4 Env: REF_NAME=gh-readonly-queue/next/pr-15018-2731d9a8aebf63d05db1a786296abdf897c49490 CURRENT_VERSION=0.87.6 CI_FULL=1 Date: Thu Jun 12 17:44:45 UTC 2025 System: ARCH=amd64 CPUS=128 MEM=493Gi HOSTNAME=pr-15018_amd64_x2-full Resources: CPU_LIST=0-127 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_b95296ef06707e5f_next 17:44:49 [17:44:49.125] INFO: prover-client:proving-broker Proving Broker started 17:44:49 [17:44:49.131] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c2f4dc4c925b925f epochNumber=42 {"provingJobId":"1:BASE_PARITY:c2f4dc4c925b925f"} 17:44:49 [17:44:49.133] WARN: prover-client:proving-broker Tried enqueueing stale proving job id=1:BASE_PARITY:3131837ce0ae5938 epochNumber=1 {"provingJobId":"1:BASE_PARITY:3131837ce0ae5938"} 17:44:49 [17:44:49.168] INFO: prover-client:proving-broker Proving Broker started 17:44:49 [17:44:49.169] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a62974027fcbaea1 epochNumber=1 {"provingJobId":"1:BASE_PARITY:a62974027fcbaea1"} 17:44:49 [17:44:49.171] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a1b9b1414053f5dc epochNumber=1 {"provingJobId":"1:BASE_PARITY:a1b9b1414053f5dc"} 17:44:49 [17:44:49.173] INFO: prover-client:proving-broker Proving Broker started 17:44:49 [17:44:49.174] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6883bf3347e14277 epochNumber=1 {"provingJobId":"1:BASE_PARITY:6883bf3347e14277"} 17:44:49 [17:44:49.175] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:6883bf3347e14277 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:6883bf3347e14277"} 17:44:49 [17:44:49.177] INFO: prover-client:proving-broker Proving Broker started 17:44:49 [17:44:49.178] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0458d6960a0a0d9f epochNumber=1 {"provingJobId":"1:BASE_PARITY:0458d6960a0a0d9f"} 17:44:49 [17:44:49.179] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:0458d6960a0a0d9f epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:0458d6960a0a0d9f"} 17:44:49 [17:44:49.179] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:0458d6960a0a0d9f type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:0458d6960a0a0d9f"} 17:44:49 [17:44:49.180] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:0458d6960a0a0d9f epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:0458d6960a0a0d9f"} 17:44:49 [17:44:49.182] INFO: prover-client:proving-broker Proving Broker started 17:44:49 [17:44:49.182] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e5e93214ac75f08a epochNumber=1 {"provingJobId":"1:BASE_PARITY:e5e93214ac75f08a"} 17:44:49 [17:44:49.208] INFO: prover-client:proving-broker Proving Broker started 17:44:49 [17:44:49.210] INFO: prover-client:proving-broker Proving Broker started 17:44:49 [17:44:49.210] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:78960b5a5ee9d554 epochNumber=1 {"provingJobId":"1:BASE_PARITY:78960b5a5ee9d554"} 17:44:49 [17:44:49.211] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:78960b5a5ee9d554 {"provingJobId":"1:BASE_PARITY:78960b5a5ee9d554"} 17:44:49 [17:44:49.211] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:78960b5a5ee9d554 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:78960b5a5ee9d554"} 17:44:49 [17:44:49.212] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:78960b5a5ee9d554 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:78960b5a5ee9d554"} 17:44:49 [17:44:49.213] INFO: prover-client:proving-broker Proving Broker started 17:44:49 [17:44:49.213] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:8f1ca77c4f32e4e2 epochNumber=1 {"provingJobId":"1:BASE_PARITY:8f1ca77c4f32e4e2"} 17:44:49 [17:44:49.214] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:8f1ca77c4f32e4e2 {"provingJobId":"1:BASE_PARITY:8f1ca77c4f32e4e2"} 17:44:49 [17:44:49.214] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:8f1ca77c4f32e4e2 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:8f1ca77c4f32e4e2"} 17:44:49 [17:44:49.226] INFO: prover-client:proving-broker Proving Broker started 17:44:49 [17:44:49.227] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1bd06bb795e0d0ef epochNumber=1 {"provingJobId":"1:BASE_PARITY:1bd06bb795e0d0ef"} 17:44:49 [17:44:49.227] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:1bd06bb795e0d0ef type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:1bd06bb795e0d0ef"} 17:44:49 [17:44:49.228] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:1bd06bb795e0d0ef type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:1bd06bb795e0d0ef"} 17:44:49 [17:44:49.229] INFO: prover-client:proving-broker Proving Broker started 17:44:49 [17:44:49.230] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:147ca30203f41739 epochNumber=1 {"provingJobId":"1:BASE_PARITY:147ca30203f41739"} 17:44:49 [17:44:49.231] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:147ca30203f41739 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:147ca30203f41739"} 17:44:49 [17:44:49.231] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:147ca30203f41739 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:147ca30203f41739"} 17:44:49 [17:44:49.232] INFO: prover-client:proving-broker Proving Broker started 17:44:49 [17:44:49.233] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:94df3a185b33fd50 epochNumber=0 {"provingJobId":"1:BASE_PARITY:94df3a185b33fd50"} 17:44:49 [17:44:49.233] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:94df3a185b33fd50 epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:94df3a185b33fd50"} 17:44:49 [17:44:49.234] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:894524bda811f863 epochNumber=0 {"provingJobId":"1:BASE_PARITY:894524bda811f863"} 17:44:49 [17:44:49.234] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:94df3a185b33fd50 epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:94df3a185b33fd50"} 17:44:49 [17:44:49.234] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:79b9e2e8110c0837 epochNumber=0 {"provingJobId":"1:BASE_PARITY:79b9e2e8110c0837"} 17:44:49 [17:44:49.236] INFO: prover-client:proving-broker Proving Broker started 17:44:49 [17:44:49.237] INFO: prover-client:proving-broker Proving Broker started 17:44:49 [17:44:49.238] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f685f5217b370726 epochNumber=2 {"provingJobId":"1:BASE_PARITY:f685f5217b370726"} 17:44:49 [17:44:49.238] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:596de1c63da0a25d epochNumber=1 {"provingJobId":"1:BASE_PARITY:596de1c63da0a25d"} 17:44:49 [17:44:49.240] INFO: prover-client:proving-broker Proving Broker started 17:44:49 [17:44:49.240] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6b2c6b593f74debc epochNumber=1 {"provingJobId":"1:BASE_PARITY:6b2c6b593f74debc"} 17:44:49 [17:44:49.241] INFO: prover-client:proving-broker Proving Broker started 17:44:49 [17:44:49.242] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0d94d289e6e43364 epochNumber=1 {"provingJobId":"1:BASE_PARITY:0d94d289e6e43364"} 17:44:49 [17:44:49.242] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:20078cdf3b4ea1dd epochNumber=1 {"provingJobId":"1:BASE_PARITY:20078cdf3b4ea1dd"} 17:44:49 [17:44:49.242] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:85ccf0fcb90ad699 epochNumber=2 {"provingJobId":"1:BASE_PARITY:85ccf0fcb90ad699"} 17:44:49 [17:44:49.243] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:56ae1b629547d7e3 epochNumber=1 {"provingJobId":"1:BASE_PARITY:56ae1b629547d7e3"} 17:44:49 [17:44:49.244] INFO: prover-client:proving-broker Proving Broker started 17:44:49 [17:44:49.244] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d872ef0486576288 epochNumber=1 {"provingJobId":"1:BASE_PARITY:d872ef0486576288"} 17:44:49 [17:44:49.245] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1644f7a9e5f42446 epochNumber=1 {"provingJobId":"1:BASE_PARITY:1644f7a9e5f42446"} 17:44:49 [17:44:49.245] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7b69d922bd9c39a9 epochNumber=2 {"provingJobId":"1:BASE_PARITY:7b69d922bd9c39a9"} 17:44:49 [17:44:49.245] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b0302e0e8c2b3a69 epochNumber=1 {"provingJobId":"1:BASE_PARITY:b0302e0e8c2b3a69"} 17:44:49 [17:44:49.247] INFO: prover-client:proving-broker Proving Broker started 17:44:49 [17:44:49.247] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b8a6a6e95c477fe1 epochNumber=1 {"provingJobId":"1:BASE_PARITY:b8a6a6e95c477fe1"} 17:44:49 [17:44:49.247] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0aa347831a48e461 epochNumber=1 {"provingJobId":"1:BASE_PARITY:0aa347831a48e461"} 17:44:49 [17:44:49.248] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:85ca2f244e0f2fff epochNumber=2 {"provingJobId":"1:BASE_PARITY:85ca2f244e0f2fff"} 17:44:49 [17:44:49.248] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a1ff336430c7a3c4 epochNumber=1 {"provingJobId":"1:BASE_PARITY:a1ff336430c7a3c4"} 17:44:49 [17:44:49.249] INFO: prover-client:proving-broker Proving Broker started 17:44:49 [17:44:49.250] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2f0be0daf3daabe8 epochNumber=1 {"provingJobId":"1:BASE_PARITY:2f0be0daf3daabe8"} 17:44:49 [17:44:49.250] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d18234ecf515f05e epochNumber=1 {"provingJobId":"1:BASE_PARITY:d18234ecf515f05e"} 17:44:49 [17:44:49.251] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:2f0be0daf3daabe8 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:2f0be0daf3daabe8"} 17:44:49 [17:44:49.252] INFO: prover-client:proving-broker Proving Broker started 17:44:49 [17:44:49.253] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:53b10ffb78881262 epochNumber=1 {"provingJobId":"1:BASE_PARITY:53b10ffb78881262"} 17:44:49 [17:44:49.253] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:5b4f8ec83c4464eb epochNumber=1 {"provingJobId":"1:BASE_PARITY:5b4f8ec83c4464eb"} 17:44:49 [17:44:49.253] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:53b10ffb78881262 type=BASE_PARITY totalAttempts=1 err=result {"provingJobId":"1:BASE_PARITY:53b10ffb78881262"} 17:44:49 [17:44:49.254] INFO: prover-client:proving-broker Proving Broker started 17:44:49 [17:44:49.255] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7e0e0b09bff4a964 epochNumber=1 {"provingJobId":"1:BASE_PARITY:7e0e0b09bff4a964"} 17:44:49 [17:44:49.255] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ac4c474d04aecee5 epochNumber=1 {"provingJobId":"1:BASE_PARITY:ac4c474d04aecee5"} 17:44:49 [17:44:49.256] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:7e0e0b09bff4a964 type=BASE_PARITY retry=1 err=result {"provingJobId":"1:BASE_PARITY:7e0e0b09bff4a964"} 17:44:49 [17:44:49.257] INFO: prover-client:proving-broker Proving Broker started 17:44:49 [17:44:49.257] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:59c265e39e60f127 epochNumber=1 {"provingJobId":"1:BASE_PARITY:59c265e39e60f127"} 17:44:49 [17:44:49.258] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:59c265e39e60f127 {"provingJobId":"1:BASE_PARITY:59c265e39e60f127"} 17:44:49 [17:44:49.258] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:59c265e39e60f127 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:59c265e39e60f127"} 17:44:49 [17:44:49.258] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c7ce89519be7bbce epochNumber=1 {"provingJobId":"1:BASE_PARITY:c7ce89519be7bbce"} 17:44:49 [17:44:49.259] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:59c265e39e60f127 has already been completed {"provingJobId":"1:BASE_PARITY:59c265e39e60f127"} 17:44:49 [17:44:49.260] INFO: prover-client:proving-broker Proving Broker started 17:44:49 [17:44:49.261] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f8ca9364b56da806 epochNumber=1 {"provingJobId":"1:BASE_PARITY:f8ca9364b56da806"} 17:44:49 [17:44:49.262] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f6c831392c8bb190 epochNumber=2 {"provingJobId":"1:BASE_PARITY:f6c831392c8bb190"} 17:44:50 [17:44:50.313] INFO: prover-client:proving-broker Proving Broker started 17:44:50 [17:44:50.314] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:f8ca9364b56da806 settled=false {"provingJobId":"1:BASE_PARITY:f8ca9364b56da806","status":"pending"} 17:44:50 [17:44:50.314] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:f6c831392c8bb190 settled=false {"provingJobId":"1:BASE_PARITY:f6c831392c8bb190","status":"pending"} 17:44:50 [17:44:50.316] INFO: prover-client:proving-broker Proving job id=1:BASE_PARITY:f8ca9364b56da806 type=BASE_PARITY startedAt=1749750289262 older agent has taken job {"provingJobId":"1:BASE_PARITY:f8ca9364b56da806"} 17:44:50 [17:44:50.316] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:f8ca9364b56da806 type=BASE_PARITY already being worked on by another agent. Sending new one {"provingJobId":"1:BASE_PARITY:f8ca9364b56da806"} 17:44:50 [17:44:50.318] INFO: prover-client:proving-broker Proving Broker started 17:44:50 [17:44:50.319] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7269d7bd0806f6dc epochNumber=1 {"provingJobId":"1:BASE_PARITY:7269d7bd0806f6dc"} 17:44:50 [17:44:50.319] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:059216cc9b4f59cc epochNumber=2 {"provingJobId":"1:BASE_PARITY:059216cc9b4f59cc"} 17:44:51 [17:44:51.320] INFO: prover-client:proving-broker Proving Broker started 17:44:51 [17:44:51.322] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:7269d7bd0806f6dc settled=false {"provingJobId":"1:BASE_PARITY:7269d7bd0806f6dc","status":"pending"} 17:44:51 [17:44:51.322] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:059216cc9b4f59cc settled=false {"provingJobId":"1:BASE_PARITY:059216cc9b4f59cc","status":"pending"} 17:44:51 [17:44:51.323] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:7269d7bd0806f6dc type=BASE_PARITY not found in the in-progress cache, adding it {"provingJobId":"1:BASE_PARITY:7269d7bd0806f6dc"} 17:44:51 [17:44:51.325] INFO: prover-client:proving-broker Proving Broker started 17:44:51 [17:44:51.326] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:994dfd33e40c384b epochNumber=1 {"provingJobId":"1:BASE_PARITY:994dfd33e40c384b"} 17:44:51 [17:44:51.327] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e1323ad57eceea4f epochNumber=2 {"provingJobId":"1:BASE_PARITY:e1323ad57eceea4f"} 17:44:52 [17:44:52.328] INFO: prover-client:proving-broker Proving Broker started 17:44:52 [17:44:52.329] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:994dfd33e40c384b settled=false {"provingJobId":"1:BASE_PARITY:994dfd33e40c384b","status":"pending"} 17:44:52 [17:44:52.329] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:e1323ad57eceea4f settled=false {"provingJobId":"1:BASE_PARITY:e1323ad57eceea4f","status":"pending"} 17:44:52 [17:44:52.330] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:994dfd33e40c384b type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:994dfd33e40c384b"} 17:44:52 [17:44:52.330] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:994dfd33e40c384b type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:994dfd33e40c384b"} 17:44:52 [17:44:52.332] INFO: prover-client:proving-broker Proving Broker started 17:44:52 [17:44:52.333] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:afad30ce8a972c6a epochNumber=1 {"provingJobId":"1:BASE_PARITY:afad30ce8a972c6a"} 17:44:52 [17:44:52.333] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ccd05da5a6980ff9 epochNumber=2 {"provingJobId":"1:BASE_PARITY:ccd05da5a6980ff9"} 17:44:52 [17:44:52.334] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:afad30ce8a972c6a type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:afad30ce8a972c6a"} 17:44:52 [17:44:52.335] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:ccd05da5a6980ff9 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:ccd05da5a6980ff9"} 17:44:52 [17:44:52.336] INFO: prover-client:proving-broker Proving Broker started 17:44:52 [17:44:52.336] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:8d308023d3221270 epochNumber=1 {"provingJobId":"1:BASE_PARITY:8d308023d3221270"} 17:44:52 [17:44:52.336] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c2c5c258cdada09d epochNumber=2 {"provingJobId":"1:BASE_PARITY:c2c5c258cdada09d"} 17:44:52 [17:44:52.337] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:8d308023d3221270 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:8d308023d3221270"} 17:44:52 [17:44:52.337] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:8d308023d3221270 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:8d308023d3221270"} 17:44:52 [17:44:52.337] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:c2c5c258cdada09d type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:c2c5c258cdada09d"} 17:44:52 [17:44:52.338] INFO: prover-client:proving-broker Proving Broker started 17:44:52 [17:44:52.338] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:c2ff5151afa3a537 err=test error {"provingJoId":"1:BASE_PARITY:c2ff5151afa3a537"} 17:44:52 [17:44:52.339] INFO: prover-client:proving-broker Proving Broker started 17:44:52 [17:44:52.340] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:02f75b5b376cce07 not found {"provingJobId":"1:BASE_PARITY:02f75b5b376cce07"} 17:44:52 [17:44:52.340] INFO: prover-client:proving-broker Proving Broker started 17:44:52 [17:44:52.341] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b66d19457f3c2674 epochNumber=1 {"provingJobId":"1:BASE_PARITY:b66d19457f3c2674"} 17:44:52 [17:44:52.342] INFO: prover-client:proving-broker Proving Broker started 17:44:52 [17:44:52.342] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c477854ee08c90a0 epochNumber=1 {"provingJobId":"1:BASE_PARITY:c477854ee08c90a0"} 17:44:52 [17:44:52.444] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:c477854ee08c90a0 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:c477854ee08c90a0"} 17:44:52 [17:44:52.458] INFO: prover-client:proving-broker Proving Broker started 17:44:52 [17:44:52.460] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f245131b23fa99a0 epochNumber=1 {"provingJobId":"1:BASE_PARITY:f245131b23fa99a0"} 17:44:52 [17:44:52.585] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:f245131b23fa99a0 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:f245131b23fa99a0"} 17:44:52 [17:44:52.587] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2db5adec6a126659 epochNumber=10 {"provingJobId":"1:BASE_PARITY:2db5adec6a126659"} 17:44:52 [17:44:52.611] INFO: prover-client:proving-broker Cleaned up jobs=1 17:44:52 [17:44:52.715] INFO: prover-client:proving-broker Proving Broker started 17:44:52 [17:44:52.715] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:28ec184aff8d4806 epochNumber=1 {"provingJobId":"1:BASE_PARITY:28ec184aff8d4806"} 17:44:52 [17:44:52.869] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:28ec184aff8d4806 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:28ec184aff8d4806"} 17:44:52 [17:44:52.920] INFO: prover-client:proving-broker Proving Broker started 17:44:52 [17:44:52.922] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f1976b2c15b0ebd8 epochNumber=1 {"provingJobId":"1:BASE_PARITY:f1976b2c15b0ebd8"} 17:44:52 [17:44:52.923] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:f1976b2c15b0ebd8 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:f1976b2c15b0ebd8"} 17:44:52 [17:44:52.925] INFO: prover-client:proving-broker Proving Broker started 17:44:52 [17:44:52.925] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:63f26cf137e154a0 epochNumber=1 {"provingJobId":"1:BASE_PARITY:63f26cf137e154a0"} 17:44:52 [17:44:52.926] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:63f26cf137e154a0 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:63f26cf137e154a0"} 17:44:52 [17:44:52.927] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:63f26cf137e154a0 type=BASE_PARITY totalAttempts=2 err=test error {"provingJobId":"1:BASE_PARITY:63f26cf137e154a0"} 17:44:52 [17:44:52.928] INFO: prover-client:proving-broker Proving Broker started 17:44:52 [17:44:52.928] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7cbe60f93aaeedf2 epochNumber=1 {"provingJobId":"1:BASE_PARITY:7cbe60f93aaeedf2"} 17:44:52 [17:44:52.929] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:7cbe60f93aaeedf2 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:7cbe60f93aaeedf2"} 17:44:52 [17:44:52.930] INFO: prover-client:proving-broker Proving Broker started 17:44:52 [17:44:52.931] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d4895b5f5c6acbf4 epochNumber=1 {"provingJobId":"1:BASE_PARITY:d4895b5f5c6acbf4"} 17:44:52 [17:44:52.932] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:d4895b5f5c6acbf4 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:d4895b5f5c6acbf4"} 17:44:52 [17:44:52.933] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:648aa169120318ab epochNumber=3 {"provingJobId":"1:BASE_PARITY:648aa169120318ab"} 17:44:52 [17:44:52.956] INFO: prover-client:proving-broker Cleaned up jobs=1 17:44:52 [17:44:52.959] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:d4895b5f5c6acbf4 err=test error {"provingJoId":"1:BASE_PARITY:d4895b5f5c6acbf4"} 17:44:52 [17:44:52.962] INFO: prover-client:proving-broker Proving Broker started 17:44:52 [17:44:52.963] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:d0bad9ff3ee30abe settled=false {"provingJobId":"1:BASE_PARITY:d0bad9ff3ee30abe","status":"pending"} 17:44:52 [17:44:52.964] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:014082764d8ee683 settled=false {"provingJobId":"1:BASE_PARITY:014082764d8ee683","status":"pending"} 17:44:52 [17:44:52.968] INFO: prover-client:proving-broker Proving Broker started 17:44:52 [17:44:52.969] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:cd3af4ed8b3611b0 settled=true {"provingJobId":"1:BASE_PARITY:cd3af4ed8b3611b0","status":"fulfilled"} 17:44:52 [17:44:52.970] INFO: prover-client:proving-broker Restoring proving job id=2:BASE_PARITY:6d6c4b5935b179c9 settled=true {"provingJobId":"2:BASE_PARITY:6d6c4b5935b179c9","status":"fulfilled"} 17:44:52 [17:44:52.972] INFO: prover-client:proving-broker Proving Broker started 17:44:52 [17:44:52.972] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:a189e744d8398b8f settled=true {"provingJobId":"1:BASE_PARITY:a189e744d8398b8f","status":"fulfilled"} 17:44:52 [17:44:52.973] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:e6d5ec0efe71ddd3 settled=false {"provingJobId":"1:BASE_PARITY:e6d5ec0efe71ddd3","status":"pending"} 17:44:52 [17:44:52.974] INFO: prover-client:proving-broker Proving Broker started 17:44:52 [17:44:52.977] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7482726dce22cd1d epochNumber=1 {"provingJobId":"1:BASE_PARITY:7482726dce22cd1d"} 17:44:52 [17:44:52.980] INFO: prover-client:proving-broker Proving Broker started 17:44:52 [17:44:52.981] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7b32cab5fb45f749 epochNumber=1 {"provingJobId":"1:BASE_PARITY:7b32cab5fb45f749"} 17:44:52 [17:44:52.982] ERROR: prover-client:proving-broker Failed to save proving job id=1:BASE_PARITY:7b32cab5fb45f749: Error: db error: Error: db error 17:44:52 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1126:63) {"provingJobId":"1:BASE_PARITY:7b32cab5fb45f749"} 17:44:52 [17:44:52.983] INFO: prover-client:proving-broker Proving Broker started 17:44:52 [17:44:52.984] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:831e9a2bd2d1bf2f epochNumber=1 {"provingJobId":"1:BASE_PARITY:831e9a2bd2d1bf2f"} 17:44:52 [17:44:52.984] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:831e9a2bd2d1bf2f type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:831e9a2bd2d1bf2f"} 17:44:52 [17:44:52.984] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:831e9a2bd2d1bf2f type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:831e9a2bd2d1bf2f"} 17:44:52 [17:44:52.986] INFO: prover-client:proving-broker Proving Broker started 17:44:52 [17:44:52.986] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:839acf1d9321acbe epochNumber=1 {"provingJobId":"1:BASE_PARITY:839acf1d9321acbe"} 17:44:52 [17:44:52.987] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:839acf1d9321acbe type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:839acf1d9321acbe"} 17:44:52 [17:44:52.987] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:839acf1d9321acbe type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:839acf1d9321acbe"} 17:44:52 [17:44:52.987] ERROR: prover-client:proving-broker Failed to save proving job result id=1:BASE_PARITY:839acf1d9321acbe: Error: db error 17:44:52 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1159:69) {"provingJobId":"1:BASE_PARITY:839acf1d9321acbe"} 17:44:52 [17:44:52.989] INFO: prover-client:proving-broker Proving Broker started 17:44:52 [17:44:52.989] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:deef86b9c9e05053 epochNumber=1 {"provingJobId":"1:BASE_PARITY:deef86b9c9e05053"} 17:44:52 [17:44:52.990] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:deef86b9c9e05053 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:deef86b9c9e05053"} 17:44:52 [17:44:52.990] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:deef86b9c9e05053 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:deef86b9c9e05053"} 17:44:52 [17:44:52.991] INFO: prover-client:proving-broker Proving Broker started 17:44:52 [17:44:52.991] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b1c47f4756004302 epochNumber=1 {"provingJobId":"1:BASE_PARITY:b1c47f4756004302"} 17:44:52 [17:44:52.992] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:b1c47f4756004302 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:b1c47f4756004302"} 17:44:52 [17:44:52.992] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:b1c47f4756004302 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:b1c47f4756004302"} 17:44:52 [17:44:52.993] ERROR: prover-client:proving-broker Failed to save proving job error status id=1:BASE_PARITY:b1c47f4756004302 jobErr=test error: Error: db error 17:44:52 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1192:68) {"provingJobId":"1:BASE_PARITY:b1c47f4756004302"} 17:44:52 [17:44:52.994] INFO: prover-client:proving-broker Proving Broker started 17:44:52 [17:44:52.995] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:ec81256a1a84b0f4 not found {"provingJobId":"1:BASE_PARITY:ec81256a1a84b0f4"} 17:44:52 [17:44:52.996] INFO: prover-client:proving-broker Proving Broker started 17:44:52 [17:44:52.997] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:04fbbccff513d014 err=test error {"provingJoId":"1:BASE_PARITY:04fbbccff513d014"} 17:44:52 [17:44:52.998] INFO: prover-client:proving-broker Proving Broker started 17:44:53 [17:44:53.008] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:fba7fe9d6f30d2c5 epochNumber=1 {"provingJobId":"1:BASE_PARITY:fba7fe9d6f30d2c5"} 17:44:53 [17:44:53.009] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:fba7fe9d6f30d2c5 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:fba7fe9d6f30d2c5"} 17:44:53 [17:44:53.009] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:fba7fe9d6f30d2c5 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:fba7fe9d6f30d2c5"} 17:44:53 [17:44:53.021] INFO: prover-client:proving-broker New proving job id=2:BASE_PARITY:a3698d772757c778 epochNumber=2 {"provingJobId":"2:BASE_PARITY:a3698d772757c778"} 17:44:53 [17:44:53.022] WARN: prover-client:proving-broker Proving job id=2:BASE_PARITY:a3698d772757c778 type=BASE_PARITY not in the in-progress set {"provingJobId":"2:BASE_PARITY:a3698d772757c778"} 17:44:53 [17:44:53.022] INFO: prover-client:proving-broker Proving job complete id=2:BASE_PARITY:a3698d772757c778 type=BASE_PARITY totalAttempts=1 {"provingJobId":"2:BASE_PARITY:a3698d772757c778"} 17:44:53 [17:44:53.086] INFO: prover-client:proving-broker New proving job id=3:BASE_PARITY:f92cf83ad7f88c1f epochNumber=3 {"provingJobId":"3:BASE_PARITY:f92cf83ad7f88c1f"} 17:44:53 [17:44:53.103] INFO: prover-client:proving-broker Cleaned up jobs=1 17:44:53 [17:44:53.149] INFO: prover-client:proving-broker New proving job id=4:BASE_PARITY:3115acfebd511de1 epochNumber=4 {"provingJobId":"4:BASE_PARITY:3115acfebd511de1"} 17:44:53 [17:44:53.155] INFO: prover-client:proving-broker Cleaned up jobs=1 17:44:53 [17:44:53.213] INFO: prover-client:proving-broker New proving job id=5:BASE_PARITY:2ae6df3257a2c626 epochNumber=5 {"provingJobId":"5:BASE_PARITY:2ae6df3257a2c626"} 17:44:53 [17:44:53.232] INFO: prover-client:proving-broker Cleaned up jobs=1 17:44:53 [17:44:53.271] INFO: prover-client:proving-broker Proving Broker started 17:44:53 [17:44:53.272] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0ea0ad51af033611 epochNumber=42 {"provingJobId":"1:BASE_PARITY:0ea0ad51af033611"} 17:44:53 [17:44:53.274] INFO: prover-client:proving-broker-database Creating broker database for epoch 42 at /tmp/proving-broker-testaGYSr9/42 with map size 1073741824 17:44:53 [17:44:53.281] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:53 [17:44:53.307] WARN: prover-client:proving-broker Tried enqueueing stale proving job id=1:BASE_PARITY:41e1b8ecf1a52134 epochNumber=1 {"provingJobId":"1:BASE_PARITY:41e1b8ecf1a52134"} 17:44:53 [17:44:53.311] INFO: prover-client:proving-broker Proving Broker started 17:44:53 [17:44:53.312] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:62e43a59358f72a3 epochNumber=1 {"provingJobId":"1:BASE_PARITY:62e43a59358f72a3"} 17:44:53 [17:44:53.313] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testTkkNf0/1 with map size 1073741824 17:44:53 [17:44:53.315] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:53 [17:44:53.335] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:63ec5b9a1108a2c9 epochNumber=1 {"provingJobId":"1:BASE_PARITY:63ec5b9a1108a2c9"} 17:44:53 [17:44:53.345] INFO: prover-client:proving-broker Proving Broker started 17:44:53 [17:44:53.346] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:cd371c6ae075474d epochNumber=1 {"provingJobId":"1:BASE_PARITY:cd371c6ae075474d"} 17:44:53 [17:44:53.356] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testjWcA7h/1 with map size 1073741824 17:44:53 [17:44:53.368] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:53 [17:44:53.392] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:cd371c6ae075474d epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:cd371c6ae075474d"} 17:44:53 [17:44:53.397] INFO: prover-client:proving-broker Proving Broker started 17:44:53 [17:44:53.398] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7f61be14dbd32b85 epochNumber=1 {"provingJobId":"1:BASE_PARITY:7f61be14dbd32b85"} 17:44:53 [17:44:53.398] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testJmDppv/1 with map size 1073741824 17:44:53 [17:44:53.400] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:53 [17:44:53.417] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:7f61be14dbd32b85 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:7f61be14dbd32b85"} 17:44:53 [17:44:53.418] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:7f61be14dbd32b85 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:7f61be14dbd32b85"} 17:44:53 [17:44:53.424] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:7f61be14dbd32b85 epochNumber=1. Not enqueuing again {"provingJobId":"1:BASE_PARITY:7f61be14dbd32b85"} 17:44:53 [17:44:53.428] INFO: prover-client:proving-broker Proving Broker started 17:44:53 [17:44:53.429] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:5158a19fe55e1472 epochNumber=1 {"provingJobId":"1:BASE_PARITY:5158a19fe55e1472"} 17:44:53 [17:44:53.429] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testQRKmFI/1 with map size 1073741824 17:44:53 [17:44:53.432] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:53 [17:44:53.465] INFO: prover-client:proving-broker Proving Broker started 17:44:53 [17:44:53.475] INFO: prover-client:proving-broker Proving Broker started 17:44:53 [17:44:53.476] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9d106022998adfa2 epochNumber=1 {"provingJobId":"1:BASE_PARITY:9d106022998adfa2"} 17:44:53 [17:44:53.477] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testsDrVnH/1 with map size 1073741824 17:44:53 [17:44:53.480] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:53 [17:44:53.499] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:9d106022998adfa2 {"provingJobId":"1:BASE_PARITY:9d106022998adfa2"} 17:44:53 [17:44:53.500] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:9d106022998adfa2 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:9d106022998adfa2"} 17:44:53 [17:44:53.500] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:9d106022998adfa2 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:9d106022998adfa2"} 17:44:53 [17:44:53.511] INFO: prover-client:proving-broker Proving Broker started 17:44:53 [17:44:53.512] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:35ecf8ef687eda53 epochNumber=1 {"provingJobId":"1:BASE_PARITY:35ecf8ef687eda53"} 17:44:53 [17:44:53.513] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testnmVirJ/1 with map size 1073741824 17:44:53 [17:44:53.514] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:53 [17:44:53.542] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:35ecf8ef687eda53 {"provingJobId":"1:BASE_PARITY:35ecf8ef687eda53"} 17:44:53 [17:44:53.542] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:35ecf8ef687eda53 type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:35ecf8ef687eda53"} 17:44:53 [17:44:53.562] INFO: prover-client:proving-broker Proving Broker started 17:44:53 [17:44:53.565] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:640b1dd15f514bfd epochNumber=1 {"provingJobId":"1:BASE_PARITY:640b1dd15f514bfd"} 17:44:53 [17:44:53.568] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test5KG5t4/1 with map size 1073741824 17:44:53 [17:44:53.572] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:53 [17:44:53.587] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:640b1dd15f514bfd type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:640b1dd15f514bfd"} 17:44:53 [17:44:53.587] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:640b1dd15f514bfd type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:640b1dd15f514bfd"} 17:44:53 [17:44:53.593] INFO: prover-client:proving-broker Proving Broker started 17:44:53 [17:44:53.593] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:00fe472e6daaca0c epochNumber=1 {"provingJobId":"1:BASE_PARITY:00fe472e6daaca0c"} 17:44:53 [17:44:53.594] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testPxXxle/1 with map size 1073741824 17:44:53 [17:44:53.599] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:53 [17:44:53.610] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:00fe472e6daaca0c type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:00fe472e6daaca0c"} 17:44:53 [17:44:53.611] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:00fe472e6daaca0c type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:00fe472e6daaca0c"} 17:44:53 [17:44:53.620] INFO: prover-client:proving-broker Proving Broker started 17:44:53 [17:44:53.621] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e459b83d5a62c185 epochNumber=0 {"provingJobId":"1:BASE_PARITY:e459b83d5a62c185"} 17:44:53 [17:44:53.621] INFO: prover-client:proving-broker-database Creating broker database for epoch 0 at /tmp/proving-broker-testRO34Gp/0 with map size 1073741824 17:44:53 [17:44:53.624] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:53 [17:44:53.635] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:e459b83d5a62c185 epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:e459b83d5a62c185"} 17:44:53 [17:44:53.636] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:44d2990f837c8724 epochNumber=0 {"provingJobId":"1:BASE_PARITY:44d2990f837c8724"} 17:44:53 [17:44:53.636] WARN: prover-client:proving-broker Cached proving job id=1:BASE_PARITY:e459b83d5a62c185 epochNumber=0. Not enqueuing again {"provingJobId":"1:BASE_PARITY:e459b83d5a62c185"} 17:44:53 [17:44:53.637] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b5efb229564698bf epochNumber=0 {"provingJobId":"1:BASE_PARITY:b5efb229564698bf"} 17:44:53 [17:44:53.646] INFO: prover-client:proving-broker Proving Broker started 17:44:53 [17:44:53.662] INFO: prover-client:proving-broker Proving Broker started 17:44:53 [17:44:53.665] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:8a4c0c4432adc103 epochNumber=2 {"provingJobId":"1:BASE_PARITY:8a4c0c4432adc103"} 17:44:53 [17:44:53.666] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testZtm4TM/2 with map size 1073741824 17:44:53 [17:44:53.669] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:53 [17:44:53.679] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:58297dba43a80924 epochNumber=1 {"provingJobId":"1:BASE_PARITY:58297dba43a80924"} 17:44:53 [17:44:53.680] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testZtm4TM/1 with map size 1073741824 17:44:53 [17:44:53.685] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:53 [17:44:53.701] INFO: prover-client:proving-broker Proving Broker started 17:44:53 [17:44:53.702] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:4aa01f02f05d4d52 epochNumber=1 {"provingJobId":"1:BASE_PARITY:4aa01f02f05d4d52"} 17:44:53 [17:44:53.703] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testHN4OC9/1 with map size 1073741824 17:44:53 [17:44:53.706] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:53 [17:44:53.719] INFO: prover-client:proving-broker Proving Broker started 17:44:53 [17:44:53.721] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e4feacd12f0a31ff epochNumber=1 {"provingJobId":"1:BASE_PARITY:e4feacd12f0a31ff"} 17:44:53 [17:44:53.722] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testYDSm7W/1 with map size 1073741824 17:44:53 [17:44:53.725] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:53 [17:44:53.734] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:451251281f95e843 epochNumber=1 {"provingJobId":"1:BASE_PARITY:451251281f95e843"} 17:44:53 [17:44:53.737] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:af03a40d70f84557 epochNumber=2 {"provingJobId":"1:BASE_PARITY:af03a40d70f84557"} 17:44:53 [17:44:53.738] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testYDSm7W/2 with map size 1073741824 17:44:53 [17:44:53.742] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:53 [17:44:53.761] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2377bcd648490cfd epochNumber=1 {"provingJobId":"1:BASE_PARITY:2377bcd648490cfd"} 17:44:53 [17:44:53.770] INFO: prover-client:proving-broker Proving Broker started 17:44:53 [17:44:53.771] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:5eefa01240458fba epochNumber=1 {"provingJobId":"1:BASE_PARITY:5eefa01240458fba"} 17:44:53 [17:44:53.771] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testpush6O/1 with map size 1073741824 17:44:53 [17:44:53.773] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:53 [17:44:53.783] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:742961c6baefa12d epochNumber=1 {"provingJobId":"1:BASE_PARITY:742961c6baefa12d"} 17:44:53 [17:44:53.786] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:be6ff8a64384bd81 epochNumber=2 {"provingJobId":"1:BASE_PARITY:be6ff8a64384bd81"} 17:44:53 [17:44:53.786] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testpush6O/2 with map size 1073741824 17:44:53 [17:44:53.788] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:53 [17:44:53.796] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:ee0a68591818ee64 epochNumber=1 {"provingJobId":"1:BASE_PARITY:ee0a68591818ee64"} 17:44:53 [17:44:53.807] INFO: prover-client:proving-broker Proving Broker started 17:44:53 [17:44:53.808] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d1a060edcbaeb581 epochNumber=1 {"provingJobId":"1:BASE_PARITY:d1a060edcbaeb581"} 17:44:53 [17:44:53.809] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testfegV4R/1 with map size 1073741824 17:44:53 [17:44:53.811] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:53 [17:44:53.821] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9937867af22f505c epochNumber=1 {"provingJobId":"1:BASE_PARITY:9937867af22f505c"} 17:44:53 [17:44:53.825] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:89ad1d2304d90b5c epochNumber=2 {"provingJobId":"1:BASE_PARITY:89ad1d2304d90b5c"} 17:44:53 [17:44:53.826] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testfegV4R/2 with map size 1073741824 17:44:53 [17:44:53.829] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:53 [17:44:53.837] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7c6ac3da2d4d8407 epochNumber=1 {"provingJobId":"1:BASE_PARITY:7c6ac3da2d4d8407"} 17:44:53 [17:44:53.844] INFO: prover-client:proving-broker Proving Broker started 17:44:53 [17:44:53.845] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1e4932ca43ca05bd epochNumber=1 {"provingJobId":"1:BASE_PARITY:1e4932ca43ca05bd"} 17:44:53 [17:44:53.845] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testCm1jJN/1 with map size 1073741824 17:44:53 [17:44:53.854] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:53 [17:44:53.868] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3f0d4c01515d2bdd epochNumber=1 {"provingJobId":"1:BASE_PARITY:3f0d4c01515d2bdd"} 17:44:53 [17:44:53.872] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:1e4932ca43ca05bd type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:1e4932ca43ca05bd"} 17:44:53 [17:44:53.878] INFO: prover-client:proving-broker Proving Broker started 17:44:53 [17:44:53.878] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e6d2a4d9dbca07ae epochNumber=1 {"provingJobId":"1:BASE_PARITY:e6d2a4d9dbca07ae"} 17:44:53 [17:44:53.879] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testTE3EfO/1 with map size 1073741824 17:44:53 [17:44:53.880] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:53 [17:44:53.890] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:d3624a213ff06dd3 epochNumber=1 {"provingJobId":"1:BASE_PARITY:d3624a213ff06dd3"} 17:44:53 [17:44:53.893] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:e6d2a4d9dbca07ae type=BASE_PARITY totalAttempts=1 err=result {"provingJobId":"1:BASE_PARITY:e6d2a4d9dbca07ae"} 17:44:53 [17:44:53.898] INFO: prover-client:proving-broker Proving Broker started 17:44:53 [17:44:53.899] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a26a16d48e457606 epochNumber=1 {"provingJobId":"1:BASE_PARITY:a26a16d48e457606"} 17:44:53 [17:44:53.899] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testQVFc8V/1 with map size 1073741824 17:44:53 [17:44:53.901] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:53 [17:44:53.912] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:4e58e62bfad7fc42 epochNumber=1 {"provingJobId":"1:BASE_PARITY:4e58e62bfad7fc42"} 17:44:53 [17:44:53.916] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:a26a16d48e457606 type=BASE_PARITY retry=1 err=result {"provingJobId":"1:BASE_PARITY:a26a16d48e457606"} 17:44:53 [17:44:53.922] INFO: prover-client:proving-broker Proving Broker started 17:44:53 [17:44:53.923] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:8dd1e67c23b9101a epochNumber=1 {"provingJobId":"1:BASE_PARITY:8dd1e67c23b9101a"} 17:44:53 [17:44:53.924] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test08iaFW/1 with map size 1073741824 17:44:53 [17:44:53.925] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:53 [17:44:53.938] INFO: prover-client:proving-broker Cancelling job id=1:BASE_PARITY:8dd1e67c23b9101a {"provingJobId":"1:BASE_PARITY:8dd1e67c23b9101a"} 17:44:53 [17:44:53.939] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:8dd1e67c23b9101a type=BASE_PARITY totalAttempts=1 err=Aborted {"provingJobId":"1:BASE_PARITY:8dd1e67c23b9101a"} 17:44:53 [17:44:53.944] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:a1fa4c3364afa3fc epochNumber=1 {"provingJobId":"1:BASE_PARITY:a1fa4c3364afa3fc"} 17:44:53 [17:44:53.954] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:8dd1e67c23b9101a has already been completed {"provingJobId":"1:BASE_PARITY:8dd1e67c23b9101a"} 17:44:53 [17:44:53.973] INFO: prover-client:proving-broker Proving Broker started 17:44:53 [17:44:53.975] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:2cea770a5191d80c epochNumber=1 {"provingJobId":"1:BASE_PARITY:2cea770a5191d80c"} 17:44:53 [17:44:53.976] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testh1bjne/1 with map size 1073741824 17:44:53 [17:44:53.978] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:53 [17:44:53.995] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:c4b85cd022c32297 epochNumber=2 {"provingJobId":"1:BASE_PARITY:c4b85cd022c32297"} 17:44:53 [17:44:53.996] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testh1bjne/2 with map size 1073741824 17:44:53 [17:44:53.999] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:55 [17:44:55.069] INFO: prover-client:proving-broker Proving Broker started 17:44:55 [17:44:55.077] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:2cea770a5191d80c settled=false {"provingJobId":"1:BASE_PARITY:2cea770a5191d80c","status":"pending"} 17:44:55 [17:44:55.079] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:c4b85cd022c32297 settled=false {"provingJobId":"1:BASE_PARITY:c4b85cd022c32297","status":"pending"} 17:44:55 [17:44:55.080] INFO: prover-client:proving-broker Proving job id=1:BASE_PARITY:2cea770a5191d80c type=BASE_PARITY startedAt=1749750294017 older agent has taken job {"provingJobId":"1:BASE_PARITY:2cea770a5191d80c"} 17:44:55 [17:44:55.081] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:2cea770a5191d80c type=BASE_PARITY already being worked on by another agent. Sending new one {"provingJobId":"1:BASE_PARITY:2cea770a5191d80c"} 17:44:55 [17:44:55.087] INFO: prover-client:proving-broker Proving Broker started 17:44:55 [17:44:55.088] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:912b95481d92fb74 epochNumber=1 {"provingJobId":"1:BASE_PARITY:912b95481d92fb74"} 17:44:55 [17:44:55.089] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testWwxKwk/1 with map size 1073741824 17:44:55 [17:44:55.090] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:55 [17:44:55.118] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:04af9bade49799cc epochNumber=2 {"provingJobId":"1:BASE_PARITY:04af9bade49799cc"} 17:44:55 [17:44:55.119] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testWwxKwk/2 with map size 1073741824 17:44:55 [17:44:55.122] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:56 [17:44:56.143] INFO: prover-client:proving-broker Proving Broker started 17:44:56 [17:44:56.146] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:912b95481d92fb74 settled=false {"provingJobId":"1:BASE_PARITY:912b95481d92fb74","status":"pending"} 17:44:56 [17:44:56.156] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:04af9bade49799cc settled=false {"provingJobId":"1:BASE_PARITY:04af9bade49799cc","status":"pending"} 17:44:56 [17:44:56.158] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:912b95481d92fb74 type=BASE_PARITY not found in the in-progress cache, adding it {"provingJobId":"1:BASE_PARITY:912b95481d92fb74"} 17:44:56 [17:44:56.163] INFO: prover-client:proving-broker Proving Broker started 17:44:56 [17:44:56.165] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:29c89f5f19f17ee6 epochNumber=1 {"provingJobId":"1:BASE_PARITY:29c89f5f19f17ee6"} 17:44:56 [17:44:56.170] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testNaY1gm/1 with map size 1073741824 17:44:56 [17:44:56.174] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:56 [17:44:56.200] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1ba12969d80880c6 epochNumber=2 {"provingJobId":"1:BASE_PARITY:1ba12969d80880c6"} 17:44:56 [17:44:56.201] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testNaY1gm/2 with map size 1073741824 17:44:56 [17:44:56.203] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:57 [17:44:57.223] INFO: prover-client:proving-broker Proving Broker started 17:44:57 [17:44:57.226] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:29c89f5f19f17ee6 settled=false {"provingJobId":"1:BASE_PARITY:29c89f5f19f17ee6","status":"pending"} 17:44:57 [17:44:57.231] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:1ba12969d80880c6 settled=false {"provingJobId":"1:BASE_PARITY:1ba12969d80880c6","status":"pending"} 17:44:57 [17:44:57.233] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:29c89f5f19f17ee6 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:29c89f5f19f17ee6"} 17:44:57 [17:44:57.233] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:29c89f5f19f17ee6 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:29c89f5f19f17ee6"} 17:44:57 [17:44:57.246] INFO: prover-client:proving-broker Proving Broker started 17:44:57 [17:44:57.247] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7a783f71d9256825 epochNumber=1 {"provingJobId":"1:BASE_PARITY:7a783f71d9256825"} 17:44:57 [17:44:57.249] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testJ0ZJtG/1 with map size 1073741824 17:44:57 [17:44:57.262] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:57 [17:44:57.287] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6d9f768953c28ff5 epochNumber=2 {"provingJobId":"1:BASE_PARITY:6d9f768953c28ff5"} 17:44:57 [17:44:57.288] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testJ0ZJtG/2 with map size 1073741824 17:44:57 [17:44:57.291] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:57 [17:44:57.310] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:7a783f71d9256825 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:7a783f71d9256825"} 17:44:57 [17:44:57.317] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:6d9f768953c28ff5 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:6d9f768953c28ff5"} 17:44:57 [17:44:57.331] INFO: prover-client:proving-broker Proving Broker started 17:44:57 [17:44:57.333] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:1bdf67c845fdd660 epochNumber=1 {"provingJobId":"1:BASE_PARITY:1bdf67c845fdd660"} 17:44:57 [17:44:57.334] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testwydvxR/1 with map size 1073741824 17:44:57 [17:44:57.339] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:57 [17:44:57.366] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:3b5d8d545b8a0a96 epochNumber=2 {"provingJobId":"1:BASE_PARITY:3b5d8d545b8a0a96"} 17:44:57 [17:44:57.369] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testwydvxR/2 with map size 1073741824 17:44:57 [17:44:57.376] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:57 [17:44:57.395] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:1bdf67c845fdd660 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:1bdf67c845fdd660"} 17:44:57 [17:44:57.396] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:1bdf67c845fdd660 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:1bdf67c845fdd660"} 17:44:57 [17:44:57.406] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:3b5d8d545b8a0a96 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:3b5d8d545b8a0a96"} 17:44:57 [17:44:57.415] INFO: prover-client:proving-broker Proving Broker started 17:44:57 [17:44:57.416] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:358155c1746ef040 err=test error {"provingJoId":"1:BASE_PARITY:358155c1746ef040"} 17:44:57 [17:44:57.419] INFO: prover-client:proving-broker Proving Broker started 17:44:57 [17:44:57.420] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:859a2dd805870e5e not found {"provingJobId":"1:BASE_PARITY:859a2dd805870e5e"} 17:44:57 [17:44:57.422] INFO: prover-client:proving-broker Proving Broker started 17:44:57 [17:44:57.422] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:af8e61404a4ef626 epochNumber=1 {"provingJobId":"1:BASE_PARITY:af8e61404a4ef626"} 17:44:57 [17:44:57.423] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testRXeVTH/1 with map size 1073741824 17:44:57 [17:44:57.424] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:57 [17:44:57.450] INFO: prover-client:proving-broker Proving Broker started 17:44:57 [17:44:57.452] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7277dd31d71ed435 epochNumber=1 {"provingJobId":"1:BASE_PARITY:7277dd31d71ed435"} 17:44:57 [17:44:57.453] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testhy4fdV/1 with map size 1073741824 17:44:57 [17:44:57.457] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:57 [17:44:57.579] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:7277dd31d71ed435 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:7277dd31d71ed435"} 17:44:57 [17:44:57.589] INFO: prover-client:proving-broker Proving Broker started 17:44:57 [17:44:57.589] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:7ea517908aa92fce epochNumber=1 {"provingJobId":"1:BASE_PARITY:7ea517908aa92fce"} 17:44:57 [17:44:57.590] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testcW66Ns/1 with map size 1073741824 17:44:57 [17:44:57.592] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:57 [17:44:57.716] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:7ea517908aa92fce timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:7ea517908aa92fce"} 17:44:57 [17:44:57.719] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:4466ec8388ed3caa epochNumber=10 {"provingJobId":"1:BASE_PARITY:4466ec8388ed3caa"} 17:44:57 [17:44:57.720] INFO: prover-client:proving-broker-database Creating broker database for epoch 10 at /tmp/proving-broker-testcW66Ns/10 with map size 1073741824 17:44:57 [17:44:57.722] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:57 [17:44:57.742] INFO: prover-client:proving-broker Cleaned up jobs=1 17:44:57 [17:44:57.743] INFO: prover-client:proving-broker-database Deleting broker database for epoch 1 17:44:57 [17:44:57.871] INFO: prover-client:proving-broker Proving Broker started 17:44:57 [17:44:57.872] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:4ffd13249137f4e2 epochNumber=1 {"provingJobId":"1:BASE_PARITY:4ffd13249137f4e2"} 17:44:57 [17:44:57.873] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testq5wIkE/1 with map size 1073741824 17:44:57 [17:44:57.876] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:58 [17:44:58.050] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:4ffd13249137f4e2 timed out. Adding it back to the queue. {"provingJobId":"1:BASE_PARITY:4ffd13249137f4e2"} 17:44:58 [17:44:58.104] INFO: prover-client:proving-broker Proving Broker started 17:44:58 [17:44:58.104] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:be6e353ee6d16d98 epochNumber=1 {"provingJobId":"1:BASE_PARITY:be6e353ee6d16d98"} 17:44:58 [17:44:58.105] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testrPVhyT/1 with map size 1073741824 17:44:58 [17:44:58.108] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:58 [17:44:58.126] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:be6e353ee6d16d98 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:be6e353ee6d16d98"} 17:44:58 [17:44:58.130] INFO: prover-client:proving-broker Proving Broker started 17:44:58 [17:44:58.130] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b2348bd41fd32654 epochNumber=1 {"provingJobId":"1:BASE_PARITY:b2348bd41fd32654"} 17:44:58 [17:44:58.131] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test0FyVMJ/1 with map size 1073741824 17:44:58 [17:44:58.134] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:58 [17:44:58.150] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:b2348bd41fd32654 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:b2348bd41fd32654"} 17:44:58 [17:44:58.151] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:b2348bd41fd32654 type=BASE_PARITY totalAttempts=2 err=test error {"provingJobId":"1:BASE_PARITY:b2348bd41fd32654"} 17:44:58 [17:44:58.160] INFO: prover-client:proving-broker Proving Broker started 17:44:58 [17:44:58.161] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:6be9b38ee6c42317 epochNumber=1 {"provingJobId":"1:BASE_PARITY:6be9b38ee6c42317"} 17:44:58 [17:44:58.162] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test1v9MCh/1 with map size 1073741824 17:44:58 [17:44:58.166] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:58 [17:44:58.191] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:6be9b38ee6c42317 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:6be9b38ee6c42317"} 17:44:58 [17:44:58.201] INFO: prover-client:proving-broker Proving Broker started 17:44:58 [17:44:58.202] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:12e5531af6cd1a09 epochNumber=1 {"provingJobId":"1:BASE_PARITY:12e5531af6cd1a09"} 17:44:58 [17:44:58.205] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testYuTWzb/1 with map size 1073741824 17:44:58 [17:44:58.207] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:58 [17:44:58.228] INFO: prover-client:proving-broker Retrying proving job id=1:BASE_PARITY:12e5531af6cd1a09 type=BASE_PARITY retry=1 err=test error {"provingJobId":"1:BASE_PARITY:12e5531af6cd1a09"} 17:44:58 [17:44:58.229] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:346c4e25b60e1e8d epochNumber=3 {"provingJobId":"1:BASE_PARITY:346c4e25b60e1e8d"} 17:44:58 [17:44:58.230] INFO: prover-client:proving-broker-database Creating broker database for epoch 3 at /tmp/proving-broker-testYuTWzb/3 with map size 1073741824 17:44:58 [17:44:58.234] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:58 [17:44:58.281] INFO: prover-client:proving-broker Cleaned up jobs=1 17:44:58 [17:44:58.282] INFO: prover-client:proving-broker-database Deleting broker database for epoch 1 17:44:58 [17:44:58.284] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:12e5531af6cd1a09 err=test error {"provingJoId":"1:BASE_PARITY:12e5531af6cd1a09"} 17:44:58 [17:44:58.290] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testtzEnsZ/1 with map size 1073741824 17:44:58 [17:44:58.292] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:58 [17:44:58.313] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testtzEnsZ/2 with map size 1073741824 17:44:58 [17:44:58.317] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:58 [17:44:58.335] INFO: prover-client:proving-broker Proving Broker started 17:44:58 [17:44:58.338] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:49fa07ea84f78554 settled=false {"provingJobId":"1:BASE_PARITY:49fa07ea84f78554","status":"pending"} 17:44:58 [17:44:58.340] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:7e77c79c9f3095c0 settled=false {"provingJobId":"1:BASE_PARITY:7e77c79c9f3095c0","status":"pending"} 17:44:58 [17:44:58.349] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testi2ggOv/1 with map size 1073741824 17:44:58 [17:44:58.353] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:58 [17:44:58.374] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testi2ggOv/2 with map size 1073741824 17:44:58 [17:44:58.378] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:58 [17:44:58.409] INFO: prover-client:proving-broker Proving Broker started 17:44:58 [17:44:58.412] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:3adead5f35a9f1dd settled=true {"provingJobId":"1:BASE_PARITY:3adead5f35a9f1dd","status":"fulfilled"} 17:44:58 [17:44:58.413] INFO: prover-client:proving-broker Restoring proving job id=2:BASE_PARITY:2ebe7e7beef55a7b settled=true {"provingJobId":"2:BASE_PARITY:2ebe7e7beef55a7b","status":"fulfilled"} 17:44:58 [17:44:58.422] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test5bY4ej/1 with map size 1073741824 17:44:58 [17:44:58.426] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:58 [17:44:58.457] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-test5bY4ej/2 with map size 1073741824 17:44:58 [17:44:58.460] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:58 [17:44:58.481] INFO: prover-client:proving-broker Proving Broker started 17:44:58 [17:44:58.484] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:3a040745718eae9f settled=true {"provingJobId":"1:BASE_PARITY:3a040745718eae9f","status":"fulfilled"} 17:44:58 [17:44:58.486] INFO: prover-client:proving-broker Restoring proving job id=1:BASE_PARITY:b8a121a1c5af9933 settled=false {"provingJobId":"1:BASE_PARITY:b8a121a1c5af9933","status":"pending"} 17:44:58 [17:44:58.492] INFO: prover-client:proving-broker Proving Broker started 17:44:58 [17:44:58.493] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:0a4c13e780a10f15 epochNumber=1 {"provingJobId":"1:BASE_PARITY:0a4c13e780a10f15"} 17:44:58 [17:44:58.494] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testYebjfX/1 with map size 1073741824 17:44:58 [17:44:58.496] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:58 [17:44:58.521] INFO: prover-client:proving-broker Proving Broker started 17:44:58 [17:44:58.522] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:80ce08fb5be9bbbc epochNumber=1 {"provingJobId":"1:BASE_PARITY:80ce08fb5be9bbbc"} 17:44:58 [17:44:58.522] ERROR: prover-client:proving-broker Failed to save proving job id=1:BASE_PARITY:80ce08fb5be9bbbc: Error: db error: Error: db error 17:44:58 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1126:63) {"provingJobId":"1:BASE_PARITY:80ce08fb5be9bbbc"} 17:44:58 [17:44:58.525] INFO: prover-client:proving-broker Proving Broker started 17:44:58 [17:44:58.526] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:9a04ffc0d57621a0 epochNumber=1 {"provingJobId":"1:BASE_PARITY:9a04ffc0d57621a0"} 17:44:58 [17:44:58.526] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testESkYLM/1 with map size 1073741824 17:44:58 [17:44:58.529] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:58 [17:44:58.550] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:9a04ffc0d57621a0 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:9a04ffc0d57621a0"} 17:44:58 [17:44:58.550] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:9a04ffc0d57621a0 type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:9a04ffc0d57621a0"} 17:44:58 [17:44:58.561] INFO: prover-client:proving-broker Proving Broker started 17:44:58 [17:44:58.562] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:74d205a8749be48a epochNumber=1 {"provingJobId":"1:BASE_PARITY:74d205a8749be48a"} 17:44:58 [17:44:58.563] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testZVAxAY/1 with map size 1073741824 17:44:58 [17:44:58.565] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:58 [17:44:58.584] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:74d205a8749be48a type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:74d205a8749be48a"} 17:44:58 [17:44:58.585] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:74d205a8749be48a type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:74d205a8749be48a"} 17:44:58 [17:44:58.586] ERROR: prover-client:proving-broker Failed to save proving job result id=1:BASE_PARITY:74d205a8749be48a: Error: db error 17:44:58 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1159:69) {"provingJobId":"1:BASE_PARITY:74d205a8749be48a"} 17:44:58 [17:44:58.590] INFO: prover-client:proving-broker Proving Broker started 17:44:58 [17:44:58.591] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:e2300cef681c1242 epochNumber=1 {"provingJobId":"1:BASE_PARITY:e2300cef681c1242"} 17:44:58 [17:44:58.592] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testGpdK2B/1 with map size 1073741824 17:44:58 [17:44:58.596] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:58 [17:44:58.614] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:e2300cef681c1242 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:e2300cef681c1242"} 17:44:58 [17:44:58.615] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:e2300cef681c1242 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:e2300cef681c1242"} 17:44:58 [17:44:58.630] INFO: prover-client:proving-broker Proving Broker started 17:44:58 [17:44:58.631] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:f0c29ca4ff9fea02 epochNumber=1 {"provingJobId":"1:BASE_PARITY:f0c29ca4ff9fea02"} 17:44:58 [17:44:58.632] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-test9KCWWr/1 with map size 1073741824 17:44:58 [17:44:58.635] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:58 [17:44:58.652] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:f0c29ca4ff9fea02 type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:f0c29ca4ff9fea02"} 17:44:58 [17:44:58.652] INFO: prover-client:proving-broker Marking proving job as failed id=1:BASE_PARITY:f0c29ca4ff9fea02 type=BASE_PARITY totalAttempts=1 err=test error {"provingJobId":"1:BASE_PARITY:f0c29ca4ff9fea02"} 17:44:58 [17:44:58.653] ERROR: prover-client:proving-broker Failed to save proving job error status id=1:BASE_PARITY:f0c29ca4ff9fea02 jobErr=test error: Error: db error 17:44:58 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/proving_broker.test.ts:1192:68) {"provingJobId":"1:BASE_PARITY:f0c29ca4ff9fea02"} 17:44:58 [17:44:58.659] INFO: prover-client:proving-broker Proving Broker started 17:44:58 [17:44:58.660] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:807d7d6ca5c85384 not found {"provingJobId":"1:BASE_PARITY:807d7d6ca5c85384"} 17:44:58 [17:44:58.665] INFO: prover-client:proving-broker Proving Broker started 17:44:58 [17:44:58.665] WARN: prover-client:proving-broker Can't set error on unknown proving job id=1:BASE_PARITY:7c3f7b28781c0e28 err=test error {"provingJoId":"1:BASE_PARITY:7c3f7b28781c0e28"} 17:44:58 [17:44:58.671] INFO: prover-client:proving-broker Proving Broker started 17:44:58 [17:44:58.683] INFO: prover-client:proving-broker New proving job id=1:BASE_PARITY:b1bd2570fc497c7c epochNumber=1 {"provingJobId":"1:BASE_PARITY:b1bd2570fc497c7c"} 17:44:58 [17:44:58.684] INFO: prover-client:proving-broker-database Creating broker database for epoch 1 at /tmp/proving-broker-testNEUy1S/1 with map size 1073741824 17:44:58 [17:44:58.686] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:58 [17:44:58.703] WARN: prover-client:proving-broker Proving job id=1:BASE_PARITY:b1bd2570fc497c7c type=BASE_PARITY not in the in-progress set {"provingJobId":"1:BASE_PARITY:b1bd2570fc497c7c"} 17:44:58 [17:44:58.704] INFO: prover-client:proving-broker Proving job complete id=1:BASE_PARITY:b1bd2570fc497c7c type=BASE_PARITY totalAttempts=1 {"provingJobId":"1:BASE_PARITY:b1bd2570fc497c7c"} 17:44:58 [17:44:58.720] INFO: prover-client:proving-broker New proving job id=2:BASE_PARITY:c8c1dfa1aabec2bf epochNumber=2 {"provingJobId":"2:BASE_PARITY:c8c1dfa1aabec2bf"} 17:44:58 [17:44:58.722] INFO: prover-client:proving-broker-database Creating broker database for epoch 2 at /tmp/proving-broker-testNEUy1S/2 with map size 1073741824 17:44:58 [17:44:58.725] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:58 [17:44:58.742] WARN: prover-client:proving-broker Proving job id=2:BASE_PARITY:c8c1dfa1aabec2bf type=BASE_PARITY not in the in-progress set {"provingJobId":"2:BASE_PARITY:c8c1dfa1aabec2bf"} 17:44:58 [17:44:58.742] INFO: prover-client:proving-broker Proving job complete id=2:BASE_PARITY:c8c1dfa1aabec2bf type=BASE_PARITY totalAttempts=1 {"provingJobId":"2:BASE_PARITY:c8c1dfa1aabec2bf"} 17:44:58 [17:44:58.809] INFO: prover-client:proving-broker New proving job id=3:BASE_PARITY:3a63496db3995f25 epochNumber=3 {"provingJobId":"3:BASE_PARITY:3a63496db3995f25"} 17:44:58 [17:44:58.810] INFO: prover-client:proving-broker-database Creating broker database for epoch 3 at /tmp/proving-broker-testNEUy1S/3 with map size 1073741824 17:44:58 [17:44:58.812] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:58 [17:44:58.851] INFO: prover-client:proving-broker Cleaned up jobs=1 17:44:58 [17:44:58.852] INFO: prover-client:proving-broker-database Deleting broker database for epoch 1 17:44:58 [17:44:58.889] INFO: prover-client:proving-broker New proving job id=4:BASE_PARITY:a31a8b07fa4ec72a epochNumber=4 {"provingJobId":"4:BASE_PARITY:a31a8b07fa4ec72a"} 17:44:58 [17:44:58.890] INFO: prover-client:proving-broker-database Creating broker database for epoch 4 at /tmp/proving-broker-testNEUy1S/4 with map size 1073741824 17:44:58 [17:44:58.895] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:58 [17:44:58.931] INFO: prover-client:proving-broker Cleaned up jobs=1 17:44:58 [17:44:58.932] INFO: prover-client:proving-broker-database Deleting broker database for epoch 2 17:44:58 [17:44:58.976] INFO: prover-client:proving-broker New proving job id=5:BASE_PARITY:72557b50806c3ea4 epochNumber=5 {"provingJobId":"5:BASE_PARITY:72557b50806c3ea4"} 17:44:58 [17:44:58.978] INFO: prover-client:proving-broker-database Creating broker database for epoch 5 at /tmp/proving-broker-testNEUy1S/5 with map size 1073741824 17:44:58 [17:44:58.980] INFO: kv-store:lmdb-v2 Starting data store with maxReaders 16 17:44:59 [17:44:59.012] INFO: prover-client:proving-broker Cleaned up jobs=1 17:44:59 [17:44:59.013] INFO: prover-client:proving-broker-database Deleting broker database for epoch 3 17:44:59 PASS src/proving_broker/proving_broker.test.ts (13.009 s) 17:44:59 ProvingBroker 17:44:59 Producer API 17:44:59 ✓ refuses stale jobs (45 ms) 17:44:59 ✓ enqueues jobs (5 ms) 17:44:59 ✓ ignores duplicate jobs (4 ms) 17:44:59 ✓ reports correct status when enqueuing repeat jobs (4 ms) 17:44:59 ✓ throws an error in case of duplicate job IDs (26 ms) 17:44:59 ✓ returns not-found status for non-existing jobs (1 ms) 17:44:59 ✓ cancels jobs in queue (3 ms) 17:44:59 ✓ cancels jobs in-progress (11 ms) 17:44:59 ✓ returns job result if successful (3 ms) 17:44:59 ✓ returns job error if failed (3 ms) 17:44:59 ✓ correctly returns job status for concurrent writes (3 ms) 17:44:59 ✓ refuses stale jobs (43 ms) 17:44:59 ✓ enqueues jobs (33 ms) 17:44:59 ✓ ignores duplicate jobs (50 ms) 17:44:59 ✓ reports correct status when enqueuing repeat jobs (31 ms) 17:44:59 ✓ throws an error in case of duplicate job IDs (30 ms) 17:44:59 ✓ returns not-found status for non-existing jobs (16 ms) 17:44:59 ✓ cancels jobs in queue (36 ms) 17:44:59 ✓ cancels jobs in-progress (40 ms) 17:44:59 ✓ returns job result if successful (40 ms) 17:44:59 ✓ returns job error if failed (26 ms) 17:44:59 ✓ correctly returns job status for concurrent writes (27 ms) 17:44:59 Consumer API 17:44:59 ✓ returns undefined if no jobs are available (2 ms) 17:44:59 ✓ returns jobs in priority order (2 ms) 17:44:59 ✓ returns undefined if no jobs are available for the given allowList (2 ms) 17:44:59 ✓ returns a job if it is in the allowList (2 ms) 17:44:59 ✓ returns the most important job if it is in the allowList (2 ms) 17:44:59 ✓ returns any job if filter is empty (3 ms) 17:44:59 ✓ returns a new job when reporting job success (2 ms) 17:44:59 ✓ returns a new job when reporting permanent error (2 ms) 17:44:59 ✓ returns a new job when reporting retry-able error (2 ms) 17:44:59 ✓ returns a new job when reporting progress if current one is cancelled (3 ms) 17:44:59 ✓ returns a new job if job is already in progress elsewhere (1057 ms) 17:44:59 ✓ avoids sending the same job to a new agent after a restart (1007 ms) 17:44:59 ✓ avoids sending a completed job to a new agent after a restart (1007 ms) 17:44:59 ✓ tracks job result if in progress (3 ms) 17:44:59 ✓ tracks job result even if job is in queue (2 ms) 17:44:59 ✓ ignores reported job error if unknown job (1 ms) 17:44:59 ✓ ignores job result if unknown job (1 ms) 17:44:59 ✓ returns undefined if no jobs are available (8 ms) 17:44:59 ✓ returns jobs in priority order (44 ms) 17:44:59 ✓ returns undefined if no jobs are available for the given allowList (18 ms) 17:44:59 ✓ returns a job if it is in the allowList (50 ms) 17:44:59 ✓ returns the most important job if it is in the allowList (36 ms) 17:44:59 ✓ returns any job if filter is empty (36 ms) 17:44:59 ✓ returns a new job when reporting job success (34 ms) 17:44:59 ✓ returns a new job when reporting permanent error (20 ms) 17:44:59 ✓ returns a new job when reporting retry-able error (22 ms) 17:44:59 ✓ returns a new job when reporting progress if current one is cancelled (40 ms) 17:44:59 ✓ returns a new job if job is already in progress elsewhere (1122 ms) 17:44:59 ✓ avoids sending the same job to a new agent after a restart (1078 ms) 17:44:59 ✓ avoids sending a completed job to a new agent after a restart (1082 ms) 17:44:59 ✓ tracks job result if in progress (82 ms) 17:44:59 ✓ tracks job result even if job is in queue (86 ms) 17:44:59 ✓ ignores reported job error if unknown job (3 ms) 17:44:59 ✓ ignores job result if unknown job (2 ms) 17:44:59 Timeouts 17:44:59 ✓ tracks in progress jobs (1 ms) 17:44:59 ✓ re-enqueues jobs that time out (111 ms) 17:44:59 ✓ cancel stale jobs that time out (260 ms) 17:44:59 ✓ keeps the jobs in progress while it is alive (205 ms) 17:44:59 ✓ tracks in progress jobs (22 ms) 17:44:59 ✓ re-enqueues jobs that time out (144 ms) 17:44:59 ✓ cancel stale jobs that time out (280 ms) 17:44:59 ✓ keeps the jobs in progress while it is alive (233 ms) 17:44:59 Retries 17:44:59 ✓ retries jobs (4 ms) 17:44:59 ✓ retries up to a maximum number of times (3 ms) 17:44:59 ✓ passing retry=false does not retry (2 ms) 17:44:59 ✓ does not retry if job is stale (30 ms) 17:44:59 ✓ retries jobs (26 ms) 17:44:59 ✓ retries up to a maximum number of times (30 ms) 17:44:59 ✓ passing retry=false does not retry (41 ms) 17:44:59 ✓ does not retry if job is stale (86 ms) 17:44:59 Database management 17:44:59 ✓ re-enqueues proof requests on start (5 ms) 17:44:59 ✓ restores proof results on start (5 ms) 17:44:59 ✓ only re-enqueues unfinished jobs (3 ms) 17:44:59 ✓ saves job when enqueued (5 ms) 17:44:59 ✓ does not retain job if database fails to save (3 ms) 17:44:59 ✓ saves job result (2 ms) 17:44:59 ✓ saves result even if database fails to save (3 ms) 17:44:59 ✓ saves job error (2 ms) 17:44:59 ✓ saves job error even if database fails to save (2 ms) 17:44:59 ✓ does not save job result if job is unknown (2 ms) 17:44:59 ✓ does not save job error if job is unknown (1 ms) 17:44:59 ✓ cleans up old jobs periodically (269 ms) 17:44:59 ✓ re-enqueues proof requests on start (57 ms) 17:44:59 ✓ restores proof results on start (73 ms) 17:44:59 ✓ only re-enqueues unfinished jobs (72 ms) 17:44:59 ✓ saves job when enqueued (29 ms) 17:44:59 ✓ does not retain job if database fails to save (4 ms) 17:44:59 ✓ saves job result (34 ms) 17:44:59 ✓ saves result even if database fails to save (28 ms) 17:44:59 ✓ saves job error (37 ms) 17:44:59 ✓ saves job error even if database fails to save (31 ms) 17:44:59 ✓ does not save job result if job is unknown (5 ms) 17:44:59 ✓ does not save job error if job is unknown (5 ms) 17:44:59 ✓ cleans up old jobs periodically (380 ms) 17:44:59 17:44:59 Test Suites: 1 passed, 1 total 17:44:59 Tests: 96 passed, 96 total 17:44:59 Snapshots: 0 total 17:44:59 Time: 13.116 s 17:44:59 Ran all test suites matching /prover-client\/src\/proving_broker\/proving_broker.test.ts/i. 17:44:59 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?