Parent Log:
http://ci.aztec-labs.com/308e04cfcea07bcf
Command: 1b54ea671a21576c yarn-project/scripts/run_test.sh prover-client/src/proving_broker/broker_prover_facade.test.ts
Commit:
https://github.com/AztecProtocol/aztec-packages/commit/30660269b33bab8cca354c41659533acf4d48e07
Env: REF_NAME=gh-readonly-queue/next/pr-15026-d96baf1c44329e8b2e3a432ad803f702f5184a62 CURRENT_VERSION=0.87.6 CI_FULL=1
Date: Fri Jun 13 09:35:33 UTC 2025
System: ARCH=amd64 CPUS=128 MEM=493Gi HOSTNAME=pr-15026_amd64_x1-full
Resources: CPU_LIST=0-127 CPUS=2 MEM=8g TIMEOUT=600s
History:
http://ci.aztec-labs.com/list/history_b85794959204d424_next
09:35:38 [09:35:38.436]
INFO:
prover-client:proving-broker Proving Broker started
09:35:38 [09:35:38.452]
INFO:
prover-client:proving-broker New proving job id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb epochNumber=42
{"provingJobId":"42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb"}
09:35:38 [09:35:38.548]
INFO:
prover-client:proving-agent Starting job id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb type=BASE_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...
09:35:38 [09:35:38.552]
INFO:
prover-client:proving-agent:job-controller-7d10ca30 Job controller started jobId=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb
{"jobId":"42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb"}
09:35:38 [09:35:38.556]
INFO:
prover-client:proving-agent Job id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb type=BASE_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22resul...
09:35:38 [09:35:38.558]
INFO:
prover-client:proving-broker Proving job complete id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb type=BASE_PARITY totalAttempts=1
{"provingJobId":"42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb"}
09:35:39 [09:35:39.456]
INFO:
prover-client:proving-broker Proving Broker started
09:35:39 [09:35:39.479]
INFO:
prover-client:proving-broker New proving job id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb epochNumber=42
{"provingJobId":"42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb"}
09:35:39 [09:35:39.559]
INFO:
prover-client:proving-agent Starting job id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb type=BASE_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...
09:35:39 [09:35:39.560]
INFO:
prover-client:proving-agent:job-controller-69c4709e Job controller started jobId=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb
{"jobId":"42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb"}
09:35:39 [09:35:39.563]
INFO:
prover-client:proving-agent Job id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb type=BASE_PARITY completed outputUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22resul...
09:35:39 [09:35:39.564]
INFO:
prover-client:proving-broker Proving job complete id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb type=BASE_PARITY totalAttempts=1
{"provingJobId":"42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb"}
09:35:40 [09:35:40.470]
WARN:
prover-client:proving-broker Cached proving job id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb epochNumber=42. Not enqueuing again
{"provingJobId":"42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb"}
09:35:41 [09:35:41.874]
INFO:
prover-client:proving-broker Proving Broker started
09:35:41 [09:35:41.884]
INFO:
prover-client:proving-broker New proving job id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb epochNumber=42
{"provingJobId":"42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb"}
09:35:41 [09:35:41.978]
INFO:
prover-client:proving-agent Starting job id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb type=BASE_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...
09:35:41 [09:35:41.979]
INFO:
prover-client:proving-agent:job-controller-7cd418db Job controller started jobId=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb
{"jobId":"42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb"}
09:35:41 [09:35:41.996]
ERROR:
prover-client:proving-agent Job id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb type=BASE_PARITY failed err=TEST ERROR retry=false: Error: TEST ERROR
09:35:41 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/prover-client/src/proving_broker/broker_prover_facade.test.ts:124:26)
09:35:41 [09:35:41.997]
INFO:
prover-client:proving-broker Marking proving job as failed id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb type=BASE_PARITY totalAttempts=1 err=TEST ERROR
{"provingJobId":"42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb"}
09:35:42 [09:35:42.876]
ERROR:
prover-client:broker-circuit-prover-facade Resolving proving job with error id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb type=BASE_PARITY: 'TEST ERROR'
09:35:42 [09:35:42.878]
ERROR:
prover-client:broker-circuit-prover-facade Job errored with 'TEST ERROR' id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb type=BASE_PARITY: {
09:35:42 provingJobId: '42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb',
09:35:42 provingJobType: 'BASE_PARITY'
09:35:42 }
09:35:42 [09:35:42.881]
WARN:
prover-client:proving-broker Cached proving job id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb epochNumber=42. Not enqueuing again
{"provingJobId":"42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb"}
09:35:42 [09:35:42.882]
INFO:
prover-client:broker-circuit-prover-facade Stored proof inputs for failed job id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb type=BASE_PARITY at data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22inputs%22%3A%22AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAMAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAwAQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADACAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAMAMAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAABAAA%3D%3D%22%7D
{"id":"42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb","type":9,"uri":"data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22inputs%22%3A%22AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAMAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAwAQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADACAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAMAMAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAABAAA%3D%3D%22%7D"}
09:35:43 [09:35:43.880]
ERROR:
prover-client:broker-circuit-prover-facade Resolving proving job with error id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb type=BASE_PARITY: 'TEST ERROR'
09:35:43 [09:35:43.881]
ERROR:
prover-client:broker-circuit-prover-facade Job errored with 'TEST ERROR' id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb type=BASE_PARITY: {
09:35:43 provingJobId: '42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb',
09:35:43 provingJobType: 'BASE_PARITY'
09:35:43 }
09:35:43 [09:35:43.882]
INFO:
prover-client:broker-circuit-prover-facade Stored proof inputs for failed job id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb type=BASE_PARITY at data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22inputs%22%3A%22AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAMAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAwAQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADACAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAMAMAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAABAAA%3D%3D%22%7D
{"id":"42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb","type":9,"uri":"data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22inputs%22%3A%22AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAMAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAwAQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAADACAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAMAMAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAABAAA%3D%3D%22%7D"}
09:35:43 [09:35:43.887]
INFO:
prover-client:proving-broker Proving Broker started
09:35:43 [09:35:43.889]
INFO:
prover-client:proving-broker New proving job id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb epochNumber=42
{"provingJobId":"42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb"}
09:35:43 [09:35:43.990]
INFO:
prover-client:proving-agent Starting job id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb type=BASE_PARITY inputsUri=data:application/json;charset=utf-8,%7B%22type%22%3A9%2C%22input...
09:35:43 [09:35:43.991]
INFO:
prover-client:proving-agent:job-controller-eb9f3ae4 Job controller started jobId=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb
{"jobId":"42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb"}
09:35:43 [09:35:43.992]
INFO:
prover-client:proving-broker Cancelling job id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb
{"provingJobId":"42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb"}
09:35:43 [09:35:43.992]
INFO:
prover-client:proving-broker Marking proving job as failed id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb type=BASE_PARITY totalAttempts=1 err=Aborted
{"provingJobId":"42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb"}
09:35:44 [09:35:44.092]
WARN:
prover-client:proving-broker Proving job id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb has already been completed
{"provingJobId":"42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb"}
09:35:44 [09:35:44.193]
WARN:
prover-client:proving-broker Proving job id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb has already been completed
{"provingJobId":"42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb"}
09:35:44 [09:35:44.295]
WARN:
prover-client:proving-broker Proving job id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb has already been completed
{"provingJobId":"42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb"}
09:35:44 [09:35:44.396]
WARN:
prover-client:proving-broker Proving job id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb has already been completed
{"provingJobId":"42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb"}
09:35:44 [09:35:44.497]
WARN:
prover-client:proving-broker Proving job id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb has already been completed
{"provingJobId":"42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb"}
09:35:44 [09:35:44.599]
WARN:
prover-client:proving-broker Proving job id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb has already been completed
{"provingJobId":"42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb"}
09:35:44 [09:35:44.700]
WARN:
prover-client:proving-broker Proving job id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb has already been completed
{"provingJobId":"42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb"}
09:35:44 [09:35:44.801]
WARN:
prover-client:proving-broker Proving job id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb has already been completed
{"provingJobId":"42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb"}
09:35:44 [09:35:44.889]
ERROR:
prover-client:broker-circuit-prover-facade Resolving proving job with error id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb type=BASE_PARITY: 'Aborted'
09:35:44 [09:35:44.890]
ERROR:
prover-client:broker-circuit-prover-facade Job errored with 'Aborted' id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb type=BASE_PARITY: {
09:35:44 provingJobId: '42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb',
09:35:44 provingJobType: 'BASE_PARITY'
09:35:44 }
09:35:44 [09:35:44.892]
WARN:
prover-client:proving-agent:job-controller-eb9f3ae4 Aborted job controller for jobId=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb
{"jobId":"42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb"}
09:35:44 [09:35:44.893]
INFO:
prover-client:proving-broker Proving Broker started
09:35:44 [09:35:44.895]
INFO:
prover-client:proving-broker New proving job id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb epochNumber=42
{"provingJobId":"42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb"}
09:35:44 [09:35:44.896]
ERROR:
prover-client:broker-circuit-prover-facade Job errored with 'Broker facade stopped' id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb type=BASE_PARITY: {
09:35:44 provingJobId: '42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb',
09:35:44 provingJobType: 'BASE_PARITY'
09:35:44 }
09:35:44 [09:35:44.897]
WARN:
prover-client:broker-circuit-prover-facade Running promise was not started
09:35:44 [09:35:44.898]
INFO:
prover-client:proving-broker Proving Broker started
09:35:44 [09:35:44.999]
ERROR:
prover-client:broker-circuit-prover-facade Job errored with 'Broker facade stopped' id=42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb type=BASE_PARITY: {
09:35:44 provingJobId: '42:BASE_PARITY:6fc11753565e9d635f3028b7106c009c3a16b7b239b7eaffb427ed8326c1c9fb',
09:35:44 provingJobType: 'BASE_PARITY'
09:35:44 }
09:35:45 [09:35:45.011]
WARN:
prover-client:broker-circuit-prover-facade Running promise was not started
09:35:45
PASS src/proving_broker/broker_prover_facade.test.ts (
10.604 s)
09:35:45 BrokerCircuitProverFacade
09:35:45
✓ sends jobs to the broker (1026 ms)
09:35:45
✓ handles multiple calls for the same job (2414 ms)
09:35:45
✓ handles proof errors (2015 ms)
09:35:45
✓ handles aborts (1006 ms)
09:35:45
✓ rejects jobs when the facade is stopped (4 ms)
09:35:45
✓ handles stopping while sending a proof to the broker (115 ms)
09:35:45
09:35:45
Test Suites: 1 passed, 1 total
09:35:45
Tests: 6 passed, 6 total
09:35:45
Snapshots: 0 total
09:35:45
Time: 10.691 s
09:35:45
Ran all test suites matching /prover-client\/src\/proving_broker\/broker_prover_facade.test.ts/i
.
09:35:45
Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?