Parent Log:
http://ci.aztec-labs.com/15824286338
Command: bootstrap_ec2 './bootstrap.sh ci-full'
Date: Mon Jun 23 13:01:28 UTC 2025
Status: 0
Took: 1797s
--- request build instance ---
Requesting m6a.32xlarge spot instance (name: pr-15211_amd64_x2-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for instance id for spot request: sir-87nf4cxj...
Timeout waiting for spot request.
Requesting m6a.32xlarge on-demand instance (name: pr-15211_amd64_x2-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for SSH at 3.144.151.30...
Stdout is not a tty, running in background...
Loading CRS into tmpfs...
Done in 17 seconds.
Stdout is not a tty, starting build container in background...
Starting devbox...
From
https://github.com/aztecprotocol/aztec-packages
* branch 505a3c071181dbc5242dc8b655a9b2d69988c8db -> FETCH_HEAD
HEAD is now at 505a3c0 chore(backport-to-staging): chore: Updated tx pool limit (#15209) (#15211)
Switched to a new branch 'gh-readonly-queue/staging/pr-15211-e8f6c3b7e3e0e72a33e118ddf8e67d11e51464a8'
+ run
+ ci3/add_timestamps
+ DUP=1
+ ci3/cache_log 'CI run' 1750681994633
CI run log id:
http://ci.aztec-labs.com/1750681994633
12:33:14 + echo 'env: REF_NAME=gh-readonly-queue/staging/pr-15211-e8f6c3b7e3e0e72a33e118ddf8e67d11e51464a8 COMMIT_HASH=505a3c071181dbc5242dc8b655a9b2d69988c8db CURRENT_VERSION=0.87.6 TARGET_BRANCH=staging'
12:33:14 env: REF_NAME=gh-readonly-queue/staging/pr-15211-e8f6c3b7e3e0e72a33e118ddf8e67d11e51464a8 COMMIT_HASH=505a3c071181dbc5242dc8b655a9b2d69988c8db CURRENT_VERSION=0.87.6 TARGET_BRANCH=staging
12:33:14 + semver check gh-readonly-queue/staging/pr-15211-e8f6c3b7e3e0e72a33e118ddf8e67d11e51464a8
12:33:14 + cpu_pid=411
12:33:14 + mpstat 2
12:33:14 + mem_pid=414
12:33:14 + set +e
12:33:14 + set -x
12:33:14 + ./bootstrap.sh ci-full
12:33:14 + vmstat -w -S M 2
12:33:14 ++ cache_log cpufile
12:33:14 ++ cache_log memfile
12:33:14 memfile log id:
http://ci.aztec-labs.com/47cdda57b83ab50b
12:33:14 cpufile log id:
http://ci.aztec-labs.com/c07bd3de3133a4a7
12:33:22
--- pull submodules ---
12:33:22 Executing: git submodule update --init --recursive (
http://ci.aztec-labs.com/11aedcba7f963f95)
12:33:31 0 .
done (9s)
12:33:33
--- noir build ---
12:33:33 Executing: retry install_deps (
http://ci.aztec-labs.com/4f5588f7874ee244)
12:33:38 0 .
done (5s)
12:33:38 build_native Executing: build_native (
http://ci.aztec-labs.com/c926d786c7197541)
12:33:38 build_packages Executing: build_packages (
http://ci.aztec-labs.com/420c3ecd66d929d2)
12:33:39 build_native 0 .
done (1s)
12:33:44 build_packages 0 .
done (6s)
12:33:45
--- bb cpp build ---
12:33:45 build_nodejs_module Executing: build_nodejs_module (
http://ci.aztec-labs.com/0333f19472eb329a)
12:33:45 build_native Executing: build_native (
http://ci.aztec-labs.com/5250eba713cfba0b)
12:33:45 build_wasm Executing: build_wasm (
http://ci.aztec-labs.com/9fe70e8df47c631b)
12:33:45 build_wasm_threads Executing: build_wasm_threads (
http://ci.aztec-labs.com/5e760b0f4ddd5ba8)
12:33:45 build_gcc_syntax_check_only Executing: build_gcc_syntax_check_only (
http://ci.aztec-labs.com/ff3855d146175f60)
12:33:45 build_fuzzing_syntax_check_only Executing: build_fuzzing_syntax_check_only (
http://ci.aztec-labs.com/c62f620a56aec9ff)
12:33:45 build_asan_fast Executing: build_asan_fast (
http://ci.aztec-labs.com/06ea2ef3feab74fb)
12:33:45 build_darwin Executing: build_darwin (
http://ci.aztec-labs.com/594b4811204e6fbe)
12:33:46 build_gcc_syntax_check_only 0 .
done (1s)
12:33:46 build_fuzzing_syntax_check_only 0 .
done (1s)
12:33:46 build_wasm 0 .
done (1s)
12:33:46 build_darwin 0 .
done (1s)
12:33:46 build_wasm_threads 0 .
done (1s)
12:33:46 build_nodejs_module 0 .
done (1s)
12:33:47 build_native 0 .
done (2s)
12:33:47 build_asan_fast 0 .
done (2s)
12:33:52
--- bb.js build ---
12:33:53 Cache download and extraction of node-modules-e85320bda7d59d54.zst complete in 1s.
12:33:53 Cache download and extraction of bb.js-93955768547ae31a.tar.gz complete in 0s.
12:33:54
--- acir_tests build ---
12:33:54 Cache download and extraction of barretenberg-acir-tests-000ad54a8a7b4100.tar.gz complete in 0s.
12:33:56 Cache download and extraction of node-modules-fec19dc5fe5a76d5.zst complete in 1s.
12:33:56 browser-test-app Executing: yarn build (
http://ci.aztec-labs.com/564409d54ae47e4b)
12:33:56 bbjs-test Executing: yarn build (
http://ci.aztec-labs.com/53800819a289ec40)
12:33:59 bbjs-test 0 .
done (3s)
12:34:01 browser-test-app 0 .
done (5s)
12:34:01
--- avm-transpiler build ---
12:34:01 Cache download and extraction of avm-transpiler-6867cd9272ea7ebd.tar.gz complete in 0s.
12:34:01
--- noir-projects build ---
12:34:01 Executing: prep (
http://ci.aztec-labs.com/a0e986e639130c3b)
12:34:04 0 .
done (3s)
12:34:05 mock-protocol-circuits Executing: ./mock-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/0902428dbc37fbcd)
12:34:05 noir-protocol-circuits Executing: ./noir-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/b2b386a6131d0e6b)
12:34:05 noir-contracts Executing: ./noir-contracts/bootstrap.sh (
http://ci.aztec-labs.com/fc8cb3dc70e9150d)
12:34:05 aztec-nr Executing: ./aztec-nr/bootstrap.sh (
http://ci.aztec-labs.com/74102194c3fd8b15)
12:34:06 noir-contracts 0 ................................................................
12:34:06 noir-contracts 64 ................................................................
12:34:06 noir-contracts 128 ................................................................
12:34:06 noir-contracts 192 ................................................................
12:34:07 noir-contracts 256 ................................................................
12:34:07 noir-contracts 320 ................................................................
12:34:07 noir-contracts 384 ................................................................
12:34:07 noir-contracts 448 ................................................................
12:34:07 noir-contracts 512 ................................................................
12:34:07 noir-contracts 576 ................................................................
12:34:08 noir-contracts 640 ................................................................
12:34:08 noir-contracts 704 ................................................................
12:34:08 noir-contracts 768 ................................................................
12:34:08 noir-contracts 832 ................................................................
12:34:08 noir-contracts 896 ................................................................
12:34:09 noir-contracts 960 ................................................................
12:34:09 noir-contracts 1024 ................................................................
12:34:09 noir-contracts 1088 ................................................................
12:34:09 noir-contracts 1152 ................................................................
12:34:09 noir-contracts 1216 ................................................................
12:34:09 noir-contracts 1280 ................................................................
12:34:10 noir-contracts 1344 ................................................................
12:34:10 noir-contracts 1408 ................................................................
12:34:10 noir-protocol-circuits 0 ................................................................
12:34:10 noir-protocol-circuits 64 ................................................................
12:34:10 noir-contracts 1472 ................................................................
12:34:10 noir-contracts 1536 ................................................................
12:34:10 noir-contracts 1600 .
done (5s)
12:34:11 noir-protocol-circuits 128 ................................................................
12:34:11 noir-protocol-circuits 192 ................................................................
12:34:12 aztec-nr 0 .
done (7s)
12:34:12 mock-protocol-circuits 0 ................................................................
12:34:12 noir-protocol-circuits 256 ................................................................
12:34:14 noir-protocol-circuits 320 ................................................................
12:34:14 mock-protocol-circuits 64 .
done (9s)
12:34:14 noir-protocol-circuits 384 ................................................................
12:34:14 noir-protocol-circuits 448 .
done (9s)
12:34:14
--- l1-contracts build ---
12:34:15 Cache download and extraction of l1-contracts-0a920e2ab51d8ecb.tar.gz complete in 1s.
12:34:15
--- yarn-project build ---
12:34:15 Executing: ./bootstrap.sh clean-lite (
http://ci.aztec-labs.com/05a756e005c8455d)
12:34:15 0 .
done (0s)
12:34:20 Cache download and extraction of node-modules-34bec2a54a394404.zst complete in 5s.
12:34:20 Executing: compile_all (
http://ci.aztec-labs.com/775552261b4a943f)
12:34:23 0 .
done (3s)
12:34:23 boxes/bootstrap.sh Executing: boxes/bootstrap.sh (
http://ci.aztec-labs.com/8aef4dad3ad1eb6c)
12:34:23 playground/bootstrap.sh Executing: playground/bootstrap.sh (
http://ci.aztec-labs.com/5be2388deb7d168f)
12:34:23 docs/bootstrap.sh Executing: docs/bootstrap.sh (
http://ci.aztec-labs.com/d878795cc7bee634)
12:34:23 release-image/bootstrap.sh Executing: release-image/bootstrap.sh (
http://ci.aztec-labs.com/5eeac8239317e7dc)
12:34:23 spartan/bootstrap.sh Executing: spartan/bootstrap.sh (
http://ci.aztec-labs.com/1f607dc846485b94)
12:34:23 aztec-up/bootstrap.sh Executing: aztec-up/bootstrap.sh (
http://ci.aztec-labs.com/73bbe63fe10427b2)
12:34:24 aztec-up/bootstrap.sh 0 .
done (1s)
12:34:28 boxes/bootstrap.sh 0 .
done (5s)
12:34:28 spartan/bootstrap.sh 0 .
done (5s)
12:34:29 playground/bootstrap.sh 0 .
done (6s)
12:34:31 docs/bootstrap.sh 0 .
done (8s)
12:35:00 release-image/bootstrap.sh 0 .
done (37s)
12:35:00
--- test all ---
12:35:00 Waiting for TXE's to start...
12:35:03 Gathering tests to run...
12:36:42 Gathered 12158 tests.
12:36:42 Starting parallel run with max 64 jobs...
12:36:42 Executing: parallel -j64 --memsuspend 64G --line-buffer --joblog joblog.txt --halt now,fail=1 'run_test_cmd {}' (
http://ci.aztec-labs.com/75463b5af22d2d50)
12:37:13 0 ................................................................
12:38:17 64 ................................................................
12:39:20 128 ................................................................
12:40:22 192 ................................................................
12:40:47 256 ................................................................
12:40:58 320 ................................................................
12:41:16 384 ................................................................
12:41:33 448 ................................................................
12:41:40 512 ................................................................
12:41:46 576 ................................................................
12:41:57 640 ................................................................
12:42:06 704 ................................................................
12:42:12 768 ................................................................
12:42:18 832 ................................................................
12:42:26 896 ................................................................
12:42:31 960 ................................................................
12:42:37 1024 ................................................................
12:42:41 1088 ................................................................
12:42:50 1152 ................................................................
12:42:57 1216 ................................................................
12:43:00 1280 ................................................................
12:43:04 1344 ................................................................
12:43:07 1408 ................................................................
12:43:10 1472 ................................................................
12:43:14 1536 ................................................................
12:43:21 1600 ................................................................
12:43:31 1664 ................................................................
12:43:46 1728 ................................................................
12:43:51 1792 ................................................................
12:43:55 1856 ................................................................
12:43:58 1920 ................................................................
12:43:59 1984 ................................................................
12:44:01 2048 ................................................................
12:44:03 2112 ................................................................
12:44:04 2176 ................................................................
12:44:06 2240 ................................................................
12:44:08 2304 ................................................................
12:44:09 2368 ................................................................
12:44:11 2432 ................................................................
12:44:12 2496 ................................................................
12:44:13 2560 ................................................................
12:44:30 2624 ................................................................
12:44:37 2688 ................................................................
12:44:39 2752 ................................................................
12:44:40 2816 ................................................................
12:44:42 2880 ................................................................
12:44:44 2944 ................................................................
12:44:56 3008 ................................................................
12:45:01 3072 ................................................................
12:45:05 3136 ................................................................
12:45:07 3200 ................................................................
12:45:08 3264 ................................................................
12:45:10 3328 ................................................................
12:45:12 3392 ................................................................
12:45:14 3456 ................................................................
12:45:16 3520 ................................................................
12:45:19 3584 ................................................................
12:45:21 3648 ................................................................
12:45:23 3712 ................................................................
12:45:24 3776 ................................................................
12:45:25 3840 ................................................................
12:45:26 3904 ................................................................
12:45:28 3968 ................................................................
12:45:29 4032 ................................................................
12:45:30 4096 ................................................................
12:45:32 4160 ................................................................
12:45:35 4224 ................................................................
12:45:39 4288 ................................................................
12:45:43 4352 ................................................................
12:45:46 4416 ................................................................
12:45:49 4480 ................................................................
12:45:52 4544 ................................................................
12:45:54 4608 ................................................................
12:45:55 4672 ................................................................
12:45:58 4736 ................................................................
12:46:01 4800 ................................................................
12:46:02 4864 ................................................................
12:46:04 4928 ................................................................
12:46:06 4992 ................................................................
12:46:08 5056 ................................................................
12:46:10 5120 ................................................................
12:46:11 5184 ................................................................
12:46:12 5248 ................................................................
12:46:14 5312 ................................................................
12:46:15 5376 ................................................................
12:46:16 5440 ................................................................
12:46:19 5504 ................................................................
12:46:21 5568 ................................................................
12:46:23 5632 ................................................................
12:46:25 5696 ................................................................
12:46:27 5760 ................................................................
12:46:30 5824 ................................................................
12:46:32 5888 ................................................................
12:46:34 5952 ................................................................
12:46:36 6016 ................................................................
12:46:38 6080 ................................................................
12:46:40 6144 ................................................................
12:46:43 6208 ................................................................
12:46:46 6272 ................................................................
12:46:48 6336 ................................................................
12:46:50 6400 ................................................................
12:46:53 6464 ................................................................
12:46:56 6528 ................................................................
12:46:59 6592 ................................................................
12:47:02 6656 ................................................................
12:47:05 6720 ................................................................
12:47:07 6784 ................................................................
12:47:09 6848 ................................................................
12:47:11 6912 ................................................................
12:47:13 6976 ................................................................
12:47:16 7040 ................................................................
12:47:18 7104 ................................................................
12:47:20 7168 ................................................................
12:47:22 7232 ................................................................
12:47:23 7296 ................................................................
12:47:24 7360 ................................................................
12:47:25 7424 ................................................................
12:47:26 7488 ................................................................
12:47:28 7552 ................................................................
12:47:29 7616 ................................................................
12:47:30 7680 ................................................................
12:47:31 7744 ................................................................
12:47:32 7808 ................................................................
12:47:34 7872 ................................................................
12:47:35 7936 ................................................................
12:47:36 8000 ................................................................
12:47:37 8064 ................................................................
12:47:38 8128 ................................................................
12:47:40 8192 ................................................................
12:47:41 8256 ................................................................
12:47:42 8320 ................................................................
12:47:43 8384 ................................................................
12:47:45 8448 ................................................................
12:47:46 8512 ................................................................
12:47:47 8576 ................................................................
12:47:48 8640 ................................................................
12:47:49 8704 ................................................................
12:47:50 8768 ................................................................
12:47:51 8832 ................................................................
12:47:53 8896 ................................................................
12:47:54 8960 ................................................................
12:47:55 9024 ................................................................
12:47:57 9088 ................................................................
12:47:58 9152 ................................................................
12:47:59 9216 ................................................................
12:48:01 9280 ................................................................
12:48:02 9344 ................................................................
12:48:03 9408 ................................................................
12:48:05 9472 ................................................................
12:48:06 9536 ................................................................
12:48:07 9600 ................................................................
12:48:09 9664 ................................................................
12:48:11 9728 ................................................................
12:48:13 9792 ................................................................
12:48:14 9856 ................................................................
12:48:16 9920 ................................................................
12:48:17 9984 ................................................................
12:48:18 10048 ................................................................
12:48:19 10112 ................................................................
12:48:20 10176 ................................................................
12:48:21 10240 ................................................................
12:48:22 10304 ................................................................
12:48:23 10368 ................................................................
12:48:24 10432 ................................................................
12:48:26 10496 ................................................................
12:48:27 10560 ................................................................
12:48:28 10624 ................................................................
12:48:29 10688 ................................................................
12:48:31 10752 ................................................................
12:48:32 10816 ................................................................
12:48:33 10880 ................................................................
12:48:33 10944 ................................................................
12:48:35 11008 ................................................................
12:48:36 11072 ................................................................
12:48:37 11136 ................................................................
12:48:38 11200 ................................................................
12:48:39 11264 ................................................................
12:48:40 11328 ................................................................
12:48:42 11392 ................................................................
12:48:43 11456 ................................................................
12:48:44 11520 ................................................................
12:48:45 11584 ................................................................
12:48:46 11648 ................................................................
12:48:47 11712 ................................................................
12:48:48 11776 ................................................................
12:48:49 11840 ................................................................
12:48:50 11904 ................................................................
12:48:51 11968 ................................................................
12:48:52 12032 ................................................................
12:48:53 12096 ................................................................
12:48:54 12160 ................................................................
12:48:55 12224 ................................................................
12:48:56 12288 ................................................................
12:49:11 12352 ................................................................
12:51:31 12416 .
done (889s)
12:51:31
WARNING: The following tests exceed 5 minute runtimes. Break them up or rethink them.
12:51:31 321.296: '6c32ccc844d598b0 barretenberg/cpp/scripts/run_test.sh dsl_tests AcirAvm2RecursionConstraint.TestGenerateVKFromConstraintsWithoutWitness'
12:51:31 339.319: '582720422b3f4dff:ISOLATE=1:NAME=e2e_p2p/data_withholding_slash yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/data_withholding_slash.test.ts'
12:51:31 341.560: '38f42676adefc499:ONLY_TERM_PARENT=1 BOX=vanilla BROWSER=* run_compose_test vanilla-all-browsers box boxes'
12:51:31 354.297: '6c32ccc844d598b0:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityPassing'
12:51:31 356.548: '6c32ccc844d598b0:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityFailing'
12:51:31 364.294: 'ae089fd8b717cb3d aztec-up/scripts/run_test.sh amm_flow'
12:51:31 382.323: '582720422b3f4dff:ISOLATE=1:NAME=p2p/src/client/p2p_client.integration.test.ts LOG_LEVEL=debug yarn-project/scripts/run_test.sh p2p/src/client/p2p_client.integration.test.ts'
12:51:31 402.786: '582720422b3f4dff:ISOLATE=1:TIMEOUT=15m:NAME=e2e_block_building yarn-project/end-to-end/scripts/run_test.sh simple e2e_block_building'
12:51:31 429.632: '582720422b3f4dff:ISOLATE=1:NAME=prover-client/src/test/bb_prover_full_rollup.test.ts:CPUS=16:MEM=96g LOG_LEVEL=verbose yarn-project/scripts/run_test.sh prover-client/src/test/bb_prover_full_rollup.test.ts'
12:51:31 430.703: '582720422b3f4dff:ISOLATE=1:NAME=e2e_p2p/reex yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/reex.test.ts'
12:51:31 443.451: '582720422b3f4dff:ISOLATE=1:NAME=e2e_l1_with_wall_time yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_l1_with_wall_time.test.ts'
12:51:31 722.095: '582720422b3f4dff:ISOLATE=1:TIMEOUT=15m:CPUS=16:MEM=96g:NAME=e2e_prover_full_real yarn-project/end-to-end/scripts/run_test.sh simple e2e_prover/full'
12:51:31 Completed run of 12158 tests in 889 seconds.
12:51:31
--- bench all ---
12:51:31 barretenberg/cpp Executing: barretenberg/cpp/bootstrap.sh build_bench (
http://ci.aztec-labs.com/bbce646fab7976fb)
12:51:31 yarn-project/end-to-end Executing: yarn-project/end-to-end/bootstrap.sh build_bench (
http://ci.aztec-labs.com/54bfee4d2707f122)
12:51:32 barretenberg/cpp 0 .
done (1s)
12:53:30 yarn-project/end-to-end 0 ................................................................
12:56:11 yarn-project/end-to-end 64 .
done (280s)
12:56:13 Starting parallel run using max 64 cpus...
12:56:13 Test run log id:
http://ci.aztec-labs.com/3a14699479eff255
13:01:18 Completed run of 95 tests in 305 seconds.
13:01:21 Completed 7.6 KiB/7.6 KiB (117.0 KiB/s) with 1 file(s) remaining
upload: ../../../tmp/tmp.RiSROONQUV to s3://aztec-ci-artifacts/build-cache/bench-505a3c071181dbc5242dc8b655a9b2d69988c8db.tar.gz
13:01:21 Cache upload of bench-505a3c071181dbc5242dc8b655a9b2d69988c8db.tar.gz complete in 2s.
13:01:21 + local code=0
13:01:21 + set +x
13:01:21 dmesg log id:
http://ci.aztec-labs.com/f9e846065af1b4fa
CI run log id:
http://ci.aztec-labs.com/1750681994633
+ code=0
+ case $code in
+ log_ci_run PASSED 1750681994633
+ exit 0
SSH exited with code: 0
Terminating instance: i-030acd0a8846bf312...