Parent Log:
http://ci.aztec-labs.com/15849889662
Command: bootstrap_ec2 './bootstrap.sh ci-full'
Date: Tue Jun 24 12:33:38 UTC 2025
Status: 0
Took: 1811s
--- request build instance ---
Requesting m6a.32xlarge spot instance (name: pr-15238_amd64_x2-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for instance id for spot request: sir-knpz4f1k...
Timeout waiting for spot request.
Requesting m6a.32xlarge on-demand instance (name: pr-15238_amd64_x2-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for SSH at 18.116.199.98...
Stdout is not a tty, running in background...
Loading CRS into tmpfs...
Done in 14 seconds.
Stdout is not a tty, starting build container in background...
Starting devbox...
From
https://github.com/aztecprotocol/aztec-packages
* branch 3863bc02d671057d0cffd4ced17ca317788ff190 -> FETCH_HEAD
HEAD is now at 3863bc0 chore(backport-to-staging): fix: p2p private key value (#15229) (#15238)
Switched to a new branch 'gh-readonly-queue/staging/pr-15238-db396f13b7ef374a230174bdc4078d9fbb3c788a'
+ run
+ ci3/add_timestamps
+ DUP=1
+ ci3/cache_log 'CI run' 1750766709867
CI run log id:
http://ci.aztec-labs.com/1750766709867
12:05:09 + echo 'env: REF_NAME=gh-readonly-queue/staging/pr-15238-db396f13b7ef374a230174bdc4078d9fbb3c788a COMMIT_HASH=3863bc02d671057d0cffd4ced17ca317788ff190 CURRENT_VERSION=1.0.0 TARGET_BRANCH=staging'
12:05:09 env: REF_NAME=gh-readonly-queue/staging/pr-15238-db396f13b7ef374a230174bdc4078d9fbb3c788a COMMIT_HASH=3863bc02d671057d0cffd4ced17ca317788ff190 CURRENT_VERSION=1.0.0 TARGET_BRANCH=staging
12:05:09 + semver check gh-readonly-queue/staging/pr-15238-db396f13b7ef374a230174bdc4078d9fbb3c788a
12:05:09 + cpu_pid=420
12:05:09 + mpstat 2
12:05:09 + mem_pid=422
12:05:09 + set +e
12:05:09 + set -x
12:05:09 + ./bootstrap.sh ci-full
12:05:09 + vmstat -w -S M 2
12:05:09 ++ cache_log cpufile
12:05:09 ++ cache_log memfile
12:05:10 cpufile log id:
http://ci.aztec-labs.com/acfd5f9e51b4d9a0
12:05:10 memfile log id:
http://ci.aztec-labs.com/897b81680708aeed
12:05:17
--- pull submodules ---
12:05:17 Executing: git submodule update --init --recursive (
http://ci.aztec-labs.com/7d8b96907efd7ca3)
12:05:26 0 .
done (9s)
12:05:27
--- noir build ---
12:05:27 Executing: retry install_deps (
http://ci.aztec-labs.com/251ba74203abb634)
12:05:32 0 .
done (5s)
12:05:32 build_native Executing: build_native (
http://ci.aztec-labs.com/18bd4c81a410777f)
12:05:32 build_packages Executing: build_packages (
http://ci.aztec-labs.com/f4b8fa2ac81b7fe3)
12:05:33 build_native 0 .
done (1s)
12:05:39 build_packages 0 .
done (7s)
12:05:40
--- bb cpp build ---
12:05:41 build_nodejs_module Executing: build_nodejs_module (
http://ci.aztec-labs.com/4727859871d9fbf6)
12:05:41 build_wasm Executing: build_wasm (
http://ci.aztec-labs.com/0457160bdb062d2d)
12:05:41 build_wasm_threads Executing: build_wasm_threads (
http://ci.aztec-labs.com/cd0e7733071d06f8)
12:05:41 build_native Executing: build_native (
http://ci.aztec-labs.com/fe83ab131cc4edd5)
12:05:41 build_gcc_syntax_check_only Executing: build_gcc_syntax_check_only (
http://ci.aztec-labs.com/7d37b8b1b651ca18)
12:05:41 build_fuzzing_syntax_check_only Executing: build_fuzzing_syntax_check_only (
http://ci.aztec-labs.com/5b42afffd1647575)
12:05:41 build_asan_fast Executing: build_asan_fast (
http://ci.aztec-labs.com/36857c1c3576f4f7)
12:05:41 build_darwin Executing: build_darwin (
http://ci.aztec-labs.com/9649bf91ddc0165d)
12:05:41 build_gcc_syntax_check_only 0 .
done (0s)
12:05:41 build_fuzzing_syntax_check_only 0 .
done (0s)
12:05:41 build_wasm 0 .
done (1s)
12:05:41 build_darwin 0 .
done (0s)
12:05:41 build_wasm_threads 0 .
done (1s)
12:05:41 build_nodejs_module 0 .
done (1s)
12:05:42 build_native 0 .
done (2s)
12:05:43 build_asan_fast 0 .
done (2s)
12:05:48
--- bb.js build ---
12:05:49 Cache download and extraction of node-modules-e85320bda7d59d54.zst complete in 1s.
12:05:50 Cache download and extraction of bb.js-93955768547ae31a.tar.gz complete in 1s.
12:05:51
--- acir_tests build ---
12:05:51 Cache download and extraction of barretenberg-acir-tests-000ad54a8a7b4100.tar.gz complete in 0s.
12:05:53 Cache download and extraction of node-modules-fec19dc5fe5a76d5.zst complete in 1s.
12:05:53 browser-test-app Executing: yarn build (
http://ci.aztec-labs.com/2c514a5578f5e70b)
12:05:53 bbjs-test Executing: yarn build (
http://ci.aztec-labs.com/d05917dc1b07061a)
12:05:56 bbjs-test 0 .
done (3s)
12:05:58 browser-test-app 0 .
done (5s)
12:05:58
--- avm-transpiler build ---
12:05:58 Cache download and extraction of avm-transpiler-6867cd9272ea7ebd.tar.gz complete in 0s.
12:05:58
--- noir-projects build ---
12:05:58 Executing: prep (
http://ci.aztec-labs.com/556aa9e034ad447a)
12:06:01 0 .
done (3s)
12:06:02 mock-protocol-circuits Executing: ./mock-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/8554d542a4b6ea74)
12:06:02 noir-protocol-circuits Executing: ./noir-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/7ab398e681521cd9)
12:06:02 noir-contracts Executing: ./noir-contracts/bootstrap.sh (
http://ci.aztec-labs.com/2cc0f1391790458b)
12:06:02 aztec-nr Executing: ./aztec-nr/bootstrap.sh (
http://ci.aztec-labs.com/8d6146fbd664f0cb)
12:06:04 noir-contracts 0 ................................................................
12:06:04 noir-contracts 64 ................................................................
12:06:04 noir-contracts 128 ................................................................
12:06:04 noir-contracts 192 ................................................................
12:06:05 noir-contracts 256 ................................................................
12:06:05 noir-contracts 320 ................................................................
12:06:05 noir-contracts 384 ................................................................
12:06:05 noir-contracts 448 ................................................................
12:06:05 noir-contracts 512 ................................................................
12:06:05 noir-contracts 576 ................................................................
12:06:05 noir-contracts 640 ................................................................
12:06:06 noir-contracts 704 ................................................................
12:06:06 noir-contracts 768 ................................................................
12:06:06 noir-contracts 832 ................................................................
12:06:06 noir-contracts 896 ................................................................
12:06:07 noir-contracts 960 ................................................................
12:06:07 noir-contracts 1024 ................................................................
12:06:07 noir-protocol-circuits 0 ................................................................
12:06:07 noir-protocol-circuits 64 ................................................................
12:06:07 noir-contracts 1088 ................................................................
12:06:07 noir-contracts 1152 ................................................................
12:06:08 noir-contracts 1216 ................................................................
12:06:08 noir-contracts 1280 ................................................................
12:06:08 noir-contracts 1344 ................................................................
12:06:08 noir-contracts 1408 ................................................................
12:06:08 noir-contracts 1472 ................................................................
12:06:08 noir-protocol-circuits 128 ................................................................
12:06:08 noir-contracts 1536 ................................................................
12:06:08 noir-contracts 1600 .
done (6s)
12:06:09 noir-protocol-circuits 192 ................................................................
12:06:09 aztec-nr 0 .
done (7s)
12:06:09 mock-protocol-circuits 0 ................................................................
12:06:10 noir-protocol-circuits 256 ................................................................
12:06:11 noir-protocol-circuits 320 ................................................................
12:06:11 mock-protocol-circuits 64 .
done (9s)
12:06:11 noir-protocol-circuits 384 ................................................................
12:06:11 noir-protocol-circuits 448 .
done (9s)
12:06:12
--- l1-contracts build ---
12:06:13 Cache download and extraction of l1-contracts-0a920e2ab51d8ecb.tar.gz complete in 1s.
12:06:13
--- yarn-project build ---
12:06:13 Executing: ./bootstrap.sh clean-lite (
http://ci.aztec-labs.com/ca735d487e5716d1)
12:06:13 0 .
done (0s)
12:06:18 Cache download and extraction of node-modules-34bec2a54a394404.zst complete in 5s.
12:06:18 Executing: compile_all (
http://ci.aztec-labs.com/4e9de84dfb449e90)
12:06:22 0 .
done (4s)
12:06:22 boxes/bootstrap.sh Executing: boxes/bootstrap.sh (
http://ci.aztec-labs.com/efe60c6a95b5521b)
12:06:22 playground/bootstrap.sh Executing: playground/bootstrap.sh (
http://ci.aztec-labs.com/b67e88f7473a76f3)
12:06:22 docs/bootstrap.sh Executing: docs/bootstrap.sh (
http://ci.aztec-labs.com/28203e1282b206f8)
12:06:22 release-image/bootstrap.sh Executing: release-image/bootstrap.sh (
http://ci.aztec-labs.com/1afbb7f59debf2a5)
12:06:22 spartan/bootstrap.sh Executing: spartan/bootstrap.sh (
http://ci.aztec-labs.com/80c2cd707ad8f275)
12:06:22 aztec-up/bootstrap.sh Executing: aztec-up/bootstrap.sh (
http://ci.aztec-labs.com/af0997ed9d395c97)
12:06:23 aztec-up/bootstrap.sh 0 .
done (1s)
12:06:26 boxes/bootstrap.sh 0 .
done (4s)
12:06:27 playground/bootstrap.sh 0 .
done (5s)
12:06:28 spartan/bootstrap.sh 0 .
done (6s)
12:06:30 docs/bootstrap.sh 0 .
done (8s)
12:07:00 release-image/bootstrap.sh 0 .
done (38s)
12:07:00
--- test all ---
12:07:00 Waiting for TXE's to start...
12:07:03 Gathering tests to run...
12:08:41 Gathered 12158 tests.
12:08:41 Starting parallel run with max 64 jobs...
12:08:41 Executing: parallel -j64 --memsuspend 64G --line-buffer --joblog joblog.txt --halt now,fail=1 'run_test_cmd {}' (
http://ci.aztec-labs.com/232a0193ad74c3c2)
12:09:13 0 ................................................................
12:10:17 64 ................................................................
12:11:21 128 ................................................................
12:12:23 192 ................................................................
12:12:46 256 ................................................................
12:12:55 320 ................................................................
12:13:15 384 ................................................................
12:13:31 448 ................................................................
12:13:39 512 ................................................................
12:13:44 576 ................................................................
12:13:56 640 ................................................................
12:14:04 704 ................................................................
12:14:11 768 ................................................................
12:14:16 832 ................................................................
12:14:24 896 ................................................................
12:14:30 960 ................................................................
12:14:35 1024 ................................................................
12:14:39 1088 ................................................................
12:14:47 1152 ................................................................
12:14:54 1216 ................................................................
12:14:57 1280 ................................................................
12:15:01 1344 ................................................................
12:15:04 1408 ................................................................
12:15:08 1472 ................................................................
12:15:11 1536 ................................................................
12:15:18 1600 ................................................................
12:15:27 1664 ................................................................
12:15:42 1728 ................................................................
12:15:47 1792 ................................................................
12:15:52 1856 ................................................................
12:15:55 1920 ................................................................
12:15:57 1984 ................................................................
12:15:59 2048 ................................................................
12:16:00 2112 ................................................................
12:16:02 2176 ................................................................
12:16:03 2240 ................................................................
12:16:05 2304 ................................................................
12:16:07 2368 ................................................................
12:16:08 2432 ................................................................
12:16:09 2496 ................................................................
12:16:11 2560 ................................................................
12:16:27 2624 ................................................................
12:16:33 2688 ................................................................
12:16:34 2752 ................................................................
12:16:36 2816 ................................................................
12:16:37 2880 ................................................................
12:16:40 2944 ................................................................
12:16:50 3008 ................................................................
12:16:57 3072 ................................................................
12:17:01 3136 ................................................................
12:17:02 3200 ................................................................
12:17:04 3264 ................................................................
12:17:05 3328 ................................................................
12:17:07 3392 ................................................................
12:17:09 3456 ................................................................
12:17:12 3520 ................................................................
12:17:14 3584 ................................................................
12:17:16 3648 ................................................................
12:17:18 3712 ................................................................
12:17:19 3776 ................................................................
12:17:20 3840 ................................................................
12:17:22 3904 ................................................................
12:17:23 3968 ................................................................
12:17:24 4032 ................................................................
12:17:26 4096 ................................................................
12:17:27 4160 ................................................................
12:17:30 4224 ................................................................
12:17:34 4288 ................................................................
12:17:37 4352 ................................................................
12:17:40 4416 ................................................................
12:17:43 4480 ................................................................
12:17:45 4544 ................................................................
12:17:47 4608 ................................................................
12:17:49 4672 ................................................................
12:17:52 4736 ................................................................
12:17:54 4800 ................................................................
12:17:56 4864 ................................................................
12:17:58 4928 ................................................................
12:18:00 4992 ................................................................
12:18:02 5056 ................................................................
12:18:04 5120 ................................................................
12:18:05 5184 ................................................................
12:18:07 5248 ................................................................
12:18:08 5312 ................................................................
12:18:09 5376 ................................................................
12:18:10 5440 ................................................................
12:18:13 5504 ................................................................
12:18:14 5568 ................................................................
12:18:17 5632 ................................................................
12:18:19 5696 ................................................................
12:18:21 5760 ................................................................
12:18:23 5824 ................................................................
12:18:25 5888 ................................................................
12:18:27 5952 ................................................................
12:18:29 6016 ................................................................
12:18:31 6080 ................................................................
12:18:33 6144 ................................................................
12:18:36 6208 ................................................................
12:18:39 6272 ................................................................
12:18:41 6336 ................................................................
12:18:43 6400 ................................................................
12:18:46 6464 ................................................................
12:18:49 6528 ................................................................
12:18:51 6592 ................................................................
12:18:54 6656 ................................................................
12:18:57 6720 ................................................................
12:18:59 6784 ................................................................
12:19:01 6848 ................................................................
12:19:03 6912 ................................................................
12:19:05 6976 ................................................................
12:19:08 7040 ................................................................
12:19:09 7104 ................................................................
12:19:12 7168 ................................................................
12:19:14 7232 ................................................................
12:19:15 7296 ................................................................
12:19:16 7360 ................................................................
12:19:17 7424 ................................................................
12:19:18 7488 ................................................................
12:19:19 7552 ................................................................
12:19:21 7616 ................................................................
12:19:22 7680 ................................................................
12:19:23 7744 ................................................................
12:19:24 7808 ................................................................
12:19:25 7872 ................................................................
12:19:27 7936 ................................................................
12:19:28 8000 ................................................................
12:19:29 8064 ................................................................
12:19:30 8128 ................................................................
12:19:32 8192 ................................................................
12:19:33 8256 ................................................................
12:19:34 8320 ................................................................
12:19:36 8384 ................................................................
12:19:37 8448 ................................................................
12:19:38 8512 ................................................................
12:19:39 8576 ................................................................
12:19:40 8640 ................................................................
12:19:42 8704 ................................................................
12:19:43 8768 ................................................................
12:19:44 8832 ................................................................
12:19:45 8896 ................................................................
12:19:46 8960 ................................................................
12:19:48 9024 ................................................................
12:19:49 9088 ................................................................
12:19:50 9152 ................................................................
12:19:52 9216 ................................................................
12:19:53 9280 ................................................................
12:19:55 9344 ................................................................
12:19:56 9408 ................................................................
12:19:57 9472 ................................................................
12:19:59 9536 ................................................................
12:20:00 9600 ................................................................
12:20:02 9664 ................................................................
12:20:04 9728 ................................................................
12:20:05 9792 ................................................................
12:20:07 9856 ................................................................
12:20:09 9920 ................................................................
12:20:10 9984 ................................................................
12:20:11 10048 ................................................................
12:20:12 10112 ................................................................
12:20:13 10176 ................................................................
12:20:14 10240 ................................................................
12:20:15 10304 ................................................................
12:20:16 10368 ................................................................
12:20:17 10432 ................................................................
12:20:19 10496 ................................................................
12:20:20 10560 ................................................................
12:20:22 10624 ................................................................
12:20:23 10688 ................................................................
12:20:24 10752 ................................................................
12:20:26 10816 ................................................................
12:20:27 10880 ................................................................
12:20:27 10944 ................................................................
12:20:29 11008 ................................................................
12:20:30 11072 ................................................................
12:20:31 11136 ................................................................
12:20:32 11200 ................................................................
12:20:33 11264 ................................................................
12:20:34 11328 ................................................................
12:20:35 11392 ................................................................
12:20:37 11456 ................................................................
12:20:38 11520 ................................................................
12:20:39 11584 ................................................................
12:20:40 11648 ................................................................
12:20:41 11712 ................................................................
12:20:42 11776 ................................................................
12:20:43 11840 ................................................................
12:20:44 11904 ................................................................
12:20:46 11968 ................................................................
12:20:47 12032 ................................................................
12:20:48 12096 ................................................................
12:20:49 12160 ................................................................
12:20:50 12224 ................................................................
12:20:51 12288 ................................................................
12:21:01 12352 ................................................................
12:23:26 12416 .
done (885s)
12:23:26
WARNING: The following tests exceed 5 minute runtimes. Break them up or rethink them.
12:23:26 306.157: '84c999e211bb73e4:ISOLATE=1:NAME=e2e_p2p/validators_sentinel yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/validators_sentinel.test.ts'
12:23:26 318.894: '6c32ccc844d598b0 barretenberg/cpp/scripts/run_test.sh dsl_tests AcirAvm2RecursionConstraint.TestGenerateVKFromConstraintsWithoutWitness'
12:23:26 339.600: '84c999e211bb73e4:ISOLATE=1:NAME=e2e_p2p/data_withholding_slash yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/data_withholding_slash.test.ts'
12:23:26 340.573: 'c9e0614cc3889111:ONLY_TERM_PARENT=1 BOX=vanilla BROWSER=* run_compose_test vanilla-all-browsers box boxes'
12:23:26 349.236: '6c32ccc844d598b0:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityPassing'
12:23:26 355.740: '6c32ccc844d598b0:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityFailing'
12:23:26 361.292: 'e156b3778e196649 aztec-up/scripts/run_test.sh amm_flow'
12:23:26 400.694: '84c999e211bb73e4:ISOLATE=1:TIMEOUT=15m:NAME=e2e_block_building yarn-project/end-to-end/scripts/run_test.sh simple e2e_block_building'
12:23:26 429.726: '84c999e211bb73e4:ISOLATE=1:NAME=e2e_p2p/reex yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/reex.test.ts'
12:23:26 430.519: '84c999e211bb73e4:ISOLATE=1:NAME=prover-client/src/test/bb_prover_full_rollup.test.ts:CPUS=16:MEM=96g LOG_LEVEL=verbose yarn-project/scripts/run_test.sh prover-client/src/test/bb_prover_full_rollup.test.ts'
12:23:26 443.690: '84c999e211bb73e4:ISOLATE=1:NAME=e2e_l1_with_wall_time yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_l1_with_wall_time.test.ts'
12:23:26 729.192: '84c999e211bb73e4:ISOLATE=1:TIMEOUT=15m:CPUS=16:MEM=96g:NAME=e2e_prover_full_real yarn-project/end-to-end/scripts/run_test.sh simple e2e_prover/full'
12:23:26 Completed run of 12158 tests in 885 seconds.
12:23:26
--- bench all ---
12:23:26 barretenberg/cpp Executing: barretenberg/cpp/bootstrap.sh build_bench (
http://ci.aztec-labs.com/38352576c2f509e9)
12:23:26 yarn-project/end-to-end Executing: yarn-project/end-to-end/bootstrap.sh build_bench (
http://ci.aztec-labs.com/95854669e3f793f3)
12:23:27 barretenberg/cpp 0 .
done (1s)
12:25:26 yarn-project/end-to-end 0 ................................................................
12:28:21 yarn-project/end-to-end 64 .
done (295s)
12:28:22 Starting parallel run using max 64 cpus...
12:28:22 Test run log id:
http://ci.aztec-labs.com/ba766d1b5e5f42de
12:33:26 Completed run of 95 tests in 304 seconds.
12:33:28 Completed 7.6 KiB/7.6 KiB (124.6 KiB/s) with 1 file(s) remaining
upload: ../../../tmp/tmp.3BFl4d34hS to s3://aztec-ci-artifacts/build-cache/bench-3863bc02d671057d0cffd4ced17ca317788ff190.tar.gz
12:33:28 Cache upload of bench-3863bc02d671057d0cffd4ced17ca317788ff190.tar.gz complete in 1s.
12:33:28 + local code=0
12:33:28 + set +x
12:33:28 dmesg log id:
http://ci.aztec-labs.com/6bb34177d845729c
CI run log id:
http://ci.aztec-labs.com/1750766709867
+ code=0
+ case $code in
+ log_ci_run PASSED 1750766709867
+ exit 0
SSH exited with code: 0
Terminating instance: i-02505797e1ff59c04...