Parent Log:
http://ci.aztec-labs.com/15849889662
Command: bootstrap_ec2 './bootstrap.sh ci-full'
Date: Tue Jun 24 12:32:40 UTC 2025
Status: 0
Took: 1753s
--- request build instance ---
Requesting m6a.32xlarge spot instance (name: pr-15238_amd64_x1-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for instance id for spot request: sir-p8d77dcj...
Waiting for SSH at 3.148.236.15...
Stdout is not a tty, running in background...
Loading CRS into tmpfs...
Done in 8 seconds.
Stdout is not a tty, starting build container in background...
Starting devbox...
From
https://github.com/aztecprotocol/aztec-packages
* branch 3863bc02d671057d0cffd4ced17ca317788ff190 -> FETCH_HEAD
HEAD is now at 3863bc0 chore(backport-to-staging): fix: p2p private key value (#15229) (#15238)
Switched to a new branch 'gh-readonly-queue/staging/pr-15238-db396f13b7ef374a230174bdc4078d9fbb3c788a'
+ run
+ ci3/add_timestamps
+ DUP=1
+ ci3/cache_log 'CI run' 1750766662134
CI run log id:
http://ci.aztec-labs.com/1750766662134
12:04:22 + echo 'env: REF_NAME=gh-readonly-queue/staging/pr-15238-db396f13b7ef374a230174bdc4078d9fbb3c788a COMMIT_HASH=3863bc02d671057d0cffd4ced17ca317788ff190 CURRENT_VERSION=1.0.0 TARGET_BRANCH=staging'
12:04:22 env: REF_NAME=gh-readonly-queue/staging/pr-15238-db396f13b7ef374a230174bdc4078d9fbb3c788a COMMIT_HASH=3863bc02d671057d0cffd4ced17ca317788ff190 CURRENT_VERSION=1.0.0 TARGET_BRANCH=staging
12:04:22 + semver check gh-readonly-queue/staging/pr-15238-db396f13b7ef374a230174bdc4078d9fbb3c788a
12:04:22 + cpu_pid=424
12:04:22 + mpstat 2
12:04:22 + mem_pid=427
12:04:22 + set +e
12:04:22 + set -x
12:04:22 + ./bootstrap.sh ci-full
12:04:22 + vmstat -w -S M 2
12:04:22 ++ cache_log cpufile
12:04:22 ++ cache_log memfile
12:04:22 cpufile log id:
http://ci.aztec-labs.com/98d8bfb8c8ce5f13
12:04:22 memfile log id:
http://ci.aztec-labs.com/07ed0b5d89463824
12:04:30
--- pull submodules ---
12:04:30 Executing: git submodule update --init --recursive (
http://ci.aztec-labs.com/ed6c1a8376847d66)
12:04:38 0 .
done (8s)
12:04:40
--- noir build ---
12:04:40 Executing: retry install_deps (
http://ci.aztec-labs.com/b90f31db865ad5f5)
12:04:45 0 .
done (5s)
12:04:45 build_native Executing: build_native (
http://ci.aztec-labs.com/24adcaffd825b94a)
12:04:45 build_packages Executing: build_packages (
http://ci.aztec-labs.com/5fecd380cba3394e)
12:04:46 build_native 0 .
done (1s)
12:04:52 build_packages 0 .
done (7s)
12:04:52
--- bb cpp build ---
12:04:52 build_wasm Executing: build_wasm (
http://ci.aztec-labs.com/614e4f0b5befc61b)
12:04:52 build_native Executing: build_native (
http://ci.aztec-labs.com/34023ca68f905a97)
12:04:52 build_nodejs_module Executing: build_nodejs_module (
http://ci.aztec-labs.com/d7a172ecfc356c98)
12:04:52 build_wasm_threads Executing: build_wasm_threads (
http://ci.aztec-labs.com/6b73a835e51025d3)
12:04:52 build_gcc_syntax_check_only Executing: build_gcc_syntax_check_only (
http://ci.aztec-labs.com/4a2e3ca579271827)
12:04:52 build_fuzzing_syntax_check_only Executing: build_fuzzing_syntax_check_only (
http://ci.aztec-labs.com/6b1d19226283d739)
12:04:52 build_asan_fast Executing: build_asan_fast (
http://ci.aztec-labs.com/cfc45ee1ae60108d)
12:04:52 build_darwin Executing: build_darwin (
http://ci.aztec-labs.com/36581ce4a86eeea6)
12:04:52 build_gcc_syntax_check_only 0 .
done (0s)
12:04:52 build_fuzzing_syntax_check_only 0 .
done (0s)
12:04:53 build_wasm 0 .
done (1s)
12:04:53 build_darwin 0 .
done (1s)
12:04:53 build_wasm_threads 0 .
done (1s)
12:04:53 build_nodejs_module 0 .
done (1s)
12:04:54 build_native 0 .
done (2s)
12:04:55 build_asan_fast 0 .
done (3s)
12:04:59
--- bb.js build ---
12:05:01 Cache download and extraction of node-modules-e85320bda7d59d54.zst complete in 1s.
12:05:01 Cache download and extraction of bb.js-93955768547ae31a.tar.gz complete in 0s.
12:05:01
--- acir_tests build ---
12:05:02 Cache download and extraction of barretenberg-acir-tests-000ad54a8a7b4100.tar.gz complete in 1s.
12:05:03 Cache download and extraction of node-modules-fec19dc5fe5a76d5.zst complete in 1s.
12:05:03 browser-test-app Executing: yarn build (
http://ci.aztec-labs.com/21ceb370b24b3769)
12:05:03 bbjs-test Executing: yarn build (
http://ci.aztec-labs.com/3e0983e48ef60e10)
12:05:06 bbjs-test 0 .
done (3s)
12:05:07 browser-test-app 0 .
done (4s)
12:05:08
--- avm-transpiler build ---
12:05:08 Cache download and extraction of avm-transpiler-6867cd9272ea7ebd.tar.gz complete in 0s.
12:05:08
--- noir-projects build ---
12:05:08 Executing: prep (
http://ci.aztec-labs.com/c112fd0c4b457cc5)
12:05:11 0 .
done (3s)
12:05:11 mock-protocol-circuits Executing: ./mock-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/69f0d4a8dea1af60)
12:05:11 noir-protocol-circuits Executing: ./noir-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/34b022584d3225dc)
12:05:11 noir-contracts Executing: ./noir-contracts/bootstrap.sh (
http://ci.aztec-labs.com/27585f74fbdaea14)
12:05:11 aztec-nr Executing: ./aztec-nr/bootstrap.sh (
http://ci.aztec-labs.com/fc6fb4297f4669ae)
12:05:12 noir-contracts 0 ................................................................
12:05:12 noir-contracts 64 ................................................................
12:05:12 noir-contracts 128 ................................................................
12:05:12 noir-contracts 192 ................................................................
12:05:13 noir-contracts 256 ................................................................
12:05:13 noir-contracts 320 ................................................................
12:05:13 noir-contracts 384 ................................................................
12:05:13 noir-contracts 448 ................................................................
12:05:13 noir-contracts 512 ................................................................
12:05:13 noir-contracts 576 ................................................................
12:05:14 noir-contracts 640 ................................................................
12:05:14 noir-contracts 704 ................................................................
12:05:14 noir-contracts 768 ................................................................
12:05:14 noir-contracts 832 ................................................................
12:05:14 noir-contracts 896 ................................................................
12:05:14 noir-contracts 960 ................................................................
12:05:15 noir-contracts 1024 ................................................................
12:05:15 noir-contracts 1088 ................................................................
12:05:15 noir-contracts 1152 ................................................................
12:05:15 noir-contracts 1216 ................................................................
12:05:15 noir-contracts 1280 ................................................................
12:05:15 noir-contracts 1344 ................................................................
12:05:15 noir-contracts 1408 ................................................................
12:05:15 noir-contracts 1472 ................................................................
12:05:16 noir-contracts 1536 ................................................................
12:05:16 noir-contracts 1600 .
done (5s)
12:05:16 noir-protocol-circuits 0 ................................................................
12:05:16 noir-protocol-circuits 64 ................................................................
12:05:17 noir-protocol-circuits 128 ................................................................
12:05:17 noir-protocol-circuits 192 ................................................................
12:05:18 mock-protocol-circuits 0 ................................................................
12:05:18 aztec-nr 0 .
done (7s)
12:05:18 noir-protocol-circuits 256 ................................................................
12:05:20 noir-protocol-circuits 320 ................................................................
12:05:20 mock-protocol-circuits 64 .
done (9s)
12:05:20 noir-protocol-circuits 384 ................................................................
12:05:20 noir-protocol-circuits 448 .
done (9s)
12:05:20
--- l1-contracts build ---
12:05:21 Cache download and extraction of l1-contracts-0a920e2ab51d8ecb.tar.gz complete in 1s.
12:05:21
--- yarn-project build ---
12:05:21 Executing: ./bootstrap.sh clean-lite (
http://ci.aztec-labs.com/54fe8dfcde3adb8d)
12:05:21 0 .
done (0s)
12:05:27 Cache download and extraction of node-modules-34bec2a54a394404.zst complete in 6s.
12:05:27 Executing: compile_all (
http://ci.aztec-labs.com/f9508b652ed032cb)
12:05:30 0 .
done (3s)
12:05:30 boxes/bootstrap.sh Executing: boxes/bootstrap.sh (
http://ci.aztec-labs.com/b058aebe015b48b2)
12:05:30 playground/bootstrap.sh Executing: playground/bootstrap.sh (
http://ci.aztec-labs.com/e8564c9e4aad7c47)
12:05:30 docs/bootstrap.sh Executing: docs/bootstrap.sh (
http://ci.aztec-labs.com/cfb12da6e8cd6eee)
12:05:30 release-image/bootstrap.sh Executing: release-image/bootstrap.sh (
http://ci.aztec-labs.com/b90aed0c549abcc4)
12:05:30 spartan/bootstrap.sh Executing: spartan/bootstrap.sh (
http://ci.aztec-labs.com/0739b89bf3f064fd)
12:05:30 aztec-up/bootstrap.sh Executing: aztec-up/bootstrap.sh (
http://ci.aztec-labs.com/21ad4cbb7a9d7822)
12:05:31 aztec-up/bootstrap.sh 0 .
done (1s)
12:05:34 spartan/bootstrap.sh 0 .
done (4s)
12:05:35 playground/bootstrap.sh 0 .
done (5s)
12:05:35 boxes/bootstrap.sh 0 .
done (5s)
12:05:39 docs/bootstrap.sh 0 .
done (9s)
12:06:08 release-image/bootstrap.sh 0 .
done (38s)
12:06:08
--- test all ---
12:06:08 Waiting for TXE's to start...
12:06:11 Gathering tests to run...
12:07:52 Gathered 12158 tests.
12:07:52 Starting parallel run with max 64 jobs...
12:07:52 Executing: parallel -j64 --memsuspend 64G --line-buffer --joblog joblog.txt --halt now,fail=1 'run_test_cmd {}' (
http://ci.aztec-labs.com/da84e1400af72320)
12:08:23 0 ................................................................
12:09:31 64 ................................................................
12:10:33 128 ................................................................
12:11:34 192 ................................................................
12:11:58 256 ................................................................
12:12:08 320 ................................................................
12:12:27 384 ................................................................
12:12:44 448 ................................................................
12:12:51 512 ................................................................
12:12:57 576 ................................................................
12:13:08 640 ................................................................
12:13:16 704 ................................................................
12:13:23 768 ................................................................
12:13:28 832 ................................................................
12:13:36 896 ................................................................
12:13:42 960 ................................................................
12:13:48 1024 ................................................................
12:13:51 1088 ................................................................
12:14:00 1152 ................................................................
12:14:07 1216 ................................................................
12:14:10 1280 ................................................................
12:14:14 1344 ................................................................
12:14:17 1408 ................................................................
12:14:21 1472 ................................................................
12:14:24 1536 ................................................................
12:14:31 1600 ................................................................
12:14:40 1664 ................................................................
12:14:55 1728 ................................................................
12:15:01 1792 ................................................................
12:15:05 1856 ................................................................
12:15:07 1920 ................................................................
12:15:09 1984 ................................................................
12:15:11 2048 ................................................................
12:15:13 2112 ................................................................
12:15:15 2176 ................................................................
12:15:17 2240 ................................................................
12:15:19 2304 ................................................................
12:15:21 2368 ................................................................
12:15:23 2432 ................................................................
12:15:24 2496 ................................................................
12:15:25 2560 ................................................................
12:15:40 2624 ................................................................
12:15:46 2688 ................................................................
12:15:48 2752 ................................................................
12:15:49 2816 ................................................................
12:15:50 2880 ................................................................
12:15:53 2944 ................................................................
12:16:03 3008 ................................................................
12:16:11 3072 ................................................................
12:16:15 3136 ................................................................
12:16:17 3200 ................................................................
12:16:18 3264 ................................................................
12:16:20 3328 ................................................................
12:16:22 3392 ................................................................
12:16:23 3456 ................................................................
12:16:26 3520 ................................................................
12:16:29 3584 ................................................................
12:16:31 3648 ................................................................
12:16:32 3712 ................................................................
12:16:34 3776 ................................................................
12:16:35 3840 ................................................................
12:16:37 3904 ................................................................
12:16:38 3968 ................................................................
12:16:39 4032 ................................................................
12:16:40 4096 ................................................................
12:16:42 4160 ................................................................
12:16:44 4224 ................................................................
12:16:48 4288 ................................................................
12:16:52 4352 ................................................................
12:16:55 4416 ................................................................
12:16:57 4480 ................................................................
12:17:00 4544 ................................................................
12:17:02 4608 ................................................................
12:17:04 4672 ................................................................
12:17:07 4736 ................................................................
12:17:09 4800 ................................................................
12:17:11 4864 ................................................................
12:17:13 4928 ................................................................
12:17:15 4992 ................................................................
12:17:17 5056 ................................................................
12:17:19 5120 ................................................................
12:17:21 5184 ................................................................
12:17:22 5248 ................................................................
12:17:24 5312 ................................................................
12:17:25 5376 ................................................................
12:17:27 5440 ................................................................
12:17:29 5504 ................................................................
12:17:32 5568 ................................................................
12:17:34 5632 ................................................................
12:17:36 5696 ................................................................
12:17:38 5760 ................................................................
12:17:40 5824 ................................................................
12:17:42 5888 ................................................................
12:17:44 5952 ................................................................
12:17:46 6016 ................................................................
12:17:49 6080 ................................................................
12:17:51 6144 ................................................................
12:17:53 6208 ................................................................
12:17:56 6272 ................................................................
12:17:58 6336 ................................................................
12:18:01 6400 ................................................................
12:18:03 6464 ................................................................
12:18:06 6528 ................................................................
12:18:09 6592 ................................................................
12:18:12 6656 ................................................................
12:18:15 6720 ................................................................
12:18:17 6784 ................................................................
12:18:19 6848 ................................................................
12:18:21 6912 ................................................................
12:18:23 6976 ................................................................
12:18:25 7040 ................................................................
12:18:27 7104 ................................................................
12:18:30 7168 ................................................................
12:18:32 7232 ................................................................
12:18:33 7296 ................................................................
12:18:34 7360 ................................................................
12:18:35 7424 ................................................................
12:18:36 7488 ................................................................
12:18:38 7552 ................................................................
12:18:39 7616 ................................................................
12:18:40 7680 ................................................................
12:18:41 7744 ................................................................
12:18:42 7808 ................................................................
12:18:44 7872 ................................................................
12:18:45 7936 ................................................................
12:18:46 8000 ................................................................
12:18:48 8064 ................................................................
12:18:49 8128 ................................................................
12:18:50 8192 ................................................................
12:18:52 8256 ................................................................
12:18:53 8320 ................................................................
12:18:54 8384 ................................................................
12:18:55 8448 ................................................................
12:18:57 8512 ................................................................
12:18:58 8576 ................................................................
12:18:59 8640 ................................................................
12:19:00 8704 ................................................................
12:19:01 8768 ................................................................
12:19:02 8832 ................................................................
12:19:03 8896 ................................................................
12:19:05 8960 ................................................................
12:19:06 9024 ................................................................
12:19:08 9088 ................................................................
12:19:09 9152 ................................................................
12:19:10 9216 ................................................................
12:19:12 9280 ................................................................
12:19:13 9344 ................................................................
12:19:15 9408 ................................................................
12:19:16 9472 ................................................................
12:19:18 9536 ................................................................
12:19:19 9600 ................................................................
12:19:21 9664 ................................................................
12:19:22 9728 ................................................................
12:19:24 9792 ................................................................
12:19:26 9856 ................................................................
12:19:27 9920 ................................................................
12:19:28 9984 ................................................................
12:19:29 10048 ................................................................
12:19:30 10112 ................................................................
12:19:32 10176 ................................................................
12:19:33 10240 ................................................................
12:19:34 10304 ................................................................
12:19:35 10368 ................................................................
12:19:36 10432 ................................................................
12:19:38 10496 ................................................................
12:19:39 10560 ................................................................
12:19:40 10624 ................................................................
12:19:42 10688 ................................................................
12:19:43 10752 ................................................................
12:19:44 10816 ................................................................
12:19:45 10880 ................................................................
12:19:46 10944 ................................................................
12:19:47 11008 ................................................................
12:19:48 11072 ................................................................
12:19:49 11136 ................................................................
12:19:50 11200 ................................................................
12:19:52 11264 ................................................................
12:19:53 11328 ................................................................
12:19:54 11392 ................................................................
12:19:55 11456 ................................................................
12:19:56 11520 ................................................................
12:19:57 11584 ................................................................
12:19:58 11648 ................................................................
12:19:59 11712 ................................................................
12:20:00 11776 ................................................................
12:20:01 11840 ................................................................
12:20:02 11904 ................................................................
12:20:03 11968 ................................................................
12:20:04 12032 ................................................................
12:20:05 12096 ................................................................
12:20:06 12160 ................................................................
12:20:07 12224 ................................................................
12:20:08 12288 ................................................................
12:20:10 12352 ................................................................
12:22:39 12416 .
done (887s)
12:22:39
WARNING: The following tests exceed 5 minute runtimes. Break them up or rethink them.
12:22:39 304.450: '84c999e211bb73e4:ISOLATE=1:NAME=e2e_p2p/validators_sentinel yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/validators_sentinel.test.ts'
12:22:39 309.213: '6c8b1f2818608a3b noir-projects/scripts/run_test.sh noir-protocol-circuits rollup_lib block_root::block_root_rollup_inputs::tests::correct_blobs_with_non_empty_fields'
12:22:39 322.581: '6c32ccc844d598b0 barretenberg/cpp/scripts/run_test.sh dsl_tests AcirAvm2RecursionConstraint.TestGenerateVKFromConstraintsWithoutWitness'
12:22:39 339.822: '84c999e211bb73e4:ISOLATE=1:NAME=e2e_p2p/data_withholding_slash yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/data_withholding_slash.test.ts'
12:22:39 352.080: '6c32ccc844d598b0:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityPassing'
12:22:39 355.078: 'c9e0614cc3889111:ONLY_TERM_PARENT=1 BOX=vanilla BROWSER=* run_compose_test vanilla-all-browsers box boxes'
12:22:39 363.455: '6c32ccc844d598b0:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityFailing'
12:22:39 380.217: 'e156b3778e196649 aztec-up/scripts/run_test.sh amm_flow'
12:22:39 393.305: '84c999e211bb73e4:ISOLATE=1:TIMEOUT=15m:NAME=e2e_block_building yarn-project/end-to-end/scripts/run_test.sh simple e2e_block_building'
12:22:39 428.827: '84c999e211bb73e4:ISOLATE=1:NAME=e2e_p2p/reex yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/reex.test.ts'
12:22:39 437.065: '84c999e211bb73e4:ISOLATE=1:NAME=prover-client/src/test/bb_prover_full_rollup.test.ts:CPUS=16:MEM=96g LOG_LEVEL=verbose yarn-project/scripts/run_test.sh prover-client/src/test/bb_prover_full_rollup.test.ts'
12:22:39 443.421: '84c999e211bb73e4:ISOLATE=1:NAME=e2e_l1_with_wall_time yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_l1_with_wall_time.test.ts'
12:22:39 727.151: '84c999e211bb73e4:ISOLATE=1:TIMEOUT=15m:CPUS=16:MEM=96g:NAME=e2e_prover_full_real yarn-project/end-to-end/scripts/run_test.sh simple e2e_prover/full'
12:22:39 Completed run of 12158 tests in 887 seconds.
12:22:39
--- bench all ---
12:22:39 barretenberg/cpp Executing: barretenberg/cpp/bootstrap.sh build_bench (
http://ci.aztec-labs.com/5cf592064cf6df1d)
12:22:39 yarn-project/end-to-end Executing: yarn-project/end-to-end/bootstrap.sh build_bench (
http://ci.aztec-labs.com/0fd7e2a256705f5d)
12:22:40 barretenberg/cpp 0 .
done (1s)
12:24:41 yarn-project/end-to-end 0 ................................................................
12:25:05 yarn-project/end-to-end 64 ................................................................
12:27:23 yarn-project/end-to-end 128 .
done (284s)
12:27:25 Starting parallel run using max 64 cpus...
12:27:25 Test run log id:
http://ci.aztec-labs.com/96f5796035c08ff8
12:32:29 Completed run of 95 tests in 304 seconds.
12:32:32 Completed 7.6 KiB/7.6 KiB (122.3 KiB/s) with 1 file(s) remaining
upload: ../../../tmp/tmp.Pq8nmekXD3 to s3://aztec-ci-artifacts/build-cache/bench-3863bc02d671057d0cffd4ced17ca317788ff190.tar.gz
12:32:32 Cache upload of bench-3863bc02d671057d0cffd4ced17ca317788ff190.tar.gz complete in 2s.
12:32:32 + local code=0
12:32:32 + set +x
12:32:32 dmesg log id:
http://ci.aztec-labs.com/ec746b8b82a30dbb
CI run log id:
http://ci.aztec-labs.com/1750766662134
+ code=0
+ case $code in
+ log_ci_run PASSED 1750766662134
+ exit 0
SSH exited with code: 0
Terminating instance: i-0ee8c800c281bbf55...