Parent Log:
http://ci.aztec-labs.com/15849889662
Command: bootstrap_ec2 './bootstrap.sh ci-full'
Date: Tue Jun 24 12:33:41 UTC 2025
Status: 0
Took: 1814s
--- request build instance ---
Requesting m6a.32xlarge spot instance (name: pr-15238_amd64_x3-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for instance id for spot request: sir-6yqf4mth...
Timeout waiting for spot request.
Requesting m6a.32xlarge on-demand instance (name: pr-15238_amd64_x3-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for SSH at 18.189.28.116...
Stdout is not a tty, running in background...
Loading CRS into tmpfs...
Done in 37 seconds.
Stdout is not a tty, starting build container in background...
Starting devbox...
From
https://github.com/aztecprotocol/aztec-packages
* branch 3863bc02d671057d0cffd4ced17ca317788ff190 -> FETCH_HEAD
HEAD is now at 3863bc0 chore(backport-to-staging): fix: p2p private key value (#15229) (#15238)
Switched to a new branch 'gh-readonly-queue/staging/pr-15238-db396f13b7ef374a230174bdc4078d9fbb3c788a'
+ run
+ DUP=1
+ ci3/cache_log 'CI run' 1750766732746
+ ci3/add_timestamps
CI run log id:
http://ci.aztec-labs.com/1750766732746
12:05:32 + echo 'env: REF_NAME=gh-readonly-queue/staging/pr-15238-db396f13b7ef374a230174bdc4078d9fbb3c788a COMMIT_HASH=3863bc02d671057d0cffd4ced17ca317788ff190 CURRENT_VERSION=1.0.0 TARGET_BRANCH=staging'
12:05:32 env: REF_NAME=gh-readonly-queue/staging/pr-15238-db396f13b7ef374a230174bdc4078d9fbb3c788a COMMIT_HASH=3863bc02d671057d0cffd4ced17ca317788ff190 CURRENT_VERSION=1.0.0 TARGET_BRANCH=staging
12:05:32 + semver check gh-readonly-queue/staging/pr-15238-db396f13b7ef374a230174bdc4078d9fbb3c788a
12:05:32 + cpu_pid=419
12:05:32 + mpstat 2
12:05:32 + mem_pid=420
12:05:32 + set +e
12:05:32 + set -x
12:05:32 + ./bootstrap.sh ci-full
12:05:32 + vmstat -w -S M 2
12:05:32 ++ cache_log cpufile
12:05:32 ++ cache_log memfile
12:05:32 cpufile log id:
http://ci.aztec-labs.com/50ec696e1853141c
12:05:32 memfile log id:
http://ci.aztec-labs.com/d7c5395a1df4f940
12:05:40
--- pull submodules ---
12:05:40 Executing: git submodule update --init --recursive (
http://ci.aztec-labs.com/ff11db8a861c7f37)
12:05:49 0 .
done (9s)
12:05:52
--- noir build ---
12:05:52 Executing: retry install_deps (
http://ci.aztec-labs.com/e4b24d913f46f466)
12:05:57 0 .
done (5s)
12:05:57 build_native Executing: build_native (
http://ci.aztec-labs.com/29aa65d6bf5f3500)
12:05:57 build_packages Executing: build_packages (
http://ci.aztec-labs.com/6dab55a34d09809b)
12:05:58 build_native 0 .
done (1s)
12:06:03 build_packages 0 .
done (6s)
12:06:04
--- bb cpp build ---
12:06:04 build_wasm Executing: build_wasm (
http://ci.aztec-labs.com/920d369baae49127)
12:06:04 build_wasm_threads Executing: build_wasm_threads (
http://ci.aztec-labs.com/95273fe6f4b83290)
12:06:04 build_native Executing: build_native (
http://ci.aztec-labs.com/5ab63101701a1331)
12:06:04 build_nodejs_module Executing: build_nodejs_module (
http://ci.aztec-labs.com/b9743f86c68eca40)
12:06:04 build_gcc_syntax_check_only Executing: build_gcc_syntax_check_only (
http://ci.aztec-labs.com/36b6726e7ffe96c8)
12:06:04 build_fuzzing_syntax_check_only Executing: build_fuzzing_syntax_check_only (
http://ci.aztec-labs.com/5d2e681da5d85018)
12:06:04 build_asan_fast Executing: build_asan_fast (
http://ci.aztec-labs.com/2b8164e61f9131b7)
12:06:04 build_darwin Executing: build_darwin (
http://ci.aztec-labs.com/954997fcef7f646e)
12:06:04 build_gcc_syntax_check_only 0 .
done (0s)
12:06:04 build_fuzzing_syntax_check_only 0 .
done (0s)
12:06:05 build_wasm 0 .
done (1s)
12:06:05 build_wasm_threads 0 .
done (1s)
12:06:05 build_darwin 0 .
done (1s)
12:06:05 build_nodejs_module 0 .
done (1s)
12:06:06 build_native 0 .
done (2s)
12:06:06 build_asan_fast 0 .
done (2s)
12:06:11
--- bb.js build ---
12:06:12 Cache download and extraction of node-modules-e85320bda7d59d54.zst complete in 1s.
12:06:12 Cache download and extraction of bb.js-93955768547ae31a.tar.gz complete in 0s.
12:06:13
--- acir_tests build ---
12:06:13 Cache download and extraction of barretenberg-acir-tests-000ad54a8a7b4100.tar.gz complete in 0s.
12:06:14 Cache download and extraction of node-modules-fec19dc5fe5a76d5.zst complete in 0s.
12:06:15 browser-test-app Executing: yarn build (
http://ci.aztec-labs.com/695cb3c9d6c4830b)
12:06:15 bbjs-test Executing: yarn build (
http://ci.aztec-labs.com/385e8b99744bf15e)
12:06:18 bbjs-test 0 .
done (3s)
12:06:19 browser-test-app 0 .
done (4s)
12:06:19
--- avm-transpiler build ---
12:06:20 Cache download and extraction of avm-transpiler-6867cd9272ea7ebd.tar.gz complete in 1s.
12:06:20
--- noir-projects build ---
12:06:20 Executing: prep (
http://ci.aztec-labs.com/1124bcf17bc11228)
12:06:22 0 .
done (2s)
12:06:23 mock-protocol-circuits Executing: ./mock-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/9b64e13651bff2e3)
12:06:23 noir-protocol-circuits Executing: ./noir-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/3752a4d228cedcc3)
12:06:23 noir-contracts Executing: ./noir-contracts/bootstrap.sh (
http://ci.aztec-labs.com/f95255722ce641d6)
12:06:23 aztec-nr Executing: ./aztec-nr/bootstrap.sh (
http://ci.aztec-labs.com/b6180cfdad1aea48)
12:06:24 noir-contracts 0 ................................................................
12:06:24 noir-contracts 64 ................................................................
12:06:24 noir-contracts 128 ................................................................
12:06:25 noir-contracts 192 ................................................................
12:06:25 noir-contracts 256 ................................................................
12:06:25 noir-contracts 320 ................................................................
12:06:25 noir-contracts 384 ................................................................
12:06:26 noir-contracts 448 ................................................................
12:06:26 noir-contracts 512 ................................................................
12:06:26 noir-contracts 576 ................................................................
12:06:26 noir-contracts 640 ................................................................
12:06:26 noir-contracts 704 ................................................................
12:06:26 noir-contracts 768 ................................................................
12:06:27 noir-contracts 832 ................................................................
12:06:27 noir-contracts 896 ................................................................
12:06:27 noir-contracts 960 ................................................................
12:06:27 noir-contracts 1024 ................................................................
12:06:27 noir-contracts 1088 ................................................................
12:06:27 noir-contracts 1152 ................................................................
12:06:28 noir-contracts 1216 ................................................................
12:06:28 noir-contracts 1280 ................................................................
12:06:28 noir-contracts 1344 ................................................................
12:06:28 noir-contracts 1408 ................................................................
12:06:28 noir-protocol-circuits 0 ................................................................
12:06:28 noir-protocol-circuits 64 ................................................................
12:06:28 noir-contracts 1472 ................................................................
12:06:28 noir-contracts 1536 ................................................................
12:06:28 noir-contracts 1600 .
done (5s)
12:06:29 noir-protocol-circuits 128 ................................................................
12:06:30 noir-protocol-circuits 192 ................................................................
12:06:30 mock-protocol-circuits 0 ................................................................
12:06:30 aztec-nr 0 .
done (7s)
12:06:31 noir-protocol-circuits 256 ................................................................
12:06:32 noir-protocol-circuits 320 ................................................................
12:06:32 mock-protocol-circuits 64 .
done (9s)
12:06:32 noir-protocol-circuits 384 ................................................................
12:06:32 noir-protocol-circuits 448 .
done (9s)
12:06:33
--- l1-contracts build ---
12:06:33 Cache download and extraction of l1-contracts-0a920e2ab51d8ecb.tar.gz complete in 0s.
12:06:33
--- yarn-project build ---
12:06:33 Executing: ./bootstrap.sh clean-lite (
http://ci.aztec-labs.com/ec3eb1cc141614ef)
12:06:33 0 .
done (0s)
12:06:38 Cache download and extraction of node-modules-34bec2a54a394404.zst complete in 5s.
12:06:38 Executing: compile_all (
http://ci.aztec-labs.com/d31581672ce551d9)
12:06:41 0 .
done (3s)
12:06:41 playground/bootstrap.sh Executing: playground/bootstrap.sh (
http://ci.aztec-labs.com/6b3093534b668fe2)
12:06:41 boxes/bootstrap.sh Executing: boxes/bootstrap.sh (
http://ci.aztec-labs.com/02906fefeb7e6e8c)
12:06:41 docs/bootstrap.sh Executing: docs/bootstrap.sh (
http://ci.aztec-labs.com/05deb2ec85c08305)
12:06:41 release-image/bootstrap.sh Executing: release-image/bootstrap.sh (
http://ci.aztec-labs.com/55a4dbd7139c425d)
12:06:41 spartan/bootstrap.sh Executing: spartan/bootstrap.sh (
http://ci.aztec-labs.com/fcd83da9dd40c102)
12:06:41 aztec-up/bootstrap.sh Executing: aztec-up/bootstrap.sh (
http://ci.aztec-labs.com/fae09fbee11f7313)
12:06:42 aztec-up/bootstrap.sh 0 .
done (1s)
12:06:45 boxes/bootstrap.sh 0 .
done (4s)
12:06:45 spartan/bootstrap.sh 0 .
done (4s)
12:06:46 playground/bootstrap.sh 0 .
done (5s)
12:06:49 docs/bootstrap.sh 0 .
done (8s)
12:07:19 release-image/bootstrap.sh 0 .
done (38s)
12:07:19
--- test all ---
12:07:19 Waiting for TXE's to start...
12:07:22 Gathering tests to run...
12:09:01 Gathered 12158 tests.
12:09:01 Starting parallel run with max 64 jobs...
12:09:01 Executing: parallel -j64 --memsuspend 64G --line-buffer --joblog joblog.txt --halt now,fail=1 'run_test_cmd {}' (
http://ci.aztec-labs.com/3b68d8ef46724aee)
12:09:32 0 ................................................................
12:10:36 64 ................................................................
12:11:40 128 ................................................................
12:12:41 192 ................................................................
12:13:05 256 ................................................................
12:13:16 320 ................................................................
12:13:36 384 ................................................................
12:13:51 448 ................................................................
12:13:58 512 ................................................................
12:14:04 576 ................................................................
12:14:16 640 ................................................................
12:14:24 704 ................................................................
12:14:31 768 ................................................................
12:14:36 832 ................................................................
12:14:44 896 ................................................................
12:14:50 960 ................................................................
12:14:56 1024 ................................................................
12:14:59 1088 ................................................................
12:15:08 1152 ................................................................
12:15:15 1216 ................................................................
12:15:18 1280 ................................................................
12:15:22 1344 ................................................................
12:15:25 1408 ................................................................
12:15:28 1472 ................................................................
12:15:32 1536 ................................................................
12:15:39 1600 ................................................................
12:15:48 1664 ................................................................
12:16:04 1728 ................................................................
12:16:09 1792 ................................................................
12:16:14 1856 ................................................................
12:16:16 1920 ................................................................
12:16:18 1984 ................................................................
12:16:20 2048 ................................................................
12:16:21 2112 ................................................................
12:16:23 2176 ................................................................
12:16:24 2240 ................................................................
12:16:26 2304 ................................................................
12:16:28 2368 ................................................................
12:16:29 2432 ................................................................
12:16:30 2496 ................................................................
12:16:31 2560 ................................................................
12:16:48 2624 ................................................................
12:16:54 2688 ................................................................
12:16:55 2752 ................................................................
12:16:57 2816 ................................................................
12:16:58 2880 ................................................................
12:17:01 2944 ................................................................
12:17:11 3008 ................................................................
12:17:17 3072 ................................................................
12:17:21 3136 ................................................................
12:17:23 3200 ................................................................
12:17:25 3264 ................................................................
12:17:26 3328 ................................................................
12:17:28 3392 ................................................................
12:17:30 3456 ................................................................
12:17:32 3520 ................................................................
12:17:35 3584 ................................................................
12:17:37 3648 ................................................................
12:17:39 3712 ................................................................
12:17:40 3776 ................................................................
12:17:41 3840 ................................................................
12:17:43 3904 ................................................................
12:17:44 3968 ................................................................
12:17:45 4032 ................................................................
12:17:47 4096 ................................................................
12:17:48 4160 ................................................................
12:17:51 4224 ................................................................
12:17:55 4288 ................................................................
12:17:58 4352 ................................................................
12:18:01 4416 ................................................................
12:18:04 4480 ................................................................
12:18:07 4544 ................................................................
12:18:09 4608 ................................................................
12:18:11 4672 ................................................................
12:18:14 4736 ................................................................
12:18:16 4800 ................................................................
12:18:18 4864 ................................................................
12:18:20 4928 ................................................................
12:18:21 4992 ................................................................
12:18:23 5056 ................................................................
12:18:25 5120 ................................................................
12:18:26 5184 ................................................................
12:18:27 5248 ................................................................
12:18:29 5312 ................................................................
12:18:30 5376 ................................................................
12:18:31 5440 ................................................................
12:18:34 5504 ................................................................
12:18:36 5568 ................................................................
12:18:38 5632 ................................................................
12:18:40 5696 ................................................................
12:18:42 5760 ................................................................
12:18:45 5824 ................................................................
12:18:47 5888 ................................................................
12:18:49 5952 ................................................................
12:18:51 6016 ................................................................
12:18:53 6080 ................................................................
12:18:55 6144 ................................................................
12:18:58 6208 ................................................................
12:19:00 6272 ................................................................
12:19:03 6336 ................................................................
12:19:05 6400 ................................................................
12:19:07 6464 ................................................................
12:19:10 6528 ................................................................
12:19:13 6592 ................................................................
12:19:16 6656 ................................................................
12:19:19 6720 ................................................................
12:19:21 6784 ................................................................
12:19:23 6848 ................................................................
12:19:25 6912 ................................................................
12:19:27 6976 ................................................................
12:19:29 7040 ................................................................
12:19:31 7104 ................................................................
12:19:34 7168 ................................................................
12:19:36 7232 ................................................................
12:19:36 7296 ................................................................
12:19:38 7360 ................................................................
12:19:39 7424 ................................................................
12:19:40 7488 ................................................................
12:19:41 7552 ................................................................
12:19:42 7616 ................................................................
12:19:44 7680 ................................................................
12:19:45 7744 ................................................................
12:19:46 7808 ................................................................
12:19:47 7872 ................................................................
12:19:48 7936 ................................................................
12:19:50 8000 ................................................................
12:19:51 8064 ................................................................
12:19:52 8128 ................................................................
12:19:53 8192 ................................................................
12:19:55 8256 ................................................................
12:19:56 8320 ................................................................
12:19:57 8384 ................................................................
12:19:58 8448 ................................................................
12:19:59 8512 ................................................................
12:20:00 8576 ................................................................
12:20:02 8640 ................................................................
12:20:03 8704 ................................................................
12:20:04 8768 ................................................................
12:20:05 8832 ................................................................
12:20:06 8896 ................................................................
12:20:07 8960 ................................................................
12:20:08 9024 ................................................................
12:20:10 9088 ................................................................
12:20:11 9152 ................................................................
12:20:13 9216 ................................................................
12:20:14 9280 ................................................................
12:20:15 9344 ................................................................
12:20:17 9408 ................................................................
12:20:18 9472 ................................................................
12:20:19 9536 ................................................................
12:20:21 9600 ................................................................
12:20:22 9664 ................................................................
12:20:24 9728 ................................................................
12:20:26 9792 ................................................................
12:20:27 9856 ................................................................
12:20:29 9920 ................................................................
12:20:30 9984 ................................................................
12:20:31 10048 ................................................................
12:20:32 10112 ................................................................
12:20:33 10176 ................................................................
12:20:34 10240 ................................................................
12:20:35 10304 ................................................................
12:20:36 10368 ................................................................
12:20:37 10432 ................................................................
12:20:39 10496 ................................................................
12:20:40 10560 ................................................................
12:20:41 10624 ................................................................
12:20:43 10688 ................................................................
12:20:44 10752 ................................................................
12:20:45 10816 ................................................................
12:20:46 10880 ................................................................
12:20:47 10944 ................................................................
12:20:48 11008 ................................................................
12:20:49 11072 ................................................................
12:20:50 11136 ................................................................
12:20:51 11200 ................................................................
12:20:52 11264 ................................................................
12:20:53 11328 ................................................................
12:20:54 11392 ................................................................
12:20:56 11456 ................................................................
12:20:56 11520 ................................................................
12:20:58 11584 ................................................................
12:20:59 11648 ................................................................
12:21:00 11712 ................................................................
12:21:01 11776 ................................................................
12:21:02 11840 ................................................................
12:21:03 11904 ................................................................
12:21:04 11968 ................................................................
12:21:05 12032 ................................................................
12:21:06 12096 ................................................................
12:21:07 12160 ................................................................
12:21:08 12224 ................................................................
12:21:09 12288 ................................................................
12:21:17 12352 ................................................................
12:23:43 12416 .
done (882s)
12:23:43
WARNING: The following tests exceed 5 minute runtimes. Break them up or rethink them.
12:23:43 302.521: '84c999e211bb73e4:ISOLATE=1:NAME=e2e_p2p/validators_sentinel yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/validators_sentinel.test.ts'
12:23:43 317.572: '6c32ccc844d598b0 barretenberg/cpp/scripts/run_test.sh dsl_tests AcirAvm2RecursionConstraint.TestGenerateVKFromConstraintsWithoutWitness'
12:23:43 339.598: '84c999e211bb73e4:ISOLATE=1:NAME=e2e_p2p/data_withholding_slash yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/data_withholding_slash.test.ts'
12:23:43 348.059: 'c9e0614cc3889111:ONLY_TERM_PARENT=1 BOX=vanilla BROWSER=* run_compose_test vanilla-all-browsers box boxes'
12:23:43 360.404: 'e156b3778e196649 aztec-up/scripts/run_test.sh amm_flow'
12:23:43 361.480: '6c32ccc844d598b0:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityPassing'
12:23:43 363.259: '6c32ccc844d598b0:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityFailing'
12:23:43 396.699: '84c999e211bb73e4:ISOLATE=1:TIMEOUT=15m:NAME=e2e_block_building yarn-project/end-to-end/scripts/run_test.sh simple e2e_block_building'
12:23:43 429.778: '84c999e211bb73e4:ISOLATE=1:NAME=prover-client/src/test/bb_prover_full_rollup.test.ts:CPUS=16:MEM=96g LOG_LEVEL=verbose yarn-project/scripts/run_test.sh prover-client/src/test/bb_prover_full_rollup.test.ts'
12:23:43 431.609: '84c999e211bb73e4:ISOLATE=1:NAME=e2e_p2p/reex yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/reex.test.ts'
12:23:43 442.463: '84c999e211bb73e4:ISOLATE=1:NAME=e2e_l1_with_wall_time yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_l1_with_wall_time.test.ts'
12:23:43 727.626: '84c999e211bb73e4:ISOLATE=1:TIMEOUT=15m:CPUS=16:MEM=96g:NAME=e2e_prover_full_real yarn-project/end-to-end/scripts/run_test.sh simple e2e_prover/full'
12:23:43 Completed run of 12158 tests in 882 seconds.
12:23:43
--- bench all ---
12:23:44 barretenberg/cpp Executing: barretenberg/cpp/bootstrap.sh build_bench (
http://ci.aztec-labs.com/ce70258a6e41829c)
12:23:44 yarn-project/end-to-end Executing: yarn-project/end-to-end/bootstrap.sh build_bench (
http://ci.aztec-labs.com/56f0045fa1c3805e)
12:23:45 barretenberg/cpp 0 .
done (1s)
12:25:44 yarn-project/end-to-end 0 ................................................................
12:28:23 yarn-project/end-to-end 64 .
done (279s)
12:28:24 Starting parallel run using max 64 cpus...
12:28:24 Test run log id:
http://ci.aztec-labs.com/dd45700a65b7a1bd
12:33:31 Completed run of 95 tests in 307 seconds.
12:33:33 Completed 7.6 KiB/7.6 KiB (76.0 KiB/s) with 1 file(s) remaining
upload: ../../../tmp/tmp.i2eZFRCHPc to s3://aztec-ci-artifacts/build-cache/bench-3863bc02d671057d0cffd4ced17ca317788ff190.tar.gz
12:33:33 Cache upload of bench-3863bc02d671057d0cffd4ced17ca317788ff190.tar.gz complete in 1s.
12:33:33 + local code=0
12:33:33 + set +x
12:33:33 dmesg log id:
http://ci.aztec-labs.com/fb5e3e459dbe0d65
CI run log id:
http://ci.aztec-labs.com/1750766732746
+ code=0
+ case $code in
+ log_ci_run PASSED 1750766732746
+ exit 0
SSH exited with code: 0
Terminating instance: i-0738ea565a186d034...