Parent Log:
http://ci.aztec-labs.com/15845332003
Command: bootstrap_ec2 './bootstrap.sh ci-full'
Date: Tue Jun 24 09:00:39 UTC 2025
Status: 0
Took: 1955s
--- request build instance ---
Requesting m6a.32xlarge spot instance (name: pr-15229_amd64_x1-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for instance id for spot request: sir-qfn748kk...
Timeout waiting for spot request.
Requesting m6a.32xlarge on-demand instance (name: pr-15229_amd64_x1-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for SSH at 3.20.232.179...
Stdout is not a tty, running in background...
Loading CRS into tmpfs...
Done in 9 seconds.
Stdout is not a tty, starting build container in background...
Starting devbox...
From
https://github.com/aztecprotocol/aztec-packages
* branch 2b96419831503435fa46a83dc2e2b7ba19109d0f -> FETCH_HEAD
HEAD is now at 2b96419 fix: p2p private key value (#15229)
Switched to a new branch 'gh-readonly-queue/next/pr-15229-af094bce13530e078c78de9f3264280e6693d533'
+ run
+ ci3/add_timestamps
+ DUP=1
+ ci3/cache_log 'CI run' 1750753788982
CI run log id:
http://ci.aztec-labs.com/1750753788982
08:29:49 + echo 'env: REF_NAME=gh-readonly-queue/next/pr-15229-af094bce13530e078c78de9f3264280e6693d533 COMMIT_HASH=2b96419831503435fa46a83dc2e2b7ba19109d0f CURRENT_VERSION=0.87.6 TARGET_BRANCH=next'
08:29:49 env: REF_NAME=gh-readonly-queue/next/pr-15229-af094bce13530e078c78de9f3264280e6693d533 COMMIT_HASH=2b96419831503435fa46a83dc2e2b7ba19109d0f CURRENT_VERSION=0.87.6 TARGET_BRANCH=next
08:29:49 + semver check gh-readonly-queue/next/pr-15229-af094bce13530e078c78de9f3264280e6693d533
08:29:49 + cpu_pid=411
08:29:49 + mpstat 2
08:29:49 + mem_pid=414
08:29:49 + set +e
08:29:49 + set -x
08:29:49 + ./bootstrap.sh ci-full
08:29:49 + vmstat -w -S M 2
08:29:49 ++ cache_log cpufile
08:29:49 ++ cache_log memfile
08:29:49 memfile log id:
http://ci.aztec-labs.com/0ada709b19795d9d
08:29:49 cpufile log id:
http://ci.aztec-labs.com/9a83cf03ff508da7
08:29:57
--- pull submodules ---
08:29:57 Executing: git submodule update --init --recursive (
http://ci.aztec-labs.com/1c6ebcd7eaac9a11)
08:30:06 0 .
done (9s)
08:30:07
--- noir build ---
08:30:07 Executing: retry install_deps (
http://ci.aztec-labs.com/5f1c8d2b7fd9b5f3)
08:30:11 0 .
done (4s)
08:30:12 build_native Executing: build_native (
http://ci.aztec-labs.com/c9b4f56b5245bfd5)
08:30:12 build_packages Executing: build_packages (
http://ci.aztec-labs.com/fa4c66feb07683e1)
08:30:12 build_native 0 .
done (0s)
08:30:18 build_packages 0 .
done (6s)
08:30:19
--- bb cpp build ---
08:30:20 build_native Executing: build_native (
http://ci.aztec-labs.com/3367b3c1fba93e8c)
08:30:20 build_wasm Executing: build_wasm (
http://ci.aztec-labs.com/04e2e5fe5f4089c0)
08:30:20 build_wasm_threads Executing: build_wasm_threads (
http://ci.aztec-labs.com/627f3b62e5702b21)
08:30:20 build_nodejs_module Executing: build_nodejs_module (
http://ci.aztec-labs.com/7dafe1aebf5e5e95)
08:30:20 build_gcc_syntax_check_only Executing: build_gcc_syntax_check_only (
http://ci.aztec-labs.com/db7eeae7e8725b71)
08:30:20 build_fuzzing_syntax_check_only Executing: build_fuzzing_syntax_check_only (
http://ci.aztec-labs.com/e9638044ef63d66e)
08:30:20 build_asan_fast Executing: build_asan_fast (
http://ci.aztec-labs.com/10028b52c0431435)
08:30:20 build_darwin Executing: build_darwin (
http://ci.aztec-labs.com/6a85aaa8809ab1ad)
08:30:20 build_gcc_syntax_check_only 0 .
done (0s)
08:30:20 build_fuzzing_syntax_check_only 0 .
done (0s)
08:30:20 build_wasm 0 .
done (0s)
08:30:20 build_darwin 0 .
done (0s)
08:30:20 build_wasm_threads 0 .
done (0s)
08:30:21 build_nodejs_module 0 .
done (0s)
08:30:21 build_native 0 .
done (1s)
08:30:21 build_asan_fast 0 .
done (1s)
08:30:26
--- bb.js build ---
08:30:28 Cache download and extraction of node-modules-e85320bda7d59d54.zst complete in 1s.
08:30:28 Cache download and extraction of bb.js-a3ce31c314ae24c3.tar.gz complete in 0s.
08:30:29
--- acir_tests build ---
08:30:29 Cache download and extraction of barretenberg-acir-tests-6a238bdbdc02f979.tar.gz complete in 0s.
08:30:31 Cache download and extraction of node-modules-fec19dc5fe5a76d5.zst complete in 1s.
08:30:31 browser-test-app Executing: yarn build (
http://ci.aztec-labs.com/ef1ec1ac29016db4)
08:30:31 bbjs-test Executing: yarn build (
http://ci.aztec-labs.com/767e9d5de6e74536)
08:30:34 bbjs-test 0 .
done (3s)
08:30:36 browser-test-app 0 .
done (5s)
08:30:36
--- avm-transpiler build ---
08:30:37 Cache download and extraction of avm-transpiler-aeabff03b3267cea.tar.gz complete in 1s.
08:30:37
--- noir-projects build ---
08:30:37 Executing: prep (
http://ci.aztec-labs.com/025e734afd429515)
08:30:39 0 .
done (2s)
08:30:40 mock-protocol-circuits Executing: ./mock-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/cd739a6d45860630)
08:30:40 noir-protocol-circuits Executing: ./noir-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/a53d5d29342166cc)
08:30:40 noir-contracts Executing: ./noir-contracts/bootstrap.sh (
http://ci.aztec-labs.com/30d92f47a8d5433f)
08:30:40 aztec-nr Executing: ./aztec-nr/bootstrap.sh (
http://ci.aztec-labs.com/22cb4d861bbf8729)
08:30:42 noir-contracts 0 ................................................................
08:30:42 noir-contracts 64 ................................................................
08:30:42 noir-contracts 128 ................................................................
08:30:42 noir-contracts 192 ................................................................
08:30:42 noir-contracts 256 ................................................................
08:30:43 noir-contracts 320 ................................................................
08:30:43 noir-contracts 384 ................................................................
08:30:43 noir-contracts 448 ................................................................
08:30:43 noir-contracts 512 ................................................................
08:30:43 noir-contracts 576 ................................................................
08:30:43 noir-contracts 640 ................................................................
08:30:44 noir-contracts 704 ................................................................
08:30:44 noir-contracts 768 ................................................................
08:30:44 noir-contracts 832 ................................................................
08:30:44 noir-contracts 896 ................................................................
08:30:44 noir-contracts 960 ................................................................
08:30:45 noir-contracts 1024 ................................................................
08:30:45 noir-contracts 1088 ................................................................
08:30:45 noir-contracts 1152 ................................................................
08:30:45 noir-protocol-circuits 0 ................................................................
08:30:45 noir-protocol-circuits 64 ................................................................
08:30:45 noir-contracts 1216 ................................................................
08:30:46 noir-contracts 1280 ................................................................
08:30:46 noir-contracts 1344 ................................................................
08:30:46 noir-contracts 1408 ................................................................
08:30:46 noir-contracts 1472 ................................................................
08:30:46 noir-protocol-circuits 128 ................................................................
08:30:46 noir-contracts 1536 ................................................................
08:30:46 noir-contracts 1600 .
done (6s)
08:30:46 noir-protocol-circuits 192 ................................................................
08:30:47 noir-protocol-circuits 256 ................................................................
08:30:47 aztec-nr 0 .
done (7s)
08:30:47 mock-protocol-circuits 0 ................................................................
08:30:48 noir-protocol-circuits 320 ................................................................
08:30:49 noir-protocol-circuits 384 ................................................................
08:30:51 noir-protocol-circuits 448 ................................................................
08:30:52 mock-protocol-circuits 64 ................................................................
08:32:56 noir-protocol-circuits 512 ................................................................
08:32:56 noir-protocol-circuits 576 ................................................................
08:32:56 noir-protocol-circuits 640 .
done (136s)
08:32:56 mock-protocol-circuits 128 .
done (136s)
08:32:57
--- l1-contracts build ---
08:32:57 ! The local project doesn't define a 'packageManager' field. Corepack will now add one referencing yarn@1.22.22+sha512.a6b2f7906b721bba3d67d4aff083df04dad64c399707841b7acf00f6b133b7ac24255f2652fa22ae3534329dc6180534e98d17432037ff6fd140556e2bb3137e.
08:32:57 ! For more details about this field, consult the documentation at
https://nodejs.org/api/packages.html#packagemanager
08:32:57
08:32:57
yarn install v1.22.22
08:32:57
[1/4] Resolving packages...
08:32:57
[2/4] Fetching packages...
08:32:59
[3/4] Linking dependencies...
08:33:00
[4/4] Building fresh packages...
08:33:01 Done in 3.41s.
08:33:01 Cache download and extraction of l1-contracts-ba22b0c96cf708b4.tar.gz complete in 0s.
08:33:01
--- yarn-project build ---
08:33:01 Executing: ./bootstrap.sh clean-lite (
http://ci.aztec-labs.com/405a32f6f1ae77fc)
08:33:01 0 .
done (0s)
08:33:06 Cache download and extraction of node-modules-34bec2a54a394404.zst complete in 4s.
08:33:06 Executing: compile_all (
http://ci.aztec-labs.com/d31af8cf3d3ab95e)
08:33:09 0 .
done (3s)
08:33:10 boxes/bootstrap.sh Executing: boxes/bootstrap.sh (
http://ci.aztec-labs.com/fd42ac361909a6ac)
08:33:10 playground/bootstrap.sh Executing: playground/bootstrap.sh (
http://ci.aztec-labs.com/73672e161e014a7d)
08:33:10 docs/bootstrap.sh Executing: docs/bootstrap.sh (
http://ci.aztec-labs.com/5397e09b3958d975)
08:33:10 release-image/bootstrap.sh Executing: release-image/bootstrap.sh (
http://ci.aztec-labs.com/bda89984d52847ba)
08:33:10 spartan/bootstrap.sh Executing: spartan/bootstrap.sh (
http://ci.aztec-labs.com/2ce28d7ad0daeaa8)
08:33:10 aztec-up/bootstrap.sh Executing: aztec-up/bootstrap.sh (
http://ci.aztec-labs.com/99990450669b8c10)
08:33:11 aztec-up/bootstrap.sh 0 .
done (1s)
08:33:13 spartan/bootstrap.sh 0 .
done (3s)
08:33:14 boxes/bootstrap.sh 0 .
done (3s)
08:33:16 playground/bootstrap.sh 0 .
done (6s)
08:33:19 docs/bootstrap.sh 0 .
done (9s)
08:33:49 release-image/bootstrap.sh 0 .
done (39s)
08:33:49
--- test all ---
08:33:49 Waiting for TXE's to start...
08:33:53 Gathering tests to run...
08:35:32 Gathered 12190 tests.
08:35:32 Starting parallel run with max 64 jobs...
08:35:32 Executing: parallel -j64 --memsuspend 64G --line-buffer --joblog joblog.txt --halt now,fail=1 'run_test_cmd {}' (
http://ci.aztec-labs.com/14599c7f9b5e088f)
08:36:04 0 ................................................................
08:37:10 64 ................................................................
08:38:15 128 ................................................................
08:39:15 192 ................................................................
08:39:40 256 ................................................................
08:39:50 320 ................................................................
08:40:10 384 ................................................................
08:40:26 448 ................................................................
08:40:33 512 ................................................................
08:40:39 576 ................................................................
08:40:51 640 ................................................................
08:40:59 704 ................................................................
08:41:06 768 ................................................................
08:41:11 832 ................................................................
08:41:20 896 ................................................................
08:41:25 960 ................................................................
08:41:31 1024 ................................................................
08:41:34 1088 ................................................................
08:41:43 1152 ................................................................
08:41:50 1216 ................................................................
08:41:53 1280 ................................................................
08:41:57 1344 ................................................................
08:42:00 1408 ................................................................
08:42:03 1472 ................................................................
08:42:07 1536 ................................................................
08:42:14 1600 ................................................................
08:42:24 1664 ................................................................
08:42:39 1728 ................................................................
08:42:43 1792 ................................................................
08:42:48 1856 ................................................................
08:42:50 1920 ................................................................
08:42:52 1984 ................................................................
08:42:54 2048 ................................................................
08:42:57 2112 ................................................................
08:42:58 2176 ................................................................
08:43:00 2240 ................................................................
08:43:02 2304 ................................................................
08:43:03 2368 ................................................................
08:43:05 2432 ................................................................
08:43:06 2496 ................................................................
08:43:07 2560 ................................................................
08:43:23 2624 ................................................................
08:43:29 2688 ................................................................
08:43:31 2752 ................................................................
08:43:32 2816 ................................................................
08:43:34 2880 ................................................................
08:43:36 2944 ................................................................
08:43:48 3008 ................................................................
08:43:54 3072 ................................................................
08:43:58 3136 ................................................................
08:44:00 3200 ................................................................
08:44:01 3264 ................................................................
08:44:03 3328 ................................................................
08:44:04 3392 ................................................................
08:44:06 3456 ................................................................
08:44:09 3520 ................................................................
08:44:12 3584 ................................................................
08:44:14 3648 ................................................................
08:44:15 3712 ................................................................
08:44:17 3776 ................................................................
08:44:18 3840 ................................................................
08:44:19 3904 ................................................................
08:44:20 3968 ................................................................
08:44:22 4032 ................................................................
08:44:23 4096 ................................................................
08:44:25 4160 ................................................................
08:44:27 4224 ................................................................
08:44:31 4288 ................................................................
08:44:35 4352 ................................................................
08:44:38 4416 ................................................................
08:44:41 4480 ................................................................
08:44:43 4544 ................................................................
08:44:45 4608 ................................................................
08:44:47 4672 ................................................................
08:44:50 4736 ................................................................
08:44:52 4800 ................................................................
08:44:55 4864 ................................................................
08:44:56 4928 ................................................................
08:44:59 4992 ................................................................
08:45:00 5056 ................................................................
08:45:02 5120 ................................................................
08:45:04 5184 ................................................................
08:45:06 5248 ................................................................
08:45:07 5312 ................................................................
08:45:08 5376 ................................................................
08:45:10 5440 ................................................................
08:45:12 5504 ................................................................
08:45:15 5568 ................................................................
08:45:17 5632 ................................................................
08:45:19 5696 ................................................................
08:45:21 5760 ................................................................
08:45:23 5824 ................................................................
08:45:25 5888 ................................................................
08:45:27 5952 ................................................................
08:45:30 6016 ................................................................
08:45:32 6080 ................................................................
08:45:34 6144 ................................................................
08:45:37 6208 ................................................................
08:45:39 6272 ................................................................
08:45:42 6336 ................................................................
08:45:44 6400 ................................................................
08:45:46 6464 ................................................................
08:45:49 6528 ................................................................
08:45:52 6592 ................................................................
08:45:56 6656 ................................................................
08:45:58 6720 ................................................................
08:46:01 6784 ................................................................
08:46:03 6848 ................................................................
08:46:05 6912 ................................................................
08:46:07 6976 ................................................................
08:46:09 7040 ................................................................
08:46:11 7104 ................................................................
08:46:13 7168 ................................................................
08:46:15 7232 ................................................................
08:46:16 7296 ................................................................
08:46:17 7360 ................................................................
08:46:19 7424 ................................................................
08:46:20 7488 ................................................................
08:46:22 7552 ................................................................
08:46:23 7616 ................................................................
08:46:24 7680 ................................................................
08:46:25 7744 ................................................................
08:46:27 7808 ................................................................
08:46:28 7872 ................................................................
08:46:29 7936 ................................................................
08:46:30 8000 ................................................................
08:46:32 8064 ................................................................
08:46:33 8128 ................................................................
08:46:34 8192 ................................................................
08:46:35 8256 ................................................................
08:46:37 8320 ................................................................
08:46:38 8384 ................................................................
08:46:39 8448 ................................................................
08:46:40 8512 ................................................................
08:46:42 8576 ................................................................
08:46:43 8640 ................................................................
08:46:44 8704 ................................................................
08:46:45 8768 ................................................................
08:46:46 8832 ................................................................
08:46:47 8896 ................................................................
08:46:48 8960 ................................................................
08:46:50 9024 ................................................................
08:46:51 9088 ................................................................
08:46:53 9152 ................................................................
08:46:54 9216 ................................................................
08:46:55 9280 ................................................................
08:46:57 9344 ................................................................
08:46:58 9408 ................................................................
08:47:00 9472 ................................................................
08:47:01 9536 ................................................................
08:47:03 9600 ................................................................
08:47:05 9664 ................................................................
08:47:06 9728 ................................................................
08:47:08 9792 ................................................................
08:47:10 9856 ................................................................
08:47:12 9920 ................................................................
08:47:13 9984 ................................................................
08:47:14 10048 ................................................................
08:47:15 10112 ................................................................
08:47:16 10176 ................................................................
08:47:17 10240 ................................................................
08:47:18 10304 ................................................................
08:47:19 10368 ................................................................
08:47:21 10432 ................................................................
08:47:22 10496 ................................................................
08:47:24 10560 ................................................................
08:47:25 10624 ................................................................
08:47:26 10688 ................................................................
08:47:28 10752 ................................................................
08:47:29 10816 ................................................................
08:47:30 10880 ................................................................
08:47:31 10944 ................................................................
08:47:32 11008 ................................................................
08:47:33 11072 ................................................................
08:47:34 11136 ................................................................
08:47:36 11200 ................................................................
08:47:37 11264 ................................................................
08:47:38 11328 ................................................................
08:47:39 11392 ................................................................
08:47:40 11456 ................................................................
08:47:42 11520 ................................................................
08:47:43 11584 ................................................................
08:47:44 11648 ................................................................
08:47:45 11712 ................................................................
08:47:46 11776 ................................................................
08:47:47 11840 ................................................................
08:47:48 11904 ................................................................
08:47:50 11968 ................................................................
08:47:51 12032 ................................................................
08:47:52 12096 ................................................................
08:47:53 12160 ................................................................
08:47:54 12224 ................................................................
08:47:55 12288 ................................................................
08:47:56 12352 ................................................................
08:50:24 12416 .
done (892s)
08:50:24
WARNING: The following tests exceed 5 minute runtimes. Break them up or rethink them.
08:50:24 300.253: '736bd65c2c998997:ISOLATE=1:NAME=e2e_p2p/validators_sentinel yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/validators_sentinel.test.ts'
08:50:24 316.990: 'b32b73fae476b0cb noir-projects/scripts/run_test.sh noir-protocol-circuits rollup_lib block_root::block_root_rollup_inputs::tests::correct_blobs_with_non_empty_fields'
08:50:24 322.026: 'da96dd06111ce1a0 barretenberg/cpp/scripts/run_test.sh dsl_tests AcirAvm2RecursionConstraint.TestGenerateVKFromConstraintsWithoutWitness'
08:50:24 343.631: '736bd65c2c998997:ISOLATE=1:NAME=e2e_p2p/data_withholding_slash yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/data_withholding_slash.test.ts'
08:50:24 347.283: 'bb78b92b92315efc:ONLY_TERM_PARENT=1 BOX=vanilla BROWSER=* run_compose_test vanilla-all-browsers box boxes'
08:50:24 353.660: 'da96dd06111ce1a0:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityFailing'
08:50:24 359.940: 'da96dd06111ce1a0:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityPassing'
08:50:24 364.735: 'adf3132cc19cbdb0 aztec-up/scripts/run_test.sh amm_flow'
08:50:24 404.384: '736bd65c2c998997:ISOLATE=1:TIMEOUT=15m:NAME=e2e_block_building yarn-project/end-to-end/scripts/run_test.sh simple e2e_block_building'
08:50:24 429.456: '736bd65c2c998997:ISOLATE=1:NAME=prover-client/src/test/bb_prover_full_rollup.test.ts:CPUS=16:MEM=96g LOG_LEVEL=verbose yarn-project/scripts/run_test.sh prover-client/src/test/bb_prover_full_rollup.test.ts'
08:50:24 430.570: '736bd65c2c998997:ISOLATE=1:NAME=e2e_p2p/reex yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/reex.test.ts'
08:50:24 443.171: '736bd65c2c998997:ISOLATE=1:NAME=e2e_l1_with_wall_time yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_l1_with_wall_time.test.ts'
08:50:24 735.779: '736bd65c2c998997:ISOLATE=1:TIMEOUT=15m:CPUS=16:MEM=96g:NAME=e2e_prover_full_real yarn-project/end-to-end/scripts/run_test.sh simple e2e_prover/full'
08:50:24 Completed run of 12190 tests in 892 seconds.
08:50:24
--- bench all ---
08:50:25 barretenberg/cpp Executing: barretenberg/cpp/bootstrap.sh build_bench (
http://ci.aztec-labs.com/3268f1ccb60ca3bb)
08:50:25 yarn-project/end-to-end Executing: yarn-project/end-to-end/bootstrap.sh build_bench (
http://ci.aztec-labs.com/71241de038dae5a5)
08:50:26 barretenberg/cpp 0 .
done (1s)
08:52:28 yarn-project/end-to-end 0 ................................................................
08:55:18 yarn-project/end-to-end 64 .
done (292s)
08:55:19 Starting parallel run using max 64 cpus...
08:55:19 Test run log id:
http://ci.aztec-labs.com/ed5235bba411194a
09:00:26 Completed run of 95 tests in 307 seconds.
09:00:28 Completed 7.7 KiB/7.7 KiB (112.9 KiB/s) with 1 file(s) remaining
upload: ../../../tmp/tmp.SOMZtKY7fM to s3://aztec-ci-artifacts/build-cache/bench-2b96419831503435fa46a83dc2e2b7ba19109d0f.tar.gz
09:00:28 Cache upload of bench-2b96419831503435fa46a83dc2e2b7ba19109d0f.tar.gz complete in 1s.
09:00:28 + local code=0
09:00:28 + set +x
09:00:28 dmesg log id:
http://ci.aztec-labs.com/cc6378ac105e0875
CI run log id:
http://ci.aztec-labs.com/1750753788982
+ code=0
+ case $code in
+ log_ci_run PASSED 1750753788982
+ exit 0
SSH exited with code: 0
Terminating instance: i-0114d1a30fdf9cfb1...