Parent Log:
http://ci.aztec-labs.com/15845652403
Command: bootstrap_ec2 './bootstrap.sh ci-full'
Date: Tue Jun 24 09:17:12 UTC 2025
Status: 0
Took: 2001s
--- request build instance ---
Terminating existing instance: i-0a5283cf8cdc42477
Requesting m6a.32xlarge spot instance (name: pr-15182_amd64_x4-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for instance id for spot request: sir-pkrz72wg...
Timeout waiting for spot request.
Requesting m6a.32xlarge on-demand instance (name: pr-15182_amd64_x4-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for SSH at 3.22.171.145...
Stdout is not a tty, running in background...
Loading CRS into tmpfs...
Done in 22 seconds.
Stdout is not a tty, starting build container in background...
Starting devbox...
From
https://github.com/aztecprotocol/aztec-packages
* branch 1c9ca312bfdace816082212846900a49694e1e50 -> FETCH_HEAD
HEAD is now at 1c9ca31 chore!: change vk hash to match bb (#15182)
Switched to a new branch 'gh-readonly-queue/next/pr-15182-af094bce13530e078c78de9f3264280e6693d533'
+ run
+ ci3/add_timestamps
+ DUP=1
+ ci3/cache_log 'CI run' 1750754744111
CI run log id:
http://ci.aztec-labs.com/1750754744111
08:45:44 + echo 'env: REF_NAME=gh-readonly-queue/next/pr-15182-af094bce13530e078c78de9f3264280e6693d533 COMMIT_HASH=1c9ca312bfdace816082212846900a49694e1e50 CURRENT_VERSION=0.87.6 TARGET_BRANCH=next'
08:45:44 env: REF_NAME=gh-readonly-queue/next/pr-15182-af094bce13530e078c78de9f3264280e6693d533 COMMIT_HASH=1c9ca312bfdace816082212846900a49694e1e50 CURRENT_VERSION=0.87.6 TARGET_BRANCH=next
08:45:44 + semver check gh-readonly-queue/next/pr-15182-af094bce13530e078c78de9f3264280e6693d533
08:45:44 + cpu_pid=414
08:45:44 + mpstat 2
08:45:44 + mem_pid=415
08:45:44 + set +e
08:45:44 + set -x
08:45:44 + ./bootstrap.sh ci-full
08:45:44 + vmstat -w -S M 2
08:45:44 ++ cache_log cpufile
08:45:44 ++ cache_log memfile
08:45:44 memfile log id:
http://ci.aztec-labs.com/40ad8d6d44f79e42
08:45:44 cpufile log id:
http://ci.aztec-labs.com/0a68b6d5ab071e59
08:45:52
--- pull submodules ---
08:45:52 Executing: git submodule update --init --recursive (
http://ci.aztec-labs.com/54868f5c6ac945cb)
08:46:01 0 .
done (9s)
08:46:03
--- noir build ---
08:46:03 Executing: retry install_deps (
http://ci.aztec-labs.com/86eecc22e950ff59)
08:46:08 0 .
done (5s)
08:46:08 build_native Executing: build_native (
http://ci.aztec-labs.com/d20d0d8bde294459)
08:46:08 build_packages Executing: build_packages (
http://ci.aztec-labs.com/6139584639c8a84d)
08:46:09 build_native 0 .
done (1s)
08:46:14 build_packages 0 .
done (6s)
08:46:16
--- bb cpp build ---
08:46:16 build_nodejs_module Executing: build_nodejs_module (
http://ci.aztec-labs.com/9ea0c9b06b7ad69b)
08:46:16 build_native Executing: build_native (
http://ci.aztec-labs.com/100ec0abc6c0b7ed)
08:46:16 build_wasm Executing: build_wasm (
http://ci.aztec-labs.com/ee23338567ab184f)
08:46:16 build_wasm_threads Executing: build_wasm_threads (
http://ci.aztec-labs.com/1f5bb4a1001c92fa)
08:46:16 build_gcc_syntax_check_only Executing: build_gcc_syntax_check_only (
http://ci.aztec-labs.com/b7631b50ac20fbb0)
08:46:16 build_fuzzing_syntax_check_only Executing: build_fuzzing_syntax_check_only (
http://ci.aztec-labs.com/5347f1aa497164b5)
08:46:16 build_asan_fast Executing: build_asan_fast (
http://ci.aztec-labs.com/ffb9beb44ab66b16)
08:46:16 build_darwin Executing: build_darwin (
http://ci.aztec-labs.com/5da7d00745504688)
08:46:16 build_gcc_syntax_check_only 0 .
done (0s)
08:46:16 build_fuzzing_syntax_check_only 0 .
done (0s)
08:46:16 build_wasm 0 .
done (0s)
08:46:16 build_wasm_threads 0 .
done (0s)
08:46:16 build_darwin 0 .
done (0s)
08:46:17 build_nodejs_module 0 .
done (1s)
08:46:17 build_native 0 .
done (1s)
08:46:18 build_asan_fast 0 .
done (2s)
08:46:22
--- bb.js build ---
08:46:24 Cache download and extraction of node-modules-e85320bda7d59d54.zst complete in 1s.
08:46:24 Cache download and extraction of bb.js-a3ce31c314ae24c3.tar.gz complete in 0s.
08:46:25
--- acir_tests build ---
08:46:26 Cache download and extraction of barretenberg-acir-tests-6a238bdbdc02f979.tar.gz complete in 1s.
08:46:27 Cache download and extraction of node-modules-fec19dc5fe5a76d5.zst complete in 1s.
08:46:27 browser-test-app Executing: yarn build (
http://ci.aztec-labs.com/84f59508b81e5a15)
08:46:27 bbjs-test Executing: yarn build (
http://ci.aztec-labs.com/b4d8f95171e28d52)
08:46:30 bbjs-test 0 .
done (3s)
08:46:32 browser-test-app 0 .
done (5s)
08:46:33
--- avm-transpiler build ---
08:46:33 Cache download and extraction of avm-transpiler-aeabff03b3267cea.tar.gz complete in 0s.
08:46:33
--- noir-projects build ---
08:46:33 Executing: prep (
http://ci.aztec-labs.com/12fcb688b4c3bb69)
08:46:35 0 .
done (2s)
08:46:36 mock-protocol-circuits Executing: ./mock-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/153a396a1657ca86)
08:46:36 noir-protocol-circuits Executing: ./noir-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/45e3ba06d53e99f6)
08:46:36 noir-contracts Executing: ./noir-contracts/bootstrap.sh (
http://ci.aztec-labs.com/af1328395db51430)
08:46:36 aztec-nr Executing: ./aztec-nr/bootstrap.sh (
http://ci.aztec-labs.com/78bc7932ebf6a6cf)
08:46:38 noir-contracts 0 ................................................................
08:46:38 noir-contracts 64 ................................................................
08:46:38 noir-contracts 128 ................................................................
08:46:38 noir-contracts 192 ................................................................
08:46:39 noir-contracts 256 ................................................................
08:46:39 noir-contracts 320 ................................................................
08:46:39 noir-contracts 384 ................................................................
08:46:39 noir-contracts 448 ................................................................
08:46:39 noir-contracts 512 ................................................................
08:46:39 noir-contracts 576 ................................................................
08:46:39 noir-contracts 640 ................................................................
08:46:40 noir-contracts 704 ................................................................
08:46:40 noir-contracts 768 ................................................................
08:46:40 noir-contracts 832 ................................................................
08:46:40 noir-contracts 896 ................................................................
08:46:41 noir-contracts 960 ................................................................
08:46:41 noir-contracts 1024 ................................................................
08:46:41 noir-contracts 1088 ................................................................
08:46:41 noir-contracts 1152 ................................................................
08:46:42 noir-contracts 1216 ................................................................
08:46:42 noir-protocol-circuits 0 ................................................................
08:46:42 noir-protocol-circuits 64 ................................................................
08:46:42 noir-contracts 1280 ................................................................
08:46:42 noir-contracts 1344 ................................................................
08:46:42 noir-contracts 1408 ................................................................
08:46:42 noir-protocol-circuits 128 ................................................................
08:46:43 noir-contracts 1472 ................................................................
08:46:43 noir-protocol-circuits 192 ................................................................
08:46:43 noir-contracts 1536 ................................................................
08:46:43 noir-contracts 1600 .
done (7s)
08:46:43 aztec-nr 0 .
done (7s)
08:46:43 noir-protocol-circuits 256 ................................................................
08:46:44 mock-protocol-circuits 0 ................................................................
08:46:44 noir-protocol-circuits 320 ................................................................
08:46:45 noir-protocol-circuits 384 ................................................................
08:46:47 noir-protocol-circuits 448 ................................................................
08:46:48 mock-protocol-circuits 64 ................................................................
08:48:48 mock-protocol-circuits 128 .
done (132s)
08:48:49 noir-protocol-circuits 512 ................................................................
08:48:49 noir-protocol-circuits 576 ................................................................
08:48:49 noir-protocol-circuits 640 .
done (133s)
08:48:50
--- l1-contracts build ---
08:48:50 ! The local project doesn't define a 'packageManager' field. Corepack will now add one referencing yarn@1.22.22+sha512.a6b2f7906b721bba3d67d4aff083df04dad64c399707841b7acf00f6b133b7ac24255f2652fa22ae3534329dc6180534e98d17432037ff6fd140556e2bb3137e.
08:48:50 ! For more details about this field, consult the documentation at
https://nodejs.org/api/packages.html#packagemanager
08:48:50
08:48:50
yarn install v1.22.22
08:48:50
[1/4] Resolving packages...
08:48:50
[2/4] Fetching packages...
08:48:53
[3/4] Linking dependencies...
08:48:54
[4/4] Building fresh packages...
08:48:54 Done in 3.68s.
08:48:54 Cache download and extraction of l1-contracts-5f6036ad2049467f.tar.gz complete in 0s.
08:48:54
--- yarn-project build ---
08:48:54 Executing: ./bootstrap.sh clean-lite (
http://ci.aztec-labs.com/b49d06f18595aa96)
08:48:54 0 .
done (0s)
08:48:59 Cache download and extraction of node-modules-34bec2a54a394404.zst complete in 4s.
08:48:59 Executing: compile_all (
http://ci.aztec-labs.com/c0d4e1792ac3a5cc)
08:49:02 0 .
done (3s)
08:49:03 playground/bootstrap.sh Executing: playground/bootstrap.sh (
http://ci.aztec-labs.com/b61dda1977669a90)
08:49:03 boxes/bootstrap.sh Executing: boxes/bootstrap.sh (
http://ci.aztec-labs.com/35eaa87e7088bb50)
08:49:03 docs/bootstrap.sh Executing: docs/bootstrap.sh (
http://ci.aztec-labs.com/03545d6f149a9867)
08:49:03 release-image/bootstrap.sh Executing: release-image/bootstrap.sh (
http://ci.aztec-labs.com/0831e934a4b9870e)
08:49:03 spartan/bootstrap.sh Executing: spartan/bootstrap.sh (
http://ci.aztec-labs.com/bf515af70b240878)
08:49:03 aztec-up/bootstrap.sh Executing: aztec-up/bootstrap.sh (
http://ci.aztec-labs.com/73b8f2e4dd8e02a1)
08:49:04 aztec-up/bootstrap.sh 0 .
done (1s)
08:49:07 spartan/bootstrap.sh 0 .
done (4s)
08:49:07 boxes/bootstrap.sh 0 .
done (4s)
08:49:08 playground/bootstrap.sh 0 .
done (5s)
08:49:10 docs/bootstrap.sh 0 .
done (7s)
08:49:36 release-image/bootstrap.sh 0 .
done (33s)
08:49:36
--- test all ---
08:49:36 Waiting for TXE's to start...
08:49:39 Gathering tests to run...
08:51:20 Gathered 12188 tests.
08:51:20 Starting parallel run with max 64 jobs...
08:51:20 Executing: parallel -j64 --memsuspend 64G --line-buffer --joblog joblog.txt --halt now,fail=1 'run_test_cmd {}' (
http://ci.aztec-labs.com/2a913f9c1a30a1e1)
08:51:51 0 ................................................................
08:53:01 64 ................................................................
08:54:08 128 ................................................................
08:55:09 192 ................................................................
08:55:39 256 ................................................................
08:55:50 320 ................................................................
08:56:10 384 ................................................................
08:56:26 448 ................................................................
08:56:34 512 ................................................................
08:56:41 576 ................................................................
08:56:52 640 ................................................................
08:57:01 704 ................................................................
08:57:07 768 ................................................................
08:57:14 832 ................................................................
08:57:20 896 ................................................................
08:57:26 960 ................................................................
08:57:31 1024 ................................................................
08:57:35 1088 ................................................................
08:57:45 1152 ................................................................
08:57:53 1216 ................................................................
08:57:55 1280 ................................................................
08:57:59 1344 ................................................................
08:58:02 1408 ................................................................
08:58:05 1472 ................................................................
08:58:09 1536 ................................................................
08:58:17 1600 ................................................................
08:58:28 1664 ................................................................
08:58:42 1728 ................................................................
08:58:47 1792 ................................................................
08:58:52 1856 ................................................................
08:58:54 1920 ................................................................
08:58:56 1984 ................................................................
08:58:58 2048 ................................................................
08:59:00 2112 ................................................................
08:59:02 2176 ................................................................
08:59:03 2240 ................................................................
08:59:06 2304 ................................................................
08:59:07 2368 ................................................................
08:59:09 2432 ................................................................
08:59:10 2496 ................................................................
08:59:11 2560 ................................................................
08:59:28 2624 ................................................................
08:59:38 2688 ................................................................
08:59:40 2752 ................................................................
08:59:41 2816 ................................................................
08:59:43 2880 ................................................................
08:59:45 2944 ................................................................
08:59:55 3008 ................................................................
09:00:00 3072 ................................................................
09:00:04 3136 ................................................................
09:00:06 3200 ................................................................
09:00:08 3264 ................................................................
09:00:10 3328 ................................................................
09:00:12 3392 ................................................................
09:00:14 3456 ................................................................
09:00:17 3520 ................................................................
09:00:20 3584 ................................................................
09:00:22 3648 ................................................................
09:00:24 3712 ................................................................
09:00:25 3776 ................................................................
09:00:27 3840 ................................................................
09:00:28 3904 ................................................................
09:00:30 3968 ................................................................
09:00:32 4032 ................................................................
09:00:33 4096 ................................................................
09:00:35 4160 ................................................................
09:00:39 4224 ................................................................
09:00:43 4288 ................................................................
09:00:47 4352 ................................................................
09:00:50 4416 ................................................................
09:00:53 4480 ................................................................
09:00:56 4544 ................................................................
09:00:57 4608 ................................................................
09:00:59 4672 ................................................................
09:01:02 4736 ................................................................
09:01:04 4800 ................................................................
09:01:06 4864 ................................................................
09:01:07 4928 ................................................................
09:01:09 4992 ................................................................
09:01:11 5056 ................................................................
09:01:12 5120 ................................................................
09:01:14 5184 ................................................................
09:01:16 5248 ................................................................
09:01:17 5312 ................................................................
09:01:19 5376 ................................................................
09:01:20 5440 ................................................................
09:01:23 5504 ................................................................
09:01:26 5568 ................................................................
09:01:28 5632 ................................................................
09:01:30 5696 ................................................................
09:01:33 5760 ................................................................
09:01:35 5824 ................................................................
09:01:37 5888 ................................................................
09:01:40 5952 ................................................................
09:01:42 6016 ................................................................
09:01:45 6080 ................................................................
09:01:47 6144 ................................................................
09:01:50 6208 ................................................................
09:01:52 6272 ................................................................
09:01:55 6336 ................................................................
09:01:57 6400 ................................................................
09:02:00 6464 ................................................................
09:02:03 6528 ................................................................
09:02:06 6592 ................................................................
09:02:10 6656 ................................................................
09:02:13 6720 ................................................................
09:02:15 6784 ................................................................
09:02:17 6848 ................................................................
09:02:19 6912 ................................................................
09:02:22 6976 ................................................................
09:02:24 7040 ................................................................
09:02:26 7104 ................................................................
09:02:28 7168 ................................................................
09:02:30 7232 ................................................................
09:02:31 7296 ................................................................
09:02:33 7360 ................................................................
09:02:34 7424 ................................................................
09:02:35 7488 ................................................................
09:02:36 7552 ................................................................
09:02:38 7616 ................................................................
09:02:39 7680 ................................................................
09:02:40 7744 ................................................................
09:02:41 7808 ................................................................
09:02:43 7872 ................................................................
09:02:44 7936 ................................................................
09:02:46 8000 ................................................................
09:02:47 8064 ................................................................
09:02:48 8128 ................................................................
09:02:49 8192 ................................................................
09:02:50 8256 ................................................................
09:02:52 8320 ................................................................
09:02:53 8384 ................................................................
09:02:54 8448 ................................................................
09:02:56 8512 ................................................................
09:02:57 8576 ................................................................
09:02:58 8640 ................................................................
09:02:59 8704 ................................................................
09:03:00 8768 ................................................................
09:03:02 8832 ................................................................
09:03:03 8896 ................................................................
09:03:04 8960 ................................................................
09:03:06 9024 ................................................................
09:03:07 9088 ................................................................
09:03:08 9152 ................................................................
09:03:10 9216 ................................................................
09:03:11 9280 ................................................................
09:03:13 9344 ................................................................
09:03:14 9408 ................................................................
09:03:15 9472 ................................................................
09:03:17 9536 ................................................................
09:03:18 9600 ................................................................
09:03:20 9664 ................................................................
09:03:22 9728 ................................................................
09:03:24 9792 ................................................................
09:03:25 9856 ................................................................
09:03:27 9920 ................................................................
09:03:28 9984 ................................................................
09:03:29 10048 ................................................................
09:03:30 10112 ................................................................
09:03:31 10176 ................................................................
09:03:33 10240 ................................................................
09:03:34 10304 ................................................................
09:03:35 10368 ................................................................
09:03:36 10432 ................................................................
09:03:37 10496 ................................................................
09:03:39 10560 ................................................................
09:03:40 10624 ................................................................
09:03:41 10688 ................................................................
09:03:43 10752 ................................................................
09:03:44 10816 ................................................................
09:03:45 10880 ................................................................
09:03:46 10944 ................................................................
09:03:47 11008 ................................................................
09:03:48 11072 ................................................................
09:03:49 11136 ................................................................
09:03:51 11200 ................................................................
09:03:52 11264 ................................................................
09:03:53 11328 ................................................................
09:03:54 11392 ................................................................
09:03:55 11456 ................................................................
09:03:56 11520 ................................................................
09:03:57 11584 ................................................................
09:03:58 11648 ................................................................
09:04:00 11712 ................................................................
09:04:01 11776 ................................................................
09:04:02 11840 ................................................................
09:04:03 11904 ................................................................
09:04:04 11968 ................................................................
09:04:05 12032 ................................................................
09:04:06 12096 ................................................................
09:04:07 12160 ................................................................
09:04:08 12224 ................................................................
09:04:09 12288 ................................................................
09:04:10 12352 ................................................................
09:06:56 12416 .
done (936s)
09:06:56
WARNING: The following tests exceed 5 minute runtimes. Break them up or rethink them.
09:06:56 306.080: '13dd8684e4e32fd7:ISOLATE=1:NAME=e2e_p2p/validators_sentinel yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/validators_sentinel.test.ts'
09:06:56 324.641: '8b9e13cd77680489 noir-projects/scripts/run_test.sh noir-protocol-circuits rollup_lib block_root::block_root_rollup_inputs::tests::correct_blobs_with_non_empty_fields'
09:06:56 338.069: 'da96dd06111ce1a0 barretenberg/cpp/scripts/run_test.sh dsl_tests AcirAvm2RecursionConstraint.TestGenerateVKFromConstraintsWithoutWitness'
09:06:56 340.315: '13dd8684e4e32fd7:ISOLATE=1:NAME=e2e_p2p/data_withholding_slash yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/data_withholding_slash.test.ts'
09:06:56 360.234: 'da96dd06111ce1a0:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityPassing'
09:06:56 360.404: '4e3e8c77ee8a55fa aztec-up/scripts/run_test.sh amm_flow'
09:06:56 365.155: 'a5bb51961af76fea:ONLY_TERM_PARENT=1 BOX=vanilla BROWSER=* run_compose_test vanilla-all-browsers box boxes'
09:06:56 387.252: 'da96dd06111ce1a0:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityFailing'
09:06:56 405.758: '13dd8684e4e32fd7:ISOLATE=1:TIMEOUT=15m:NAME=e2e_block_building yarn-project/end-to-end/scripts/run_test.sh simple e2e_block_building'
09:06:56 414.167: '13dd8684e4e32fd7:ISOLATE=1:NAME=p2p/src/client/p2p_client.integration.test.ts LOG_LEVEL=debug yarn-project/scripts/run_test.sh p2p/src/client/p2p_client.integration.test.ts'
09:06:56 432.949: '13dd8684e4e32fd7:ISOLATE=1:NAME=e2e_p2p/reex yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/reex.test.ts'
09:06:56 443.733: '13dd8684e4e32fd7:ISOLATE=1:NAME=prover-client/src/test/bb_prover_full_rollup.test.ts:CPUS=16:MEM=96g LOG_LEVEL=verbose yarn-project/scripts/run_test.sh prover-client/src/test/bb_prover_full_rollup.test.ts'
09:06:56 480.815: '13dd8684e4e32fd7:ISOLATE=1:NAME=e2e_l1_with_wall_time yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_l1_with_wall_time.test.ts'
09:06:56 743.353: '13dd8684e4e32fd7:ISOLATE=1:TIMEOUT=15m:CPUS=16:MEM=96g:NAME=e2e_prover_full_real yarn-project/end-to-end/scripts/run_test.sh simple e2e_prover/full'
09:06:56 Completed run of 12188 tests in 936 seconds.
09:06:56
--- bench all ---
09:06:57 barretenberg/cpp Executing: barretenberg/cpp/bootstrap.sh build_bench (
http://ci.aztec-labs.com/a1adb334581a332f)
09:06:57 yarn-project/end-to-end Executing: yarn-project/end-to-end/bootstrap.sh build_bench (
http://ci.aztec-labs.com/2c9fc1b05cb5ef07)
09:06:58 barretenberg/cpp 0 .
done (1s)
09:09:03 yarn-project/end-to-end 0 ................................................................
09:11:52 yarn-project/end-to-end 64 .
done (295s)
09:11:53 Starting parallel run using max 64 cpus...
09:11:53 Test run log id:
http://ci.aztec-labs.com/cce192e64a661f1f
09:17:03 Completed run of 95 tests in 310 seconds.
09:17:06 Completed 7.7 KiB/7.7 KiB (126.7 KiB/s) with 1 file(s) remaining
upload: ../../../tmp/tmp.QviFz7U5gI to s3://aztec-ci-artifacts/build-cache/bench-1c9ca312bfdace816082212846900a49694e1e50.tar.gz
09:17:06 Cache upload of bench-1c9ca312bfdace816082212846900a49694e1e50.tar.gz complete in 1s.
09:17:06 + local code=0
09:17:06 + set +x
09:17:06 dmesg log id:
http://ci.aztec-labs.com/08c8142dca5bd048
CI run log id:
http://ci.aztec-labs.com/1750754744111
+ code=0
+ case $code in
+ log_ci_run PASSED 1750754744111
+ exit 0
SSH exited with code: 0
Terminating instance: i-05351efd9c1737530...