Parent Log:
http://ci.aztec-labs.com/15780892348
Command: bootstrap_ec2 './bootstrap.sh ci-full'
Date: Fri Jun 20 14:40:06 UTC 2025
Status: 0
Took: 1656s
--- request build instance ---
Requesting m6a.32xlarge spot instance (name: pr-15186_amd64_x3-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for instance id for spot request: sir-bsyz7vij...
Waiting for SSH at 3.133.111.124...
Stdout is not a tty, running in background...
Loading CRS into tmpfs...
Done in 13 seconds.
Stdout is not a tty, starting build container in background...
Starting devbox...
From
https://github.com/aztecprotocol/aztec-packages
* branch 107a625e4a5b124b87c02fa9ff2ae12b5778baa9 -> FETCH_HEAD
HEAD is now at 107a625 chore: import blockchain node engine (#15186)
Switched to a new branch 'gh-readonly-queue/next/pr-15186-54fc27adbce52a5aa04aeae6eec34ae4b1044f92'
+ ci3/add_timestamps
+ run
+ DUP=1
+ ci3/cache_log 'CI run' 1750428802988
CI run log id:
http://ci.aztec-labs.com/1750428802988
14:13:23 + echo 'env: REF_NAME=gh-readonly-queue/next/pr-15186-54fc27adbce52a5aa04aeae6eec34ae4b1044f92 COMMIT_HASH=107a625e4a5b124b87c02fa9ff2ae12b5778baa9 CURRENT_VERSION=0.87.6 TARGET_BRANCH=next'
14:13:23 env: REF_NAME=gh-readonly-queue/next/pr-15186-54fc27adbce52a5aa04aeae6eec34ae4b1044f92 COMMIT_HASH=107a625e4a5b124b87c02fa9ff2ae12b5778baa9 CURRENT_VERSION=0.87.6 TARGET_BRANCH=next
14:13:23 + semver check gh-readonly-queue/next/pr-15186-54fc27adbce52a5aa04aeae6eec34ae4b1044f92
14:13:23 + cpu_pid=411
14:13:23 + mpstat 2
14:13:23 + mem_pid=412
14:13:23 + set +e
14:13:23 + set -x
14:13:23 + ./bootstrap.sh ci-full
14:13:23 + vmstat -w -S M 2
14:13:23 ++ cache_log cpufile
14:13:23 ++ cache_log memfile
14:13:23 memfile log id:
http://ci.aztec-labs.com/f74b891b9d1baa7d
14:13:23 cpufile log id:
http://ci.aztec-labs.com/09f0f817cc4fc65e
14:13:30
--- pull submodules ---
14:13:30 Executing: git submodule update --init --recursive (
http://ci.aztec-labs.com/df8c08ea18351dc8)
14:13:39 0 .
done (9s)
14:13:41
--- noir build ---
14:13:41 Executing: retry install_deps (
http://ci.aztec-labs.com/961e48cb6417995a)
14:13:45 0 .
done (4s)
14:13:46 build_native Executing: build_native (
http://ci.aztec-labs.com/5daa58a04bc8f715)
14:13:46 build_packages Executing: build_packages (
http://ci.aztec-labs.com/81c3c78570b4fe20)
14:13:46 build_native 0 .
done (0s)
14:13:52 build_packages 0 .
done (6s)
14:13:53
--- bb cpp build ---
14:13:53 build_wasm Executing: build_wasm (
http://ci.aztec-labs.com/1c97a6567a88fe14)
14:13:53 build_native Executing: build_native (
http://ci.aztec-labs.com/eec7e3678b595ed0)
14:13:53 build_nodejs_module Executing: build_nodejs_module (
http://ci.aztec-labs.com/af13a9b9bf6705f6)
14:13:53 build_wasm_threads Executing: build_wasm_threads (
http://ci.aztec-labs.com/234fe48117391495)
14:13:53 build_gcc_syntax_check_only Executing: build_gcc_syntax_check_only (
http://ci.aztec-labs.com/58b221e0a936cb46)
14:13:53 build_fuzzing_syntax_check_only Executing: build_fuzzing_syntax_check_only (
http://ci.aztec-labs.com/f2e3c080fdd90462)
14:13:53 build_asan_fast Executing: build_asan_fast (
http://ci.aztec-labs.com/904b61e98341298a)
14:13:53 build_darwin Executing: build_darwin (
http://ci.aztec-labs.com/632b2e9c359ecd3f)
14:13:54 build_fuzzing_syntax_check_only 0 .
done (0s)
14:13:54 build_gcc_syntax_check_only 0 .
done (0s)
14:13:54 build_darwin 0 .
done (1s)
14:13:54 build_wasm 0 .
done (1s)
14:13:54 build_wasm_threads 0 .
done (1s)
14:13:54 build_nodejs_module 0 .
done (1s)
14:13:55 build_native 0 .
done (2s)
14:13:55 build_asan_fast 0 .
done (2s)
14:14:00
--- bb.js build ---
14:14:01 Cache download and extraction of node-modules-e85320bda7d59d54.zst complete in 1s.
14:14:01 Cache download and extraction of bb.js-7cabe67228ed2cf3.tar.gz complete in 0s.
14:14:03
--- acir_tests build ---
14:14:03 Cache download and extraction of barretenberg-acir-tests-7d5511b6125e191e.tar.gz complete in 0s.
14:14:04 Cache download and extraction of node-modules-fec19dc5fe5a76d5.zst complete in 1s.
14:14:04 browser-test-app Executing: yarn build (
http://ci.aztec-labs.com/a275f7cc89d84f8c)
14:14:04 bbjs-test Executing: yarn build (
http://ci.aztec-labs.com/cfd67a9c2f12ebdc)
14:14:08 bbjs-test 0 .
done (4s)
14:14:09 browser-test-app 0 .
done (5s)
14:14:10
--- avm-transpiler build ---
14:14:10 Cache download and extraction of avm-transpiler-6867cd9272ea7ebd.tar.gz complete in 0s.
14:14:10
--- noir-projects build ---
14:14:10 Executing: prep (
http://ci.aztec-labs.com/f8cc62fe1532ab69)
14:14:14 0 .
done (4s)
14:14:14 mock-protocol-circuits Executing: ./mock-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/003065070b6141b0)
14:14:14 noir-protocol-circuits Executing: ./noir-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/f70c3b02371a8a89)
14:14:14 noir-contracts Executing: ./noir-contracts/bootstrap.sh (
http://ci.aztec-labs.com/290634e05142784a)
14:14:14 aztec-nr Executing: ./aztec-nr/bootstrap.sh (
http://ci.aztec-labs.com/d8434cf0ca7929de)
14:14:16 noir-contracts 0 ................................................................
14:14:16 noir-contracts 64 ................................................................
14:14:16 noir-contracts 128 ................................................................
14:14:16 noir-contracts 192 ................................................................
14:14:17 noir-contracts 256 ................................................................
14:14:17 noir-contracts 320 ................................................................
14:14:17 noir-contracts 384 ................................................................
14:14:17 noir-contracts 448 ................................................................
14:14:18 noir-contracts 512 ................................................................
14:14:18 noir-contracts 576 ................................................................
14:14:18 noir-contracts 640 ................................................................
14:14:18 noir-contracts 704 ................................................................
14:14:19 noir-contracts 768 ................................................................
14:14:19 noir-contracts 832 ................................................................
14:14:19 noir-contracts 896 ................................................................
14:14:19 noir-contracts 960 ................................................................
14:14:19 noir-contracts 1024 ................................................................
14:14:20 noir-contracts 1088 ................................................................
14:14:20 noir-contracts 1152 ................................................................
14:14:20 noir-contracts 1216 ................................................................
14:14:20 noir-protocol-circuits 0 ................................................................
14:14:20 noir-protocol-circuits 64 ................................................................
14:14:20 noir-contracts 1280 ................................................................
14:14:20 noir-contracts 1344 ................................................................
14:14:20 noir-contracts 1408 ................................................................
14:14:21 noir-contracts 1472 ................................................................
14:14:21 noir-protocol-circuits 128 ................................................................
14:14:21 noir-contracts 1536 ................................................................
14:14:21 noir-contracts 1600 .
done (7s)
14:14:21 noir-protocol-circuits 192 ................................................................
14:14:22 aztec-nr 0 .
done (8s)
14:14:22 noir-protocol-circuits 256 ................................................................
14:14:22 mock-protocol-circuits 0 ................................................................
14:14:23 noir-protocol-circuits 320 ................................................................
14:14:24 noir-protocol-circuits 384 ................................................................
14:14:26 noir-protocol-circuits 448 ................................................................
14:14:28 mock-protocol-circuits 64 ................................................................
14:16:57 noir-protocol-circuits 512 ................................................................
14:16:57 noir-protocol-circuits 576 ................................................................
14:16:57 noir-protocol-circuits 640 .
done (163s)
14:17:00 mock-protocol-circuits 128 .
done (165s)
14:17:00
--- l1-contracts build ---
14:17:00 Cache download and extraction of l1-contracts-a5227845f7b33808.tar.gz complete in 0s.
14:17:01
--- yarn-project build ---
14:17:01 Executing: ./bootstrap.sh clean-lite (
http://ci.aztec-labs.com/f5e377af7e443d02)
14:17:01 0 .
done (0s)
14:17:16 Cache download and extraction of node-modules-34bec2a54a394404.zst complete in 15s.
14:17:16 Executing: compile_all (
http://ci.aztec-labs.com/166ee90009047fff)
14:17:19 0 .
done (3s)
14:17:19 boxes/bootstrap.sh Executing: boxes/bootstrap.sh (
http://ci.aztec-labs.com/fe83acda04a04f84)
14:17:19 playground/bootstrap.sh Executing: playground/bootstrap.sh (
http://ci.aztec-labs.com/52dbe972a9c358cc)
14:17:19 docs/bootstrap.sh Executing: docs/bootstrap.sh (
http://ci.aztec-labs.com/edcc06a118fabdef)
14:17:19 release-image/bootstrap.sh Executing: release-image/bootstrap.sh (
http://ci.aztec-labs.com/25db135d753270eb)
14:17:19 spartan/bootstrap.sh Executing: spartan/bootstrap.sh (
http://ci.aztec-labs.com/2c55a975043b038e)
14:17:19 aztec-up/bootstrap.sh Executing: aztec-up/bootstrap.sh (
http://ci.aztec-labs.com/91ca2e42d8e92710)
14:17:20 aztec-up/bootstrap.sh 0 .
done (1s)
14:17:23 boxes/bootstrap.sh 0 .
done (4s)
14:17:24 playground/bootstrap.sh 0 .
done (5s)
14:17:25 spartan/bootstrap.sh 0 .
done (5s)
14:17:26 docs/bootstrap.sh 0 .
done (7s)
14:17:53 release-image/bootstrap.sh 0 .
done (34s)
14:17:53
--- test all ---
14:17:53 Waiting for TXE's to start...
14:17:56 Gathering tests to run...
14:19:37 Gathered 12132 tests.
14:19:37 Starting parallel run with max 64 jobs...
14:19:37 Executing: parallel -j64 --memsuspend 64G --line-buffer --joblog joblog.txt --halt now,fail=1 'run_test_cmd {}' (
http://ci.aztec-labs.com/da2e9aeec7681664)
14:20:08 0 ................................................................
14:21:16 64 ................................................................
14:22:22 128 ................................................................
14:23:26 192 ................................................................
14:23:47 256 ................................................................
14:23:57 320 ................................................................
14:24:17 384 ................................................................
14:24:32 448 ................................................................
14:24:39 512 ................................................................
14:24:45 576 ................................................................
14:24:57 640 ................................................................
14:25:05 704 ................................................................
14:25:12 768 ................................................................
14:25:18 832 ................................................................
14:25:26 896 ................................................................
14:25:32 960 ................................................................
14:25:37 1024 ................................................................
14:25:41 1088 ................................................................
14:25:50 1152 ................................................................
14:25:58 1216 ................................................................
14:26:01 1280 ................................................................
14:26:05 1344 ................................................................
14:26:08 1408 ................................................................
14:26:12 1472 ................................................................
14:26:15 1536 ................................................................
14:26:23 1600 ................................................................
14:26:37 1664 ................................................................
14:26:48 1728 ................................................................
14:26:53 1792 ................................................................
14:26:58 1856 ................................................................
14:27:01 1920 ................................................................
14:27:03 1984 ................................................................
14:27:05 2048 ................................................................
14:27:08 2112 ................................................................
14:27:10 2176 ................................................................
14:27:12 2240 ................................................................
14:27:14 2304 ................................................................
14:27:16 2368 ................................................................
14:27:17 2432 ................................................................
14:27:19 2496 ................................................................
14:27:20 2560 ................................................................
14:27:30 2624 ................................................................
14:27:32 2688 ................................................................
14:27:33 2752 ................................................................
14:27:35 2816 ................................................................
14:27:37 2880 ................................................................
14:27:40 2944 ................................................................
14:27:58 3008 ................................................................
14:28:03 3072 ................................................................
14:28:06 3136 ................................................................
14:28:08 3200 ................................................................
14:28:10 3264 ................................................................
14:28:12 3328 ................................................................
14:28:13 3392 ................................................................
14:28:15 3456 ................................................................
14:28:19 3520 ................................................................
14:28:21 3584 ................................................................
14:28:23 3648 ................................................................
14:28:25 3712 ................................................................
14:28:26 3776 ................................................................
14:28:27 3840 ................................................................
14:28:28 3904 ................................................................
14:28:30 3968 ................................................................
14:28:31 4032 ................................................................
14:28:32 4096 ................................................................
14:28:34 4160 ................................................................
14:28:38 4224 ................................................................
14:28:43 4288 ................................................................
14:28:47 4352 ................................................................
14:28:49 4416 ................................................................
14:28:52 4480 ................................................................
14:28:54 4544 ................................................................
14:28:56 4608 ................................................................
14:28:59 4672 ................................................................
14:29:01 4736 ................................................................
14:29:04 4800 ................................................................
14:29:06 4864 ................................................................
14:29:08 4928 ................................................................
14:29:10 4992 ................................................................
14:29:12 5056 ................................................................
14:29:14 5120 ................................................................
14:29:16 5184 ................................................................
14:29:17 5248 ................................................................
14:29:19 5312 ................................................................
14:29:21 5376 ................................................................
14:29:23 5440 ................................................................
14:29:26 5504 ................................................................
14:29:29 5568 ................................................................
14:29:31 5632 ................................................................
14:29:34 5696 ................................................................
14:29:36 5760 ................................................................
14:29:38 5824 ................................................................
14:29:40 5888 ................................................................
14:29:42 5952 ................................................................
14:29:44 6016 ................................................................
14:29:46 6080 ................................................................
14:29:49 6144 ................................................................
14:29:52 6208 ................................................................
14:29:54 6272 ................................................................
14:29:57 6336 ................................................................
14:29:59 6400 ................................................................
14:30:02 6464 ................................................................
14:30:05 6528 ................................................................
14:30:07 6592 ................................................................
14:30:11 6656 ................................................................
14:30:13 6720 ................................................................
14:30:16 6784 ................................................................
14:30:17 6848 ................................................................
14:30:20 6912 ................................................................
14:30:22 6976 ................................................................
14:30:24 7040 ................................................................
14:30:26 7104 ................................................................
14:30:28 7168 ................................................................
14:30:29 7232 ................................................................
14:30:30 7296 ................................................................
14:30:32 7360 ................................................................
14:30:33 7424 ................................................................
14:30:34 7488 ................................................................
14:30:35 7552 ................................................................
14:30:36 7616 ................................................................
14:30:37 7680 ................................................................
14:30:39 7744 ................................................................
14:30:40 7808 ................................................................
14:30:41 7872 ................................................................
14:30:42 7936 ................................................................
14:30:44 8000 ................................................................
14:30:45 8064 ................................................................
14:30:46 8128 ................................................................
14:30:47 8192 ................................................................
14:30:49 8256 ................................................................
14:30:50 8320 ................................................................
14:30:51 8384 ................................................................
14:30:52 8448 ................................................................
14:30:53 8512 ................................................................
14:30:54 8576 ................................................................
14:30:56 8640 ................................................................
14:30:57 8704 ................................................................
14:30:58 8768 ................................................................
14:30:59 8832 ................................................................
14:31:00 8896 ................................................................
14:31:01 8960 ................................................................
14:31:03 9024 ................................................................
14:31:04 9088 ................................................................
14:31:06 9152 ................................................................
14:31:07 9216 ................................................................
14:31:09 9280 ................................................................
14:31:10 9344 ................................................................
14:31:11 9408 ................................................................
14:31:13 9472 ................................................................
14:31:14 9536 ................................................................
14:31:16 9600 ................................................................
14:31:18 9664 ................................................................
14:31:19 9728 ................................................................
14:31:21 9792 ................................................................
14:31:23 9856 ................................................................
14:31:24 9920 ................................................................
14:31:25 9984 ................................................................
14:31:26 10048 ................................................................
14:31:28 10112 ................................................................
14:31:29 10176 ................................................................
14:31:30 10240 ................................................................
14:31:31 10304 ................................................................
14:31:32 10368 ................................................................
14:31:33 10432 ................................................................
14:31:35 10496 ................................................................
14:31:36 10560 ................................................................
14:31:37 10624 ................................................................
14:31:38 10688 ................................................................
14:31:40 10752 ................................................................
14:31:41 10816 ................................................................
14:31:42 10880 ................................................................
14:31:43 10944 ................................................................
14:31:44 11008 ................................................................
14:31:45 11072 ................................................................
14:31:47 11136 ................................................................
14:31:48 11200 ................................................................
14:31:49 11264 ................................................................
14:31:50 11328 ................................................................
14:31:52 11392 ................................................................
14:31:53 11456 ................................................................
14:31:54 11520 ................................................................
14:31:55 11584 ................................................................
14:31:56 11648 ................................................................
14:31:58 11712 ................................................................
14:31:59 11776 ................................................................
14:32:00 11840 ................................................................
14:32:01 11904 ................................................................
14:32:02 11968 ................................................................
14:32:04 12032 ................................................................
14:32:05 12096 ................................................................
14:32:06 12160 ................................................................
14:32:07 12224 ................................................................
14:32:08 12288 ................................................................
14:34:40 12352 .
done (903s)
14:34:40
WARNING: The following tests exceed 5 minute runtimes. Break them up or rethink them.
14:34:40 305.043: 'a8cc061dbe484831:ISOLATE=1:NAME=e2e_p2p/validators_sentinel yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/validators_sentinel.test.ts'
14:34:40 321.663: 'f6d0f30efb64f09d noir-projects/scripts/run_test.sh noir-protocol-circuits rollup_lib block_root::block_root_rollup_inputs::tests::correct_blobs_with_non_empty_fields'
14:34:40 340.934: 'a8cc061dbe484831:ISOLATE=1:NAME=e2e_p2p/data_withholding_slash yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/data_withholding_slash.test.ts'
14:34:40 342.417: 'e9297abd416742f6 barretenberg/cpp/scripts/run_test.sh dsl_tests AcirAvm2RecursionConstraint.TestGenerateVKFromConstraintsWithoutWitness'
14:34:40 353.940: 'ae0982473148bd1c:ONLY_TERM_PARENT=1 BOX=vanilla BROWSER=* run_compose_test vanilla-all-browsers box boxes'
14:34:40 369.109: 'e9297abd416742f6:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityPassing'
14:34:40 374.364: 'e9297abd416742f6:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityFailing'
14:34:40 389.466: 'a8cc061dbe484831:ISOLATE=1:NAME=p2p/src/client/p2p_client.integration.test.ts LOG_LEVEL=debug yarn-project/scripts/run_test.sh p2p/src/client/p2p_client.integration.test.ts'
14:34:40 390.598: '7bc4cc182e85e17f aztec-up/scripts/run_test.sh amm_flow'
14:34:40 408.050: 'a8cc061dbe484831:ISOLATE=1:TIMEOUT=15m:NAME=e2e_block_building yarn-project/end-to-end/scripts/run_test.sh simple e2e_block_building'
14:34:40 429.832: 'a8cc061dbe484831:ISOLATE=1:NAME=e2e_p2p/reex yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/reex.test.ts'
14:34:40 433.342: 'ae0982473148bd1c:ONLY_TERM_PARENT=1 BOX=vite BROWSER=webkit run_compose_test vite-webkit box boxes'
14:34:40 444.826: 'a8cc061dbe484831:ISOLATE=1:NAME=e2e_l1_with_wall_time yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_l1_with_wall_time.test.ts'
14:34:40 461.375: 'a8cc061dbe484831:ISOLATE=1:NAME=prover-client/src/test/bb_prover_full_rollup.test.ts:CPUS=16:MEM=96g LOG_LEVEL=verbose yarn-project/scripts/run_test.sh prover-client/src/test/bb_prover_full_rollup.test.ts'
14:34:40 767.393: 'a8cc061dbe484831:ISOLATE=1:TIMEOUT=15m:CPUS=16:MEM=96g:NAME=e2e_prover_full_real yarn-project/end-to-end/scripts/run_test.sh simple e2e_prover/full'
14:34:40 Completed run of 12132 tests in 903 seconds.
14:34:40
--- bench all ---
14:34:40 barretenberg/cpp Executing: barretenberg/cpp/bootstrap.sh build_bench (
http://ci.aztec-labs.com/c62c49941c5c666b)
14:34:40 yarn-project/end-to-end Executing: yarn-project/end-to-end/bootstrap.sh build_bench (
http://ci.aztec-labs.com/22fcc8a727692398)
14:34:41 barretenberg/cpp 0 .
done (1s)
14:34:42 yarn-project/end-to-end 0 .
done (2s)
14:34:43 Starting parallel run using max 64 cpus...
14:34:43 Test run log id:
http://ci.aztec-labs.com/ff807aac5dd9f7b2
14:39:55 Completed run of 95 tests in 312 seconds.
14:39:57 Completed 7.6 KiB/7.6 KiB (117.0 KiB/s) with 1 file(s) remaining
upload: ../../../tmp/tmp.7Cikjg6bQ4 to s3://aztec-ci-artifacts/build-cache/bench-107a625e4a5b124b87c02fa9ff2ae12b5778baa9.tar.gz
14:39:57 Cache upload of bench-107a625e4a5b124b87c02fa9ff2ae12b5778baa9.tar.gz complete in 1s.
14:39:57 + local code=0
14:39:57 + set +x
14:39:57 dmesg log id:
http://ci.aztec-labs.com/8102832673cb7426
CI run log id:
http://ci.aztec-labs.com/1750428802988
+ code=0
+ case $code in
+ log_ci_run PASSED 1750428802988
+ exit 0
SSH exited with code: 0
Terminating instance: i-0120b09261053de9b...