Parent Log:
http://ci.aztec-labs.com/15875352069
Command: bootstrap_ec2 './bootstrap.sh ci-full'
Date: Wed Jun 25 12:16:01 UTC 2025
Status: 0
Took: 2082s
--- request build instance ---
Requesting m6a.32xlarge spot instance (name: pr-15266_amd64_x4-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for instance id for spot request: sir-mkdf5iqh...
Timeout waiting for spot request.
Requesting m6a.32xlarge on-demand instance (name: pr-15266_amd64_x4-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for SSH at 3.137.154.31...
Stdout is not a tty, running in background...
Loading CRS into tmpfs...
Done in 18 seconds.
Stdout is not a tty, starting build container in background...
Starting devbox...
From
https://github.com/aztecprotocol/aztec-packages
* branch 7e5cc6ce64702f5290c0271c7abe90e51c2a4b2c -> FETCH_HEAD
HEAD is now at 7e5cc6c feat: enable shared telemetry (#15266)
Switched to a new branch 'gh-readonly-queue/next/pr-15266-64d39fa80e65db5015d6874e0fa1e463a248808b'
+ run
+ ci3/add_timestamps
+ DUP=1
+ ci3/cache_log 'CI run' 1750851777618
CI run log id:
http://ci.aztec-labs.com/1750851777618
11:42:57 + echo 'env: REF_NAME=gh-readonly-queue/next/pr-15266-64d39fa80e65db5015d6874e0fa1e463a248808b COMMIT_HASH=7e5cc6ce64702f5290c0271c7abe90e51c2a4b2c CURRENT_VERSION=0.87.6 TARGET_BRANCH=next'
11:42:57 env: REF_NAME=gh-readonly-queue/next/pr-15266-64d39fa80e65db5015d6874e0fa1e463a248808b COMMIT_HASH=7e5cc6ce64702f5290c0271c7abe90e51c2a4b2c CURRENT_VERSION=0.87.6 TARGET_BRANCH=next
11:42:57 + semver check gh-readonly-queue/next/pr-15266-64d39fa80e65db5015d6874e0fa1e463a248808b
11:42:57 + cpu_pid=415
11:42:57 + mpstat 2
11:42:57 + mem_pid=416
11:42:57 + vmstat -w -S M 2
11:42:57 + set +e
11:42:57 + set -x
11:42:57 + ./bootstrap.sh ci-full
11:42:57 ++ cache_log cpufile
11:42:57 ++ cache_log memfile
11:42:57 cpufile log id:
http://ci.aztec-labs.com/f15a3275cea54120
11:42:57 memfile log id:
http://ci.aztec-labs.com/93d8919f931fa920
11:43:04
--- pull submodules ---
11:43:04 Executing: git submodule update --init --recursive (
http://ci.aztec-labs.com/765fe3c584067356)
11:43:12 0 .
done (8s)
11:43:14
--- noir build ---
11:43:14 Executing: retry install_deps (
http://ci.aztec-labs.com/54e640f2f2026cd5)
11:43:18 0 .
done (4s)
11:43:19 build_native Executing: build_native (
http://ci.aztec-labs.com/995482d89946b54f)
11:43:19 build_packages Executing: build_packages (
http://ci.aztec-labs.com/3a24e5f636e1164e)
11:43:19 build_native 0 .
done (0s)
11:43:25 build_packages 0 .
done (6s)
11:43:26
--- bb cpp build ---
11:43:26 build_nodejs_module Executing: build_nodejs_module (
http://ci.aztec-labs.com/ef2f0437cda656ce)
11:43:26 build_wasm_threads Executing: build_wasm_threads (
http://ci.aztec-labs.com/c9187a8fdc1a8dee)
11:43:26 build_wasm Executing: build_wasm (
http://ci.aztec-labs.com/b4af992f55c9100f)
11:43:26 build_native Executing: build_native (
http://ci.aztec-labs.com/fb5ac7337d9c1197)
11:43:26 build_gcc_syntax_check_only Executing: build_gcc_syntax_check_only (
http://ci.aztec-labs.com/c968b5f5c35556b5)
11:43:26 build_fuzzing_syntax_check_only Executing: build_fuzzing_syntax_check_only (
http://ci.aztec-labs.com/dab3ca6c88a4c9ca)
11:43:26 build_asan_fast Executing: build_asan_fast (
http://ci.aztec-labs.com/d1b4fa916c86b535)
11:43:26 build_darwin Executing: build_darwin (
http://ci.aztec-labs.com/69ac5eb365762641)
11:43:26 build_gcc_syntax_check_only 0 .
done (0s)
11:43:26 build_fuzzing_syntax_check_only 0 .
done (0s)
11:43:26 build_wasm 0 .
done (0s)
11:43:26 build_darwin 0 .
done (0s)
11:43:26 build_wasm_threads 0 .
done (0s)
11:43:27 build_nodejs_module 0 .
done (1s)
11:43:27 build_native 0 .
done (1s)
11:43:28 build_asan_fast 0 .
done (2s)
11:43:32
--- bb.js build ---
11:43:34 Cache download and extraction of node-modules-e85320bda7d59d54.zst complete in 1s.
11:43:34 Cache download and extraction of bb.js-da698083bc54aa8e.tar.gz complete in 0s.
11:43:35
--- acir_tests build ---
11:43:35 Cache download and extraction of barretenberg-acir-tests-ac37c69e8bf7d55f.tar.gz complete in 0s.
11:43:36 Cache download and extraction of node-modules-fec19dc5fe5a76d5.zst complete in 1s.
11:43:36 browser-test-app Executing: yarn build (
http://ci.aztec-labs.com/ebcb369bdb6ca530)
11:43:36 bbjs-test Executing: yarn build (
http://ci.aztec-labs.com/938b1506edd2dbe0)
11:43:40 bbjs-test 0 .
done (4s)
11:43:41 browser-test-app 0 .
done (5s)
11:43:42
--- avm-transpiler build ---
11:43:42 Cache download and extraction of avm-transpiler-bff6096d112435ba.tar.gz complete in 0s.
11:43:42
--- noir-projects build ---
11:43:42 Executing: prep (
http://ci.aztec-labs.com/7ae1323ff1e8bf5a)
11:43:45 0 .
done (3s)
11:43:45 mock-protocol-circuits Executing: ./mock-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/837cd2ca64d39ae7)
11:43:45 noir-protocol-circuits Executing: ./noir-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/0625d05136dccdb0)
11:43:45 noir-contracts Executing: ./noir-contracts/bootstrap.sh (
http://ci.aztec-labs.com/4d96e35b8084ced9)
11:43:45 aztec-nr Executing: ./aztec-nr/bootstrap.sh (
http://ci.aztec-labs.com/23cbdb29aea052f6)
11:43:46 noir-contracts 0 ................................................................
11:43:46 noir-contracts 64 ................................................................
11:43:46 noir-contracts 128 ................................................................
11:43:46 noir-contracts 192 ................................................................
11:43:47 noir-contracts 256 ................................................................
11:43:47 noir-contracts 320 ................................................................
11:43:47 noir-contracts 384 ................................................................
11:43:47 noir-contracts 448 ................................................................
11:43:47 noir-contracts 512 ................................................................
11:43:48 noir-contracts 576 ................................................................
11:43:48 noir-contracts 640 ................................................................
11:43:48 noir-contracts 704 ................................................................
11:43:48 noir-contracts 768 ................................................................
11:43:48 noir-contracts 832 ................................................................
11:43:48 noir-contracts 896 ................................................................
11:43:49 noir-contracts 960 ................................................................
11:43:49 noir-contracts 1024 ................................................................
11:43:49 noir-contracts 1088 ................................................................
11:43:49 noir-contracts 1152 ................................................................
11:43:49 noir-contracts 1216 ................................................................
11:43:50 noir-contracts 1280 ................................................................
11:43:50 noir-contracts 1344 ................................................................
11:43:50 noir-contracts 1408 ................................................................
11:43:50 noir-contracts 1472 ................................................................
11:43:50 noir-protocol-circuits 0 ................................................................
11:43:50 noir-protocol-circuits 64 ................................................................
11:43:50 noir-contracts 1536 ................................................................
11:43:50 noir-contracts 1600 .
done (5s)
11:43:51 noir-protocol-circuits 128 ................................................................
11:43:51 noir-protocol-circuits 192 ................................................................
11:43:51 mock-protocol-circuits 0 ................................................................
11:43:52 noir-protocol-circuits 256 ................................................................
11:43:52 aztec-nr 0 .
done (7s)
11:43:53 noir-protocol-circuits 320 ................................................................
11:43:54 noir-protocol-circuits 384 ................................................................
11:43:55 noir-protocol-circuits 448 ................................................................
11:43:57 mock-protocol-circuits 64 ................................................................
11:45:57 mock-protocol-circuits 128 .
done (132s)
11:46:01 noir-protocol-circuits 512 ................................................................
11:46:01 noir-protocol-circuits 576 ................................................................
11:46:01 noir-protocol-circuits 640 .
done (136s)
11:46:02
--- l1-contracts build ---
11:46:02
➤ YN0000: ·
Yarn 4.5.2
11:46:02
➤ YN0000: ┌ Resolution step
11:46:02
➤ YN0000: └ Completed
11:46:02
➤ YN0000: ┌ Fetch step
11:46:03
➤ YN0013: │
134 packages were added to the project (
+ 44.9 MiB).
11:46:03
➤ YN0000: └ Completed in 0s 738ms
11:46:03
➤ YN0000: ┌ Link step
11:46:03
➤ YN0000: └ Completed in 0s 873ms
11:46:04
➤ YN0000: · Done in 1s 679ms
11:46:04 Cache download and extraction of l1-contracts-d3ef5bc6472a5473.tar.gz complete in 0s.
11:46:04
--- yarn-project build ---
11:46:04 Executing: ./bootstrap.sh clean-lite (
http://ci.aztec-labs.com/a8a39e3950397baf)
11:46:04 0 .
done (0s)
11:46:09 Cache download and extraction of node-modules-34bec2a54a394404.zst complete in 4s.
11:46:09 Executing: compile_all (
http://ci.aztec-labs.com/d3da34a7fa1dfae0)
11:46:19 0 ................................................................
11:48:41 64 .
done (152s)
11:48:41 boxes/bootstrap.sh Executing: boxes/bootstrap.sh (
http://ci.aztec-labs.com/4b647037ce000e61)
11:48:41 playground/bootstrap.sh Executing: playground/bootstrap.sh (
http://ci.aztec-labs.com/8c71c79cc279ebd5)
11:48:41 docs/bootstrap.sh Executing: docs/bootstrap.sh (
http://ci.aztec-labs.com/6aec8d45780efbb1)
11:48:41 release-image/bootstrap.sh Executing: release-image/bootstrap.sh (
http://ci.aztec-labs.com/6105f713804de461)
11:48:41 spartan/bootstrap.sh Executing: spartan/bootstrap.sh (
http://ci.aztec-labs.com/7e50f81b7717463c)
11:48:41 aztec-up/bootstrap.sh Executing: aztec-up/bootstrap.sh (
http://ci.aztec-labs.com/e03d22281a6e6352)
11:48:42 aztec-up/bootstrap.sh 0 .
done (1s)
11:48:45 spartan/bootstrap.sh 0 .
done (4s)
11:48:46 boxes/bootstrap.sh 0 .
done (5s)
11:48:46 playground/bootstrap.sh 0 .
done (5s)
11:48:48 docs/bootstrap.sh 0 .
done (7s)
11:49:14 release-image/bootstrap.sh 0 .
done (33s)
11:49:14
--- test all ---
11:49:14 Waiting for TXE's to start...
11:49:17 Gathering tests to run...
11:50:56 Gathered 12181 tests.
11:50:56 Starting parallel run with max 64 jobs...
11:50:56 Executing: parallel -j64 --memsuspend 64G --line-buffer --joblog joblog.txt --halt now,fail=1 'run_test_cmd {}' (
http://ci.aztec-labs.com/ee4b3992e137dc29)
11:51:28 0 ................................................................
11:52:32 64 ................................................................
11:53:36 128 ................................................................
11:54:37 192 ................................................................
11:55:01 256 ................................................................
11:55:11 320 ................................................................
11:55:30 384 ................................................................
11:55:46 448 ................................................................
11:55:54 512 ................................................................
11:56:00 576 ................................................................
11:56:11 640 ................................................................
11:56:18 704 ................................................................
11:56:24 768 ................................................................
11:56:30 832 ................................................................
11:56:37 896 ................................................................
11:56:43 960 ................................................................
11:56:47 1024 ................................................................
11:56:51 1088 ................................................................
11:57:00 1152 ................................................................
11:57:07 1216 ................................................................
11:57:10 1280 ................................................................
11:57:13 1344 ................................................................
11:57:16 1408 ................................................................
11:57:20 1472 ................................................................
11:57:23 1536 ................................................................
11:57:31 1600 ................................................................
11:57:43 1664 ................................................................
11:57:55 1728 ................................................................
11:58:00 1792 ................................................................
11:58:04 1856 ................................................................
11:58:07 1920 ................................................................
11:58:09 1984 ................................................................
11:58:11 2048 ................................................................
11:58:13 2112 ................................................................
11:58:14 2176 ................................................................
11:58:16 2240 ................................................................
11:58:18 2304 ................................................................
11:58:20 2368 ................................................................
11:58:21 2432 ................................................................
11:58:23 2496 ................................................................
11:58:24 2560 ................................................................
11:58:40 2624 ................................................................
11:58:49 2688 ................................................................
11:58:50 2752 ................................................................
11:58:52 2816 ................................................................
11:58:53 2880 ................................................................
11:58:56 2944 ................................................................
11:59:07 3008 ................................................................
11:59:14 3072 ................................................................
11:59:18 3136 ................................................................
11:59:19 3200 ................................................................
11:59:21 3264 ................................................................
11:59:23 3328 ................................................................
11:59:24 3392 ................................................................
11:59:26 3456 ................................................................
11:59:28 3520 ................................................................
11:59:31 3584 ................................................................
11:59:33 3648 ................................................................
11:59:35 3712 ................................................................
11:59:36 3776 ................................................................
11:59:37 3840 ................................................................
11:59:39 3904 ................................................................
11:59:40 3968 ................................................................
11:59:41 4032 ................................................................
11:59:42 4096 ................................................................
11:59:44 4160 ................................................................
11:59:47 4224 ................................................................
11:59:51 4288 ................................................................
11:59:55 4352 ................................................................
11:59:58 4416 ................................................................
12:00:01 4480 ................................................................
12:00:03 4544 ................................................................
12:00:05 4608 ................................................................
12:00:07 4672 ................................................................
12:00:10 4736 ................................................................
12:00:12 4800 ................................................................
12:00:14 4864 ................................................................
12:00:16 4928 ................................................................
12:00:18 4992 ................................................................
12:00:19 5056 ................................................................
12:00:21 5120 ................................................................
12:00:22 5184 ................................................................
12:00:24 5248 ................................................................
12:00:25 5312 ................................................................
12:00:26 5376 ................................................................
12:00:28 5440 ................................................................
12:00:30 5504 ................................................................
12:00:33 5568 ................................................................
12:00:35 5632 ................................................................
12:00:37 5696 ................................................................
12:00:39 5760 ................................................................
12:00:41 5824 ................................................................
12:00:43 5888 ................................................................
12:00:45 5952 ................................................................
12:00:48 6016 ................................................................
12:00:50 6080 ................................................................
12:00:52 6144 ................................................................
12:00:55 6208 ................................................................
12:00:57 6272 ................................................................
12:01:00 6336 ................................................................
12:01:02 6400 ................................................................
12:01:04 6464 ................................................................
12:01:07 6528 ................................................................
12:01:10 6592 ................................................................
12:01:14 6656 ................................................................
12:01:16 6720 ................................................................
12:01:19 6784 ................................................................
12:01:21 6848 ................................................................
12:01:23 6912 ................................................................
12:01:25 6976 ................................................................
12:01:27 7040 ................................................................
12:01:29 7104 ................................................................
12:01:31 7168 ................................................................
12:01:33 7232 ................................................................
12:01:34 7296 ................................................................
12:01:35 7360 ................................................................
12:01:37 7424 ................................................................
12:01:38 7488 ................................................................
12:01:39 7552 ................................................................
12:01:41 7616 ................................................................
12:01:42 7680 ................................................................
12:01:43 7744 ................................................................
12:01:44 7808 ................................................................
12:01:46 7872 ................................................................
12:01:47 7936 ................................................................
12:01:48 8000 ................................................................
12:01:49 8064 ................................................................
12:01:51 8128 ................................................................
12:01:52 8192 ................................................................
12:01:53 8256 ................................................................
12:01:54 8320 ................................................................
12:01:56 8384 ................................................................
12:01:57 8448 ................................................................
12:01:58 8512 ................................................................
12:01:59 8576 ................................................................
12:02:00 8640 ................................................................
12:02:02 8704 ................................................................
12:02:03 8768 ................................................................
12:02:04 8832 ................................................................
12:02:05 8896 ................................................................
12:02:06 8960 ................................................................
12:02:08 9024 ................................................................
12:02:09 9088 ................................................................
12:02:10 9152 ................................................................
12:02:12 9216 ................................................................
12:02:13 9280 ................................................................
12:02:15 9344 ................................................................
12:02:16 9408 ................................................................
12:02:17 9472 ................................................................
12:02:19 9536 ................................................................
12:02:20 9600 ................................................................
12:02:22 9664 ................................................................
12:02:23 9728 ................................................................
12:02:25 9792 ................................................................
12:02:27 9856 ................................................................
12:02:28 9920 ................................................................
12:02:29 9984 ................................................................
12:02:30 10048 ................................................................
12:02:31 10112 ................................................................
12:02:32 10176 ................................................................
12:02:33 10240 ................................................................
12:02:34 10304 ................................................................
12:02:36 10368 ................................................................
12:02:37 10432 ................................................................
12:02:38 10496 ................................................................
12:02:40 10560 ................................................................
12:02:41 10624 ................................................................
12:02:42 10688 ................................................................
12:02:43 10752 ................................................................
12:02:44 10816 ................................................................
12:02:46 10880 ................................................................
12:02:46 10944 ................................................................
12:02:47 11008 ................................................................
12:02:48 11072 ................................................................
12:02:49 11136 ................................................................
12:02:51 11200 ................................................................
12:02:52 11264 ................................................................
12:02:53 11328 ................................................................
12:02:54 11392 ................................................................
12:02:55 11456 ................................................................
12:02:56 11520 ................................................................
12:02:57 11584 ................................................................
12:02:58 11648 ................................................................
12:02:59 11712 ................................................................
12:03:00 11776 ................................................................
12:03:01 11840 ................................................................
12:03:02 11904 ................................................................
12:03:03 11968 ................................................................
12:03:04 12032 ................................................................
12:03:05 12096 ................................................................
12:03:06 12160 ................................................................
12:03:07 12224 ................................................................
12:03:08 12288 ................................................................
12:03:09 12352 ................................................................
12:05:41 12416 .
done (885s)
12:05:41
WARNING: The following tests exceed 5 minute runtimes. Break them up or rethink them.
12:05:41 306.532: '2a104c7046a7f175:ISOLATE=1:NAME=e2e_p2p/validators_sentinel yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/validators_sentinel.test.ts'
12:05:41 321.949: 'ecf04592d062e0f7 barretenberg/cpp/scripts/run_test.sh dsl_tests AcirAvm2RecursionConstraint.TestGenerateVKFromConstraintsWithoutWitness'
12:05:41 339.610: '2a104c7046a7f175:ISOLATE=1:NAME=e2e_p2p/data_withholding_slash yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/data_withholding_slash.test.ts'
12:05:41 346.394: '5ce5d3938449b34e:ONLY_TERM_PARENT=1 BOX=vanilla BROWSER=* run_compose_test vanilla-all-browsers box boxes'
12:05:41 354.076: 'ecf04592d062e0f7:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityPassing'
12:05:41 356.434: 'ecf04592d062e0f7:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityFailing'
12:05:41 361.864: '46319242639f856b aztec-up/scripts/run_test.sh amm_flow'
12:05:41 377.421: '2a104c7046a7f175:ISOLATE=1:NAME=p2p/src/client/p2p_client.integration.test.ts LOG_LEVEL=debug yarn-project/scripts/run_test.sh p2p/src/client/p2p_client.integration.test.ts'
12:05:41 403.708: '2a104c7046a7f175:ISOLATE=1:TIMEOUT=15m:NAME=e2e_block_building yarn-project/end-to-end/scripts/run_test.sh simple e2e_block_building'
12:05:41 420.875: '2a104c7046a7f175:ISOLATE=1:NAME=prover-client/src/test/bb_prover_full_rollup.test.ts:CPUS=16:MEM=96g LOG_LEVEL=verbose yarn-project/scripts/run_test.sh prover-client/src/test/bb_prover_full_rollup.test.ts'
12:05:41 430.185: '2a104c7046a7f175:ISOLATE=1:NAME=e2e_p2p/reex yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/reex.test.ts'
12:05:41 442.487: '2a104c7046a7f175:ISOLATE=1:NAME=e2e_l1_with_wall_time yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_l1_with_wall_time.test.ts'
12:05:41 728.639: '2a104c7046a7f175:ISOLATE=1:TIMEOUT=15m:CPUS=16:MEM=96g:NAME=e2e_prover_full_real yarn-project/end-to-end/scripts/run_test.sh simple e2e_prover/full'
12:05:41 Completed run of 12181 tests in 885 seconds.
12:05:41
--- bench all ---
12:05:41 barretenberg/cpp Executing: barretenberg/cpp/bootstrap.sh build_bench (
http://ci.aztec-labs.com/5e80daeb19f1cbfd)
12:05:41 yarn-project/end-to-end Executing: yarn-project/end-to-end/bootstrap.sh build_bench (
http://ci.aztec-labs.com/f324f35a69b4a77e)
12:05:42 barretenberg/cpp 0 .
done (1s)
12:07:39 yarn-project/end-to-end 0 ................................................................
12:10:37 yarn-project/end-to-end 64 .
done (296s)
12:10:38 Starting parallel run using max 64 cpus...
12:10:38 Test run log id:
http://ci.aztec-labs.com/06a93c8f57ae876f
12:15:48 Completed run of 95 tests in 310 seconds.
12:15:51 Completed 7.7 KiB/7.7 KiB (121.9 KiB/s) with 1 file(s) remaining
upload: ../../../tmp/tmp.epSmdLsBsW to s3://aztec-ci-artifacts/build-cache/bench-7e5cc6ce64702f5290c0271c7abe90e51c2a4b2c.tar.gz
12:15:51 Cache upload of bench-7e5cc6ce64702f5290c0271c7abe90e51c2a4b2c.tar.gz complete in 1s.
12:15:51 + local code=0
12:15:51 + set +x
12:15:51 dmesg log id:
http://ci.aztec-labs.com/34d11d20e1f5f136
CI run log id:
http://ci.aztec-labs.com/1750851777618
+ code=0
+ case $code in
+ log_ci_run PASSED 1750851777618
+ exit 0
SSH exited with code: 0
Terminating instance: i-018f270d377350f8e...