Parent Log:
http://ci.aztec-labs.com/15852074498
Command: bootstrap_ec2 './bootstrap.sh ci-full'
Date: Tue Jun 24 14:07:00 UTC 2025
Status: 0
Took: 1601s
--- request build instance ---
Requesting m6a.32xlarge spot instance (name: pr-15232_amd64_x4-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for instance id for spot request: sir-x4zf4tfk...
Waiting for SSH at 52.14.105.173...
Stdout is not a tty, running in background...
Loading CRS into tmpfs...
Done in 9 seconds.
Stdout is not a tty, starting build container in background...
Starting devbox...
From
https://github.com/aztecprotocol/aztec-packages
* branch 1c2c2ee2949dbe31742cc9501a31bf3bce8083cf -> FETCH_HEAD
HEAD is now at 1c2c2ee chore: tf public otel fixes (#15232)
Switched to a new branch 'gh-readonly-queue/next/pr-15232-aedcee89a2544b0e6baf93c4e71d88991f09111e'
+ run
+ ci3/add_timestamps
+ DUP=1
+ ci3/cache_log 'CI run' 1750772472386
CI run log id:
http://ci.aztec-labs.com/1750772472386
13:41:12 + echo 'env: REF_NAME=gh-readonly-queue/next/pr-15232-aedcee89a2544b0e6baf93c4e71d88991f09111e COMMIT_HASH=1c2c2ee2949dbe31742cc9501a31bf3bce8083cf CURRENT_VERSION=0.87.6 TARGET_BRANCH=next'
13:41:12 env: REF_NAME=gh-readonly-queue/next/pr-15232-aedcee89a2544b0e6baf93c4e71d88991f09111e COMMIT_HASH=1c2c2ee2949dbe31742cc9501a31bf3bce8083cf CURRENT_VERSION=0.87.6 TARGET_BRANCH=next
13:41:12 + semver check gh-readonly-queue/next/pr-15232-aedcee89a2544b0e6baf93c4e71d88991f09111e
13:41:12 + cpu_pid=422
13:41:12 + mpstat 2
13:41:12 + mem_pid=423
13:41:12 + set +e
13:41:12 + set -x
13:41:12 + ./bootstrap.sh ci-full
13:41:12 + vmstat -w -S M 2
13:41:12 ++ cache_log cpufile
13:41:12 ++ cache_log memfile
13:41:12 memfile log id:
http://ci.aztec-labs.com/d4cc4412503caad2
13:41:12 cpufile log id:
http://ci.aztec-labs.com/02db78852345422e
13:41:21
--- pull submodules ---
13:41:21 Executing: git submodule update --init --recursive (
http://ci.aztec-labs.com/000a0a1964ce3209)
13:41:30 0 .
done (9s)
13:41:31
--- noir build ---
13:41:31 Executing: retry install_deps (
http://ci.aztec-labs.com/9e2c17d729583ece)
13:41:35 0 .
done (4s)
13:41:36 build_native Executing: build_native (
http://ci.aztec-labs.com/5df4fceeb5427572)
13:41:36 build_packages Executing: build_packages (
http://ci.aztec-labs.com/fb5265c82689300a)
13:41:36 build_native 0 .
done (0s)
13:41:42 build_packages 0 .
done (6s)
13:41:43
--- bb cpp build ---
13:41:43 build_nodejs_module Executing: build_nodejs_module (
http://ci.aztec-labs.com/5404aa74ed586d7b)
13:41:43 build_wasm_threads Executing: build_wasm_threads (
http://ci.aztec-labs.com/17e30000592b5b10)
13:41:43 build_native Executing: build_native (
http://ci.aztec-labs.com/a4692604720cef89)
13:41:43 build_wasm Executing: build_wasm (
http://ci.aztec-labs.com/870ecf1fdd2eb5bf)
13:41:43 build_gcc_syntax_check_only Executing: build_gcc_syntax_check_only (
http://ci.aztec-labs.com/35f916282a26978a)
13:41:43 build_fuzzing_syntax_check_only Executing: build_fuzzing_syntax_check_only (
http://ci.aztec-labs.com/fae2378e54c08320)
13:41:43 build_asan_fast Executing: build_asan_fast (
http://ci.aztec-labs.com/e3f229093f1e63ad)
13:41:43 build_darwin Executing: build_darwin (
http://ci.aztec-labs.com/8e6a6e9f47df1c87)
13:41:43 build_gcc_syntax_check_only 0 .
done (0s)
13:41:43 build_fuzzing_syntax_check_only 0 .
done (0s)
13:41:43 build_wasm_threads 0 .
done (0s)
13:41:43 build_darwin 0 .
done (0s)
13:41:43 build_wasm 0 .
done (0s)
13:41:44 build_nodejs_module 0 .
done (1s)
13:41:44 build_native 0 .
done (1s)
13:41:45 build_asan_fast 0 .
done (2s)
13:41:49
--- bb.js build ---
13:41:50 Cache download and extraction of node-modules-e85320bda7d59d54.zst complete in 0s.
13:41:51 Cache download and extraction of bb.js-b74ea8bcb48182c9.tar.gz complete in 1s.
13:41:51
--- acir_tests build ---
13:41:52 Cache download and extraction of barretenberg-acir-tests-d0fc50e3220e68e1.tar.gz complete in 1s.
13:41:53 Cache download and extraction of node-modules-fec19dc5fe5a76d5.zst complete in 1s.
13:41:53 browser-test-app Executing: yarn build (
http://ci.aztec-labs.com/fd8373b865071e72)
13:41:53 bbjs-test Executing: yarn build (
http://ci.aztec-labs.com/24561605f63721b1)
13:41:56 bbjs-test 0 .
done (3s)
13:41:57 browser-test-app 0 .
done (4s)
13:41:58
--- avm-transpiler build ---
13:41:58 Cache download and extraction of avm-transpiler-bff6096d112435ba.tar.gz complete in 0s.
13:41:58
--- noir-projects build ---
13:41:58 Executing: prep (
http://ci.aztec-labs.com/a7619f7d28d7b8a9)
13:42:01 0 .
done (3s)
13:42:01 mock-protocol-circuits Executing: ./mock-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/e05541c31e19516a)
13:42:01 noir-protocol-circuits Executing: ./noir-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/751fe580bd138bbe)
13:42:01 noir-contracts Executing: ./noir-contracts/bootstrap.sh (
http://ci.aztec-labs.com/123bdb31fe293fcc)
13:42:01 aztec-nr Executing: ./aztec-nr/bootstrap.sh (
http://ci.aztec-labs.com/ef43b623c79ba947)
13:42:02 noir-contracts 0 ................................................................
13:42:03 noir-contracts 64 ................................................................
13:42:03 noir-contracts 128 ................................................................
13:42:03 noir-contracts 192 ................................................................
13:42:03 noir-contracts 256 ................................................................
13:42:03 noir-contracts 320 ................................................................
13:42:03 noir-contracts 384 ................................................................
13:42:03 noir-contracts 448 ................................................................
13:42:03 noir-contracts 512 ................................................................
13:42:04 noir-contracts 576 ................................................................
13:42:04 noir-contracts 640 ................................................................
13:42:04 noir-contracts 704 ................................................................
13:42:04 noir-contracts 768 ................................................................
13:42:04 noir-contracts 832 ................................................................
13:42:04 noir-contracts 896 ................................................................
13:42:05 noir-contracts 960 ................................................................
13:42:05 noir-contracts 1024 ................................................................
13:42:05 noir-contracts 1088 ................................................................
13:42:05 noir-contracts 1152 ................................................................
13:42:05 noir-contracts 1216 ................................................................
13:42:05 noir-contracts 1280 ................................................................
13:42:05 noir-contracts 1344 ................................................................
13:42:06 noir-contracts 1408 ................................................................
13:42:06 noir-contracts 1472 ................................................................
13:42:06 noir-protocol-circuits 0 ................................................................
13:42:06 noir-protocol-circuits 64 ................................................................
13:42:06 noir-contracts 1536 ................................................................
13:42:06 noir-contracts 1600 .
done (5s)
13:42:07 noir-protocol-circuits 128 ................................................................
13:42:07 noir-protocol-circuits 192 ................................................................
13:42:08 mock-protocol-circuits 0 ................................................................
13:42:08 noir-protocol-circuits 256 ................................................................
13:42:08 aztec-nr 0 .
done (7s)
13:42:08 noir-protocol-circuits 320 ................................................................
13:42:10 noir-protocol-circuits 384 ................................................................
13:42:11 noir-protocol-circuits 448 ................................................................
13:42:12 mock-protocol-circuits 64 ................................................................
13:44:09 noir-protocol-circuits 512 ................................................................
13:44:09 noir-protocol-circuits 576 ................................................................
13:44:09 noir-protocol-circuits 640 .
done (128s)
13:44:17 mock-protocol-circuits 128 .
done (136s)
13:44:17
--- l1-contracts build ---
13:44:18
➤ YN0000: ·
Yarn 4.5.2
13:44:18
➤ YN0000: ┌ Resolution step
13:44:18
➤ YN0000: └ Completed
13:44:18
➤ YN0000: ┌ Fetch step
13:44:18
➤ YN0013: │
134 packages were added to the project (
+ 44.9 MiB).
13:44:18
➤ YN0000: └ Completed in 0s 781ms
13:44:18
➤ YN0000: ┌ Link step
13:44:19
➤ YN0000: └ Completed in 0s 834ms
13:44:19
➤ YN0000: · Done in 1s 678ms
13:44:20 Cache download and extraction of l1-contracts-c0dca769d7442f43.tar.gz complete in 1s.
13:44:20
--- yarn-project build ---
13:44:20 Executing: ./bootstrap.sh clean-lite (
http://ci.aztec-labs.com/a8bf4022fc336eeb)
13:44:20 0 .
done (0s)
13:44:25 Cache download and extraction of node-modules-34bec2a54a394404.zst complete in 5s.
13:44:25 Executing: compile_all (
http://ci.aztec-labs.com/156956a150ca2480)
13:44:28 0 .
done (3s)
13:44:28 boxes/bootstrap.sh Executing: boxes/bootstrap.sh (
http://ci.aztec-labs.com/cc859e16e00a2f85)
13:44:28 playground/bootstrap.sh Executing: playground/bootstrap.sh (
http://ci.aztec-labs.com/ce413bfe525175b6)
13:44:28 docs/bootstrap.sh Executing: docs/bootstrap.sh (
http://ci.aztec-labs.com/2d9ba9bcfcdb8f67)
13:44:28 release-image/bootstrap.sh Executing: release-image/bootstrap.sh (
http://ci.aztec-labs.com/8d2bfaea0ab16150)
13:44:28 spartan/bootstrap.sh Executing: spartan/bootstrap.sh (
http://ci.aztec-labs.com/31b69fd4090918f4)
13:44:28 aztec-up/bootstrap.sh Executing: aztec-up/bootstrap.sh (
http://ci.aztec-labs.com/031c7a2abb6964fe)
13:44:29 aztec-up/bootstrap.sh 0 .
done (1s)
13:44:32 spartan/bootstrap.sh 0 .
done (4s)
13:44:32 boxes/bootstrap.sh 0 .
done (4s)
13:44:32 playground/bootstrap.sh 0 .
done (4s)
13:44:34 docs/bootstrap.sh 0 .
done (6s)
13:45:01 release-image/bootstrap.sh 0 .
done (33s)
13:45:01
--- test all ---
13:45:01 Waiting for TXE's to start...
13:45:04 Gathering tests to run...
13:46:44 Gathered 12176 tests.
13:46:44 Starting parallel run with max 64 jobs...
13:46:44 Executing: parallel -j64 --memsuspend 64G --line-buffer --joblog joblog.txt --halt now,fail=1 'run_test_cmd {}' (
http://ci.aztec-labs.com/8a3ee89ab285e396)
13:47:15 0 ................................................................
13:48:24 64 ................................................................
13:49:28 128 ................................................................
13:50:29 192 ................................................................
13:50:54 256 ................................................................
13:51:06 320 ................................................................
13:51:24 384 ................................................................
13:51:41 448 ................................................................
13:51:48 512 ................................................................
13:51:54 576 ................................................................
13:52:05 640 ................................................................
13:52:13 704 ................................................................
13:52:19 768 ................................................................
13:52:25 832 ................................................................
13:52:32 896 ................................................................
13:52:38 960 ................................................................
13:52:42 1024 ................................................................
13:52:46 1088 ................................................................
13:52:55 1152 ................................................................
13:53:02 1216 ................................................................
13:53:05 1280 ................................................................
13:53:09 1344 ................................................................
13:53:12 1408 ................................................................
13:53:15 1472 ................................................................
13:53:18 1536 ................................................................
13:53:26 1600 ................................................................
13:53:38 1664 ................................................................
13:53:50 1728 ................................................................
13:53:55 1792 ................................................................
13:54:00 1856 ................................................................
13:54:03 1920 ................................................................
13:54:05 1984 ................................................................
13:54:07 2048 ................................................................
13:54:09 2112 ................................................................
13:54:11 2176 ................................................................
13:54:12 2240 ................................................................
13:54:14 2304 ................................................................
13:54:16 2368 ................................................................
13:54:17 2432 ................................................................
13:54:19 2496 ................................................................
13:54:20 2560 ................................................................
13:54:35 2624 ................................................................
13:54:42 2688 ................................................................
13:54:43 2752 ................................................................
13:54:45 2816 ................................................................
13:54:47 2880 ................................................................
13:54:49 2944 ................................................................
13:55:01 3008 ................................................................
13:55:07 3072 ................................................................
13:55:10 3136 ................................................................
13:55:12 3200 ................................................................
13:55:14 3264 ................................................................
13:55:15 3328 ................................................................
13:55:17 3392 ................................................................
13:55:19 3456 ................................................................
13:55:22 3520 ................................................................
13:55:24 3584 ................................................................
13:55:26 3648 ................................................................
13:55:28 3712 ................................................................
13:55:29 3776 ................................................................
13:55:30 3840 ................................................................
13:55:32 3904 ................................................................
13:55:33 3968 ................................................................
13:55:35 4032 ................................................................
13:55:36 4096 ................................................................
13:55:38 4160 ................................................................
13:55:41 4224 ................................................................
13:55:45 4288 ................................................................
13:55:48 4352 ................................................................
13:55:51 4416 ................................................................
13:55:54 4480 ................................................................
13:55:57 4544 ................................................................
13:55:58 4608 ................................................................
13:56:01 4672 ................................................................
13:56:04 4736 ................................................................
13:56:06 4800 ................................................................
13:56:08 4864 ................................................................
13:56:10 4928 ................................................................
13:56:11 4992 ................................................................
13:56:13 5056 ................................................................
13:56:15 5120 ................................................................
13:56:17 5184 ................................................................
13:56:18 5248 ................................................................
13:56:20 5312 ................................................................
13:56:21 5376 ................................................................
13:56:22 5440 ................................................................
13:56:25 5504 ................................................................
13:56:27 5568 ................................................................
13:56:29 5632 ................................................................
13:56:31 5696 ................................................................
13:56:34 5760 ................................................................
13:56:36 5824 ................................................................
13:56:38 5888 ................................................................
13:56:40 5952 ................................................................
13:56:42 6016 ................................................................
13:56:45 6080 ................................................................
13:56:47 6144 ................................................................
13:56:50 6208 ................................................................
13:56:52 6272 ................................................................
13:56:54 6336 ................................................................
13:56:57 6400 ................................................................
13:56:59 6464 ................................................................
13:57:02 6528 ................................................................
13:57:05 6592 ................................................................
13:57:08 6656 ................................................................
13:57:11 6720 ................................................................
13:57:13 6784 ................................................................
13:57:15 6848 ................................................................
13:57:17 6912 ................................................................
13:57:19 6976 ................................................................
13:57:21 7040 ................................................................
13:57:23 7104 ................................................................
13:57:25 7168 ................................................................
13:57:27 7232 ................................................................
13:57:28 7296 ................................................................
13:57:29 7360 ................................................................
13:57:30 7424 ................................................................
13:57:32 7488 ................................................................
13:57:33 7552 ................................................................
13:57:34 7616 ................................................................
13:57:36 7680 ................................................................
13:57:37 7744 ................................................................
13:57:38 7808 ................................................................
13:57:39 7872 ................................................................
13:57:41 7936 ................................................................
13:57:42 8000 ................................................................
13:57:43 8064 ................................................................
13:57:45 8128 ................................................................
13:57:46 8192 ................................................................
13:57:47 8256 ................................................................
13:57:49 8320 ................................................................
13:57:50 8384 ................................................................
13:57:51 8448 ................................................................
13:57:53 8512 ................................................................
13:57:54 8576 ................................................................
13:57:55 8640 ................................................................
13:57:56 8704 ................................................................
13:57:57 8768 ................................................................
13:57:58 8832 ................................................................
13:58:00 8896 ................................................................
13:58:01 8960 ................................................................
13:58:02 9024 ................................................................
13:58:04 9088 ................................................................
13:58:05 9152 ................................................................
13:58:07 9216 ................................................................
13:58:08 9280 ................................................................
13:58:10 9344 ................................................................
13:58:11 9408 ................................................................
13:58:12 9472 ................................................................
13:58:14 9536 ................................................................
13:58:15 9600 ................................................................
13:58:17 9664 ................................................................
13:58:19 9728 ................................................................
13:58:21 9792 ................................................................
13:58:22 9856 ................................................................
13:58:24 9920 ................................................................
13:58:25 9984 ................................................................
13:58:26 10048 ................................................................
13:58:27 10112 ................................................................
13:58:28 10176 ................................................................
13:58:29 10240 ................................................................
13:58:31 10304 ................................................................
13:58:32 10368 ................................................................
13:58:33 10432 ................................................................
13:58:34 10496 ................................................................
13:58:36 10560 ................................................................
13:58:37 10624 ................................................................
13:58:38 10688 ................................................................
13:58:40 10752 ................................................................
13:58:41 10816 ................................................................
13:58:42 10880 ................................................................
13:58:43 10944 ................................................................
13:58:44 11008 ................................................................
13:58:45 11072 ................................................................
13:58:46 11136 ................................................................
13:58:47 11200 ................................................................
13:58:49 11264 ................................................................
13:58:50 11328 ................................................................
13:58:51 11392 ................................................................
13:58:52 11456 ................................................................
13:58:53 11520 ................................................................
13:58:54 11584 ................................................................
13:58:55 11648 ................................................................
13:58:57 11712 ................................................................
13:58:58 11776 ................................................................
13:58:59 11840 ................................................................
13:59:00 11904 ................................................................
13:59:01 11968 ................................................................
13:59:02 12032 ................................................................
13:59:03 12096 ................................................................
13:59:04 12160 ................................................................
13:59:05 12224 ................................................................
13:59:06 12288 ................................................................
13:59:07 12352 ................................................................
14:01:39 12416 .
done (895s)
14:01:39
WARNING: The following tests exceed 5 minute runtimes. Break them up or rethink them.
14:01:39 305.284: 'b7fb67cfac1bc3bc noir-projects/scripts/run_test.sh noir-protocol-circuits rollup_lib block_root::block_root_rollup_inputs::tests::correct_blobs_with_non_empty_fields'
14:01:39 305.365: '270716767bef7882:ISOLATE=1:NAME=e2e_p2p/validators_sentinel yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/validators_sentinel.test.ts'
14:01:39 317.993: 'd9adb066b7d7e95a barretenberg/cpp/scripts/run_test.sh dsl_tests AcirAvm2RecursionConstraint.TestGenerateVKFromConstraintsWithoutWitness'
14:01:39 339.856: '270716767bef7882:ISOLATE=1:NAME=e2e_p2p/data_withholding_slash yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/data_withholding_slash.test.ts'
14:01:39 345.582: '478b4dcee41f7ecc:ONLY_TERM_PARENT=1 BOX=vanilla BROWSER=* run_compose_test vanilla-all-browsers box boxes'
14:01:39 361.463: 'd9adb066b7d7e95a:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityPassing'
14:01:39 362.361: '82785b4eeeba405f aztec-up/scripts/run_test.sh amm_flow'
14:01:39 369.599: 'd9adb066b7d7e95a:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityFailing'
14:01:39 412.151: '270716767bef7882:ISOLATE=1:TIMEOUT=15m:NAME=e2e_block_building yarn-project/end-to-end/scripts/run_test.sh simple e2e_block_building'
14:01:39 430.569: '270716767bef7882:ISOLATE=1:NAME=e2e_p2p/reex yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/reex.test.ts'
14:01:39 442.565: '270716767bef7882:ISOLATE=1:NAME=prover-client/src/test/bb_prover_full_rollup.test.ts:CPUS=16:MEM=96g LOG_LEVEL=verbose yarn-project/scripts/run_test.sh prover-client/src/test/bb_prover_full_rollup.test.ts'
14:01:39 444.089: '270716767bef7882:ISOLATE=1:NAME=e2e_l1_with_wall_time yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_l1_with_wall_time.test.ts'
14:01:39 731.835: '270716767bef7882:ISOLATE=1:TIMEOUT=15m:CPUS=16:MEM=96g:NAME=e2e_prover_full_real yarn-project/end-to-end/scripts/run_test.sh simple e2e_prover/full'
14:01:39 Completed run of 12176 tests in 895 seconds.
14:01:39
--- bench all ---
14:01:39 barretenberg/cpp Executing: barretenberg/cpp/bootstrap.sh build_bench (
http://ci.aztec-labs.com/3f21d679a688fdef)
14:01:39 yarn-project/end-to-end Executing: yarn-project/end-to-end/bootstrap.sh build_bench (
http://ci.aztec-labs.com/ffe0fb89bb361876)
14:01:40 yarn-project/end-to-end 0 .
done (1s)
14:01:40 barretenberg/cpp 0 .
done (1s)
14:01:41 Starting parallel run using max 64 cpus...
14:01:42 Test run log id:
http://ci.aztec-labs.com/9cb9a42bd8b920ee
14:06:46 Completed run of 95 tests in 305 seconds.
14:06:49 Completed 7.7 KiB/7.7 KiB (75.1 KiB/s) with 1 file(s) remaining
upload: ../../../tmp/tmp.ODqMDety6H to s3://aztec-ci-artifacts/build-cache/bench-1c2c2ee2949dbe31742cc9501a31bf3bce8083cf.tar.gz
14:06:49 Cache upload of bench-1c2c2ee2949dbe31742cc9501a31bf3bce8083cf.tar.gz complete in 1s.
14:06:49 + local code=0
14:06:49 + set +x
14:06:49 dmesg log id:
http://ci.aztec-labs.com/64e2b078c8cf7c16
CI run log id:
http://ci.aztec-labs.com/1750772472386
+ code=0
+ case $code in
+ log_ci_run PASSED 1750772472386
+ exit 0
SSH exited with code: 0
Terminating instance: i-0a97634b674f5023f...