Parent Log:
http://ci.aztec-labs.com/15782013234
Command: bootstrap_ec2 './bootstrap.sh ci-full'
Date: Fri Jun 20 15:46:19 UTC 2025
Status: 0
Took: 2125s
--- request build instance ---
Requesting m6a.32xlarge spot instance (name: pr-15154_amd64_x4-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for instance id for spot request: sir-68e74fng...
Waiting for SSH at 3.145.186.24...
Stdout is not a tty, running in background...
Loading CRS into tmpfs...
Done in 17 seconds.
Stdout is not a tty, starting build container in background...
Starting devbox...
From
https://github.com/aztecprotocol/aztec-packages
* branch 28bf32bfc2566751e8baa0a9125a9db20d474bee -> FETCH_HEAD
HEAD is now at 28bf32b feat: auto-update exported metrics (#15154)
Switched to a new branch 'gh-readonly-queue/next/pr-15154-9071986bfe3af58c70d2c80c10f523e22bfe4cb4'
+ run
+ ci3/add_timestamps
+ DUP=1
+ ci3/cache_log 'CI run' 1750432314805
CI run log id:
http://ci.aztec-labs.com/1750432314805
15:11:54 + echo 'env: REF_NAME=gh-readonly-queue/next/pr-15154-9071986bfe3af58c70d2c80c10f523e22bfe4cb4 COMMIT_HASH=28bf32bfc2566751e8baa0a9125a9db20d474bee CURRENT_VERSION=0.87.6 TARGET_BRANCH=next'
15:11:54 env: REF_NAME=gh-readonly-queue/next/pr-15154-9071986bfe3af58c70d2c80c10f523e22bfe4cb4 COMMIT_HASH=28bf32bfc2566751e8baa0a9125a9db20d474bee CURRENT_VERSION=0.87.6 TARGET_BRANCH=next
15:11:54 + semver check gh-readonly-queue/next/pr-15154-9071986bfe3af58c70d2c80c10f523e22bfe4cb4
15:11:54 + cpu_pid=418
15:11:54 + mpstat 2
15:11:54 + mem_pid=419
15:11:54 + set +e
15:11:54 + set -x
15:11:54 + ./bootstrap.sh ci-full
15:11:54 + vmstat -w -S M 2
15:11:54 ++ cache_log cpufile
15:11:54 ++ cache_log memfile
15:11:54 memfile log id:
http://ci.aztec-labs.com/78be738570fa4aa0
15:11:54 cpufile log id:
http://ci.aztec-labs.com/75f70362a24b2e28
15:12:02
--- pull submodules ---
15:12:02 Executing: git submodule update --init --recursive (
http://ci.aztec-labs.com/3dc3968543c515b9)
15:12:11 0 .
done (9s)
15:12:12
--- noir build ---
15:12:12 Executing: retry install_deps (
http://ci.aztec-labs.com/4915a921f96ff69b)
15:12:16 0 .
done (4s)
15:12:17 build_native Executing: build_native (
http://ci.aztec-labs.com/70e55b257a6b1904)
15:12:17 build_packages Executing: build_packages (
http://ci.aztec-labs.com/2807d28d14078acf)
15:12:17 build_native 0 .
done (0s)
15:12:23 build_packages 0 .
done (6s)
15:12:24
--- bb cpp build ---
15:12:24 build_nodejs_module Executing: build_nodejs_module (
http://ci.aztec-labs.com/df52f36dd48a9f0e)
15:12:24 build_native Executing: build_native (
http://ci.aztec-labs.com/ab666c005b3d8e8e)
15:12:24 build_wasm Executing: build_wasm (
http://ci.aztec-labs.com/39959d0a4e7a1008)
15:12:24 build_wasm_threads Executing: build_wasm_threads (
http://ci.aztec-labs.com/be5e60f2430af9fc)
15:12:24 build_gcc_syntax_check_only Executing: build_gcc_syntax_check_only (
http://ci.aztec-labs.com/65d4b7103671725e)
15:12:24 build_fuzzing_syntax_check_only Executing: build_fuzzing_syntax_check_only (
http://ci.aztec-labs.com/ea85138e7c2387ef)
15:12:24 build_asan_fast Executing: build_asan_fast (
http://ci.aztec-labs.com/de386e82fdc98a1c)
15:12:24 build_darwin Executing: build_darwin (
http://ci.aztec-labs.com/9c50bbdb93c61d7b)
15:12:24 build_gcc_syntax_check_only 0 .
done (0s)
15:12:24 build_fuzzing_syntax_check_only 0 .
done (0s)
15:12:25 build_darwin 0 .
done (1s)
15:12:25 build_wasm 0 .
done (1s)
15:12:25 build_wasm_threads 0 .
done (1s)
15:12:25 build_nodejs_module 0 .
done (1s)
15:12:26 build_native 0 .
done (1s)
15:12:26 build_asan_fast 0 .
done (2s)
15:12:30
--- bb.js build ---
15:12:32 Cache download and extraction of node-modules-e85320bda7d59d54.zst complete in 1s.
15:12:32 Cache download and extraction of bb.js-ee60cf044fbe25d5.tar.gz complete in 0s.
15:12:33
--- acir_tests build ---
15:12:33 Cache download and extraction of barretenberg-acir-tests-95b8ad4482daac2e.tar.gz complete in 0s.
15:12:35 Cache download and extraction of node-modules-fec19dc5fe5a76d5.zst complete in 1s.
15:12:35 browser-test-app Executing: yarn build (
http://ci.aztec-labs.com/ace07cd8746f1829)
15:12:35 bbjs-test Executing: yarn build (
http://ci.aztec-labs.com/3cd0623172d4bccb)
15:12:38 bbjs-test 0 .
done (3s)
15:12:40 browser-test-app 0 .
done (5s)
15:12:40
--- avm-transpiler build ---
15:12:40 Cache download and extraction of avm-transpiler-6867cd9272ea7ebd.tar.gz complete in 0s.
15:12:40
--- noir-projects build ---
15:12:40 Executing: prep (
http://ci.aztec-labs.com/bc11555054f4f28d)
15:12:43 0 .
done (3s)
15:12:44 mock-protocol-circuits Executing: ./mock-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/5c6d6c0cfc46bdc3)
15:12:44 noir-protocol-circuits Executing: ./noir-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/6549844eaab78caf)
15:12:44 noir-contracts Executing: ./noir-contracts/bootstrap.sh (
http://ci.aztec-labs.com/b82b116512a64409)
15:12:44 aztec-nr Executing: ./aztec-nr/bootstrap.sh (
http://ci.aztec-labs.com/45ac1f6809506d3c)
15:12:45 noir-contracts 0 ................................................................
15:12:45 noir-contracts 64 ................................................................
15:12:45 noir-contracts 128 ................................................................
15:12:46 noir-contracts 192 ................................................................
15:12:46 noir-contracts 256 ................................................................
15:12:46 noir-contracts 320 ................................................................
15:12:47 noir-contracts 384 ................................................................
15:12:47 noir-contracts 448 ................................................................
15:12:47 noir-contracts 512 ................................................................
15:12:47 noir-contracts 576 ................................................................
15:12:47 noir-contracts 640 ................................................................
15:12:47 noir-contracts 704 ................................................................
15:12:48 noir-contracts 768 ................................................................
15:12:48 noir-contracts 832 ................................................................
15:12:48 noir-contracts 896 ................................................................
15:12:48 noir-contracts 960 ................................................................
15:12:48 noir-contracts 1024 ................................................................
15:12:49 noir-contracts 1088 ................................................................
15:12:49 noir-contracts 1152 ................................................................
15:12:49 noir-contracts 1216 ................................................................
15:12:49 noir-contracts 1280 ................................................................
15:12:49 noir-protocol-circuits 0 ................................................................
15:12:49 noir-protocol-circuits 64 ................................................................
15:12:49 noir-contracts 1344 ................................................................
15:12:49 noir-contracts 1408 ................................................................
15:12:50 noir-contracts 1472 ................................................................
15:12:50 noir-protocol-circuits 128 ................................................................
15:12:50 noir-contracts 1536 ................................................................
15:12:50 noir-contracts 1600 .
done (6s)
15:12:50 noir-protocol-circuits 192 ................................................................
15:12:51 noir-protocol-circuits 256 ................................................................
15:12:51 mock-protocol-circuits 0 ................................................................
15:12:51 aztec-nr 0 .
done (7s)
15:12:52 noir-protocol-circuits 320 ................................................................
15:12:53 noir-protocol-circuits 384 ................................................................
15:12:55 noir-protocol-circuits 448 ................................................................
15:12:57 mock-protocol-circuits 64 ................................................................
15:15:27 noir-protocol-circuits 512 ................................................................
15:15:27 noir-protocol-circuits 576 ................................................................
15:15:27 noir-protocol-circuits 640 .
done (163s)
15:15:28 mock-protocol-circuits 128 .
done (164s)
15:15:28
--- l1-contracts build ---
15:15:28 Cache download and extraction of l1-contracts-52d0554817b52bf7.tar.gz complete in 0s.
15:15:28
--- yarn-project build ---
15:15:28 Executing: ./bootstrap.sh clean-lite (
http://ci.aztec-labs.com/3bc338c7ca8f67bf)
15:15:29 0 .
done (0s)
15:15:33 Cache download and extraction of node-modules-34bec2a54a394404.zst complete in 4s.
15:15:33 Executing: compile_all (
http://ci.aztec-labs.com/b97065aff7b0c6a3)
15:15:44 0 ................................................................
15:18:07 64 .
done (154s)
15:18:07 playground/bootstrap.sh Executing: playground/bootstrap.sh (
http://ci.aztec-labs.com/ec81595e9a2c59b0)
15:18:07 boxes/bootstrap.sh Executing: boxes/bootstrap.sh (
http://ci.aztec-labs.com/7f21e66f8b7b1d81)
15:18:07 docs/bootstrap.sh Executing: docs/bootstrap.sh (
http://ci.aztec-labs.com/b8a8f66530b2153f)
15:18:07 release-image/bootstrap.sh Executing: release-image/bootstrap.sh (
http://ci.aztec-labs.com/844400a21d02f5f4)
15:18:07 spartan/bootstrap.sh Executing: spartan/bootstrap.sh (
http://ci.aztec-labs.com/aed38a683eb22198)
15:18:07 aztec-up/bootstrap.sh Executing: aztec-up/bootstrap.sh (
http://ci.aztec-labs.com/f393397770852f47)
15:18:08 aztec-up/bootstrap.sh 0 .
done (1s)
15:18:11 spartan/bootstrap.sh 0 .
done (4s)
15:18:15 docs/bootstrap.sh 0 .
done (8s)
15:18:40 release-image/bootstrap.sh 0 .
done (33s)
15:18:48 boxes/bootstrap.sh 0 .
done (41s)
15:19:02 playground/bootstrap.sh 0 .
done (55s)
15:19:02
--- test all ---
15:19:02 Waiting for TXE's to start...
15:19:06 Gathering tests to run...
15:20:47 Gathered 12132 tests.
15:20:47 Starting parallel run with max 64 jobs...
15:20:47 Executing: parallel -j64 --memsuspend 64G --line-buffer --joblog joblog.txt --halt now,fail=1 'run_test_cmd {}' (
http://ci.aztec-labs.com/7a25bc159312f3ac)
15:21:18 0 ................................................................
15:22:28 64 ................................................................
15:23:31 128 ................................................................
15:24:34 192 ................................................................
15:25:00 256 ................................................................
15:25:12 320 ................................................................
15:25:30 384 ................................................................
15:25:46 448 ................................................................
15:25:53 512 ................................................................
15:26:00 576 ................................................................
15:26:11 640 ................................................................
15:26:21 704 ................................................................
15:26:28 768 ................................................................
15:26:33 832 ................................................................
15:26:41 896 ................................................................
15:26:48 960 ................................................................
15:26:54 1024 ................................................................
15:26:57 1088 ................................................................
15:27:06 1152 ................................................................
15:27:14 1216 ................................................................
15:27:17 1280 ................................................................
15:27:22 1344 ................................................................
15:27:25 1408 ................................................................
15:27:28 1472 ................................................................
15:27:32 1536 ................................................................
15:27:40 1600 ................................................................
15:27:48 1664 ................................................................
15:28:05 1728 ................................................................
15:28:10 1792 ................................................................
15:28:16 1856 ................................................................
15:28:19 1920 ................................................................
15:28:21 1984 ................................................................
15:28:22 2048 ................................................................
15:28:24 2112 ................................................................
15:28:26 2176 ................................................................
15:28:27 2240 ................................................................
15:28:30 2304 ................................................................
15:28:31 2368 ................................................................
15:28:33 2432 ................................................................
15:28:34 2496 ................................................................
15:28:35 2560 ................................................................
15:28:45 2624 ................................................................
15:28:48 2688 ................................................................
15:28:49 2752 ................................................................
15:28:51 2816 ................................................................
15:28:52 2880 ................................................................
15:28:56 2944 ................................................................
15:29:15 3008 ................................................................
15:29:20 3072 ................................................................
15:29:23 3136 ................................................................
15:29:24 3200 ................................................................
15:29:26 3264 ................................................................
15:29:28 3328 ................................................................
15:29:29 3392 ................................................................
15:29:32 3456 ................................................................
15:29:35 3520 ................................................................
15:29:38 3584 ................................................................
15:29:40 3648 ................................................................
15:29:41 3712 ................................................................
15:29:43 3776 ................................................................
15:29:44 3840 ................................................................
15:29:45 3904 ................................................................
15:29:47 3968 ................................................................
15:29:48 4032 ................................................................
15:29:50 4096 ................................................................
15:29:52 4160 ................................................................
15:29:57 4224 ................................................................
15:30:01 4288 ................................................................
15:30:05 4352 ................................................................
15:30:07 4416 ................................................................
15:30:10 4480 ................................................................
15:30:12 4544 ................................................................
15:30:14 4608 ................................................................
15:30:17 4672 ................................................................
15:30:19 4736 ................................................................
15:30:21 4800 ................................................................
15:30:24 4864 ................................................................
15:30:26 4928 ................................................................
15:30:28 4992 ................................................................
15:30:30 5056 ................................................................
15:30:32 5120 ................................................................
15:30:33 5184 ................................................................
15:30:35 5248 ................................................................
15:30:36 5312 ................................................................
15:30:38 5376 ................................................................
15:30:39 5440 ................................................................
15:30:42 5504 ................................................................
15:30:45 5568 ................................................................
15:30:47 5632 ................................................................
15:30:50 5696 ................................................................
15:30:52 5760 ................................................................
15:30:54 5824 ................................................................
15:30:57 5888 ................................................................
15:30:59 5952 ................................................................
15:31:01 6016 ................................................................
15:31:03 6080 ................................................................
15:31:06 6144 ................................................................
15:31:09 6208 ................................................................
15:31:11 6272 ................................................................
15:31:14 6336 ................................................................
15:31:16 6400 ................................................................
15:31:19 6464 ................................................................
15:31:22 6528 ................................................................
15:31:25 6592 ................................................................
15:31:28 6656 ................................................................
15:31:30 6720 ................................................................
15:31:32 6784 ................................................................
15:31:35 6848 ................................................................
15:31:37 6912 ................................................................
15:31:39 6976 ................................................................
15:31:41 7040 ................................................................
15:31:43 7104 ................................................................
15:31:45 7168 ................................................................
15:31:47 7232 ................................................................
15:31:48 7296 ................................................................
15:31:49 7360 ................................................................
15:31:50 7424 ................................................................
15:31:52 7488 ................................................................
15:31:53 7552 ................................................................
15:31:54 7616 ................................................................
15:31:55 7680 ................................................................
15:31:57 7744 ................................................................
15:31:58 7808 ................................................................
15:31:59 7872 ................................................................
15:32:01 7936 ................................................................
15:32:02 8000 ................................................................
15:32:03 8064 ................................................................
15:32:04 8128 ................................................................
15:32:05 8192 ................................................................
15:32:07 8256 ................................................................
15:32:08 8320 ................................................................
15:32:09 8384 ................................................................
15:32:10 8448 ................................................................
15:32:12 8512 ................................................................
15:32:13 8576 ................................................................
15:32:14 8640 ................................................................
15:32:15 8704 ................................................................
15:32:16 8768 ................................................................
15:32:17 8832 ................................................................
15:32:18 8896 ................................................................
15:32:20 8960 ................................................................
15:32:21 9024 ................................................................
15:32:22 9088 ................................................................
15:32:24 9152 ................................................................
15:32:25 9216 ................................................................
15:32:27 9280 ................................................................
15:32:28 9344 ................................................................
15:32:29 9408 ................................................................
15:32:31 9472 ................................................................
15:32:32 9536 ................................................................
15:32:34 9600 ................................................................
15:32:36 9664 ................................................................
15:32:37 9728 ................................................................
15:32:39 9792 ................................................................
15:32:40 9856 ................................................................
15:32:42 9920 ................................................................
15:32:43 9984 ................................................................
15:32:44 10048 ................................................................
15:32:45 10112 ................................................................
15:32:46 10176 ................................................................
15:32:47 10240 ................................................................
15:32:48 10304 ................................................................
15:32:49 10368 ................................................................
15:32:50 10432 ................................................................
15:32:52 10496 ................................................................
15:32:53 10560 ................................................................
15:32:55 10624 ................................................................
15:32:56 10688 ................................................................
15:32:57 10752 ................................................................
15:32:58 10816 ................................................................
15:32:59 10880 ................................................................
15:33:00 10944 ................................................................
15:33:01 11008 ................................................................
15:33:02 11072 ................................................................
15:33:03 11136 ................................................................
15:33:05 11200 ................................................................
15:33:06 11264 ................................................................
15:33:07 11328 ................................................................
15:33:08 11392 ................................................................
15:33:09 11456 ................................................................
15:33:10 11520 ................................................................
15:33:11 11584 ................................................................
15:33:12 11648 ................................................................
15:33:13 11712 ................................................................
15:33:15 11776 ................................................................
15:33:16 11840 ................................................................
15:33:17 11904 ................................................................
15:33:18 11968 ................................................................
15:33:19 12032 ................................................................
15:33:20 12096 ................................................................
15:33:21 12160 ................................................................
15:33:22 12224 ................................................................
15:33:23 12288 ................................................................
15:35:58 12352 .
done (911s)
15:35:58
WARNING: The following tests exceed 5 minute runtimes. Break them up or rethink them.
15:35:58 305.967: '55a5c1e5cd3f3ca6:ISOLATE=1:NAME=e2e_p2p/validators_sentinel yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/validators_sentinel.test.ts'
15:35:58 325.565: 'f6d0f30efb64f09d noir-projects/scripts/run_test.sh noir-protocol-circuits rollup_lib block_root::block_root_rollup_inputs::tests::correct_blobs_with_non_empty_fields'
15:35:58 342.223: '55a5c1e5cd3f3ca6:ISOLATE=1:NAME=e2e_p2p/data_withholding_slash yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/data_withholding_slash.test.ts'
15:35:58 350.506: '24d076b411d925ca:ONLY_TERM_PARENT=1 BOX=vanilla BROWSER=* run_compose_test vanilla-all-browsers box boxes'
15:35:58 358.233: 'ebb2d5bf21766e6e barretenberg/cpp/scripts/run_test.sh dsl_tests AcirAvm2RecursionConstraint.TestGenerateVKFromConstraintsWithoutWitness'
15:35:58 384.961: 'ebb2d5bf21766e6e:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityPassing'
15:35:58 387.492: '9945abf2c88d4de8 aztec-up/scripts/run_test.sh amm_flow'
15:35:58 389.591: 'ebb2d5bf21766e6e:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityFailing'
15:35:58 398.851: '55a5c1e5cd3f3ca6:ISOLATE=1:NAME=p2p/src/client/p2p_client.integration.test.ts LOG_LEVEL=debug yarn-project/scripts/run_test.sh p2p/src/client/p2p_client.integration.test.ts'
15:35:58 410.726: '55a5c1e5cd3f3ca6:ISOLATE=1:TIMEOUT=15m:NAME=e2e_block_building yarn-project/end-to-end/scripts/run_test.sh simple e2e_block_building'
15:35:58 430.233: '55a5c1e5cd3f3ca6:ISOLATE=1:NAME=e2e_p2p/reex yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/reex.test.ts'
15:35:58 445.649: '55a5c1e5cd3f3ca6:ISOLATE=1:NAME=e2e_l1_with_wall_time yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_l1_with_wall_time.test.ts'
15:35:58 456.946: '55a5c1e5cd3f3ca6:ISOLATE=1:NAME=prover-client/src/test/bb_prover_full_rollup.test.ts:CPUS=16:MEM=96g LOG_LEVEL=verbose yarn-project/scripts/run_test.sh prover-client/src/test/bb_prover_full_rollup.test.ts'
15:35:58 781.224: '55a5c1e5cd3f3ca6:ISOLATE=1:TIMEOUT=15m:CPUS=16:MEM=96g:NAME=e2e_prover_full_real yarn-project/end-to-end/scripts/run_test.sh simple e2e_prover/full'
15:35:58 Completed run of 12132 tests in 911 seconds.
15:35:58
--- bench all ---
15:35:58 barretenberg/cpp Executing: barretenberg/cpp/bootstrap.sh build_bench (
http://ci.aztec-labs.com/515ba8e46dee0824)
15:35:58 yarn-project/end-to-end Executing: yarn-project/end-to-end/bootstrap.sh build_bench (
http://ci.aztec-labs.com/21d1e70983f32248)
15:35:59 barretenberg/cpp 0 .
done (1s)
15:38:08 yarn-project/end-to-end 0 ................................................................
15:40:53 yarn-project/end-to-end 64 .
done (295s)
15:40:54 Starting parallel run using max 64 cpus...
15:40:54 Test run log id:
http://ci.aztec-labs.com/f9dba58b2080f00c
15:46:07 Completed run of 95 tests in 313 seconds.
15:46:10 Completed 7.6 KiB/7.6 KiB (120.6 KiB/s) with 1 file(s) remaining
upload: ../../../tmp/tmp.OxYhvm32SC to s3://aztec-ci-artifacts/build-cache/bench-28bf32bfc2566751e8baa0a9125a9db20d474bee.tar.gz
15:46:10 Cache upload of bench-28bf32bfc2566751e8baa0a9125a9db20d474bee.tar.gz complete in 2s.
15:46:10 + local code=0
15:46:10 + set +x
15:46:10 dmesg log id:
http://ci.aztec-labs.com/ff5ffbf37ba1cfb9
CI run log id:
http://ci.aztec-labs.com/1750432314805
+ code=0
+ case $code in
+ log_ci_run PASSED 1750432314805
+ exit 0
SSH exited with code: 0
Terminating instance: i-0d92753af554cb780...