Parent Log:
http://ci.aztec-labs.com/15779663990
Command: bootstrap_ec2 './bootstrap.sh ci-full'
Date: Fri Jun 20 13:36:05 UTC 2025
Status: 0
Took: 1647s
--- request build instance ---
Requesting m6a.32xlarge spot instance (name: pr-15181_amd64_x4-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for instance id for spot request: sir-be1f6e6g...
Waiting for SSH at 3.145.101.30...
Stdout is not a tty, running in background...
Loading CRS into tmpfs...
Done in 9 seconds.
Stdout is not a tty, starting build container in background...
Starting devbox...
From
https://github.com/aztecprotocol/aztec-packages
* branch c2e27576e66fad0caaa136e905b8439d70c05e37 -> FETCH_HEAD
HEAD is now at c2e2757 chore(ci): rename fuzzing-docker-build (#15181)
Switched to a new branch 'gh-readonly-queue/next/pr-15181-58696523cc93fda453138a4f2c2dff72b21f0bfa'
+ run
+ ci3/add_timestamps
+ DUP=1
+ ci3/cache_log 'CI run' 1750424962872
CI run log id:
http://ci.aztec-labs.com/1750424962872
13:09:22 + echo 'env: REF_NAME=gh-readonly-queue/next/pr-15181-58696523cc93fda453138a4f2c2dff72b21f0bfa COMMIT_HASH=c2e27576e66fad0caaa136e905b8439d70c05e37 CURRENT_VERSION=0.87.6 TARGET_BRANCH=next'
13:09:22 env: REF_NAME=gh-readonly-queue/next/pr-15181-58696523cc93fda453138a4f2c2dff72b21f0bfa COMMIT_HASH=c2e27576e66fad0caaa136e905b8439d70c05e37 CURRENT_VERSION=0.87.6 TARGET_BRANCH=next
13:09:22 + semver check gh-readonly-queue/next/pr-15181-58696523cc93fda453138a4f2c2dff72b21f0bfa
13:09:22 + cpu_pid=413
13:09:22 + mpstat 2
13:09:22 + mem_pid=414
13:09:22 + set +e
13:09:22 + set -x
13:09:22 + ./bootstrap.sh ci-full
13:09:22 + vmstat -w -S M 2
13:09:22 ++ cache_log cpufile
13:09:23 ++ cache_log memfile
13:09:23 memfile log id:
http://ci.aztec-labs.com/42f98e21fa4faac6
13:09:23 cpufile log id:
http://ci.aztec-labs.com/e75a0cc7c1a7d713
13:09:30
--- pull submodules ---
13:09:30 Executing: git submodule update --init --recursive (
http://ci.aztec-labs.com/290828a1f0867f1f)
13:09:39 0 .
done (9s)
13:09:41
--- noir build ---
13:09:41 Executing: retry install_deps (
http://ci.aztec-labs.com/32970ab22bd11906)
13:09:45 0 .
done (4s)
13:09:45 build_native Executing: build_native (
http://ci.aztec-labs.com/246180f56df4099d)
13:09:45 build_packages Executing: build_packages (
http://ci.aztec-labs.com/a46d42e84cb9a2a0)
13:09:46 build_native 0 .
done (1s)
13:09:52 build_packages 0 .
done (7s)
13:09:53
--- bb cpp build ---
13:09:53 build_wasm Executing: build_wasm (
http://ci.aztec-labs.com/3af14f9e1a76c09a)
13:09:53 build_native Executing: build_native (
http://ci.aztec-labs.com/b8e20c4e26f347e1)
13:09:53 build_wasm_threads Executing: build_wasm_threads (
http://ci.aztec-labs.com/5e22b42504668eba)
13:09:53 build_nodejs_module Executing: build_nodejs_module (
http://ci.aztec-labs.com/ce100fc0fa79d0d6)
13:09:53 build_gcc_syntax_check_only Executing: build_gcc_syntax_check_only (
http://ci.aztec-labs.com/da7fda1997454cce)
13:09:53 build_fuzzing_syntax_check_only Executing: build_fuzzing_syntax_check_only (
http://ci.aztec-labs.com/930e1443b602088e)
13:09:53 build_asan_fast Executing: build_asan_fast (
http://ci.aztec-labs.com/26eebbf652538fbf)
13:09:53 build_darwin Executing: build_darwin (
http://ci.aztec-labs.com/a6f9c6e4e3eb241b)
13:09:53 build_gcc_syntax_check_only 0 .
done (0s)
13:09:53 build_fuzzing_syntax_check_only 0 .
done (0s)
13:09:54 build_darwin 0 .
done (1s)
13:09:54 build_wasm_threads 0 .
done (1s)
13:09:54 build_wasm 0 .
done (1s)
13:09:54 build_nodejs_module 0 .
done (1s)
13:09:54 build_native 0 .
done (1s)
13:09:55 build_asan_fast 0 .
done (2s)
13:10:00
--- bb.js build ---
13:10:01 Cache download and extraction of node-modules-e85320bda7d59d54.zst complete in 1s.
13:10:01 Cache download and extraction of bb.js-7cabe67228ed2cf3.tar.gz complete in 0s.
13:10:03
--- acir_tests build ---
13:10:03 Cache download and extraction of barretenberg-acir-tests-7d5511b6125e191e.tar.gz complete in 0s.
13:10:04 Cache download and extraction of node-modules-fec19dc5fe5a76d5.zst complete in 1s.
13:10:04 browser-test-app Executing: yarn build (
http://ci.aztec-labs.com/edb1faa8577066b1)
13:10:04 bbjs-test Executing: yarn build (
http://ci.aztec-labs.com/8f321636c6663e38)
13:10:07 bbjs-test 0 .
done (3s)
13:10:09 browser-test-app 0 .
done (5s)
13:10:09
--- avm-transpiler build ---
13:10:10 Cache download and extraction of avm-transpiler-6867cd9272ea7ebd.tar.gz complete in 0s.
13:10:10
--- noir-projects build ---
13:10:10 Executing: prep (
http://ci.aztec-labs.com/5276b9d1b3c6a26a)
13:10:13 0 .
done (3s)
13:10:13 mock-protocol-circuits Executing: ./mock-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/2cc1bcff303ca6e4)
13:10:13 noir-protocol-circuits Executing: ./noir-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/48a76a921f4903c7)
13:10:13 noir-contracts Executing: ./noir-contracts/bootstrap.sh (
http://ci.aztec-labs.com/70ba241c7c7683ea)
13:10:13 aztec-nr Executing: ./aztec-nr/bootstrap.sh (
http://ci.aztec-labs.com/76f077e6ee1e492a)
13:10:15 noir-contracts 0 ................................................................
13:10:15 noir-contracts 64 ................................................................
13:10:15 noir-contracts 128 ................................................................
13:10:15 noir-contracts 192 ................................................................
13:10:16 noir-contracts 256 ................................................................
13:10:16 noir-contracts 320 ................................................................
13:10:16 noir-contracts 384 ................................................................
13:10:16 noir-contracts 448 ................................................................
13:10:16 noir-contracts 512 ................................................................
13:10:16 noir-contracts 576 ................................................................
13:10:17 noir-contracts 640 ................................................................
13:10:17 noir-contracts 704 ................................................................
13:10:17 noir-contracts 768 ................................................................
13:10:18 noir-contracts 832 ................................................................
13:10:18 noir-contracts 896 ................................................................
13:10:18 noir-contracts 960 ................................................................
13:10:18 noir-contracts 1024 ................................................................
13:10:18 noir-contracts 1088 ................................................................
13:10:19 noir-protocol-circuits 0 ................................................................
13:10:19 noir-protocol-circuits 64 ................................................................
13:10:19 noir-contracts 1152 ................................................................
13:10:19 noir-contracts 1216 ................................................................
13:10:19 noir-contracts 1280 ................................................................
13:10:19 noir-contracts 1344 ................................................................
13:10:19 noir-contracts 1408 ................................................................
13:10:19 noir-contracts 1472 ................................................................
13:10:20 noir-protocol-circuits 128 ................................................................
13:10:20 noir-contracts 1536 ................................................................
13:10:20 noir-contracts 1600 .
done (7s)
13:10:20 noir-protocol-circuits 192 ................................................................
13:10:21 noir-protocol-circuits 256 ................................................................
13:10:21 aztec-nr 0 .
done (8s)
13:10:21 mock-protocol-circuits 0 ................................................................
13:10:22 noir-protocol-circuits 320 ................................................................
13:10:23 noir-protocol-circuits 384 ................................................................
13:10:25 noir-protocol-circuits 448 ................................................................
13:10:27 mock-protocol-circuits 64 ................................................................
13:12:54 mock-protocol-circuits 128 .
done (161s)
13:13:00 noir-protocol-circuits 512 ................................................................
13:13:00 noir-protocol-circuits 576 ................................................................
13:13:00 noir-protocol-circuits 640 .
done (166s)
13:13:00
--- l1-contracts build ---
13:13:01 Cache download and extraction of l1-contracts-a5227845f7b33808.tar.gz complete in 1s.
13:13:01
--- yarn-project build ---
13:13:01 Executing: ./bootstrap.sh clean-lite (
http://ci.aztec-labs.com/910da42b01963722)
13:13:01 0 .
done (0s)
13:13:06 Cache download and extraction of node-modules-34bec2a54a394404.zst complete in 5s.
13:13:06 Executing: compile_all (
http://ci.aztec-labs.com/ed71935f3df38640)
13:13:09 0 .
done (3s)
13:13:09 boxes/bootstrap.sh Executing: boxes/bootstrap.sh (
http://ci.aztec-labs.com/906548dcb0a51f16)
13:13:09 playground/bootstrap.sh Executing: playground/bootstrap.sh (
http://ci.aztec-labs.com/d914e6c0ce608470)
13:13:09 docs/bootstrap.sh Executing: docs/bootstrap.sh (
http://ci.aztec-labs.com/a24895c6288365e1)
13:13:09 release-image/bootstrap.sh Executing: release-image/bootstrap.sh (
http://ci.aztec-labs.com/bd8619ca66fda9ba)
13:13:09 spartan/bootstrap.sh Executing: spartan/bootstrap.sh (
http://ci.aztec-labs.com/225aca3e05c2290b)
13:13:09 aztec-up/bootstrap.sh Executing: aztec-up/bootstrap.sh (
http://ci.aztec-labs.com/a2c2968293159992)
13:13:10 aztec-up/bootstrap.sh 0 .
done (1s)
13:13:13 boxes/bootstrap.sh 0 .
done (4s)
13:13:13 spartan/bootstrap.sh 0 .
done (4s)
13:13:14 playground/bootstrap.sh 0 .
done (5s)
13:13:17 docs/bootstrap.sh 0 .
done (7s)
13:13:46 release-image/bootstrap.sh 0 .
done (37s)
13:13:46
--- test all ---
13:13:46 Waiting for TXE's to start...
13:13:49 Gathering tests to run...
13:15:31 Gathered 12132 tests.
13:15:31 Starting parallel run with max 64 jobs...
13:15:31 Executing: parallel -j64 --memsuspend 64G --line-buffer --joblog joblog.txt --halt now,fail=1 'run_test_cmd {}' (
http://ci.aztec-labs.com/4709fb91efd811fe)
13:16:02 0 ................................................................
13:17:11 64 ................................................................
13:18:15 128 ................................................................
13:19:18 192 ................................................................
13:19:42 256 ................................................................
13:19:53 320 ................................................................
13:20:12 384 ................................................................
13:20:27 448 ................................................................
13:20:34 512 ................................................................
13:20:40 576 ................................................................
13:20:52 640 ................................................................
13:21:00 704 ................................................................
13:21:07 768 ................................................................
13:21:13 832 ................................................................
13:21:21 896 ................................................................
13:21:26 960 ................................................................
13:21:33 1024 ................................................................
13:21:36 1088 ................................................................
13:21:46 1152 ................................................................
13:21:53 1216 ................................................................
13:21:56 1280 ................................................................
13:22:00 1344 ................................................................
13:22:03 1408 ................................................................
13:22:07 1472 ................................................................
13:22:10 1536 ................................................................
13:22:18 1600 ................................................................
13:22:28 1664 ................................................................
13:22:43 1728 ................................................................
13:22:49 1792 ................................................................
13:22:54 1856 ................................................................
13:22:56 1920 ................................................................
13:22:58 1984 ................................................................
13:23:01 2048 ................................................................
13:23:03 2112 ................................................................
13:23:05 2176 ................................................................
13:23:07 2240 ................................................................
13:23:09 2304 ................................................................
13:23:11 2368 ................................................................
13:23:12 2432 ................................................................
13:23:14 2496 ................................................................
13:23:15 2560 ................................................................
13:23:25 2624 ................................................................
13:23:28 2688 ................................................................
13:23:29 2752 ................................................................
13:23:30 2816 ................................................................
13:23:32 2880 ................................................................
13:23:35 2944 ................................................................
13:23:56 3008 ................................................................
13:23:59 3072 ................................................................
13:24:02 3136 ................................................................
13:24:04 3200 ................................................................
13:24:06 3264 ................................................................
13:24:08 3328 ................................................................
13:24:09 3392 ................................................................
13:24:11 3456 ................................................................
13:24:15 3520 ................................................................
13:24:17 3584 ................................................................
13:24:19 3648 ................................................................
13:24:21 3712 ................................................................
13:24:22 3776 ................................................................
13:24:24 3840 ................................................................
13:24:25 3904 ................................................................
13:24:26 3968 ................................................................
13:24:28 4032 ................................................................
13:24:29 4096 ................................................................
13:24:32 4160 ................................................................
13:24:35 4224 ................................................................
13:24:40 4288 ................................................................
13:24:43 4352 ................................................................
13:24:46 4416 ................................................................
13:24:49 4480 ................................................................
13:24:51 4544 ................................................................
13:24:53 4608 ................................................................
13:24:56 4672 ................................................................
13:24:58 4736 ................................................................
13:25:01 4800 ................................................................
13:25:03 4864 ................................................................
13:25:05 4928 ................................................................
13:25:07 4992 ................................................................
13:25:09 5056 ................................................................
13:25:11 5120 ................................................................
13:25:13 5184 ................................................................
13:25:15 5248 ................................................................
13:25:16 5312 ................................................................
13:25:18 5376 ................................................................
13:25:19 5440 ................................................................
13:25:23 5504 ................................................................
13:25:25 5568 ................................................................
13:25:27 5632 ................................................................
13:25:30 5696 ................................................................
13:25:32 5760 ................................................................
13:25:34 5824 ................................................................
13:25:36 5888 ................................................................
13:25:39 5952 ................................................................
13:25:41 6016 ................................................................
13:25:43 6080 ................................................................
13:25:45 6144 ................................................................
13:25:48 6208 ................................................................
13:25:51 6272 ................................................................
13:25:54 6336 ................................................................
13:25:56 6400 ................................................................
13:25:59 6464 ................................................................
13:26:01 6528 ................................................................
13:26:05 6592 ................................................................
13:26:07 6656 ................................................................
13:26:10 6720 ................................................................
13:26:12 6784 ................................................................
13:26:14 6848 ................................................................
13:26:16 6912 ................................................................
13:26:19 6976 ................................................................
13:26:21 7040 ................................................................
13:26:23 7104 ................................................................
13:26:25 7168 ................................................................
13:26:26 7232 ................................................................
13:26:27 7296 ................................................................
13:26:29 7360 ................................................................
13:26:30 7424 ................................................................
13:26:32 7488 ................................................................
13:26:33 7552 ................................................................
13:26:34 7616 ................................................................
13:26:35 7680 ................................................................
13:26:37 7744 ................................................................
13:26:38 7808 ................................................................
13:26:39 7872 ................................................................
13:26:41 7936 ................................................................
13:26:42 8000 ................................................................
13:26:43 8064 ................................................................
13:26:44 8128 ................................................................
13:26:46 8192 ................................................................
13:26:47 8256 ................................................................
13:26:48 8320 ................................................................
13:26:50 8384 ................................................................
13:26:51 8448 ................................................................
13:26:52 8512 ................................................................
13:26:53 8576 ................................................................
13:26:55 8640 ................................................................
13:26:56 8704 ................................................................
13:26:57 8768 ................................................................
13:26:58 8832 ................................................................
13:26:59 8896 ................................................................
13:27:00 8960 ................................................................
13:27:02 9024 ................................................................
13:27:03 9088 ................................................................
13:27:05 9152 ................................................................
13:27:06 9216 ................................................................
13:27:07 9280 ................................................................
13:27:09 9344 ................................................................
13:27:10 9408 ................................................................
13:27:12 9472 ................................................................
13:27:13 9536 ................................................................
13:27:15 9600 ................................................................
13:27:17 9664 ................................................................
13:27:18 9728 ................................................................
13:27:20 9792 ................................................................
13:27:22 9856 ................................................................
13:27:23 9920 ................................................................
13:27:24 9984 ................................................................
13:27:25 10048 ................................................................
13:27:26 10112 ................................................................
13:27:27 10176 ................................................................
13:27:28 10240 ................................................................
13:27:30 10304 ................................................................
13:27:31 10368 ................................................................
13:27:32 10432 ................................................................
13:27:34 10496 ................................................................
13:27:35 10560 ................................................................
13:27:36 10624 ................................................................
13:27:37 10688 ................................................................
13:27:39 10752 ................................................................
13:27:40 10816 ................................................................
13:27:41 10880 ................................................................
13:27:42 10944 ................................................................
13:27:43 11008 ................................................................
13:27:44 11072 ................................................................
13:27:45 11136 ................................................................
13:27:46 11200 ................................................................
13:27:47 11264 ................................................................
13:27:49 11328 ................................................................
13:27:50 11392 ................................................................
13:27:51 11456 ................................................................
13:27:52 11520 ................................................................
13:27:53 11584 ................................................................
13:27:54 11648 ................................................................
13:27:56 11712 ................................................................
13:27:57 11776 ................................................................
13:27:58 11840 ................................................................
13:27:59 11904 ................................................................
13:28:00 11968 ................................................................
13:28:01 12032 ................................................................
13:28:02 12096 ................................................................
13:28:03 12160 ................................................................
13:28:04 12224 ................................................................
13:28:05 12288 ................................................................
13:30:37 12352 .
done (906s)
13:30:37
WARNING: The following tests exceed 5 minute runtimes. Break them up or rethink them.
13:30:37 305.281: 'a8cc061dbe484831:ISOLATE=1:NAME=e2e_p2p/validators_sentinel yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/validators_sentinel.test.ts'
13:30:37 309.476: 'f6d0f30efb64f09d noir-projects/scripts/run_test.sh noir-protocol-circuits rollup_lib block_root::block_root_rollup_inputs::tests::correct_blobs_with_non_empty_fields'
13:30:37 341.067: 'a8cc061dbe484831:ISOLATE=1:NAME=e2e_p2p/data_withholding_slash yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/data_withholding_slash.test.ts'
13:30:37 349.426: 'e9297abd416742f6 barretenberg/cpp/scripts/run_test.sh dsl_tests AcirAvm2RecursionConstraint.TestGenerateVKFromConstraintsWithoutWitness'
13:30:37 352.434: 'ae0982473148bd1c:ONLY_TERM_PARENT=1 BOX=vanilla BROWSER=* run_compose_test vanilla-all-browsers box boxes'
13:30:37 368.815: 'e9297abd416742f6:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityPassing'
13:30:37 376.282: 'e9297abd416742f6:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityFailing'
13:30:37 383.418: '7bc4cc182e85e17f aztec-up/scripts/run_test.sh amm_flow'
13:30:37 401.202: 'a8cc061dbe484831:ISOLATE=1:NAME=p2p/src/client/p2p_client.integration.test.ts LOG_LEVEL=debug yarn-project/scripts/run_test.sh p2p/src/client/p2p_client.integration.test.ts'
13:30:37 405.184: 'a8cc061dbe484831:ISOLATE=1:TIMEOUT=15m:NAME=e2e_block_building yarn-project/end-to-end/scripts/run_test.sh simple e2e_block_building'
13:30:37 430.582: 'a8cc061dbe484831:ISOLATE=1:NAME=e2e_p2p/reex yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/reex.test.ts'
13:30:37 445.435: 'a8cc061dbe484831:ISOLATE=1:NAME=e2e_l1_with_wall_time yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_l1_with_wall_time.test.ts'
13:30:37 463.936: 'a8cc061dbe484831:ISOLATE=1:NAME=prover-client/src/test/bb_prover_full_rollup.test.ts:CPUS=16:MEM=96g LOG_LEVEL=verbose yarn-project/scripts/run_test.sh prover-client/src/test/bb_prover_full_rollup.test.ts'
13:30:37 766.914: 'a8cc061dbe484831:ISOLATE=1:TIMEOUT=15m:CPUS=16:MEM=96g:NAME=e2e_prover_full_real yarn-project/end-to-end/scripts/run_test.sh simple e2e_prover/full'
13:30:37 Completed run of 12132 tests in 906 seconds.
13:30:37
--- bench all ---
13:30:38 barretenberg/cpp Executing: barretenberg/cpp/bootstrap.sh build_bench (
http://ci.aztec-labs.com/335df1a8899b388b)
13:30:38 yarn-project/end-to-end Executing: yarn-project/end-to-end/bootstrap.sh build_bench (
http://ci.aztec-labs.com/696dfde3cd6e9fa0)
13:30:39 barretenberg/cpp 0 .
done (1s)
13:30:39 yarn-project/end-to-end 0 .
done (1s)
13:30:40 Starting parallel run using max 64 cpus...
13:30:40 Test run log id:
http://ci.aztec-labs.com/6436613d99d375b3
13:35:52 Completed run of 95 tests in 312 seconds.
13:35:55 Completed 7.6 KiB/7.6 KiB (108.8 KiB/s) with 1 file(s) remaining
upload: ../../../tmp/tmp.JYoUGoIpJS to s3://aztec-ci-artifacts/build-cache/bench-c2e27576e66fad0caaa136e905b8439d70c05e37.tar.gz
13:35:55 Cache upload of bench-c2e27576e66fad0caaa136e905b8439d70c05e37.tar.gz complete in 1s.
13:35:55 + local code=0
13:35:55 + set +x
13:35:55 dmesg log id:
http://ci.aztec-labs.com/2c4bfd4e59ac85ea
CI run log id:
http://ci.aztec-labs.com/1750424962872
+ code=0
+ case $code in
+ log_ci_run PASSED 1750424962872
+ exit 0
SSH exited with code: 0
Terminating instance: i-0e54862825b88bea7...