Parent Log:
http://ci.aztec-labs.com/15853803733
Command: bootstrap_ec2 './bootstrap.sh ci-full'
Date: Tue Jun 24 15:20:06 UTC 2025
Status: 0
Took: 1831s
--- request build instance ---
Requesting m6a.32xlarge spot instance (name: pr-15247_amd64_x2-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for instance id for spot request: sir-w3ff6pvk...
Timeout waiting for spot request.
Requesting m6a.32xlarge on-demand instance (name: pr-15247_amd64_x2-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for SSH at 18.189.29.6...
Stdout is not a tty, running in background...
Loading CRS into tmpfs...
Done in 28 seconds.
Stdout is not a tty, starting build container in background...
Starting devbox...
From
https://github.com/aztecprotocol/aztec-packages
* branch 9ba478709ce5c48099f79f9531da8292811cb18a -> FETCH_HEAD
HEAD is now at 9ba4787 chore(backport-to-staging): fix: ensure block gas limit for simulation is large enough (#15242) (#15247)
Switched to a new branch 'gh-readonly-queue/staging/pr-15247-3863bc02d671057d0cffd4ced17ca317788ff190'
+ run
+ ci3/add_timestamps
+ DUP=1
+ ci3/cache_log 'CI run' 1750776688582
CI run log id:
http://ci.aztec-labs.com/1750776688582
14:51:28 + echo 'env: REF_NAME=gh-readonly-queue/staging/pr-15247-3863bc02d671057d0cffd4ced17ca317788ff190 COMMIT_HASH=9ba478709ce5c48099f79f9531da8292811cb18a CURRENT_VERSION=1.0.0 TARGET_BRANCH=staging'
14:51:28 env: REF_NAME=gh-readonly-queue/staging/pr-15247-3863bc02d671057d0cffd4ced17ca317788ff190 COMMIT_HASH=9ba478709ce5c48099f79f9531da8292811cb18a CURRENT_VERSION=1.0.0 TARGET_BRANCH=staging
14:51:28 + semver check gh-readonly-queue/staging/pr-15247-3863bc02d671057d0cffd4ced17ca317788ff190
14:51:28 + cpu_pid=418
14:51:28 + mem_pid=420
14:51:28 + mpstat 2
14:51:28 + set +e
14:51:28 + set -x
14:51:28 + ./bootstrap.sh ci-full
14:51:28 + vmstat -w -S M 2
14:51:28 ++ cache_log memfile
14:51:28 ++ cache_log cpufile
14:51:28 cpufile log id:
http://ci.aztec-labs.com/d09482dcee8d0a73
14:51:28 memfile log id:
http://ci.aztec-labs.com/5ae267465ad93c8e
14:51:36
--- pull submodules ---
14:51:36 Executing: git submodule update --init --recursive (
http://ci.aztec-labs.com/f201c6d64a31ac49)
14:51:45 0 .
done (9s)
14:51:48
--- noir build ---
14:51:48 Executing: retry install_deps (
http://ci.aztec-labs.com/201839a7a70c7685)
14:51:53 0 .
done (5s)
14:51:54 build_native Executing: build_native (
http://ci.aztec-labs.com/b657b3377e065739)
14:51:54 build_packages Executing: build_packages (
http://ci.aztec-labs.com/61d4538fcc44f09e)
14:51:54 build_native 0 .
done (0s)
14:52:00 build_packages 0 .
done (6s)
14:52:01
--- bb cpp build ---
14:52:01 build_nodejs_module Executing: build_nodejs_module (
http://ci.aztec-labs.com/82952c6d9bcc5198)
14:52:01 build_wasm_threads Executing: build_wasm_threads (
http://ci.aztec-labs.com/1c2268748daef336)
14:52:01 build_native Executing: build_native (
http://ci.aztec-labs.com/db2846d8fda08619)
14:52:01 build_wasm Executing: build_wasm (
http://ci.aztec-labs.com/264d692b8c865949)
14:52:01 build_gcc_syntax_check_only Executing: build_gcc_syntax_check_only (
http://ci.aztec-labs.com/a6412ceeb58f9e94)
14:52:01 build_fuzzing_syntax_check_only Executing: build_fuzzing_syntax_check_only (
http://ci.aztec-labs.com/1f8eeb0e68589934)
14:52:01 build_asan_fast Executing: build_asan_fast (
http://ci.aztec-labs.com/712b49b6cf9ff3ef)
14:52:01 build_darwin Executing: build_darwin (
http://ci.aztec-labs.com/c20ba1cde7b95936)
14:52:01 build_gcc_syntax_check_only 0 .
done (0s)
14:52:01 build_fuzzing_syntax_check_only 0 .
done (0s)
14:52:02 build_wasm 0 .
done (1s)
14:52:02 build_wasm_threads 0 .
done (1s)
14:52:02 build_darwin 0 .
done (1s)
14:52:02 build_nodejs_module 0 .
done (1s)
14:52:03 build_native 0 .
done (1s)
14:52:03 build_asan_fast 0 .
done (2s)
14:52:08
--- bb.js build ---
14:52:09 Cache download and extraction of node-modules-e85320bda7d59d54.zst complete in 1s.
14:52:09 Cache download and extraction of bb.js-93955768547ae31a.tar.gz complete in 0s.
14:52:10
--- acir_tests build ---
14:52:10 Cache download and extraction of barretenberg-acir-tests-000ad54a8a7b4100.tar.gz complete in 0s.
14:52:11 Cache download and extraction of node-modules-fec19dc5fe5a76d5.zst complete in 1s.
14:52:11 browser-test-app Executing: yarn build (
http://ci.aztec-labs.com/2aa498fa62dae165)
14:52:11 bbjs-test Executing: yarn build (
http://ci.aztec-labs.com/9e64e3880c375131)
14:52:15 bbjs-test 0 .
done (4s)
14:52:16 browser-test-app 0 .
done (5s)
14:52:17
--- avm-transpiler build ---
14:52:17 Cache download and extraction of avm-transpiler-6867cd9272ea7ebd.tar.gz complete in 0s.
14:52:17
--- noir-projects build ---
14:52:17 Executing: prep (
http://ci.aztec-labs.com/93afe6b0f3572acd)
14:52:20 0 .
done (3s)
14:52:20 mock-protocol-circuits Executing: ./mock-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/2d816aa956e8a945)
14:52:20 noir-protocol-circuits Executing: ./noir-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/fc517de0ff478622)
14:52:20 noir-contracts Executing: ./noir-contracts/bootstrap.sh (
http://ci.aztec-labs.com/64d15de642b8522e)
14:52:20 aztec-nr Executing: ./aztec-nr/bootstrap.sh (
http://ci.aztec-labs.com/23d6dd06cf9095d9)
14:52:22 noir-contracts 0 ................................................................
14:52:22 noir-contracts 64 ................................................................
14:52:22 noir-contracts 128 ................................................................
14:52:22 noir-contracts 192 ................................................................
14:52:22 noir-contracts 256 ................................................................
14:52:22 noir-contracts 320 ................................................................
14:52:23 noir-contracts 384 ................................................................
14:52:23 noir-contracts 448 ................................................................
14:52:23 noir-contracts 512 ................................................................
14:52:23 noir-contracts 576 ................................................................
14:52:23 noir-contracts 640 ................................................................
14:52:23 noir-contracts 704 ................................................................
14:52:23 noir-contracts 768 ................................................................
14:52:24 noir-contracts 832 ................................................................
14:52:24 noir-contracts 896 ................................................................
14:52:24 noir-contracts 960 ................................................................
14:52:24 noir-contracts 1024 ................................................................
14:52:24 noir-contracts 1088 ................................................................
14:52:24 noir-contracts 1152 ................................................................
14:52:25 noir-contracts 1216 ................................................................
14:52:25 noir-contracts 1280 ................................................................
14:52:25 noir-contracts 1344 ................................................................
14:52:25 noir-contracts 1408 ................................................................
14:52:25 noir-contracts 1472 ................................................................
14:52:25 noir-protocol-circuits 0 ................................................................
14:52:25 noir-protocol-circuits 64 ................................................................
14:52:25 noir-contracts 1536 ................................................................
14:52:25 noir-contracts 1600 .
done (5s)
14:52:26 noir-protocol-circuits 128 ................................................................
14:52:27 noir-protocol-circuits 192 ................................................................
14:52:27 mock-protocol-circuits 0 ................................................................
14:52:28 noir-protocol-circuits 256 ................................................................
14:52:28 aztec-nr 0 .
done (8s)
14:52:29 noir-protocol-circuits 320 ................................................................
14:52:29 mock-protocol-circuits 64 .
done (9s)
14:52:29 noir-protocol-circuits 384 ................................................................
14:52:29 noir-protocol-circuits 448 .
done (9s)
14:52:30
--- l1-contracts build ---
14:52:30 Cache download and extraction of l1-contracts-0a920e2ab51d8ecb.tar.gz complete in 0s.
14:52:30
--- yarn-project build ---
14:52:30 Executing: ./bootstrap.sh clean-lite (
http://ci.aztec-labs.com/e0148a9ce34d0d6a)
14:52:30 0 .
done (0s)
14:52:35 Cache download and extraction of node-modules-34bec2a54a394404.zst complete in 5s.
14:52:35 Executing: compile_all (
http://ci.aztec-labs.com/b1dd6aecd7a61965)
14:52:38 0 .
done (3s)
14:52:39 playground/bootstrap.sh Executing: playground/bootstrap.sh (
http://ci.aztec-labs.com/d900d33d7f0d00b1)
14:52:39 boxes/bootstrap.sh Executing: boxes/bootstrap.sh (
http://ci.aztec-labs.com/e8218d4e03365149)
14:52:39 docs/bootstrap.sh Executing: docs/bootstrap.sh (
http://ci.aztec-labs.com/ede2a0a777da1e0e)
14:52:39 release-image/bootstrap.sh Executing: release-image/bootstrap.sh (
http://ci.aztec-labs.com/25a32978f0532947)
14:52:39 spartan/bootstrap.sh Executing: spartan/bootstrap.sh (
http://ci.aztec-labs.com/6197bdea8de645ab)
14:52:39 aztec-up/bootstrap.sh Executing: aztec-up/bootstrap.sh (
http://ci.aztec-labs.com/1bf5a89971a046ed)
14:52:39 aztec-up/bootstrap.sh 0 .
done (0s)
14:52:43 boxes/bootstrap.sh 0 .
done (4s)
14:52:43 spartan/bootstrap.sh 0 .
done (4s)
14:52:44 playground/bootstrap.sh 0 .
done (5s)
14:52:47 docs/bootstrap.sh 0 .
done (8s)
14:53:17 release-image/bootstrap.sh 0 .
done (38s)
14:53:17
--- test all ---
14:53:17 Waiting for TXE's to start...
14:53:20 Gathering tests to run...
14:55:00 Gathered 12158 tests.
14:55:00 Starting parallel run with max 64 jobs...
14:55:00 Executing: parallel -j64 --memsuspend 64G --line-buffer --joblog joblog.txt --halt now,fail=1 'run_test_cmd {}' (
http://ci.aztec-labs.com/903550316e4b829b)
14:55:31 0 ................................................................
14:56:38 64 ................................................................
14:57:41 128 ................................................................
14:58:41 192 ................................................................
14:59:08 256 ................................................................
14:59:17 320 ................................................................
14:59:35 384 ................................................................
14:59:52 448 ................................................................
15:00:00 512 ................................................................
15:00:06 576 ................................................................
15:00:17 640 ................................................................
15:00:25 704 ................................................................
15:00:33 768 ................................................................
15:00:38 832 ................................................................
15:00:46 896 ................................................................
15:00:52 960 ................................................................
15:00:58 1024 ................................................................
15:01:01 1088 ................................................................
15:01:10 1152 ................................................................
15:01:17 1216 ................................................................
15:01:20 1280 ................................................................
15:01:24 1344 ................................................................
15:01:27 1408 ................................................................
15:01:30 1472 ................................................................
15:01:34 1536 ................................................................
15:01:41 1600 ................................................................
15:01:50 1664 ................................................................
15:02:06 1728 ................................................................
15:02:11 1792 ................................................................
15:02:16 1856 ................................................................
15:02:19 1920 ................................................................
15:02:21 1984 ................................................................
15:02:23 2048 ................................................................
15:02:25 2112 ................................................................
15:02:26 2176 ................................................................
15:02:28 2240 ................................................................
15:02:30 2304 ................................................................
15:02:32 2368 ................................................................
15:02:33 2432 ................................................................
15:02:34 2496 ................................................................
15:02:36 2560 ................................................................
15:02:51 2624 ................................................................
15:02:58 2688 ................................................................
15:02:59 2752 ................................................................
15:03:01 2816 ................................................................
15:03:02 2880 ................................................................
15:03:05 2944 ................................................................
15:03:15 3008 ................................................................
15:03:22 3072 ................................................................
15:03:26 3136 ................................................................
15:03:28 3200 ................................................................
15:03:30 3264 ................................................................
15:03:31 3328 ................................................................
15:03:33 3392 ................................................................
15:03:35 3456 ................................................................
15:03:38 3520 ................................................................
15:03:40 3584 ................................................................
15:03:42 3648 ................................................................
15:03:44 3712 ................................................................
15:03:45 3776 ................................................................
15:03:46 3840 ................................................................
15:03:48 3904 ................................................................
15:03:49 3968 ................................................................
15:03:50 4032 ................................................................
15:03:52 4096 ................................................................
15:03:53 4160 ................................................................
15:03:56 4224 ................................................................
15:04:00 4288 ................................................................
15:04:03 4352 ................................................................
15:04:06 4416 ................................................................
15:04:09 4480 ................................................................
15:04:11 4544 ................................................................
15:04:14 4608 ................................................................
15:04:16 4672 ................................................................
15:04:19 4736 ................................................................
15:04:21 4800 ................................................................
15:04:23 4864 ................................................................
15:04:25 4928 ................................................................
15:04:27 4992 ................................................................
15:04:29 5056 ................................................................
15:04:31 5120 ................................................................
15:04:33 5184 ................................................................
15:04:34 5248 ................................................................
15:04:35 5312 ................................................................
15:04:37 5376 ................................................................
15:04:38 5440 ................................................................
15:04:41 5504 ................................................................
15:04:43 5568 ................................................................
15:04:45 5632 ................................................................
15:04:46 5696 ................................................................
15:04:49 5760 ................................................................
15:04:51 5824 ................................................................
15:04:53 5888 ................................................................
15:04:55 5952 ................................................................
15:04:57 6016 ................................................................
15:04:59 6080 ................................................................
15:05:01 6144 ................................................................
15:05:04 6208 ................................................................
15:05:06 6272 ................................................................
15:05:09 6336 ................................................................
15:05:11 6400 ................................................................
15:05:13 6464 ................................................................
15:05:16 6528 ................................................................
15:05:19 6592 ................................................................
15:05:22 6656 ................................................................
15:05:25 6720 ................................................................
15:05:27 6784 ................................................................
15:05:30 6848 ................................................................
15:05:32 6912 ................................................................
15:05:34 6976 ................................................................
15:05:36 7040 ................................................................
15:05:38 7104 ................................................................
15:05:40 7168 ................................................................
15:05:42 7232 ................................................................
15:05:43 7296 ................................................................
15:05:44 7360 ................................................................
15:05:45 7424 ................................................................
15:05:46 7488 ................................................................
15:05:48 7552 ................................................................
15:05:49 7616 ................................................................
15:05:50 7680 ................................................................
15:05:51 7744 ................................................................
15:05:52 7808 ................................................................
15:05:53 7872 ................................................................
15:05:55 7936 ................................................................
15:05:56 8000 ................................................................
15:05:57 8064 ................................................................
15:05:58 8128 ................................................................
15:06:00 8192 ................................................................
15:06:01 8256 ................................................................
15:06:02 8320 ................................................................
15:06:04 8384 ................................................................
15:06:05 8448 ................................................................
15:06:06 8512 ................................................................
15:06:07 8576 ................................................................
15:06:08 8640 ................................................................
15:06:09 8704 ................................................................
15:06:11 8768 ................................................................
15:06:12 8832 ................................................................
15:06:13 8896 ................................................................
15:06:14 8960 ................................................................
15:06:16 9024 ................................................................
15:06:17 9088 ................................................................
15:06:18 9152 ................................................................
15:06:20 9216 ................................................................
15:06:21 9280 ................................................................
15:06:23 9344 ................................................................
15:06:24 9408 ................................................................
15:06:26 9472 ................................................................
15:06:27 9536 ................................................................
15:06:28 9600 ................................................................
15:06:30 9664 ................................................................
15:06:32 9728 ................................................................
15:06:34 9792 ................................................................
15:06:35 9856 ................................................................
15:06:37 9920 ................................................................
15:06:38 9984 ................................................................
15:06:39 10048 ................................................................
15:06:40 10112 ................................................................
15:06:41 10176 ................................................................
15:06:42 10240 ................................................................
15:06:43 10304 ................................................................
15:06:44 10368 ................................................................
15:06:45 10432 ................................................................
15:06:47 10496 ................................................................
15:06:48 10560 ................................................................
15:06:49 10624 ................................................................
15:06:51 10688 ................................................................
15:06:52 10752 ................................................................
15:06:53 10816 ................................................................
15:06:54 10880 ................................................................
15:06:55 10944 ................................................................
15:06:56 11008 ................................................................
15:06:57 11072 ................................................................
15:06:58 11136 ................................................................
15:07:00 11200 ................................................................
15:07:01 11264 ................................................................
15:07:02 11328 ................................................................
15:07:03 11392 ................................................................
15:07:04 11456 ................................................................
15:07:05 11520 ................................................................
15:07:06 11584 ................................................................
15:07:07 11648 ................................................................
15:07:08 11712 ................................................................
15:07:10 11776 ................................................................
15:07:11 11840 ................................................................
15:07:12 11904 ................................................................
15:07:13 11968 ................................................................
15:07:14 12032 ................................................................
15:07:15 12096 ................................................................
15:07:16 12160 ................................................................
15:07:17 12224 ................................................................
15:07:18 12288 ................................................................
15:07:20 12352 ................................................................
15:09:51 12416 .
done (891s)
15:09:51
WARNING: The following tests exceed 5 minute runtimes. Break them up or rethink them.
15:09:51 305.263: 'ef85c2b8680d9e9c:ISOLATE=1:NAME=e2e_p2p/validators_sentinel yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/validators_sentinel.test.ts'
15:09:51 305.668: '6c8b1f2818608a3b noir-projects/scripts/run_test.sh noir-protocol-circuits rollup_lib block_root::block_root_rollup_inputs::tests::correct_blobs_with_non_empty_fields'
15:09:51 325.551: '6c32ccc844d598b0 barretenberg/cpp/scripts/run_test.sh dsl_tests AcirAvm2RecursionConstraint.TestGenerateVKFromConstraintsWithoutWitness'
15:09:51 340.338: 'ef85c2b8680d9e9c:ISOLATE=1:NAME=e2e_p2p/data_withholding_slash yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/data_withholding_slash.test.ts'
15:09:51 352.444: 'beb8af968925c4a6:ONLY_TERM_PARENT=1 BOX=vanilla BROWSER=* run_compose_test vanilla-all-browsers box boxes'
15:09:51 364.976: '8969ea11e31033a3 aztec-up/scripts/run_test.sh amm_flow'
15:09:51 367.401: '6c32ccc844d598b0:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityFailing'
15:09:51 367.980: '6c32ccc844d598b0:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityPassing'
15:09:51 389.845: 'ef85c2b8680d9e9c:ISOLATE=1:TIMEOUT=15m:NAME=e2e_block_building yarn-project/end-to-end/scripts/run_test.sh simple e2e_block_building'
15:09:51 431.208: 'ef85c2b8680d9e9c:ISOLATE=1:NAME=e2e_p2p/reex yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/reex.test.ts'
15:09:51 443.293: 'ef85c2b8680d9e9c:ISOLATE=1:NAME=e2e_l1_with_wall_time yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_l1_with_wall_time.test.ts'
15:09:51 444.071: 'ef85c2b8680d9e9c:ISOLATE=1:NAME=prover-client/src/test/bb_prover_full_rollup.test.ts:CPUS=16:MEM=96g LOG_LEVEL=verbose yarn-project/scripts/run_test.sh prover-client/src/test/bb_prover_full_rollup.test.ts'
15:09:51 740.393: 'ef85c2b8680d9e9c:ISOLATE=1:TIMEOUT=15m:CPUS=16:MEM=96g:NAME=e2e_prover_full_real yarn-project/end-to-end/scripts/run_test.sh simple e2e_prover/full'
15:09:51 Completed run of 12158 tests in 891 seconds.
15:09:51
--- bench all ---
15:09:51 barretenberg/cpp Executing: barretenberg/cpp/bootstrap.sh build_bench (
http://ci.aztec-labs.com/1d8bb4c43245816d)
15:09:51 yarn-project/end-to-end Executing: yarn-project/end-to-end/bootstrap.sh build_bench (
http://ci.aztec-labs.com/515c8267fee4e14b)
15:09:52 barretenberg/cpp 0 .
done (1s)
15:11:51 yarn-project/end-to-end 0 ................................................................
15:14:48 yarn-project/end-to-end 64 .
done (297s)
15:14:49 Starting parallel run using max 64 cpus...
15:14:49 Test run log id:
http://ci.aztec-labs.com/95b3731672c1ce7e
15:19:54 Completed run of 95 tests in 305 seconds.
15:19:56 Completed 7.6 KiB/7.6 KiB (96.3 KiB/s) with 1 file(s) remaining
upload: ../../../tmp/tmp.vIDcPIjRh2 to s3://aztec-ci-artifacts/build-cache/bench-9ba478709ce5c48099f79f9531da8292811cb18a.tar.gz
15:19:57 Cache upload of bench-9ba478709ce5c48099f79f9531da8292811cb18a.tar.gz complete in 2s.
15:19:57 + local code=0
15:19:57 + set +x
15:19:57 dmesg log id:
http://ci.aztec-labs.com/68d9f1e5787aba31
CI run log id:
http://ci.aztec-labs.com/1750776688582
+ code=0
+ case $code in
+ log_ci_run PASSED 1750776688582
+ exit 0
SSH exited with code: 0
Terminating instance: i-0899ccc257d85b8e9...