Parent Log:
http://ci.aztec-labs.com/15860905620
Command: bootstrap_ec2 './bootstrap.sh ci-full'
Date: Tue Jun 24 21:09:55 UTC 2025
Status: 0
Took: 2130s
--- request build instance ---
Requesting m6a.32xlarge spot instance (name: pr-15230_amd64_x3-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for instance id for spot request: sir-gia75f4g...
Timeout waiting for spot request.
Requesting m6a.32xlarge on-demand instance (name: pr-15230_amd64_x3-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for SSH at 13.59.7.138...
Stdout is not a tty, running in background...
Loading CRS into tmpfs...
Done in 23 seconds.
Stdout is not a tty, starting build container in background...
Starting devbox...
From
https://github.com/aztecprotocol/aztec-packages
* branch 534f06e45f48274efd53a2204c90cb0b91a53efb -> FETCH_HEAD
HEAD is now at 534f06e feat: reward booster as separate contract (#15230)
Switched to a new branch 'gh-readonly-queue/next/pr-15230-ad85cda24c2f9b5b4b17d4921f8597b71949bb6c'
+ run
+ ci3/add_timestamps
+ DUP=1
+ ci3/cache_log 'CI run' 1750797375580
CI run log id:
http://ci.aztec-labs.com/1750797375580
20:36:15 + echo 'env: REF_NAME=gh-readonly-queue/next/pr-15230-ad85cda24c2f9b5b4b17d4921f8597b71949bb6c COMMIT_HASH=534f06e45f48274efd53a2204c90cb0b91a53efb CURRENT_VERSION=0.87.6 TARGET_BRANCH=next'
20:36:15 env: REF_NAME=gh-readonly-queue/next/pr-15230-ad85cda24c2f9b5b4b17d4921f8597b71949bb6c COMMIT_HASH=534f06e45f48274efd53a2204c90cb0b91a53efb CURRENT_VERSION=0.87.6 TARGET_BRANCH=next
20:36:15 + semver check gh-readonly-queue/next/pr-15230-ad85cda24c2f9b5b4b17d4921f8597b71949bb6c
20:36:15 + cpu_pid=418
20:36:15 + mpstat 2
20:36:15 + mem_pid=421
20:36:15 + set +e
20:36:15 + set -x
20:36:15 + ./bootstrap.sh ci-full
20:36:15 + vmstat -w -S M 2
20:36:15 ++ cache_log cpufile
20:36:15 ++ cache_log memfile
20:36:15 cpufile log id:
http://ci.aztec-labs.com/eefb4263cf780135
20:36:15 memfile log id:
http://ci.aztec-labs.com/7c89b0d3c2c8f2d1
20:36:22
--- pull submodules ---
20:36:22 Executing: git submodule update --init --recursive (
http://ci.aztec-labs.com/52832f39c771d650)
20:36:31 0 .
done (9s)
20:36:32
--- noir build ---
20:36:32 Executing: retry install_deps (
http://ci.aztec-labs.com/f2b925b5eb47dc22)
20:36:37 0 .
done (5s)
20:36:37 build_native Executing: build_native (
http://ci.aztec-labs.com/d3f0ad521045f319)
20:36:37 build_packages Executing: build_packages (
http://ci.aztec-labs.com/272bc526b2de7783)
20:36:38 build_native 0 .
done (1s)
20:36:44 build_packages 0 .
done (7s)
20:36:45
--- bb cpp build ---
20:36:45 build_native Executing: build_native (
http://ci.aztec-labs.com/b1cbdbb4307ae120)
20:36:45 build_nodejs_module Executing: build_nodejs_module (
http://ci.aztec-labs.com/504d6d2b8b1935e4)
20:36:45 build_wasm Executing: build_wasm (
http://ci.aztec-labs.com/55f9a6ae011bae75)
20:36:45 build_wasm_threads Executing: build_wasm_threads (
http://ci.aztec-labs.com/2d5a9debc12c7aa4)
20:36:45 build_gcc_syntax_check_only Executing: build_gcc_syntax_check_only (
http://ci.aztec-labs.com/f7ce7e78b2d02114)
20:36:45 build_fuzzing_syntax_check_only Executing: build_fuzzing_syntax_check_only (
http://ci.aztec-labs.com/151ddfd63df7b6e2)
20:36:45 build_asan_fast Executing: build_asan_fast (
http://ci.aztec-labs.com/c51fd90043bb927f)
20:36:45 build_darwin Executing: build_darwin (
http://ci.aztec-labs.com/333f5ddc556e0d8a)
20:36:45 build_fuzzing_syntax_check_only 0 .
done (0s)
20:36:45 build_gcc_syntax_check_only 0 .
done (0s)
20:36:45 build_wasm 0 .
done (0s)
20:36:45 build_darwin 0 .
done (0s)
20:36:45 build_wasm_threads 0 .
done (0s)
20:36:46 build_nodejs_module 0 .
done (1s)
20:36:47 build_native 0 .
done (2s)
20:36:49 build_asan_fast 0 .
done (4s)
20:36:53
--- bb.js build ---
20:36:55 Cache download and extraction of node-modules-e85320bda7d59d54.zst complete in 1s.
20:36:55 Cache download and extraction of bb.js-c648fbb0d0d1fbe2.tar.gz complete in 0s.
20:36:56
--- acir_tests build ---
20:36:56 Cache download and extraction of barretenberg-acir-tests-e9791828d8ef32d7.tar.gz complete in 0s.
20:36:57 Cache download and extraction of node-modules-fec19dc5fe5a76d5.zst complete in 0s.
20:36:58 browser-test-app Executing: yarn build (
http://ci.aztec-labs.com/9c38f0f4d822beb2)
20:36:58 bbjs-test Executing: yarn build (
http://ci.aztec-labs.com/dd17c507feb3d30e)
20:37:01 bbjs-test 0 .
done (3s)
20:37:03 browser-test-app 0 .
done (5s)
20:37:03
--- avm-transpiler build ---
20:37:03 Cache download and extraction of avm-transpiler-bff6096d112435ba.tar.gz complete in 0s.
20:37:03
--- noir-projects build ---
20:37:04 Executing: prep (
http://ci.aztec-labs.com/067bd4bbca3c58a9)
20:37:06 0 .
done (3s)
20:37:07 mock-protocol-circuits Executing: ./mock-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/16a10f8c21c944ce)
20:37:07 noir-protocol-circuits Executing: ./noir-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/13ee0bfa06c78d85)
20:37:07 noir-contracts Executing: ./noir-contracts/bootstrap.sh (
http://ci.aztec-labs.com/36b523a94cb32448)
20:37:07 aztec-nr Executing: ./aztec-nr/bootstrap.sh (
http://ci.aztec-labs.com/254b100241b44b25)
20:37:08 noir-contracts 0 ................................................................
20:37:08 noir-contracts 64 ................................................................
20:37:08 noir-contracts 128 ................................................................
20:37:08 noir-contracts 192 ................................................................
20:37:09 noir-contracts 256 ................................................................
20:37:09 noir-contracts 320 ................................................................
20:37:09 noir-contracts 384 ................................................................
20:37:10 noir-contracts 448 ................................................................
20:37:10 noir-contracts 512 ................................................................
20:37:10 noir-contracts 576 ................................................................
20:37:10 noir-contracts 640 ................................................................
20:37:10 noir-contracts 704 ................................................................
20:37:10 noir-contracts 768 ................................................................
20:37:11 noir-contracts 832 ................................................................
20:37:11 noir-contracts 896 ................................................................
20:37:11 noir-contracts 960 ................................................................
20:37:11 noir-contracts 1024 ................................................................
20:37:11 noir-contracts 1088 ................................................................
20:37:12 noir-contracts 1152 ................................................................
20:37:12 noir-protocol-circuits 0 ................................................................
20:37:12 noir-protocol-circuits 64 ................................................................
20:37:12 noir-contracts 1216 ................................................................
20:37:12 noir-contracts 1280 ................................................................
20:37:12 noir-contracts 1344 ................................................................
20:37:12 noir-contracts 1408 ................................................................
20:37:12 noir-contracts 1472 ................................................................
20:37:13 noir-protocol-circuits 128 ................................................................
20:37:13 noir-contracts 1536 ................................................................
20:37:13 noir-contracts 1600 .
done (6s)
20:37:13 noir-protocol-circuits 192 ................................................................
20:37:14 noir-protocol-circuits 256 ................................................................
20:37:14 mock-protocol-circuits 0 ................................................................
20:37:14 aztec-nr 0 .
done (7s)
20:37:14 noir-protocol-circuits 320 ................................................................
20:37:15 noir-protocol-circuits 384 ................................................................
20:37:17 noir-protocol-circuits 448 ................................................................
20:37:18 mock-protocol-circuits 64 ................................................................
20:39:19 noir-protocol-circuits 512 ................................................................
20:39:19 noir-protocol-circuits 576 ................................................................
20:39:19 noir-protocol-circuits 640 .
done (132s)
20:39:24 mock-protocol-circuits 128 .
done (137s)
20:39:24
--- l1-contracts build ---
20:39:24
➤ YN0000: ·
Yarn 4.5.2
20:39:24
➤ YN0000: ┌ Resolution step
20:39:24
➤ YN0000: └ Completed
20:39:24
➤ YN0000: ┌ Fetch step
20:39:25
➤ YN0013: │
134 packages were added to the project (
+ 44.9 MiB).
20:39:25
➤ YN0000: └ Completed in 0s 752ms
20:39:25
➤ YN0000: ┌ Link step
20:39:26
➤ YN0000: └ Completed in 0s 930ms
20:39:26
➤ YN0000: · Done in 1s 749ms
20:39:27 Cache download and extraction of l1-contracts-c28ef09dcaaa5782.tar.gz complete in 1s.
20:39:27
--- yarn-project build ---
20:39:27 Executing: ./bootstrap.sh clean-lite (
http://ci.aztec-labs.com/379e141587847358)
20:39:27 0 .
done (0s)
20:39:33 Cache download and extraction of node-modules-34bec2a54a394404.zst complete in 6s.
20:39:33 Executing: compile_all (
http://ci.aztec-labs.com/9432e111fdce4eba)
20:39:44 0 ................................................................
20:42:06 64 .
done (153s)
20:42:07 boxes/bootstrap.sh Executing: boxes/bootstrap.sh (
http://ci.aztec-labs.com/bec06d3a321e7936)
20:42:07 playground/bootstrap.sh Executing: playground/bootstrap.sh (
http://ci.aztec-labs.com/4c8d0e875483f7a2)
20:42:07 docs/bootstrap.sh Executing: docs/bootstrap.sh (
http://ci.aztec-labs.com/8bb820ca78217216)
20:42:07 release-image/bootstrap.sh Executing: release-image/bootstrap.sh (
http://ci.aztec-labs.com/755680f4e9d1bf79)
20:42:07 spartan/bootstrap.sh Executing: spartan/bootstrap.sh (
http://ci.aztec-labs.com/4febd56f73cc8c54)
20:42:07 aztec-up/bootstrap.sh Executing: aztec-up/bootstrap.sh (
http://ci.aztec-labs.com/7835dffaa97b0061)
20:42:07 aztec-up/bootstrap.sh 0 .
done (0s)
20:42:13 spartan/bootstrap.sh 0 .
done (6s)
20:42:14 docs/bootstrap.sh 0 .
done (7s)
20:42:40 release-image/bootstrap.sh 0 .
done (33s)
20:42:45 boxes/bootstrap.sh 0 .
done (39s)
20:42:56 playground/bootstrap.sh 0 .
done (50s)
20:42:56
--- test all ---
20:42:56 Waiting for TXE's to start...
20:42:59 Gathering tests to run...
20:44:39 Gathered 12181 tests.
20:44:39 Starting parallel run with max 64 jobs...
20:44:39 Executing: parallel -j64 --memsuspend 64G --line-buffer --joblog joblog.txt --halt now,fail=1 'run_test_cmd {}' (
http://ci.aztec-labs.com/e0a41d634b82744d)
20:45:11 0 ................................................................
20:46:16 64 ................................................................
20:47:21 128 ................................................................
20:48:22 192 ................................................................
20:48:51 256 ................................................................
20:49:03 320 ................................................................
20:49:21 384 ................................................................
20:49:36 448 ................................................................
20:49:44 512 ................................................................
20:49:50 576 ................................................................
20:50:01 640 ................................................................
20:50:09 704 ................................................................
20:50:15 768 ................................................................
20:50:21 832 ................................................................
20:50:28 896 ................................................................
20:50:34 960 ................................................................
20:50:39 1024 ................................................................
20:50:43 1088 ................................................................
20:50:52 1152 ................................................................
20:50:59 1216 ................................................................
20:51:02 1280 ................................................................
20:51:06 1344 ................................................................
20:51:09 1408 ................................................................
20:51:12 1472 ................................................................
20:51:16 1536 ................................................................
20:51:23 1600 ................................................................
20:51:33 1664 ................................................................
20:51:48 1728 ................................................................
20:51:53 1792 ................................................................
20:51:58 1856 ................................................................
20:52:00 1920 ................................................................
20:52:02 1984 ................................................................
20:52:04 2048 ................................................................
20:52:06 2112 ................................................................
20:52:08 2176 ................................................................
20:52:10 2240 ................................................................
20:52:12 2304 ................................................................
20:52:14 2368 ................................................................
20:52:15 2432 ................................................................
20:52:16 2496 ................................................................
20:52:18 2560 ................................................................
20:52:33 2624 ................................................................
20:52:41 2688 ................................................................
20:52:42 2752 ................................................................
20:52:44 2816 ................................................................
20:52:45 2880 ................................................................
20:52:48 2944 ................................................................
20:52:58 3008 ................................................................
20:53:06 3072 ................................................................
20:53:10 3136 ................................................................
20:53:11 3200 ................................................................
20:53:13 3264 ................................................................
20:53:15 3328 ................................................................
20:53:16 3392 ................................................................
20:53:18 3456 ................................................................
20:53:21 3520 ................................................................
20:53:23 3584 ................................................................
20:53:25 3648 ................................................................
20:53:27 3712 ................................................................
20:53:28 3776 ................................................................
20:53:29 3840 ................................................................
20:53:30 3904 ................................................................
20:53:32 3968 ................................................................
20:53:33 4032 ................................................................
20:53:34 4096 ................................................................
20:53:35 4160 ................................................................
20:53:38 4224 ................................................................
20:53:42 4288 ................................................................
20:53:46 4352 ................................................................
20:53:48 4416 ................................................................
20:53:51 4480 ................................................................
20:53:54 4544 ................................................................
20:53:56 4608 ................................................................
20:53:58 4672 ................................................................
20:54:01 4736 ................................................................
20:54:03 4800 ................................................................
20:54:05 4864 ................................................................
20:54:07 4928 ................................................................
20:54:09 4992 ................................................................
20:54:11 5056 ................................................................
20:54:12 5120 ................................................................
20:54:14 5184 ................................................................
20:54:16 5248 ................................................................
20:54:17 5312 ................................................................
20:54:19 5376 ................................................................
20:54:20 5440 ................................................................
20:54:23 5504 ................................................................
20:54:25 5568 ................................................................
20:54:27 5632 ................................................................
20:54:29 5696 ................................................................
20:54:31 5760 ................................................................
20:54:34 5824 ................................................................
20:54:36 5888 ................................................................
20:54:38 5952 ................................................................
20:54:40 6016 ................................................................
20:54:42 6080 ................................................................
20:54:44 6144 ................................................................
20:54:47 6208 ................................................................
20:54:50 6272 ................................................................
20:54:52 6336 ................................................................
20:54:54 6400 ................................................................
20:54:57 6464 ................................................................
20:55:00 6528 ................................................................
20:55:02 6592 ................................................................
20:55:06 6656 ................................................................
20:55:09 6720 ................................................................
20:55:11 6784 ................................................................
20:55:13 6848 ................................................................
20:55:15 6912 ................................................................
20:55:17 6976 ................................................................
20:55:19 7040 ................................................................
20:55:21 7104 ................................................................
20:55:23 7168 ................................................................
20:55:26 7232 ................................................................
20:55:27 7296 ................................................................
20:55:28 7360 ................................................................
20:55:29 7424 ................................................................
20:55:30 7488 ................................................................
20:55:32 7552 ................................................................
20:55:33 7616 ................................................................
20:55:34 7680 ................................................................
20:55:35 7744 ................................................................
20:55:36 7808 ................................................................
20:55:37 7872 ................................................................
20:55:39 7936 ................................................................
20:55:40 8000 ................................................................
20:55:41 8064 ................................................................
20:55:43 8128 ................................................................
20:55:44 8192 ................................................................
20:55:45 8256 ................................................................
20:55:46 8320 ................................................................
20:55:48 8384 ................................................................
20:55:49 8448 ................................................................
20:55:50 8512 ................................................................
20:55:51 8576 ................................................................
20:55:52 8640 ................................................................
20:55:53 8704 ................................................................
20:55:54 8768 ................................................................
20:55:56 8832 ................................................................
20:55:57 8896 ................................................................
20:55:58 8960 ................................................................
20:55:59 9024 ................................................................
20:56:01 9088 ................................................................
20:56:02 9152 ................................................................
20:56:03 9216 ................................................................
20:56:05 9280 ................................................................
20:56:06 9344 ................................................................
20:56:08 9408 ................................................................
20:56:09 9472 ................................................................
20:56:11 9536 ................................................................
20:56:12 9600 ................................................................
20:56:14 9664 ................................................................
20:56:15 9728 ................................................................
20:56:17 9792 ................................................................
20:56:19 9856 ................................................................
20:56:20 9920 ................................................................
20:56:21 9984 ................................................................
20:56:22 10048 ................................................................
20:56:23 10112 ................................................................
20:56:24 10176 ................................................................
20:56:26 10240 ................................................................
20:56:27 10304 ................................................................
20:56:28 10368 ................................................................
20:56:29 10432 ................................................................
20:56:30 10496 ................................................................
20:56:32 10560 ................................................................
20:56:33 10624 ................................................................
20:56:34 10688 ................................................................
20:56:36 10752 ................................................................
20:56:37 10816 ................................................................
20:56:38 10880 ................................................................
20:56:39 10944 ................................................................
20:56:40 11008 ................................................................
20:56:41 11072 ................................................................
20:56:42 11136 ................................................................
20:56:43 11200 ................................................................
20:56:44 11264 ................................................................
20:56:46 11328 ................................................................
20:56:47 11392 ................................................................
20:56:48 11456 ................................................................
20:56:49 11520 ................................................................
20:56:50 11584 ................................................................
20:56:51 11648 ................................................................
20:56:52 11712 ................................................................
20:56:53 11776 ................................................................
20:56:54 11840 ................................................................
20:56:55 11904 ................................................................
20:56:56 11968 ................................................................
20:56:57 12032 ................................................................
20:56:58 12096 ................................................................
20:56:59 12160 ................................................................
20:57:00 12224 ................................................................
20:57:01 12288 ................................................................
20:57:02 12352 ................................................................
20:59:35 12416 .
done (896s)
20:59:35
WARNING: The following tests exceed 5 minute runtimes. Break them up or rethink them.
20:59:35 304.672: '6d103549f0f4c9d2:ISOLATE=1:NAME=e2e_p2p/validators_sentinel yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/validators_sentinel.test.ts'
20:59:35 328.480: 'f6f1e598082a1c18 barretenberg/cpp/scripts/run_test.sh dsl_tests AcirAvm2RecursionConstraint.TestGenerateVKFromConstraintsWithoutWitness'
20:59:35 340.103: '6d103549f0f4c9d2:ISOLATE=1:NAME=e2e_p2p/data_withholding_slash yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/data_withholding_slash.test.ts'
20:59:35 346.430: '7b21af32f6e5c085:ONLY_TERM_PARENT=1 BOX=vanilla BROWSER=* run_compose_test vanilla-all-browsers box boxes'
20:59:35 359.095: 'f6f1e598082a1c18:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityFailing'
20:59:35 367.355: 'f6f1e598082a1c18:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityPassing'
20:59:35 377.492: '05c0a9dbc240866e aztec-up/scripts/run_test.sh amm_flow'
20:59:35 400.895: '6d103549f0f4c9d2:ISOLATE=1:TIMEOUT=15m:NAME=e2e_block_building yarn-project/end-to-end/scripts/run_test.sh simple e2e_block_building'
20:59:35 429.888: '6d103549f0f4c9d2:ISOLATE=1:NAME=e2e_p2p/reex yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/reex.test.ts'
20:59:35 441.009: '6d103549f0f4c9d2:ISOLATE=1:NAME=prover-client/src/test/bb_prover_full_rollup.test.ts:CPUS=16:MEM=96g LOG_LEVEL=verbose yarn-project/scripts/run_test.sh prover-client/src/test/bb_prover_full_rollup.test.ts'
20:59:35 443.460: '6d103549f0f4c9d2:ISOLATE=1:NAME=e2e_l1_with_wall_time yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_l1_with_wall_time.test.ts'
20:59:35 734.075: '6d103549f0f4c9d2:ISOLATE=1:TIMEOUT=15m:CPUS=16:MEM=96g:NAME=e2e_prover_full_real yarn-project/end-to-end/scripts/run_test.sh simple e2e_prover/full'
20:59:35 Completed run of 12181 tests in 896 seconds.
20:59:35
--- bench all ---
20:59:36 barretenberg/cpp Executing: barretenberg/cpp/bootstrap.sh build_bench (
http://ci.aztec-labs.com/5c76e4cda05c8635)
20:59:36 yarn-project/end-to-end Executing: yarn-project/end-to-end/bootstrap.sh build_bench (
http://ci.aztec-labs.com/52cebdd2fb18f92c)
20:59:37 barretenberg/cpp 0 .
done (1s)
21:01:35 yarn-project/end-to-end 0 ................................................................
21:04:28 yarn-project/end-to-end 64 ................................................................
21:04:29 yarn-project/end-to-end 128 ................................................................
21:04:29 yarn-project/end-to-end 192 ................................................................
21:04:29 yarn-project/end-to-end 256 ................................................................
21:04:29 yarn-project/end-to-end 320 ................................................................
21:04:29 yarn-project/end-to-end 384 ................................................................
21:04:29 yarn-project/end-to-end 448 ................................................................
21:04:29 yarn-project/end-to-end 512 ................................................................
21:04:29 yarn-project/end-to-end 576 ................................................................
21:04:29 yarn-project/end-to-end 640 ................................................................
21:04:29 yarn-project/end-to-end 704 ................................................................
21:04:32 yarn-project/end-to-end 768 .
done (296s)
21:04:33 Starting parallel run using max 64 cpus...
21:04:33 Test run log id:
http://ci.aztec-labs.com/5267d93c9e41ae05
21:09:39 Completed run of 95 tests in 306 seconds.
21:09:42 Completed 7.7 KiB/7.7 KiB (124.4 KiB/s) with 1 file(s) remaining
upload: ../../../tmp/tmp.T2myvD4365 to s3://aztec-ci-artifacts/build-cache/bench-534f06e45f48274efd53a2204c90cb0b91a53efb.tar.gz
21:09:42 Cache upload of bench-534f06e45f48274efd53a2204c90cb0b91a53efb.tar.gz complete in 2s.
21:09:42 + local code=0
21:09:42 + set +x
21:09:42 dmesg log id:
http://ci.aztec-labs.com/8507beddd8fd8fbd
CI run log id:
http://ci.aztec-labs.com/1750797375580
+ code=0
+ case $code in
+ log_ci_run PASSED 1750797375580
+ exit 0
SSH exited with code: 0
Terminating instance: i-0645da3fdacb29bc3...