Parent Log:
http://ci.aztec-labs.com/15637354560
Command: bootstrap_ec2 './bootstrap.sh ci-full'
Date: Fri Jun 13 15:15:27 UTC 2025
Status: 0
Took: 1711s
--- request build instance ---
Requesting m6a.32xlarge spot instance (name: pr-15002_amd64_x1-full) (type: m6a.32xlarge) (ami: ami-069f88e34f8fb5021) (bid: 5.5424)...
Waiting for instance id for spot request: sir-r45f7qqg...
Timeout waiting for spot request.
Requesting m6a.32xlarge on-demand instance (name: pr-15002_amd64_x1-full) (type: m6a.32xlarge) (ami: ami-069f88e34f8fb5021) (bid: 5.5424)...
Waiting for SSH at 3.19.237.175...
No tty, running in background...
Loading CRS into tmpfs...
Done in 14 seconds.
Starting devbox...
From
https://github.com/aztecprotocol/aztec-packages
* branch 267ac35e8ccb487bdc79bbe12d428f4c8b4d4d9f -> FETCH_HEAD
HEAD is now at 267ac35 backport: use shared cache for pippenger_runtime_state (#14753) (#15002)
Switched to a new branch 'gh-readonly-queue/master/pr-15002-1338cef09c870378254c56748f972ae827c4d482'
+ ci3/aws_handle_evict run
+ ci3/add_timestamps
+ DUP=1
+ ci3/cache_log 'CI run' 1749826113336
CI run log id:
http://ci.aztec-labs.com/1749826113336
14:48:33 env: REF_NAME=gh-readonly-queue/master/pr-15002-1338cef09c870378254c56748f972ae827c4d482 COMMIT_HASH=267ac35e8ccb487bdc79bbe12d428f4c8b4d4d9f CURRENT_VERSION=0.87.8 TARGET_BRANCH=master
14:48:33 + ./bootstrap.sh ci-full
14:48:41
--- pull submodules ---
14:48:41 Executing: git submodule update --init --recursive (
http://ci.aztec-labs.com/2c30afd947096b47)
14:48:49 0 .
done (7s)
14:48:50
--- noir build ---
14:48:50 Executing: retry install_deps (
http://ci.aztec-labs.com/e33b1d5bdeebe80b)
14:48:55 0 .
done (5s)
14:48:55 build_native Executing: build_native (
http://ci.aztec-labs.com/bb49a1588a3cf3ad)
14:48:55 build_packages Executing: build_packages (
http://ci.aztec-labs.com/f1bf0579bbae61d0)
14:48:56 build_native 0 .
done (1s)
14:49:03 build_packages 0 .
done (8s)
14:49:03
--- bb cpp build ---
14:49:04 build_nodejs_module Executing: build_nodejs_module (
http://ci.aztec-labs.com/bf68260adc505030)
14:49:04 build_wasm Executing: build_wasm (
http://ci.aztec-labs.com/17246a513a440cf3)
14:49:04 build_wasm_threads Executing: build_wasm_threads (
http://ci.aztec-labs.com/7de97e8664b6d376)
14:49:04 build_native Executing: build_native (
http://ci.aztec-labs.com/9e0252dc90fb1a96)
14:49:04 build_gcc_syntax_check_only Executing: build_gcc_syntax_check_only (
http://ci.aztec-labs.com/4ab3cb6fa041a92e)
14:49:04 build_fuzzing_syntax_check_only Executing: build_fuzzing_syntax_check_only (
http://ci.aztec-labs.com/b1a53b57ea281320)
14:49:04 build_asan_fast Executing: build_asan_fast (
http://ci.aztec-labs.com/57da29f3936a64e0)
14:49:04 build_darwin Executing: build_darwin (
http://ci.aztec-labs.com/e0c4af38fc23c9dd)
14:49:04 build_fuzzing_syntax_check_only 0 .
done (0s)
14:49:04 build_gcc_syntax_check_only 0 .
done (0s)
14:49:04 build_darwin 0 .
done (0s)
14:49:04 build_wasm 0 .
done (0s)
14:49:04 build_wasm_threads 0 .
done (0s)
14:49:04 build_nodejs_module 0 .
done (0s)
14:49:06 build_native 0 .
done (2s)
14:49:08 build_asan_fast 0 .
done (4s)
14:49:12
--- bb.js build ---
14:49:13 Cache download and extraction of node-modules-aa659bb2a892ab4f.zst complete in 1s.
14:49:14 Cache download and extraction of bb.js-a4bf2509278deab9.tar.gz complete in 1s.
14:49:14
--- acir_tests build ---
14:49:14 Cache download and extraction of barretenberg-acir-tests-02f79a599fd31657.tar.gz complete in 0s.
14:49:16 Cache download and extraction of node-modules-fec19dc5fe5a76d5.zst complete in 1s.
14:49:16 Executing: cd browser-test-app && yarn build (
http://ci.aztec-labs.com/cc80f4c820d722c0)
14:49:20 0 .
done (4s)
14:49:20 Executing: cd bbjs-test && yarn build (
http://ci.aztec-labs.com/351fc258f1f0ef6d)
14:49:23 0 .
done (3s)
14:49:23
--- avm-transpiler build ---
14:49:23 Cache download and extraction of avm-transpiler-10ea3821ff0e6f60.tar.gz complete in 0s.
14:49:23
--- noir-projects build ---
14:49:23 Executing: prep (
http://ci.aztec-labs.com/b0d814295b2e7aad)
14:49:26 0 .
done (3s)
14:49:26 mock-protocol-circuits Executing: ./mock-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/b462074c8b3e8a26)
14:49:26 noir-protocol-circuits Executing: ./noir-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/be6d82a5f14851ab)
14:49:26 noir-contracts Executing: ./noir-contracts/bootstrap.sh (
http://ci.aztec-labs.com/e37ecaf7174eb48e)
14:49:26 aztec-nr Executing: ./aztec-nr/bootstrap.sh (
http://ci.aztec-labs.com/078005b0dfb93f4f)
14:49:28 noir-contracts 0 ................................................................
14:49:28 noir-contracts 64 ................................................................
14:49:28 noir-contracts 128 ................................................................
14:49:28 noir-contracts 192 ................................................................
14:49:28 noir-contracts 256 ................................................................
14:49:29 noir-contracts 320 ................................................................
14:49:29 noir-contracts 384 ................................................................
14:49:29 noir-contracts 448 ................................................................
14:49:29 noir-contracts 512 ................................................................
14:49:29 noir-contracts 576 ................................................................
14:49:29 noir-contracts 640 ................................................................
14:49:30 noir-contracts 704 ................................................................
14:49:30 noir-contracts 768 ................................................................
14:49:30 noir-contracts 832 ................................................................
14:49:30 noir-contracts 896 ................................................................
14:49:30 noir-contracts 960 ................................................................
14:49:30 noir-contracts 1024 ................................................................
14:49:31 noir-contracts 1088 ................................................................
14:49:31 noir-contracts 1152 ................................................................
14:49:31 noir-contracts 1216 ................................................................
14:49:31 noir-protocol-circuits 0 ................................................................
14:49:31 noir-protocol-circuits 64 ................................................................
14:49:31 noir-contracts 1280 ................................................................
14:49:31 noir-contracts 1344 ................................................................
14:49:31 noir-contracts 1408 .
done (5s)
14:49:32 noir-protocol-circuits 128 ................................................................
14:49:32 aztec-nr 0 .
done (6s)
14:49:33 noir-protocol-circuits 192 ................................................................
14:49:33 mock-protocol-circuits 0 ................................................................
14:49:34 noir-protocol-circuits 256 ................................................................
14:49:35 noir-protocol-circuits 320 ................................................................
14:49:35 mock-protocol-circuits 64 .
done (9s)
14:49:39 noir-protocol-circuits 384 ................................................................
14:49:39 noir-protocol-circuits 448 .
done (13s)
14:49:40
--- l1-contracts build ---
14:49:40 Cache download and extraction of l1-contracts-b16c798236bc092e.tar.gz complete in 0s.
14:49:40
--- yarn-project build ---
14:49:40 Executing: ./bootstrap.sh clean-lite (
http://ci.aztec-labs.com/bbcbbc7c0ff284de)
14:49:40 0 .
done (0s)
14:49:47 Cache download and extraction of node-modules-45f5b7daac61c7b8.zst complete in 7s.
14:49:47 Executing: compile_all (
http://ci.aztec-labs.com/68d15ad6654bf2c9)
14:49:50 0 .
done (3s)
14:49:51 boxes/bootstrap.sh Executing: boxes/bootstrap.sh (
http://ci.aztec-labs.com/4ab550ffdf2ccee0)
14:49:51 playground/bootstrap.sh Executing: playground/bootstrap.sh (
http://ci.aztec-labs.com/618316729dfc93ab)
14:49:51 docs/bootstrap.sh Executing: docs/bootstrap.sh (
http://ci.aztec-labs.com/1ce29f93530bf1cd)
14:49:51 release-image/bootstrap.sh Executing: release-image/bootstrap.sh (
http://ci.aztec-labs.com/421603641aa2e6e7)
14:49:51 spartan/bootstrap.sh Executing: spartan/bootstrap.sh (
http://ci.aztec-labs.com/6fb5795a075a6012)
14:49:51 aztec-up/bootstrap.sh Executing: aztec-up/bootstrap.sh (
http://ci.aztec-labs.com/ef07917c4a4fae56)
14:49:51 aztec-up/bootstrap.sh 0 .
done (0s)
14:49:54 spartan/bootstrap.sh 0 .
done (3s)
14:49:55 boxes/bootstrap.sh 0 .
done (4s)
14:49:55 playground/bootstrap.sh 0 .
done (4s)
14:49:58 docs/bootstrap.sh 0 .
done (7s)
14:50:30 release-image/bootstrap.sh 0 .
done (39s)
14:50:30
--- test all ---
14:50:30 Waiting for TXE's to start...
14:50:33 Gathering tests to run...
14:51:41 Gathered 9399 tests.
14:51:41 Starting parallel run with max 64 jobs...
14:51:41 Executing: parallel -j64 --memsuspend 64G --line-buffer --joblog joblog.txt --halt now,fail=1 'run_test_cmd {}' (
http://ci.aztec-labs.com/203368854ee7e10a)
14:52:12 0 ................................................................
14:53:31 64 ................................................................
14:54:35 128 ................................................................
14:55:22 192 ................................................................
14:55:37 256 ................................................................
14:55:49 320 ................................................................
14:56:09 384 ................................................................
14:56:17 448 ................................................................
14:56:24 512 ................................................................
14:56:34 576 ................................................................
14:56:44 640 ................................................................
14:56:51 704 ................................................................
14:56:59 768 ................................................................
14:57:05 832 ................................................................
14:57:11 896 ................................................................
14:57:16 960 ................................................................
14:57:21 1024 ................................................................
14:57:27 1088 ................................................................
14:57:30 1152 ................................................................
14:57:34 1216 ................................................................
14:57:37 1280 ................................................................
14:57:40 1344 ................................................................
14:57:44 1408 ................................................................
14:58:05 1472 ................................................................
14:58:19 1536 ................................................................
14:58:27 1600 ................................................................
14:58:32 1664 ................................................................
14:58:34 1728 ................................................................
14:58:36 1792 ................................................................
14:58:38 1856 ................................................................
14:58:41 1920 ................................................................
14:58:43 1984 ................................................................
14:58:45 2048 ................................................................
14:58:48 2112 ................................................................
14:58:49 2176 ................................................................
14:58:51 2240 ................................................................
14:58:53 2304 ................................................................
14:58:55 2368 ................................................................
14:59:04 2432 ................................................................
14:59:05 2496 ................................................................
14:59:07 2560 ................................................................
14:59:08 2624 ................................................................
14:59:11 2688 ................................................................
14:59:18 2752 ................................................................
14:59:28 2816 ................................................................
14:59:33 2880 ................................................................
14:59:35 2944 ................................................................
14:59:37 3008 ................................................................
14:59:39 3072 ................................................................
14:59:41 3136 ................................................................
14:59:43 3200 ................................................................
14:59:45 3264 ................................................................
14:59:49 3328 ................................................................
14:59:51 3392 ................................................................
14:59:53 3456 ................................................................
14:59:54 3520 ................................................................
14:59:55 3584 ................................................................
14:59:57 3648 ................................................................
14:59:58 3712 ................................................................
14:59:59 3776 ................................................................
15:00:01 3840 ................................................................
15:00:04 3904 ................................................................
15:00:07 3968 ................................................................
15:00:11 4032 ................................................................
15:00:13 4096 ................................................................
15:00:16 4160 ................................................................
15:00:18 4224 ................................................................
15:00:20 4288 ................................................................
15:00:23 4352 ................................................................
15:00:24 4416 ................................................................
15:00:26 4480 ................................................................
15:00:28 4544 ................................................................
15:00:29 4608 ................................................................
15:00:31 4672 ................................................................
15:00:33 4736 ................................................................
15:00:34 4800 ................................................................
15:00:35 4864 ................................................................
15:00:37 4928 ................................................................
15:00:38 4992 ................................................................
15:00:39 5056 ................................................................
15:00:44 5120 ................................................................
15:00:46 5184 ................................................................
15:00:49 5248 ................................................................
15:00:52 5312 ................................................................
15:00:54 5376 ................................................................
15:00:57 5440 ................................................................
15:01:00 5504 ................................................................
15:01:02 5568 ................................................................
15:01:05 5632 ................................................................
15:01:07 5696 ................................................................
15:01:10 5760 ................................................................
15:01:12 5824 ................................................................
15:01:15 5888 ................................................................
15:01:17 5952 ................................................................
15:01:19 6016 ................................................................
15:01:22 6080 ................................................................
15:01:25 6144 ................................................................
15:01:28 6208 ................................................................
15:01:30 6272 ................................................................
15:01:32 6336 ................................................................
15:01:34 6400 ................................................................
15:01:36 6464 ................................................................
15:01:38 6528 ................................................................
15:01:40 6592 ................................................................
15:01:42 6656 ................................................................
15:01:44 6720 ................................................................
15:01:45 6784 ................................................................
15:01:47 6848 ................................................................
15:01:48 6912 ................................................................
15:01:50 6976 ................................................................
15:01:51 7040 ................................................................
15:01:54 7104 ................................................................
15:01:55 7168 ................................................................
15:01:58 7232 ................................................................
15:02:00 7296 ................................................................
15:02:01 7360 ................................................................
15:02:02 7424 ................................................................
15:02:03 7488 ................................................................
15:02:04 7552 ................................................................
15:02:05 7616 ................................................................
15:02:06 7680 ................................................................
15:02:07 7744 ................................................................
15:02:08 7808 ................................................................
15:02:09 7872 ................................................................
15:02:11 7936 ................................................................
15:02:13 8000 ................................................................
15:02:14 8064 ................................................................
15:02:15 8128 ................................................................
15:02:17 8192 ................................................................
15:02:18 8256 ................................................................
15:02:19 8320 ................................................................
15:02:20 8384 ................................................................
15:02:21 8448 ................................................................
15:02:22 8512 ................................................................
15:02:23 8576 ................................................................
15:02:25 8640 ................................................................
15:02:26 8704 ................................................................
15:02:27 8768 ................................................................
15:02:28 8832 ................................................................
15:02:29 8896 ................................................................
15:02:30 8960 ................................................................
15:02:31 9024 ................................................................
15:02:32 9088 ................................................................
15:02:33 9152 ................................................................
15:02:35 9216 ................................................................
15:02:36 9280 ................................................................
15:02:37 9344 ................................................................
15:02:38 9408 ................................................................
15:02:39 9472 ................................................................
15:02:40 9536 ................................................................
15:06:18 9600 .
done (877s)
15:06:18
WARNING: The following tests exceed 5 minute runtimes. Break them up or rethink them.
15:06:18 300.796: '4bfd2d3585b9db66:ISOLATE=1:NAME=e2e_p2p/add_rollup yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/add_rollup.test.ts'
15:06:18 316.945: 'de30be46e225864a barretenberg/cpp/scripts/run_test.sh dsl_tests AcirAvm2RecursionConstraint.TestGenerateVKFromConstraintsWithoutWitness'
15:06:18 320.930: '4bfd2d3585b9db66:ISOLATE=1:NAME=e2e_epochs/epochs_proof_fails yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_proof_fails.test.ts'
15:06:18 321.029: '025a2f2889357ef6:ONLY_TERM_PARENT=1 BOX=vanilla BROWSER=* run_compose_test vanilla-all-browsers box boxes'
15:06:18 352.205: 'de30be46e225864a:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityFailing'
15:06:18 356.376: 'de30be46e225864a:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityPassing'
15:06:18 368.761: '4bfd2d3585b9db66:ISOLATE=1:NAME=e2e_epochs/epochs_l1_reorgs yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_l1_reorgs.test.ts'
15:06:18 371.266: '4bfd2d3585b9db66:ISOLATE=1:TIMEOUT=15m:NAME=e2e_block_building yarn-project/end-to-end/scripts/run_test.sh simple e2e_block_building'
15:06:18 371.577: '97cfc341852a92fa aztec-up/scripts/run_test.sh amm_flow'
15:06:18 397.384: '4bfd2d3585b9db66:ISOLATE=1:NAME=e2e_p2p/reex yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/reex.test.ts'
15:06:18 454.911: '4bfd2d3585b9db66:ISOLATE=1:NAME=e2e_l1_with_wall_time yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_l1_with_wall_time.test.ts'
15:06:18 461.101: '4bfd2d3585b9db66:ISOLATE=1:NAME=prover-client/src/test/bb_prover_full_rollup.test.ts:CPUS=16:MEM=96g LOG_LEVEL=verbose yarn-project/scripts/run_test.sh prover-client/src/test/bb_prover_full_rollup.test.ts'
15:06:18 568.973: '4bfd2d3585b9db66:ISOLATE=1:NAME=e2e_epochs/epochs_empty_blocks yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_empty_blocks.test.ts'
15:06:18 694.831: '4bfd2d3585b9db66:ISOLATE=1:TIMEOUT=15m:CPUS=16:MEM=96g:NAME=e2e_prover_full_real yarn-project/end-to-end/scripts/run_test.sh simple e2e_prover/full'
15:06:18 Completed run of 9399 tests in 877 seconds.
15:06:18
--- bench all ---
15:06:19 barretenberg/cpp Executing: barretenberg/cpp/bootstrap.sh build_bench (
http://ci.aztec-labs.com/be7952a66fef7c46)
15:06:19 yarn-project/end-to-end Executing: yarn-project/end-to-end/bootstrap.sh build_bench (
http://ci.aztec-labs.com/7312635f1923200f)
15:08:24 yarn-project/end-to-end 0 ................................................................
15:08:54 barretenberg/cpp 0 .
done (155s)
15:10:54 yarn-project/end-to-end 64 ................................................................
15:10:54 yarn-project/end-to-end 128 ................................................................
15:10:54 yarn-project/end-to-end 192 ................................................................
15:10:54 yarn-project/end-to-end 256 ................................................................
15:10:54 yarn-project/end-to-end 320 ................................................................
15:10:54 yarn-project/end-to-end 384 ................................................................
15:10:54 yarn-project/end-to-end 448 ................................................................
15:10:54 yarn-project/end-to-end 512 ................................................................
15:10:54 yarn-project/end-to-end 576 ................................................................
15:10:56 yarn-project/end-to-end 640 .
done (277s)
15:10:58 Starting parallel run using max 64 cpus...
15:10:58 Test run log id:
http://ci.aztec-labs.com/0cb6597f349e6b60
15:15:19 Completed run of 90 tests in 261 seconds.
15:15:22 Completed 6.3 KiB/6.3 KiB (98.1 KiB/s) with 1 file(s) remaining
upload: ../../../tmp/tmp.x6vEr78zgg to s3://aztec-ci-artifacts/build-cache/bench-267ac35e8ccb487bdc79bbe12d428f4c8b4d4d9f.tar.gz
15:15:22 Cache upload of bench-267ac35e8ccb487bdc79bbe12d428f4c8b4d4d9f.tar.gz complete in 2s.
15:15:22 + local code=0
15:15:22 + set +x
15:15:22 dmesg log id:
http://ci.aztec-labs.com/cde46886ea201efe
15:15:22 cpufile log id:
http://ci.aztec-labs.com/1461efe04e323393
15:15:22 memfile log id:
http://ci.aztec-labs.com/10af5457b369ed11
CI run log id:
http://ci.aztec-labs.com/1749826113336
+ code=0
+ case $code in
+ log_ci_run PASSED 1749826113336
+ exit 0
SSH exited with code: 0
Terminating instance: i-041336f1bb0d7f4ed...