Parent Log:
http://ci.aztec-labs.com/15676282638
Command: bootstrap_ec2 './bootstrap.sh ci-full'
Date: Mon Jun 16 09:29:24 UTC 2025
Status: 0
Took: 2101s
--- request build instance ---
Requesting m6a.32xlarge spot instance (name: pr-14986_amd64_x1-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for instance id for spot request: sir-f1vf7yck...
Waiting for SSH at 3.148.174.149...
No tty, running in background...
Loading CRS into tmpfs...
Done in 11 seconds.
Starting devbox...
From
https://github.com/aztecprotocol/aztec-packages
* branch daebab2c4bace59ef25ddb29040a040926f095e6 -> FETCH_HEAD
HEAD is now at daebab2 feat!: staking entry queue (#14986)
Switched to a new branch 'gh-readonly-queue/next/pr-14986-b80949775e5c27908a6055ad24592f7d98bdc45a'
+ ci3/add_timestamps
+ ci3/aws_handle_evict run
+ DUP=1
+ ci3/cache_log 'CI run' 1750064113187
CI run log id:
http://ci.aztec-labs.com/1750064113187
08:55:13 env: REF_NAME=gh-readonly-queue/next/pr-14986-b80949775e5c27908a6055ad24592f7d98bdc45a COMMIT_HASH=daebab2c4bace59ef25ddb29040a040926f095e6 CURRENT_VERSION=0.87.6 TARGET_BRANCH=next
08:55:13 + ./bootstrap.sh ci-full
08:55:20
--- pull submodules ---
08:55:20 Executing: git submodule update --init --recursive (
http://ci.aztec-labs.com/625649cb6362f2e4)
08:55:29 0 .
done (9s)
08:55:30
--- noir build ---
08:55:30 Executing: retry install_deps (
http://ci.aztec-labs.com/b3a9e2d28346e123)
08:55:35 0 .
done (5s)
08:55:36 build_native Executing: build_native (
http://ci.aztec-labs.com/7efe45bdd55acdc5)
08:55:36 build_packages Executing: build_packages (
http://ci.aztec-labs.com/5a586c0fe75919b3)
08:55:36 build_native 0 .
done (0s)
08:55:42 build_packages 0 .
done (6s)
08:55:42
--- bb cpp build ---
08:55:43 build_wasm Executing: build_wasm (
http://ci.aztec-labs.com/06c2b4a14e3a516d)
08:55:43 build_nodejs_module Executing: build_nodejs_module (
http://ci.aztec-labs.com/4579d01ed457ccbf)
08:55:43 build_native Executing: build_native (
http://ci.aztec-labs.com/e1b8d0f0c412fc4a)
08:55:43 build_wasm_threads Executing: build_wasm_threads (
http://ci.aztec-labs.com/1accde26dcd687cd)
08:55:43 build_gcc_syntax_check_only Executing: build_gcc_syntax_check_only (
http://ci.aztec-labs.com/cbf4779c71a016c1)
08:55:43 build_fuzzing_syntax_check_only Executing: build_fuzzing_syntax_check_only (
http://ci.aztec-labs.com/ad4d031a1326581c)
08:55:43 build_asan_fast Executing: build_asan_fast (
http://ci.aztec-labs.com/0bdeaa6b57f391c9)
08:55:43 build_darwin Executing: build_darwin (
http://ci.aztec-labs.com/0fb863f34c774eca)
08:55:43 build_gcc_syntax_check_only 0 .
done (0s)
08:55:43 build_fuzzing_syntax_check_only 0 .
done (0s)
08:55:43 build_darwin 0 .
done (0s)
08:55:43 build_wasm 0 .
done (0s)
08:55:43 build_wasm_threads 0 .
done (0s)
08:55:43 build_nodejs_module 0 .
done (0s)
08:55:44 build_native 0 .
done (1s)
08:55:44 build_asan_fast 0 .
done (1s)
08:55:48
--- bb.js build ---
08:55:49 Cache download and extraction of node-modules-aa659bb2a892ab4f.zst complete in 0s.
08:55:50 Cache download and extraction of bb.js-32262dccd874f9cd.tar.gz complete in 1s.
08:55:50
--- acir_tests build ---
08:55:50 Cache download and extraction of barretenberg-acir-tests-ec319bd41247c671.tar.gz complete in 0s.
08:55:51 Cache download and extraction of node-modules-fec19dc5fe5a76d5.zst complete in 0s.
08:55:51 Executing: cd browser-test-app && yarn build (
http://ci.aztec-labs.com/3cae704a8627375e)
08:55:56 0 .
done (5s)
08:55:56 Executing: cd bbjs-test && yarn build (
http://ci.aztec-labs.com/6bdf80834ce847cf)
08:55:59 0 .
done (3s)
08:55:59
--- avm-transpiler build ---
08:55:59 Cache download and extraction of avm-transpiler-2ef373cf3e06b25d.tar.gz complete in 0s.
08:55:59
--- noir-projects build ---
08:55:59 Executing: prep (
http://ci.aztec-labs.com/b4453795eb172533)
08:56:03 0 .
done (4s)
08:56:03 mock-protocol-circuits Executing: ./mock-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/da24cfd1864a900a)
08:56:03 noir-protocol-circuits Executing: ./noir-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/b043f2e6a248d84e)
08:56:03 noir-contracts Executing: ./noir-contracts/bootstrap.sh (
http://ci.aztec-labs.com/f98ac19b1ad0189c)
08:56:03 aztec-nr Executing: ./aztec-nr/bootstrap.sh (
http://ci.aztec-labs.com/d49c8e0578b32d7f)
08:56:04 noir-contracts 0 ................................................................
08:56:04 noir-contracts 64 ................................................................
08:56:04 noir-contracts 128 ................................................................
08:56:04 noir-contracts 192 ................................................................
08:56:04 noir-contracts 256 ................................................................
08:56:05 noir-contracts 320 ................................................................
08:56:05 noir-contracts 384 ................................................................
08:56:05 noir-contracts 448 ................................................................
08:56:05 noir-contracts 512 ................................................................
08:56:05 noir-contracts 576 ................................................................
08:56:05 noir-contracts 640 ................................................................
08:56:06 noir-contracts 704 ................................................................
08:56:06 noir-contracts 768 ................................................................
08:56:06 noir-contracts 832 ................................................................
08:56:06 noir-contracts 896 ................................................................
08:56:06 noir-contracts 960 ................................................................
08:56:06 noir-contracts 1024 ................................................................
08:56:06 noir-contracts 1088 ................................................................
08:56:07 noir-contracts 1152 ................................................................
08:56:07 noir-contracts 1216 ................................................................
08:56:07 noir-contracts 1280 ................................................................
08:56:07 noir-contracts 1344 ................................................................
08:56:07 noir-contracts 1408 ................................................................
08:56:07 noir-contracts 1472 ................................................................
08:56:07 noir-contracts 1536 ................................................................
08:56:07 noir-contracts 1600 .
done (4s)
08:56:08 noir-protocol-circuits 0 ................................................................
08:56:08 noir-protocol-circuits 64 ................................................................
08:56:09 noir-protocol-circuits 128 ................................................................
08:56:09 aztec-nr 0 .
done (6s)
08:56:09 mock-protocol-circuits 0 ................................................................
08:56:10 noir-protocol-circuits 192 ................................................................
08:56:12 noir-protocol-circuits 256 ................................................................
08:56:16 noir-protocol-circuits 320 ................................................................
08:56:18 noir-protocol-circuits 384 ................................................................
08:56:19 noir-protocol-circuits 448 ................................................................
08:56:21 mock-protocol-circuits 64 ................................................................
08:56:22 noir-protocol-circuits 512 ................................................................
08:56:48 noir-protocol-circuits 576 ................................................................
08:58:50 mock-protocol-circuits 128 .
done (167s)
08:59:57 noir-protocol-circuits 640 ................................................................
08:59:57 noir-protocol-circuits 704 .
done (234s)
08:59:58
--- l1-contracts build ---
08:59:58 Cache download of l1-contracts-bb19bf19d1375181.tar.gz failed.
08:59:58 Updating dependencies in /home/aztec-dev/aztec-packages/l1-contracts/lib
08:59:59 Compiling 265 files with Solc 0.8.27
09:00:39 Solc 0.8.27 finished in 40.56s
09:00:39 Compiler run successful!
09:00:43 Compiling 1 files with Solc 0.8.27
09:00:44 Solc 0.8.27 finished in 343.58ms
09:00:44 Compiler run successful!
09:00:47 Completed 1.0 MiB/11.7 MiB (12.7 MiB/s) with 1 file(s) remaining
Completed 2.0 MiB/11.7 MiB (24.2 MiB/s) with 1 file(s) remaining
Completed 3.0 MiB/11.7 MiB (32.7 MiB/s) with 1 file(s) remaining
Completed 4.0 MiB/11.7 MiB (42.9 MiB/s) with 1 file(s) remaining
Completed 4.7 MiB/11.7 MiB (49.0 MiB/s) with 1 file(s) remaining
Completed 5.7 MiB/11.7 MiB (42.3 MiB/s) with 1 file(s) remaining
Completed 6.7 MiB/11.7 MiB (44.7 MiB/s) with 1 file(s) remaining
Completed 7.7 MiB/11.7 MiB (48.4 MiB/s) with 1 file(s) remaining
Completed 8.7 MiB/11.7 MiB (52.1 MiB/s) with 1 file(s) remaining
Completed 9.7 MiB/11.7 MiB (57.5 MiB/s) with 1 file(s) remaining
Completed 10.7 MiB/11.7 MiB (61.3 MiB/s) with 1 file(s) remaining
Completed 11.7 MiB/11.7 MiB (64.7 MiB/s) with 1 file(s) remaining
upload: ../../../../tmp/tmp.Cuar77Q2kw to s3://aztec-ci-artifacts/build-cache/l1-contracts-bb19bf19d1375181.tar.gz
09:00:47 Cache upload of l1-contracts-bb19bf19d1375181.tar.gz complete in 3s.
09:00:47
--- yarn-project build ---
09:00:47 Executing: ./bootstrap.sh clean-lite (
http://ci.aztec-labs.com/0740e72e20b573bd)
09:00:47 0 .
done (0s)
09:00:52 Cache download and extraction of node-modules-d160581125851fb0.zst complete in 5s.
09:00:52 Executing: compile_all (
http://ci.aztec-labs.com/143c20aa4899ceaa)
09:01:02 0 ................................................................
09:03:27 64 .
done (155s)
09:03:27 boxes/bootstrap.sh Executing: boxes/bootstrap.sh (
http://ci.aztec-labs.com/9dd75589459dfc00)
09:03:27 playground/bootstrap.sh Executing: playground/bootstrap.sh (
http://ci.aztec-labs.com/b21085be078f25a8)
09:03:27 docs/bootstrap.sh Executing: docs/bootstrap.sh (
http://ci.aztec-labs.com/69cffe1d33faf266)
09:03:27 release-image/bootstrap.sh Executing: release-image/bootstrap.sh (
http://ci.aztec-labs.com/18f88f00d7304575)
09:03:27 spartan/bootstrap.sh Executing: spartan/bootstrap.sh (
http://ci.aztec-labs.com/b1862bfab2986977)
09:03:27 aztec-up/bootstrap.sh Executing: aztec-up/bootstrap.sh (
http://ci.aztec-labs.com/7488182fb9baeb5a)
09:03:28 aztec-up/bootstrap.sh 0 .
done (1s)
09:03:30 spartan/bootstrap.sh 0 .
done (3s)
09:03:34 docs/bootstrap.sh 0 .
done (7s)
09:03:59 release-image/bootstrap.sh 0 .
done (32s)
09:04:05 boxes/bootstrap.sh 0 .
done (38s)
09:04:14 playground/bootstrap.sh 0 .
done (47s)
09:04:14
--- test all ---
09:04:14 Waiting for TXE's to start...
09:04:17 Gathering tests to run...
09:05:57 Gathered 11356 tests.
09:05:57 Starting parallel run with max 64 jobs...
09:05:57 Executing: parallel -j64 --memsuspend 64G --line-buffer --joblog joblog.txt --halt now,fail=1 'run_test_cmd {}' (
http://ci.aztec-labs.com/66e7c042a97f543f)
09:06:28 0 ................................................................
09:07:38 64 ................................................................
09:08:46 128 ................................................................
09:09:55 192 ................................................................
09:10:21 256 ................................................................
09:10:31 320 ................................................................
09:10:48 384 ................................................................
09:11:02 448 ................................................................
09:11:09 512 ................................................................
09:11:15 576 ................................................................
09:11:28 640 ................................................................
09:11:36 704 ................................................................
09:11:43 768 ................................................................
09:11:49 832 ................................................................
09:11:56 896 ................................................................
09:12:04 960 ................................................................
09:12:09 1024 ................................................................
09:12:12 1088 ................................................................
09:12:24 1152 ................................................................
09:12:28 1216 ................................................................
09:12:31 1280 ................................................................
09:12:35 1344 ................................................................
09:12:39 1408 ................................................................
09:12:42 1472 ................................................................
09:12:46 1536 ................................................................
09:12:57 1600 ................................................................
09:13:18 1664 ................................................................
09:13:38 1728 ................................................................
09:13:45 1792 ................................................................
09:13:52 1856 ................................................................
09:13:54 1920 ................................................................
09:13:55 1984 ................................................................
09:13:57 2048 ................................................................
09:13:59 2112 ................................................................
09:14:01 2176 ................................................................
09:14:02 2240 ................................................................
09:14:04 2304 ................................................................
09:14:06 2368 ................................................................
09:14:07 2432 ................................................................
09:14:08 2496 ................................................................
09:14:10 2560 ................................................................
09:14:18 2624 ................................................................
09:14:21 2688 ................................................................
09:14:23 2752 ................................................................
09:14:24 2816 ................................................................
09:14:26 2880 ................................................................
09:14:29 2944 ................................................................
09:14:48 3008 ................................................................
09:14:54 3072 ................................................................
09:14:57 3136 ................................................................
09:14:58 3200 ................................................................
09:15:00 3264 ................................................................
09:15:01 3328 ................................................................
09:15:02 3392 ................................................................
09:15:04 3456 ................................................................
09:15:08 3520 ................................................................
09:15:10 3584 ................................................................
09:15:12 3648 ................................................................
09:15:14 3712 ................................................................
09:15:15 3776 ................................................................
09:15:16 3840 ................................................................
09:15:18 3904 ................................................................
09:15:19 3968 ................................................................
09:15:21 4032 ................................................................
09:15:22 4096 ................................................................
09:15:25 4160 ................................................................
09:15:28 4224 ................................................................
09:15:32 4288 ................................................................
09:15:35 4352 ................................................................
09:15:38 4416 ................................................................
09:15:41 4480 ................................................................
09:15:43 4544 ................................................................
09:15:45 4608 ................................................................
09:15:49 4672 ................................................................
09:15:51 4736 ................................................................
09:15:53 4800 ................................................................
09:15:55 4864 ................................................................
09:15:56 4928 ................................................................
09:15:58 4992 ................................................................
09:16:00 5056 ................................................................
09:16:02 5120 ................................................................
09:16:03 5184 ................................................................
09:16:04 5248 ................................................................
09:16:06 5312 ................................................................
09:16:07 5376 ................................................................
09:16:10 5440 ................................................................
09:16:12 5504 ................................................................
09:16:15 5568 ................................................................
09:16:17 5632 ................................................................
09:16:19 5696 ................................................................
09:16:22 5760 ................................................................
09:16:24 5824 ................................................................
09:16:26 5888 ................................................................
09:16:28 5952 ................................................................
09:16:30 6016 ................................................................
09:16:33 6080 ................................................................
09:16:36 6144 ................................................................
09:16:38 6208 ................................................................
09:16:41 6272 ................................................................
09:16:43 6336 ................................................................
09:16:47 6400 ................................................................
09:16:50 6464 ................................................................
09:16:52 6528 ................................................................
09:16:55 6592 ................................................................
09:16:57 6656 ................................................................
09:16:59 6720 ................................................................
09:17:01 6784 ................................................................
09:17:03 6848 ................................................................
09:17:05 6912 ................................................................
09:17:07 6976 ................................................................
09:17:09 7040 ................................................................
09:17:11 7104 ................................................................
09:17:12 7168 ................................................................
09:17:13 7232 ................................................................
09:17:14 7296 ................................................................
09:17:15 7360 ................................................................
09:17:17 7424 ................................................................
09:17:18 7488 ................................................................
09:17:19 7552 ................................................................
09:17:20 7616 ................................................................
09:17:22 7680 ................................................................
09:17:23 7744 ................................................................
09:17:24 7808 ................................................................
09:17:26 7872 ................................................................
09:17:27 7936 ................................................................
09:17:28 8000 ................................................................
09:17:29 8064 ................................................................
09:17:31 8128 ................................................................
09:17:32 8192 ................................................................
09:17:33 8256 ................................................................
09:17:34 8320 ................................................................
09:17:36 8384 ................................................................
09:17:37 8448 ................................................................
09:17:38 8512 ................................................................
09:17:40 8576 ................................................................
09:17:41 8640 ................................................................
09:17:42 8704 ................................................................
09:17:44 8768 ................................................................
09:17:45 8832 ................................................................
09:17:47 8896 ................................................................
09:17:49 8960 ................................................................
09:17:50 9024 ................................................................
09:17:52 9088 ................................................................
09:17:54 9152 ................................................................
09:17:55 9216 ................................................................
09:17:56 9280 ................................................................
09:17:57 9344 ................................................................
09:17:58 9408 ................................................................
09:17:59 9472 ................................................................
09:18:00 9536 ................................................................
09:18:01 9600 ................................................................
09:18:02 9664 ................................................................
09:18:04 9728 ................................................................
09:18:05 9792 ................................................................
09:18:07 9856 ................................................................
09:18:08 9920 ................................................................
09:18:09 9984 ................................................................
09:18:10 10048 ................................................................
09:18:12 10112 ................................................................
09:18:12 10176 ................................................................
09:18:13 10240 ................................................................
09:18:14 10304 ................................................................
09:18:15 10368 ................................................................
09:18:17 10432 ................................................................
09:18:18 10496 ................................................................
09:18:19 10560 ................................................................
09:18:20 10624 ................................................................
09:18:21 10688 ................................................................
09:18:22 10752 ................................................................
09:18:23 10816 ................................................................
09:18:24 10880 ................................................................
09:18:25 10944 ................................................................
09:18:26 11008 ................................................................
09:18:28 11072 ................................................................
09:18:29 11136 ................................................................
09:18:30 11200 ................................................................
09:18:31 11264 ................................................................
09:18:32 11328 ................................................................
09:18:33 11392 ................................................................
09:18:34 11456 ................................................................
09:18:35 11520 ................................................................
09:19:41 11584 .
done (824s)
09:19:41
WARNING: The following tests exceed 5 minute runtimes. Break them up or rethink them.
09:19:41 316.748: '1213493448839150 noir-projects/scripts/run_test.sh noir-protocol-circuits rollup_lib block_root::block_root_rollup_inputs::tests::correct_blobs_with_non_empty_fields'
09:19:41 330.257: '56432573a8f669fa:ONLY_TERM_PARENT=1 BOX=vanilla BROWSER=* run_compose_test vanilla-all-browsers box boxes'
09:19:41 336.210: '76b039a0ac133f0c barretenberg/cpp/scripts/run_test.sh dsl_tests AcirAvm2RecursionConstraint.TestGenerateVKFromConstraintsWithoutWitness'
09:19:41 361.022: '731d98bdb3377842:ISOLATE=1:NAME=e2e_p2p/data_withholding_slash yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/data_withholding_slash.test.ts'
09:19:41 377.977: '731d98bdb3377842:ISOLATE=1:NAME=p2p/src/client/p2p_client.integration.test.ts LOG_LEVEL=debug yarn-project/scripts/run_test.sh p2p/src/client/p2p_client.integration.test.ts'
09:19:41 379.726: '76b039a0ac133f0c:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityPassing'
09:19:41 380.107: 'ea17931dd3b6732e aztec-up/scripts/run_test.sh amm_flow'
09:19:41 384.197: '76b039a0ac133f0c:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityFailing'
09:19:41 404.671: '731d98bdb3377842:ISOLATE=1:NAME=e2e_p2p/reex yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/reex.test.ts'
09:19:41 419.256: '731d98bdb3377842:ISOLATE=1:NAME=e2e_l1_with_wall_time yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_l1_with_wall_time.test.ts'
09:19:41 451.815: '731d98bdb3377842:ISOLATE=1:TIMEOUT=15m:NAME=e2e_block_building yarn-project/end-to-end/scripts/run_test.sh simple e2e_block_building'
09:19:41 452.805: '731d98bdb3377842:ISOLATE=1:NAME=prover-client/src/test/bb_prover_full_rollup.test.ts:CPUS=16:MEM=96g LOG_LEVEL=verbose yarn-project/scripts/run_test.sh prover-client/src/test/bb_prover_full_rollup.test.ts'
09:19:41 778.346: '731d98bdb3377842:ISOLATE=1:TIMEOUT=15m:CPUS=16:MEM=96g:NAME=e2e_prover_full_real yarn-project/end-to-end/scripts/run_test.sh simple e2e_prover/full'
09:19:41 Completed run of 11356 tests in 824 seconds.
09:19:41
--- bench all ---
09:19:41 barretenberg/cpp Executing: barretenberg/cpp/bootstrap.sh build_bench (
http://ci.aztec-labs.com/5ba536755f8d64ea)
09:19:41 yarn-project/end-to-end Executing: yarn-project/end-to-end/bootstrap.sh build_bench (
http://ci.aztec-labs.com/19bd934101e6df90)
09:19:42 barretenberg/cpp 0 .
done (1s)
09:21:46 yarn-project/end-to-end 0 ................................................................
09:24:42 yarn-project/end-to-end 64 ................................................................
09:24:42 yarn-project/end-to-end 128 ................................................................
09:24:42 yarn-project/end-to-end 192 ................................................................
09:24:42 yarn-project/end-to-end 256 ................................................................
09:24:42 yarn-project/end-to-end 320 ................................................................
09:24:42 yarn-project/end-to-end 384 ................................................................
09:24:42 yarn-project/end-to-end 448 ................................................................
09:24:42 yarn-project/end-to-end 512 ................................................................
09:24:42 yarn-project/end-to-end 576 ................................................................
09:24:45 yarn-project/end-to-end 640 .
done (304s)
09:24:46 Starting parallel run using max 64 cpus...
09:24:46 Test run log id:
http://ci.aztec-labs.com/2b05be2dd32fd3aa
09:29:15 Completed run of 91 tests in 269 seconds.
09:29:18 Completed 6.8 KiB/6.8 KiB (74.8 KiB/s) with 1 file(s) remaining
upload: ../../../tmp/tmp.Ec7YXgJuDw to s3://aztec-ci-artifacts/build-cache/bench-daebab2c4bace59ef25ddb29040a040926f095e6.tar.gz
09:29:18 Cache upload of bench-daebab2c4bace59ef25ddb29040a040926f095e6.tar.gz complete in 1s.
09:29:18 + local code=0
09:29:18 + set +x
09:29:18 dmesg log id:
http://ci.aztec-labs.com/3a81262d7654c8aa
09:29:18 cpufile log id:
http://ci.aztec-labs.com/4e74206521e8349d
09:29:19 memfile log id:
http://ci.aztec-labs.com/4c8bdae5c96ca259
CI run log id:
http://ci.aztec-labs.com/1750064113187
+ code=0
+ case $code in
+ log_ci_run PASSED 1750064113187
+ exit 0
SSH exited with code: 0
Terminating instance: i-04f05868efea86645...