Parent Log:
http://ci.aztec-labs.com/15731374977
Command: bootstrap_ec2 './bootstrap.sh ci-full'
Date: Wed Jun 18 11:56:20 UTC 2025
Status: 0
Took: 2275s
--- request build instance ---
Requesting m6a.32xlarge spot instance (name: pr-14921_amd64_x2-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for instance id for spot request: sir-p1mq4wgh...
Waiting for SSH at 3.16.70.243...
No tty, running in background...
Loading CRS into tmpfs...
Done in 17 seconds.
Starting devbox...
From
https://github.com/aztecprotocol/aztec-packages
* branch 8cc8a56892d36191eefb49254ebbe49ea99ef4b8 -> FETCH_HEAD
HEAD is now at 8cc8a56 chore: Limit IVC verification concurrency (#14921)
Switched to a new branch 'gh-readonly-queue/next/pr-14921-78d87cb88633aee537d022d6fd8e57ceb74a3a95'
+ ci3/aws_handle_evict run
+ ci3/add_timestamps
+ DUP=1
+ ci3/cache_log 'CI run' 1750245561946
CI run log id:
http://ci.aztec-labs.com/1750245561946
11:19:22 env: REF_NAME=gh-readonly-queue/next/pr-14921-78d87cb88633aee537d022d6fd8e57ceb74a3a95 COMMIT_HASH=8cc8a56892d36191eefb49254ebbe49ea99ef4b8 CURRENT_VERSION=0.87.6 TARGET_BRANCH=next
11:19:22 + ./bootstrap.sh ci-full
11:19:30
--- pull submodules ---
11:19:30 Executing: git submodule update --init --recursive (
http://ci.aztec-labs.com/940f447154e71014)
11:19:40 0 .
done (10s)
11:19:41
--- noir build ---
11:19:41 Executing: retry install_deps (
http://ci.aztec-labs.com/523f350f8b362841)
11:19:45 0 .
done (4s)
11:19:46 build_native Executing: build_native (
http://ci.aztec-labs.com/148fe6f02a2b872f)
11:19:46 build_packages Executing: build_packages (
http://ci.aztec-labs.com/f8c6c94175bb30c6)
11:19:46 build_native 0 .
done (0s)
11:19:52 build_packages 0 .
done (6s)
11:19:53
--- bb cpp build ---
11:19:54 build_nodejs_module Executing: build_nodejs_module (
http://ci.aztec-labs.com/c877955d775f1593)
11:19:54 build_native Executing: build_native (
http://ci.aztec-labs.com/637d5389df041a42)
11:19:54 build_wasm Executing: build_wasm (
http://ci.aztec-labs.com/752e05d3f495375e)
11:19:54 build_wasm_threads Executing: build_wasm_threads (
http://ci.aztec-labs.com/d9c79fd18bb58c41)
11:19:54 build_gcc_syntax_check_only Executing: build_gcc_syntax_check_only (
http://ci.aztec-labs.com/a8b973a614881aa8)
11:19:54 build_fuzzing_syntax_check_only Executing: build_fuzzing_syntax_check_only (
http://ci.aztec-labs.com/50a16038b8cdc63a)
11:19:54 build_asan_fast Executing: build_asan_fast (
http://ci.aztec-labs.com/ae20a4c9edaf074e)
11:19:54 build_darwin Executing: build_darwin (
http://ci.aztec-labs.com/c6c07fa13ba2806d)
11:19:54 build_fuzzing_syntax_check_only 0 .
done (0s)
11:19:54 build_gcc_syntax_check_only 0 .
done (0s)
11:19:54 build_wasm 0 .
done (0s)
11:19:54 build_darwin 0 .
done (0s)
11:19:54 build_wasm_threads 0 .
done (0s)
11:19:54 build_nodejs_module 0 .
done (0s)
11:19:55 build_native 0 .
done (1s)
11:19:55 build_asan_fast 0 .
done (1s)
11:20:00
--- bb.js build ---
11:20:01 Cache download and extraction of node-modules-e85320bda7d59d54.zst complete in 1s.
11:20:01 Cache download and extraction of bb.js-a4d1fce58d939e86.tar.gz complete in 0s.
11:20:03
--- acir_tests build ---
11:20:03 Cache download and extraction of barretenberg-acir-tests-7435b7d717fa5ea6.tar.gz complete in 0s.
11:20:04 Cache download and extraction of node-modules-fec19dc5fe5a76d5.zst complete in 1s.
11:20:04 Executing: cd browser-test-app && yarn build (
http://ci.aztec-labs.com/05e78e623ae1599c)
11:20:09 0 .
done (5s)
11:20:09 Executing: cd bbjs-test && yarn build (
http://ci.aztec-labs.com/f12cc2adf4cb0b35)
11:20:11 0 .
done (2s)
11:20:12
--- avm-transpiler build ---
11:20:12 Cache download and extraction of avm-transpiler-d7aa7d339b410ee2.tar.gz complete in 0s.
11:20:12
--- noir-projects build ---
11:20:12 Executing: prep (
http://ci.aztec-labs.com/08ab1d86f3499007)
11:20:15 0 .
done (3s)
11:20:15 mock-protocol-circuits Executing: ./mock-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/939358c4403b84f4)
11:20:15 noir-protocol-circuits Executing: ./noir-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/f4451a99eede881e)
11:20:15 noir-contracts Executing: ./noir-contracts/bootstrap.sh (
http://ci.aztec-labs.com/d93f746f5db2f18d)
11:20:15 aztec-nr Executing: ./aztec-nr/bootstrap.sh (
http://ci.aztec-labs.com/fab489aef690710d)
11:20:17 noir-contracts 0 ................................................................
11:20:17 noir-contracts 64 ................................................................
11:20:17 noir-contracts 128 ................................................................
11:20:17 noir-contracts 192 ................................................................
11:20:18 noir-contracts 256 ................................................................
11:20:18 noir-contracts 320 ................................................................
11:20:18 noir-contracts 384 ................................................................
11:20:18 noir-contracts 448 ................................................................
11:20:18 noir-contracts 512 ................................................................
11:20:18 noir-contracts 576 ................................................................
11:20:19 noir-contracts 640 ................................................................
11:20:19 noir-contracts 704 ................................................................
11:20:19 noir-contracts 768 ................................................................
11:20:19 noir-contracts 832 ................................................................
11:20:19 noir-contracts 896 ................................................................
11:20:20 noir-contracts 960 ................................................................
11:20:20 noir-contracts 1024 ................................................................
11:20:20 noir-contracts 1088 ................................................................
11:20:20 noir-contracts 1152 ................................................................
11:20:21 noir-contracts 1216 ................................................................
11:20:21 noir-contracts 1280 ................................................................
11:20:21 noir-protocol-circuits 0 ................................................................
11:20:21 noir-protocol-circuits 64 ................................................................
11:20:21 noir-contracts 1344 ................................................................
11:20:21 noir-contracts 1408 ................................................................
11:20:21 noir-contracts 1472 ................................................................
11:20:21 noir-contracts 1536 ................................................................
11:20:21 noir-contracts 1600 .
done (6s)
11:20:22 noir-protocol-circuits 128 ................................................................
11:20:22 aztec-nr 0 .
done (7s)
11:20:23 mock-protocol-circuits 0 ................................................................
11:20:23 noir-protocol-circuits 192 ................................................................
11:20:25 noir-protocol-circuits 256 ................................................................
11:20:29 noir-protocol-circuits 320 ................................................................
11:20:30 noir-protocol-circuits 384 ................................................................
11:20:32 noir-protocol-circuits 448 ................................................................
11:20:34 mock-protocol-circuits 64 ................................................................
11:20:35 noir-protocol-circuits 512 ................................................................
11:21:28 noir-protocol-circuits 576 ................................................................
11:23:09 mock-protocol-circuits 128 .
done (174s)
11:24:26 noir-protocol-circuits 640 ................................................................
11:24:26 noir-protocol-circuits 704 .
done (251s)
11:24:26
--- l1-contracts build ---
11:24:26 Cache download and extraction of l1-contracts-086fc344fc430142.tar.gz complete in 0s.
11:24:26
--- yarn-project build ---
11:24:26 Executing: ./bootstrap.sh clean-lite (
http://ci.aztec-labs.com/d6db8f857adb7ee3)
11:24:27 0 .
done (1s)
11:24:31 Cache download and extraction of node-modules-759d401ab6f7f5f6.zst complete in 4s.
11:24:31 Executing: compile_all (
http://ci.aztec-labs.com/1111cc241a8ea8e6)
11:24:42 0 ................................................................
11:27:03 64 .
done (152s)
11:27:03 playground/bootstrap.sh Executing: playground/bootstrap.sh (
http://ci.aztec-labs.com/cc6b04a0a57bffaf)
11:27:03 boxes/bootstrap.sh Executing: boxes/bootstrap.sh (
http://ci.aztec-labs.com/56970eef1c91623b)
11:27:03 docs/bootstrap.sh Executing: docs/bootstrap.sh (
http://ci.aztec-labs.com/2232aa68b99206eb)
11:27:03 release-image/bootstrap.sh Executing: release-image/bootstrap.sh (
http://ci.aztec-labs.com/4e5fe35e08c98bb3)
11:27:03 spartan/bootstrap.sh Executing: spartan/bootstrap.sh (
http://ci.aztec-labs.com/dda96098aac4b079)
11:27:03 aztec-up/bootstrap.sh Executing: aztec-up/bootstrap.sh (
http://ci.aztec-labs.com/d204d24252e5942a)
11:27:04 aztec-up/bootstrap.sh 0 .
done (1s)
11:27:08 spartan/bootstrap.sh 0 .
done (5s)
11:27:11 docs/bootstrap.sh 0 .
done (8s)
11:27:35 release-image/bootstrap.sh 0 .
done (32s)
11:27:44 boxes/bootstrap.sh 0 .
done (41s)
11:28:02 playground/bootstrap.sh 0 .
done (59s)
11:28:02
--- test all ---
11:28:02 Waiting for TXE's to start...
11:28:05 Gathering tests to run...
11:29:47 Gathered 12064 tests.
11:29:47 Starting parallel run with max 64 jobs...
11:29:47 Executing: parallel -j64 --memsuspend 64G --line-buffer --joblog joblog.txt --halt now,fail=1 'run_test_cmd {}' (
http://ci.aztec-labs.com/0f04f3152db33879)
11:30:18 0 ................................................................
11:31:29 64 ................................................................
11:32:42 128 ................................................................
11:33:49 192 ................................................................
11:34:21 256 ................................................................
11:34:30 320 ................................................................
11:34:48 384 ................................................................
11:35:03 448 ................................................................
11:35:10 512 ................................................................
11:35:17 576 ................................................................
11:35:30 640 ................................................................
11:35:38 704 ................................................................
11:35:46 768 ................................................................
11:35:52 832 ................................................................
11:35:59 896 ................................................................
11:36:06 960 ................................................................
11:36:11 1024 ................................................................
11:36:14 1088 ................................................................
11:36:23 1152 ................................................................
11:36:31 1216 ................................................................
11:36:34 1280 ................................................................
11:36:38 1344 ................................................................
11:36:41 1408 ................................................................
11:36:44 1472 ................................................................
11:36:47 1536 ................................................................
11:36:59 1600 ................................................................
11:37:20 1664 ................................................................
11:37:39 1728 ................................................................
11:37:46 1792 ................................................................
11:37:52 1856 ................................................................
11:37:54 1920 ................................................................
11:37:56 1984 ................................................................
11:37:58 2048 ................................................................
11:37:59 2112 ................................................................
11:38:01 2176 ................................................................
11:38:03 2240 ................................................................
11:38:04 2304 ................................................................
11:38:06 2368 ................................................................
11:38:07 2432 ................................................................
11:38:09 2496 ................................................................
11:38:10 2560 ................................................................
11:38:17 2624 ................................................................
11:38:20 2688 ................................................................
11:38:21 2752 ................................................................
11:38:22 2816 ................................................................
11:38:25 2880 ................................................................
11:38:29 2944 ................................................................
11:38:49 3008 ................................................................
11:38:53 3072 ................................................................
11:38:56 3136 ................................................................
11:38:58 3200 ................................................................
11:39:00 3264 ................................................................
11:39:01 3328 ................................................................
11:39:02 3392 ................................................................
11:39:04 3456 ................................................................
11:39:08 3520 ................................................................
11:39:11 3584 ................................................................
11:39:13 3648 ................................................................
11:39:15 3712 ................................................................
11:39:16 3776 ................................................................
11:39:17 3840 ................................................................
11:39:19 3904 ................................................................
11:39:20 3968 ................................................................
11:39:22 4032 ................................................................
11:39:23 4096 ................................................................
11:39:26 4160 ................................................................
11:39:29 4224 ................................................................
11:39:33 4288 ................................................................
11:39:37 4352 ................................................................
11:39:40 4416 ................................................................
11:39:43 4480 ................................................................
11:39:46 4544 ................................................................
11:39:48 4608 ................................................................
11:39:51 4672 ................................................................
11:39:53 4736 ................................................................
11:39:55 4800 ................................................................
11:39:57 4864 ................................................................
11:40:00 4928 ................................................................
11:40:01 4992 ................................................................
11:40:03 5056 ................................................................
11:40:05 5120 ................................................................
11:40:07 5184 ................................................................
11:40:09 5248 ................................................................
11:40:10 5312 ................................................................
11:40:12 5376 ................................................................
11:40:13 5440 ................................................................
11:40:16 5504 ................................................................
11:40:19 5568 ................................................................
11:40:21 5632 ................................................................
11:40:24 5696 ................................................................
11:40:26 5760 ................................................................
11:40:28 5824 ................................................................
11:40:30 5888 ................................................................
11:40:32 5952 ................................................................
11:40:35 6016 ................................................................
11:40:37 6080 ................................................................
11:40:39 6144 ................................................................
11:40:42 6208 ................................................................
11:40:45 6272 ................................................................
11:40:47 6336 ................................................................
11:40:50 6400 ................................................................
11:40:53 6464 ................................................................
11:40:56 6528 ................................................................
11:40:59 6592 ................................................................
11:41:02 6656 ................................................................
11:41:04 6720 ................................................................
11:41:06 6784 ................................................................
11:41:08 6848 ................................................................
11:41:10 6912 ................................................................
11:41:12 6976 ................................................................
11:41:15 7040 ................................................................
11:41:17 7104 ................................................................
11:41:19 7168 ................................................................
11:41:20 7232 ................................................................
11:41:21 7296 ................................................................
11:41:22 7360 ................................................................
11:41:24 7424 ................................................................
11:41:25 7488 ................................................................
11:41:27 7552 ................................................................
11:41:28 7616 ................................................................
11:41:29 7680 ................................................................
11:41:30 7744 ................................................................
11:41:31 7808 ................................................................
11:41:33 7872 ................................................................
11:41:34 7936 ................................................................
11:41:35 8000 ................................................................
11:41:37 8064 ................................................................
11:41:38 8128 ................................................................
11:41:39 8192 ................................................................
11:41:41 8256 ................................................................
11:41:42 8320 ................................................................
11:41:43 8384 ................................................................
11:41:44 8448 ................................................................
11:41:46 8512 ................................................................
11:41:47 8576 ................................................................
11:41:48 8640 ................................................................
11:41:49 8704 ................................................................
11:41:50 8768 ................................................................
11:41:51 8832 ................................................................
11:41:52 8896 ................................................................
11:41:54 8960 ................................................................
11:41:55 9024 ................................................................
11:41:57 9088 ................................................................
11:41:58 9152 ................................................................
11:41:59 9216 ................................................................
11:42:01 9280 ................................................................
11:42:02 9344 ................................................................
11:42:04 9408 ................................................................
11:42:05 9472 ................................................................
11:42:07 9536 ................................................................
11:42:08 9600 ................................................................
11:42:10 9664 ................................................................
11:42:12 9728 ................................................................
11:42:13 9792 ................................................................
11:42:15 9856 ................................................................
11:42:16 9920 ................................................................
11:42:17 9984 ................................................................
11:42:18 10048 ................................................................
11:42:19 10112 ................................................................
11:42:21 10176 ................................................................
11:42:22 10240 ................................................................
11:42:23 10304 ................................................................
11:42:24 10368 ................................................................
11:42:26 10432 ................................................................
11:42:27 10496 ................................................................
11:42:28 10560 ................................................................
11:42:29 10624 ................................................................
11:42:31 10688 ................................................................
11:42:32 10752 ................................................................
11:42:33 10816 ................................................................
11:42:34 10880 ................................................................
11:42:35 10944 ................................................................
11:42:36 11008 ................................................................
11:42:38 11072 ................................................................
11:42:39 11136 ................................................................
11:42:40 11200 ................................................................
11:42:41 11264 ................................................................
11:42:42 11328 ................................................................
11:42:43 11392 ................................................................
11:42:45 11456 ................................................................
11:42:46 11520 ................................................................
11:42:47 11584 ................................................................
11:42:48 11648 ................................................................
11:42:49 11712 ................................................................
11:42:50 11776 ................................................................
11:42:51 11840 ................................................................
11:42:52 11904 ................................................................
11:42:53 11968 ................................................................
11:42:54 12032 ................................................................
11:42:55 12096 ................................................................
11:42:56 12160 ................................................................
11:42:58 12224 ................................................................
11:43:10 12288 ................................................................
11:45:38 12352 .
done (951s)
11:45:38
WARNING: The following tests exceed 5 minute runtimes. Break them up or rethink them.
11:45:38 302.888: '1c4b0bdf550ede4a noir-projects/scripts/run_test.sh noir-protocol-circuits rollup_lib block_root::block_root_rollup_inputs::tests::correct_blobs_with_non_empty_fields'
11:45:38 341.032: '24e90b7895ff1ed6:ISOLATE=1:NAME=e2e_p2p/data_withholding_slash yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/data_withholding_slash.test.ts'
11:45:38 342.763: '17f1ce0a127de26d barretenberg/cpp/scripts/run_test.sh dsl_tests AcirAvm2RecursionConstraint.TestGenerateVKFromConstraintsWithoutWitness'
11:45:38 342.970: '8c27b04c159445e9:ONLY_TERM_PARENT=1 BOX=vanilla BROWSER=* run_compose_test vanilla-all-browsers box boxes'
11:45:38 376.754: '17f1ce0a127de26d:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityFailing'
11:45:38 377.234: '17f1ce0a127de26d:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityPassing'
11:45:38 392.571: '392b0236741bc79f aztec-up/scripts/run_test.sh amm_flow'
11:45:38 404.488: '24e90b7895ff1ed6:ISOLATE=1:NAME=p2p/src/client/p2p_client.integration.test.ts LOG_LEVEL=debug yarn-project/scripts/run_test.sh p2p/src/client/p2p_client.integration.test.ts'
11:45:38 433.734: '24e90b7895ff1ed6:ISOLATE=1:NAME=e2e_p2p/reex yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/reex.test.ts'
11:45:38 444.178: '24e90b7895ff1ed6:ISOLATE=1:NAME=e2e_l1_with_wall_time yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_l1_with_wall_time.test.ts'
11:45:38 454.924: '24e90b7895ff1ed6:ISOLATE=1:NAME=prover-client/src/test/bb_prover_full_rollup.test.ts:CPUS=16:MEM=96g LOG_LEVEL=verbose yarn-project/scripts/run_test.sh prover-client/src/test/bb_prover_full_rollup.test.ts'
11:45:38 468.955: '24e90b7895ff1ed6:ISOLATE=1:TIMEOUT=15m:NAME=e2e_block_building yarn-project/end-to-end/scripts/run_test.sh simple e2e_block_building'
11:45:38 788.986: '24e90b7895ff1ed6:ISOLATE=1:TIMEOUT=15m:CPUS=16:MEM=96g:NAME=e2e_prover_full_real yarn-project/end-to-end/scripts/run_test.sh simple e2e_prover/full'
11:45:38 Completed run of 12064 tests in 951 seconds.
11:45:38
--- bench all ---
11:45:39 barretenberg/cpp Executing: barretenberg/cpp/bootstrap.sh build_bench (
http://ci.aztec-labs.com/ee862ac6338b48d0)
11:45:39 yarn-project/end-to-end Executing: yarn-project/end-to-end/bootstrap.sh build_bench (
http://ci.aztec-labs.com/e24013b8c493431f)
11:45:39 barretenberg/cpp 0 .
done (0s)
11:47:47 yarn-project/end-to-end 0 ................................................................
11:50:54 yarn-project/end-to-end 64 .
done (315s)
11:50:55 Starting parallel run using max 64 cpus...
11:50:55 Test run log id:
http://ci.aztec-labs.com/d0bd544b658c1d67
11:56:12 Completed run of 94 tests in 317 seconds.
11:56:15 Completed 7.4 KiB/7.4 KiB (85.4 KiB/s) with 1 file(s) remaining
upload: ../../../tmp/tmp.ZCM99qgnWd to s3://aztec-ci-artifacts/build-cache/bench-8cc8a56892d36191eefb49254ebbe49ea99ef4b8.tar.gz
11:56:15 Cache upload of bench-8cc8a56892d36191eefb49254ebbe49ea99ef4b8.tar.gz complete in 2s.
11:56:15 + local code=0
11:56:15 + set +x
11:56:15 dmesg log id:
http://ci.aztec-labs.com/2714daf93048cb15
11:56:15 cpufile log id:
http://ci.aztec-labs.com/284bf864ae727c7a
11:56:15 memfile log id:
http://ci.aztec-labs.com/15e11af06e6d8b29
CI run log id:
http://ci.aztec-labs.com/1750245561946
+ code=0
+ case $code in
+ log_ci_run PASSED 1750245561946
+ exit 0
SSH exited with code: 0
Terminating instance: i-0e1f00436be4d471b...