Parent Log:
http://ci.aztec-labs.com/15684782454
Command: bootstrap_ec2 './bootstrap.sh ci-full'
Date: Mon Jun 16 15:52:02 UTC 2025
Status: 0
Took: 2143s
--- request build instance ---
Terminating existing instance: i-0ad350d072dfbe50c
Requesting m6a.32xlarge spot instance (name: pr-15073_amd64_x1-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for instance id for spot request: sir-6gef54kg...
Timeout waiting for spot request.
Requesting m6a.32xlarge on-demand instance (name: pr-15073_amd64_x1-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for SSH at 3.15.232.21...
No tty, running in background...
Loading CRS into tmpfs...
Done in 11 seconds.
Starting devbox...
From
https://github.com/aztecprotocol/aztec-packages
* branch fa4d5ef48c8de52059b5658bbd42e4514386f7db -> FETCH_HEAD
HEAD is now at fa4d5ef chore(bb-pilcom): support aliases in skippable (#15073)
Switched to a new branch 'gh-readonly-queue/next/pr-15073-5ca43853c40a2b8bfbc2148d5fdd46c6f82a74eb'
+ ci3/aws_handle_evict run
+ ci3/add_timestamps
+ DUP=1
+ ci3/cache_log 'CI run' 1750087074119
CI run log id:
http://ci.aztec-labs.com/1750087074119
15:17:54 env: REF_NAME=gh-readonly-queue/next/pr-15073-5ca43853c40a2b8bfbc2148d5fdd46c6f82a74eb COMMIT_HASH=fa4d5ef48c8de52059b5658bbd42e4514386f7db CURRENT_VERSION=0.87.6 TARGET_BRANCH=next
15:17:54 + ./bootstrap.sh ci-full
15:18:01
--- pull submodules ---
15:18:01 Executing: git submodule update --init --recursive (
http://ci.aztec-labs.com/28b3ccaf00c79a51)
15:18:10 0 .
done (9s)
15:18:11
--- noir build ---
15:18:11 Executing: retry install_deps (
http://ci.aztec-labs.com/f7a08b381d4f3520)
15:18:15 0 .
done (4s)
15:18:16 build_native Executing: build_native (
http://ci.aztec-labs.com/1fd44f25339a0f1e)
15:18:16 build_packages Executing: build_packages (
http://ci.aztec-labs.com/b0c09c2ea37d4c0b)
15:18:16 build_native 0 .
done (0s)
15:18:22 build_packages 0 .
done (6s)
15:18:23
--- bb cpp build ---
15:18:23 build_native Executing: build_native (
http://ci.aztec-labs.com/d3b74833f2fa85b4)
15:18:23 build_nodejs_module Executing: build_nodejs_module (
http://ci.aztec-labs.com/24a8d71f14188cd2)
15:18:23 build_wasm Executing: build_wasm (
http://ci.aztec-labs.com/f589d1aeb57d6baa)
15:18:23 build_wasm_threads Executing: build_wasm_threads (
http://ci.aztec-labs.com/c31bab3a41b9efd0)
15:18:23 build_gcc_syntax_check_only Executing: build_gcc_syntax_check_only (
http://ci.aztec-labs.com/739bea22aee4fe4c)
15:18:23 build_fuzzing_syntax_check_only Executing: build_fuzzing_syntax_check_only (
http://ci.aztec-labs.com/883bf9baaa367853)
15:18:23 build_asan_fast Executing: build_asan_fast (
http://ci.aztec-labs.com/040cafc1f7b74f95)
15:18:23 build_darwin Executing: build_darwin (
http://ci.aztec-labs.com/2572b3d7b660748e)
15:18:23 build_gcc_syntax_check_only 0 .
done (0s)
15:18:23 build_fuzzing_syntax_check_only 0 .
done (0s)
15:18:23 build_wasm 0 .
done (0s)
15:18:23 build_wasm_threads 0 .
done (0s)
15:18:24 build_nodejs_module 0 .
done (1s)
15:18:24 build_native 0 .
done (1s)
15:18:25 build_asan_fast 0 .
done (2s)
15:18:36 build_darwin 0 ................................................................
15:18:43 build_darwin 64 ................................................................
15:18:48 build_darwin 128 ................................................................
15:18:52 build_darwin 192 ................................................................
15:18:55 build_darwin 256 ................................................................
15:19:01 build_darwin 320 ................................................................
15:19:07 build_darwin 384 ................................................................
15:19:14 build_darwin 448 ................................................................
15:19:31 build_darwin 512 ................................................................
15:20:54 build_darwin 576 .
done (151s)
15:20:59
--- bb.js build ---
15:21:00 Cache download and extraction of node-modules-27a69dd9b9012b6d.zst complete in 1s.
15:21:00 Cache download and extraction of bb.js-d405f006a32994f5.tar.gz complete in 0s.
15:21:00
--- acir_tests build ---
15:21:00 Cache download and extraction of barretenberg-acir-tests-f2c4e7093ed993fc.tar.gz complete in 0s.
15:21:01 Cache download and extraction of node-modules-fec19dc5fe5a76d5.zst complete in 0s.
15:21:01 Executing: cd browser-test-app && yarn build (
http://ci.aztec-labs.com/89d28147590562fc)
15:21:06 0 .
done (5s)
15:21:06 Executing: cd bbjs-test && yarn build (
http://ci.aztec-labs.com/eb764d675875dedb)
15:21:09 0 .
done (3s)
15:21:09
--- avm-transpiler build ---
15:21:09 Cache download and extraction of avm-transpiler-2ef373cf3e06b25d.tar.gz complete in 0s.
15:21:09
--- noir-projects build ---
15:21:10 Executing: prep (
http://ci.aztec-labs.com/3686d451cba11d4f)
15:21:12 0 .
done (3s)
15:21:13 mock-protocol-circuits Executing: ./mock-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/dfd052715b39d183)
15:21:13 noir-protocol-circuits Executing: ./noir-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/069743846af26abf)
15:21:13 noir-contracts Executing: ./noir-contracts/bootstrap.sh (
http://ci.aztec-labs.com/a807018474023a3c)
15:21:13 aztec-nr Executing: ./aztec-nr/bootstrap.sh (
http://ci.aztec-labs.com/c153b30a4ea40afa)
15:21:14 noir-contracts 0 ................................................................
15:21:14 noir-contracts 64 ................................................................
15:21:14 noir-contracts 128 ................................................................
15:21:14 noir-contracts 192 ................................................................
15:21:14 noir-contracts 256 ................................................................
15:21:14 noir-contracts 320 ................................................................
15:21:15 noir-contracts 384 ................................................................
15:21:15 noir-contracts 448 ................................................................
15:21:15 noir-contracts 512 ................................................................
15:21:15 noir-contracts 576 ................................................................
15:21:15 noir-contracts 640 ................................................................
15:21:15 noir-contracts 704 ................................................................
15:21:15 noir-contracts 768 ................................................................
15:21:15 noir-contracts 832 ................................................................
15:21:16 noir-contracts 896 ................................................................
15:21:16 noir-contracts 960 ................................................................
15:21:16 noir-contracts 1024 ................................................................
15:21:16 noir-contracts 1088 ................................................................
15:21:16 noir-contracts 1152 ................................................................
15:21:16 noir-contracts 1216 ................................................................
15:21:16 noir-contracts 1280 ................................................................
15:21:16 noir-contracts 1344 ................................................................
15:21:16 noir-contracts 1408 ................................................................
15:21:17 noir-contracts 1472 ................................................................
15:21:17 noir-contracts 1536 ................................................................
15:21:17 noir-contracts 1600 .
done (4s)
15:21:18 noir-protocol-circuits 0 ................................................................
15:21:18 noir-protocol-circuits 64 ................................................................
15:21:19 noir-protocol-circuits 128 ................................................................
15:21:19 aztec-nr 0 .
done (6s)
15:21:19 mock-protocol-circuits 0 ................................................................
15:21:20 noir-protocol-circuits 192 ................................................................
15:21:22 noir-protocol-circuits 256 ................................................................
15:21:25 noir-protocol-circuits 320 ................................................................
15:21:28 noir-protocol-circuits 384 ................................................................
15:21:29 noir-protocol-circuits 448 ................................................................
15:21:31 mock-protocol-circuits 64 ................................................................
15:21:32 noir-protocol-circuits 512 ................................................................
15:22:25 noir-protocol-circuits 576 ................................................................
15:24:04 mock-protocol-circuits 128 .
done (171s)
15:25:13 noir-protocol-circuits 640 ................................................................
15:25:13 noir-protocol-circuits 704 .
done (240s)
15:25:14
--- l1-contracts build ---
15:25:14 Cache download and extraction of l1-contracts-a38472da5814feae.tar.gz complete in 0s.
15:25:14
--- yarn-project build ---
15:25:14 Executing: ./bootstrap.sh clean-lite (
http://ci.aztec-labs.com/57f95850beac3039)
15:25:14 0 .
done (0s)
15:25:23 Cache download and extraction of node-modules-d8cf0b7acd9cac96.zst complete in 8s.
15:25:23 Executing: compile_all (
http://ci.aztec-labs.com/c69c3727b5341475)
15:25:27 0 .
done (4s)
15:25:27 playground/bootstrap.sh Executing: playground/bootstrap.sh (
http://ci.aztec-labs.com/7a00f91bcb9b7ea2)
15:25:27 boxes/bootstrap.sh Executing: boxes/bootstrap.sh (
http://ci.aztec-labs.com/86af45f7505d0116)
15:25:27 docs/bootstrap.sh Executing: docs/bootstrap.sh (
http://ci.aztec-labs.com/2b9aab8ab60a4ccb)
15:25:27 release-image/bootstrap.sh Executing: release-image/bootstrap.sh (
http://ci.aztec-labs.com/8b162f07a56e80cb)
15:25:27 spartan/bootstrap.sh Executing: spartan/bootstrap.sh (
http://ci.aztec-labs.com/c9ff00311e829114)
15:25:27 aztec-up/bootstrap.sh Executing: aztec-up/bootstrap.sh (
http://ci.aztec-labs.com/1c2ba87e9fe356e0)
15:25:28 aztec-up/bootstrap.sh 0 .
done (1s)
15:25:30 spartan/bootstrap.sh 0 .
done (3s)
15:25:32 boxes/bootstrap.sh 0 .
done (5s)
15:25:32 playground/bootstrap.sh 0 .
done (5s)
15:25:35 docs/bootstrap.sh 0 .
done (8s)
15:26:02 release-image/bootstrap.sh 0 .
done (35s)
15:26:02
--- test all ---
15:26:02 Waiting for TXE's to start...
15:26:05 Gathering tests to run...
15:27:44 Gathered 11365 tests.
15:27:44 Starting parallel run with max 64 jobs...
15:27:44 Executing: parallel -j64 --memsuspend 64G --line-buffer --joblog joblog.txt --halt now,fail=1 'run_test_cmd {}' (
http://ci.aztec-labs.com/bbf582f0608bb8c1)
15:28:15 0 ................................................................
15:29:28 64 ................................................................
15:30:39 128 ................................................................
15:31:45 192 ................................................................
15:32:12 256 ................................................................
15:32:23 320 ................................................................
15:32:43 384 ................................................................
15:32:58 448 ................................................................
15:33:06 512 ................................................................
15:33:12 576 ................................................................
15:33:24 640 ................................................................
15:33:32 704 ................................................................
15:33:40 768 ................................................................
15:33:46 832 ................................................................
15:33:53 896 ................................................................
15:34:00 960 ................................................................
15:34:05 1024 ................................................................
15:34:09 1088 ................................................................
15:34:20 1152 ................................................................
15:34:25 1216 ................................................................
15:34:28 1280 ................................................................
15:34:32 1344 ................................................................
15:34:35 1408 ................................................................
15:34:39 1472 ................................................................
15:34:42 1536 ................................................................
15:34:53 1600 ................................................................
15:35:15 1664 ................................................................
15:35:33 1728 ................................................................
15:35:40 1792 ................................................................
15:35:46 1856 ................................................................
15:35:49 1920 ................................................................
15:35:50 1984 ................................................................
15:35:53 2048 ................................................................
15:35:55 2112 ................................................................
15:35:57 2176 ................................................................
15:35:58 2240 ................................................................
15:36:00 2304 ................................................................
15:36:01 2368 ................................................................
15:36:02 2432 ................................................................
15:36:04 2496 ................................................................
15:36:05 2560 ................................................................
15:36:13 2624 ................................................................
15:36:16 2688 ................................................................
15:36:18 2752 ................................................................
15:36:19 2816 ................................................................
15:36:21 2880 ................................................................
15:36:24 2944 ................................................................
15:36:43 3008 ................................................................
15:36:48 3072 ................................................................
15:36:51 3136 ................................................................
15:36:52 3200 ................................................................
15:36:54 3264 ................................................................
15:36:55 3328 ................................................................
15:36:57 3392 ................................................................
15:36:59 3456 ................................................................
15:37:03 3520 ................................................................
15:37:05 3584 ................................................................
15:37:08 3648 ................................................................
15:37:09 3712 ................................................................
15:37:11 3776 ................................................................
15:37:12 3840 ................................................................
15:37:13 3904 ................................................................
15:37:15 3968 ................................................................
15:37:16 4032 ................................................................
15:37:17 4096 ................................................................
15:37:20 4160 ................................................................
15:37:23 4224 ................................................................
15:37:27 4288 ................................................................
15:37:30 4352 ................................................................
15:37:34 4416 ................................................................
15:37:37 4480 ................................................................
15:37:39 4544 ................................................................
15:37:42 4608 ................................................................
15:37:45 4672 ................................................................
15:37:47 4736 ................................................................
15:37:49 4800 ................................................................
15:37:51 4864 ................................................................
15:37:52 4928 ................................................................
15:37:54 4992 ................................................................
15:37:56 5056 ................................................................
15:37:58 5120 ................................................................
15:37:59 5184 ................................................................
15:38:01 5248 ................................................................
15:38:02 5312 ................................................................
15:38:03 5376 ................................................................
15:38:06 5440 ................................................................
15:38:08 5504 ................................................................
15:38:11 5568 ................................................................
15:38:13 5632 ................................................................
15:38:15 5696 ................................................................
15:38:17 5760 ................................................................
15:38:19 5824 ................................................................
15:38:22 5888 ................................................................
15:38:24 5952 ................................................................
15:38:26 6016 ................................................................
15:38:29 6080 ................................................................
15:38:32 6144 ................................................................
15:38:35 6208 ................................................................
15:38:37 6272 ................................................................
15:38:40 6336 ................................................................
15:38:43 6400 ................................................................
15:38:46 6464 ................................................................
15:38:49 6528 ................................................................
15:38:52 6592 ................................................................
15:38:54 6656 ................................................................
15:38:56 6720 ................................................................
15:38:58 6784 ................................................................
15:39:00 6848 ................................................................
15:39:02 6912 ................................................................
15:39:04 6976 ................................................................
15:39:06 7040 ................................................................
15:39:08 7104 ................................................................
15:39:09 7168 ................................................................
15:39:10 7232 ................................................................
15:39:11 7296 ................................................................
15:39:13 7360 ................................................................
15:39:14 7424 ................................................................
15:39:15 7488 ................................................................
15:39:16 7552 ................................................................
15:39:17 7616 ................................................................
15:39:19 7680 ................................................................
15:39:20 7744 ................................................................
15:39:21 7808 ................................................................
15:39:23 7872 ................................................................
15:39:24 7936 ................................................................
15:39:25 8000 ................................................................
15:39:26 8064 ................................................................
15:39:28 8128 ................................................................
15:39:29 8192 ................................................................
15:39:30 8256 ................................................................
15:39:31 8320 ................................................................
15:39:32 8384 ................................................................
15:39:34 8448 ................................................................
15:39:35 8512 ................................................................
15:39:36 8576 ................................................................
15:39:38 8640 ................................................................
15:39:39 8704 ................................................................
15:39:41 8768 ................................................................
15:39:42 8832 ................................................................
15:39:44 8896 ................................................................
15:39:46 8960 ................................................................
15:39:47 9024 ................................................................
15:39:49 9088 ................................................................
15:39:51 9152 ................................................................
15:39:52 9216 ................................................................
15:39:52 9280 ................................................................
15:39:53 9344 ................................................................
15:39:55 9408 ................................................................
15:39:56 9472 ................................................................
15:39:57 9536 ................................................................
15:39:58 9600 ................................................................
15:39:59 9664 ................................................................
15:40:00 9728 ................................................................
15:40:02 9792 ................................................................
15:40:03 9856 ................................................................
15:40:04 9920 ................................................................
15:40:05 9984 ................................................................
15:40:07 10048 ................................................................
15:40:08 10112 ................................................................
15:40:09 10176 ................................................................
15:40:10 10240 ................................................................
15:40:11 10304 ................................................................
15:40:12 10368 ................................................................
15:40:13 10432 ................................................................
15:40:14 10496 ................................................................
15:40:15 10560 ................................................................
15:40:17 10624 ................................................................
15:40:18 10688 ................................................................
15:40:19 10752 ................................................................
15:40:20 10816 ................................................................
15:40:21 10880 ................................................................
15:40:22 10944 ................................................................
15:40:23 11008 ................................................................
15:40:24 11072 ................................................................
15:40:25 11136 ................................................................
15:40:26 11200 ................................................................
15:40:27 11264 ................................................................
15:40:28 11328 ................................................................
15:40:29 11392 ................................................................
15:40:30 11456 ................................................................
15:40:31 11520 ................................................................
15:40:37 11584 ................................................................
15:41:41 11648 .
done (837s)
15:41:41
WARNING: The following tests exceed 5 minute runtimes. Break them up or rethink them.
15:41:41 302.929: '1213493448839150 noir-projects/scripts/run_test.sh noir-protocol-circuits rollup_lib block_root::block_root_rollup_inputs::tests::correct_blobs_with_non_empty_fields'
15:41:41 322.680: 'b5d029682575c433:ISOLATE=1:NAME=e2e_epochs/epochs_l1_reorgs yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_l1_reorgs.test.ts'
15:41:41 322.915: 'b5d029682575c433:ISOLATE=1:NAME=e2e_fees/dapp_subscription yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_fees/dapp_subscription.test.ts'
15:41:41 333.734: 'a0dd824f8b6420e8:ONLY_TERM_PARENT=1 BOX=vanilla BROWSER=* run_compose_test vanilla-all-browsers box boxes'
15:41:41 334.260: 'b5d029682575c433:ISOLATE=1:NAME=e2e_p2p/data_withholding_slash yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/data_withholding_slash.test.ts'
15:41:41 341.493: 'a23ed5f4cabd3a36 barretenberg/cpp/scripts/run_test.sh dsl_tests AcirAvm2RecursionConstraint.TestGenerateVKFromConstraintsWithoutWitness'
15:41:41 379.387: 'a23ed5f4cabd3a36:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityPassing'
15:41:41 385.669: 'a23ed5f4cabd3a36:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityFailing'
15:41:41 390.404: 'b5d029682575c433:ISOLATE=1:NAME=p2p/src/client/p2p_client.integration.test.ts LOG_LEVEL=debug yarn-project/scripts/run_test.sh p2p/src/client/p2p_client.integration.test.ts'
15:41:41 391.645: '7205003900d73b99 aztec-up/scripts/run_test.sh amm_flow'
15:41:41 423.254: 'b5d029682575c433:ISOLATE=1:NAME=e2e_p2p/reex yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/reex.test.ts'
15:41:41 432.332: 'b5d029682575c433:ISOLATE=1:NAME=e2e_l1_with_wall_time yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_l1_with_wall_time.test.ts'
15:41:41 454.639: 'b5d029682575c433:ISOLATE=1:TIMEOUT=15m:NAME=e2e_block_building yarn-project/end-to-end/scripts/run_test.sh simple e2e_block_building'
15:41:41 456.011: 'b5d029682575c433:ISOLATE=1:NAME=prover-client/src/test/bb_prover_full_rollup.test.ts:CPUS=16:MEM=96g LOG_LEVEL=verbose yarn-project/scripts/run_test.sh prover-client/src/test/bb_prover_full_rollup.test.ts'
15:41:41 776.857: 'b5d029682575c433:ISOLATE=1:TIMEOUT=15m:CPUS=16:MEM=96g:NAME=e2e_prover_full_real yarn-project/end-to-end/scripts/run_test.sh simple e2e_prover/full'
15:41:41 Completed run of 11365 tests in 837 seconds.
15:41:41
--- bench all ---
15:41:41 barretenberg/cpp Executing: barretenberg/cpp/bootstrap.sh build_bench (
http://ci.aztec-labs.com/7ee5c1d41dfc4db8)
15:41:41 yarn-project/end-to-end Executing: yarn-project/end-to-end/bootstrap.sh build_bench (
http://ci.aztec-labs.com/f1c4c5994812547b)
15:44:09 yarn-project/end-to-end 0 ................................................................
15:44:47 barretenberg/cpp 0 .
done (186s)
15:47:20 yarn-project/end-to-end 64 .
done (339s)
15:47:21 Starting parallel run using max 64 cpus...
15:47:21 Test run log id:
http://ci.aztec-labs.com/da9dc88e2903e53e
15:51:52 Completed run of 91 tests in 271 seconds.
15:51:55 Completed 6.7 KiB/6.7 KiB (96.5 KiB/s) with 1 file(s) remaining
upload: ../../../tmp/tmp.81koqqIrQD to s3://aztec-ci-artifacts/build-cache/bench-fa4d5ef48c8de52059b5658bbd42e4514386f7db.tar.gz
15:51:56 Cache upload of bench-fa4d5ef48c8de52059b5658bbd42e4514386f7db.tar.gz complete in 2s.
15:51:56 + local code=0
15:51:56 + set +x
15:51:56 dmesg log id:
http://ci.aztec-labs.com/4f47740fe3f2043f
15:51:56 cpufile log id:
http://ci.aztec-labs.com/149918c0ec1760ba
15:51:56 memfile log id:
http://ci.aztec-labs.com/70f33ca281ee0c69
CI run log id:
http://ci.aztec-labs.com/1750087074119
+ code=0
+ case $code in
+ log_ci_run PASSED 1750087074119
+ exit 0
SSH exited with code: 0
Terminating instance: i-0635d9f6d0fa72f64...