Parent Log:
http://ci.aztec-labs.com/15634699716
Command: bootstrap_ec2 './bootstrap.sh ci-full'
Date: Fri Jun 13 13:15:31 UTC 2025
Status: 0
Took: 2238s
--- request build instance ---
Requesting m6a.32xlarge spot instance (name: pr-14877_amd64_x1-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for instance id for spot request: sir-4m4q6abk...
Waiting for SSH at 3.148.184.225...
No tty, running in background...
Loading CRS into tmpfs...
Done in 8 seconds.
Starting devbox...
From
https://github.com/aztecprotocol/aztec-packages
* branch d3bba2d69dbc070d51bcd50607354193573876ba -> FETCH_HEAD
HEAD is now at d3bba2d chore: Monitor sequencer is behaving properly (#14877)
Switched to a new branch 'gh-readonly-queue/next/pr-14877-314d7622c6bacc8333ae49fe9583967cab78349b'
+ ci3/aws_handle_evict run
+ ci3/add_timestamps
+ DUP=1
+ ci3/cache_log 'CI run' 1749818342549
CI run log id:
http://ci.aztec-labs.com/1749818342549
12:39:02 env: REF_NAME=gh-readonly-queue/next/pr-14877-314d7622c6bacc8333ae49fe9583967cab78349b COMMIT_HASH=d3bba2d69dbc070d51bcd50607354193573876ba CURRENT_VERSION=0.87.6 TARGET_BRANCH=next
12:39:02 + ./bootstrap.sh ci-full
12:39:10
--- pull submodules ---
12:39:10 Executing: git submodule update --init --recursive (
http://ci.aztec-labs.com/d8dda6f29e4bccf6)
12:39:20 0 .
done (10s)
12:39:21
--- noir build ---
12:39:21 Executing: retry install_deps (
http://ci.aztec-labs.com/f49fa0c2a8b85efd)
12:39:26 0 .
done (5s)
12:39:26 build_native Executing: build_native (
http://ci.aztec-labs.com/6ea5bac09923a774)
12:39:26 build_packages Executing: build_packages (
http://ci.aztec-labs.com/1667868b0357d114)
12:39:27 build_native 0 .
done (1s)
12:39:33 build_packages 0 .
done (7s)
12:39:34
--- bb cpp build ---
12:39:34 build_nodejs_module Executing: build_nodejs_module (
http://ci.aztec-labs.com/fc14b023f944eddb)
12:39:34 build_wasm Executing: build_wasm (
http://ci.aztec-labs.com/43fc2761a5914445)
12:39:34 build_native Executing: build_native (
http://ci.aztec-labs.com/3af9a870f96030e3)
12:39:34 build_wasm_threads Executing: build_wasm_threads (
http://ci.aztec-labs.com/927633447cb70652)
12:39:34 build_gcc_syntax_check_only Executing: build_gcc_syntax_check_only (
http://ci.aztec-labs.com/837e869b48172183)
12:39:34 build_fuzzing_syntax_check_only Executing: build_fuzzing_syntax_check_only (
http://ci.aztec-labs.com/4c3b6456a2631d9c)
12:39:34 build_asan_fast Executing: build_asan_fast (
http://ci.aztec-labs.com/8416f840bd4f817f)
12:39:34 build_darwin Executing: build_darwin (
http://ci.aztec-labs.com/64f7d620396b8893)
12:39:34 build_gcc_syntax_check_only 0 .
done (0s)
12:39:34 build_fuzzing_syntax_check_only 0 .
done (0s)
12:39:34 build_darwin 0 .
done (0s)
12:39:34 build_wasm 0 .
done (0s)
12:39:34 build_wasm_threads 0 .
done (0s)
12:39:35 build_nodejs_module 0 .
done (1s)
12:39:37 build_native 0 .
done (3s)
12:39:38 build_asan_fast 0 .
done (4s)
12:39:42
--- bb.js build ---
12:39:43 Cache download and extraction of node-modules-aa659bb2a892ab4f.zst complete in 1s.
12:39:43 Cache download and extraction of bb.js-e065a82a38d1b825.tar.gz complete in 0s.
12:39:44
--- acir_tests build ---
12:39:44 Cache download and extraction of barretenberg-acir-tests-79af0b0ef54c490c.tar.gz complete in 0s.
12:39:45 Cache download and extraction of node-modules-fec19dc5fe5a76d5.zst complete in 0s.
12:39:45 Executing: cd browser-test-app && yarn build (
http://ci.aztec-labs.com/81722a1e77aa34c6)
12:39:50 0 .
done (5s)
12:39:50 Executing: cd bbjs-test && yarn build (
http://ci.aztec-labs.com/9984ef8a443a80e8)
12:39:52 0 .
done (2s)
12:39:53
--- avm-transpiler build ---
12:39:53 Cache download and extraction of avm-transpiler-2ef373cf3e06b25d.tar.gz complete in 0s.
12:39:53
--- noir-projects build ---
12:39:53 Executing: prep (
http://ci.aztec-labs.com/48eac2179ebf3f42)
12:39:56 0 .
done (3s)
12:39:56 mock-protocol-circuits Executing: ./mock-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/ed8dfcdb6c9b45d5)
12:39:56 noir-protocol-circuits Executing: ./noir-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/552417eca35f6236)
12:39:56 noir-contracts Executing: ./noir-contracts/bootstrap.sh (
http://ci.aztec-labs.com/5d7f8974e36da4ef)
12:39:56 aztec-nr Executing: ./aztec-nr/bootstrap.sh (
http://ci.aztec-labs.com/44cf1dcf2d5a0413)
12:39:58 noir-contracts 0 ................................................................
12:39:58 noir-contracts 64 ................................................................
12:39:58 noir-contracts 128 ................................................................
12:39:58 noir-contracts 192 ................................................................
12:39:58 noir-contracts 256 ................................................................
12:39:59 noir-contracts 320 ................................................................
12:39:59 noir-contracts 384 ................................................................
12:39:59 noir-contracts 448 ................................................................
12:39:59 noir-contracts 512 ................................................................
12:39:59 noir-contracts 576 ................................................................
12:39:59 noir-contracts 640 ................................................................
12:40:00 noir-contracts 704 ................................................................
12:40:00 noir-contracts 768 ................................................................
12:40:00 noir-contracts 832 ................................................................
12:40:00 noir-contracts 896 ................................................................
12:40:00 noir-contracts 960 ................................................................
12:40:00 noir-contracts 1024 ................................................................
12:40:01 noir-contracts 1088 ................................................................
12:40:01 noir-contracts 1152 ................................................................
12:40:01 noir-contracts 1216 ................................................................
12:40:01 noir-contracts 1280 ................................................................
12:40:01 noir-contracts 1344 ................................................................
12:40:01 noir-contracts 1408 ................................................................
12:40:01 noir-protocol-circuits 0 ................................................................
12:40:01 noir-protocol-circuits 64 ................................................................
12:40:01 noir-contracts 1472 ................................................................
12:40:02 noir-contracts 1536 ................................................................
12:40:02 noir-contracts 1600 .
done (6s)
12:40:02 noir-protocol-circuits 128 ................................................................
12:40:03 aztec-nr 0 .
done (7s)
12:40:03 mock-protocol-circuits 0 ................................................................
12:40:04 noir-protocol-circuits 192 ................................................................
12:40:05 noir-protocol-circuits 256 ................................................................
12:40:09 noir-protocol-circuits 320 ................................................................
12:40:11 noir-protocol-circuits 384 ................................................................
12:40:13 noir-protocol-circuits 448 ................................................................
12:40:15 mock-protocol-circuits 64 ................................................................
12:40:15 noir-protocol-circuits 512 ................................................................
12:40:36 noir-protocol-circuits 576 ................................................................
12:42:49 mock-protocol-circuits 128 .
done (173s)
12:44:00 noir-protocol-circuits 640 ................................................................
12:44:00 noir-protocol-circuits 704 .
done (244s)
12:44:01
--- l1-contracts build ---
12:44:01 Cache download and extraction of l1-contracts-501074c554645aef.tar.gz complete in 0s.
12:44:01
--- yarn-project build ---
12:44:01 Executing: ./bootstrap.sh clean-lite (
http://ci.aztec-labs.com/9067ce00500a1e7d)
12:44:01 0 .
done (0s)
12:44:06 Cache download and extraction of node-modules-d160581125851fb0.zst complete in 4s.
12:44:06 Executing: compile_all (
http://ci.aztec-labs.com/c57ad07277171c25)
12:44:16 0 ................................................................
12:46:40 64 .
done (154s)
12:46:40 playground/bootstrap.sh Executing: playground/bootstrap.sh (
http://ci.aztec-labs.com/aa4f6725ac634f8e)
12:46:40 boxes/bootstrap.sh Executing: boxes/bootstrap.sh (
http://ci.aztec-labs.com/dd7c581f37569d4b)
12:46:40 docs/bootstrap.sh Executing: docs/bootstrap.sh (
http://ci.aztec-labs.com/a188b6da3bc8f18e)
12:46:40 release-image/bootstrap.sh Executing: release-image/bootstrap.sh (
http://ci.aztec-labs.com/3a983b8712b1a5f8)
12:46:40 spartan/bootstrap.sh Executing: spartan/bootstrap.sh (
http://ci.aztec-labs.com/4e19fab22a1c5ff3)
12:46:40 aztec-up/bootstrap.sh Executing: aztec-up/bootstrap.sh (
http://ci.aztec-labs.com/331e9b6d7482ee76)
12:46:41 aztec-up/bootstrap.sh 0 .
done (1s)
12:46:44 spartan/bootstrap.sh 0 .
done (4s)
12:47:12 release-image/bootstrap.sh 0 .
done (32s)
12:47:23 boxes/bootstrap.sh 0 .
done (43s)
12:47:33 playground/bootstrap.sh 0 .
done (53s)
12:48:42 docs/bootstrap.sh 0 .
done (122s)
12:48:42
--- test all ---
12:48:42 Waiting for TXE's to start...
12:48:45 Gathering tests to run...
12:50:23 Gathered 11355 tests.
12:50:23 Starting parallel run with max 64 jobs...
12:50:23 Executing: parallel -j64 --memsuspend 64G --line-buffer --joblog joblog.txt --halt now,fail=1 'run_test_cmd {}' (
http://ci.aztec-labs.com/000f65c59bad2a22)
12:50:55 0 ................................................................
12:52:09 64 ................................................................
12:53:20 128 ................................................................
12:54:28 192 ................................................................
12:54:55 256 ................................................................
12:55:06 320 ................................................................
12:55:24 384 ................................................................
12:55:39 448 ................................................................
12:55:46 512 ................................................................
12:55:52 576 ................................................................
12:56:04 640 ................................................................
12:56:12 704 ................................................................
12:56:19 768 ................................................................
12:56:26 832 ................................................................
12:56:33 896 ................................................................
12:56:41 960 ................................................................
12:56:46 1024 ................................................................
12:56:49 1088 ................................................................
12:57:02 1152 ................................................................
12:57:07 1216 ................................................................
12:57:10 1280 ................................................................
12:57:14 1344 ................................................................
12:57:17 1408 ................................................................
12:57:21 1472 ................................................................
12:57:24 1536 ................................................................
12:57:38 1600 ................................................................
12:58:04 1664 ................................................................
12:58:21 1728 ................................................................
12:58:29 1792 ................................................................
12:58:35 1856 ................................................................
12:58:38 1920 ................................................................
12:58:40 1984 ................................................................
12:58:42 2048 ................................................................
12:58:43 2112 ................................................................
12:58:45 2176 ................................................................
12:58:47 2240 ................................................................
12:58:49 2304 ................................................................
12:58:50 2368 ................................................................
12:58:52 2432 ................................................................
12:58:53 2496 ................................................................
12:58:54 2560 ................................................................
12:59:03 2624 ................................................................
12:59:05 2688 ................................................................
12:59:07 2752 ................................................................
12:59:08 2816 ................................................................
12:59:10 2880 ................................................................
12:59:13 2944 ................................................................
12:59:35 3008 ................................................................
12:59:41 3072 ................................................................
12:59:44 3136 ................................................................
12:59:45 3200 ................................................................
12:59:47 3264 ................................................................
12:59:48 3328 ................................................................
12:59:50 3392 ................................................................
12:59:52 3456 ................................................................
12:59:55 3520 ................................................................
12:59:59 3584 ................................................................
13:00:01 3648 ................................................................
13:00:03 3712 ................................................................
13:00:04 3776 ................................................................
13:00:06 3840 ................................................................
13:00:07 3904 ................................................................
13:00:09 3968 ................................................................
13:00:10 4032 ................................................................
13:00:11 4096 ................................................................
13:00:14 4160 ................................................................
13:00:16 4224 ................................................................
13:00:21 4288 ................................................................
13:00:24 4352 ................................................................
13:00:26 4416 ................................................................
13:00:30 4480 ................................................................
13:00:32 4544 ................................................................
13:00:34 4608 ................................................................
13:00:38 4672 ................................................................
13:00:40 4736 ................................................................
13:00:42 4800 ................................................................
13:00:44 4864 ................................................................
13:00:46 4928 ................................................................
13:00:48 4992 ................................................................
13:00:50 5056 ................................................................
13:00:52 5120 ................................................................
13:00:53 5184 ................................................................
13:00:55 5248 ................................................................
13:00:57 5312 ................................................................
13:00:58 5376 ................................................................
13:01:01 5440 ................................................................
13:01:04 5504 ................................................................
13:01:07 5568 ................................................................
13:01:09 5632 ................................................................
13:01:12 5696 ................................................................
13:01:14 5760 ................................................................
13:01:16 5824 ................................................................
13:01:19 5888 ................................................................
13:01:21 5952 ................................................................
13:01:23 6016 ................................................................
13:01:25 6080 ................................................................
13:01:29 6144 ................................................................
13:01:32 6208 ................................................................
13:01:34 6272 ................................................................
13:01:37 6336 ................................................................
13:01:40 6400 ................................................................
13:01:43 6464 ................................................................
13:01:45 6528 ................................................................
13:01:48 6592 ................................................................
13:01:50 6656 ................................................................
13:01:52 6720 ................................................................
13:01:54 6784 ................................................................
13:01:56 6848 ................................................................
13:01:58 6912 ................................................................
13:02:00 6976 ................................................................
13:02:02 7040 ................................................................
13:02:03 7104 ................................................................
13:02:04 7168 ................................................................
13:02:05 7232 ................................................................
13:02:07 7296 ................................................................
13:02:08 7360 ................................................................
13:02:09 7424 ................................................................
13:02:10 7488 ................................................................
13:02:11 7552 ................................................................
13:02:12 7616 ................................................................
13:02:14 7680 ................................................................
13:02:15 7744 ................................................................
13:02:16 7808 ................................................................
13:02:17 7872 ................................................................
13:02:18 7936 ................................................................
13:02:19 8000 ................................................................
13:02:21 8064 ................................................................
13:02:22 8128 ................................................................
13:02:23 8192 ................................................................
13:02:24 8256 ................................................................
13:02:25 8320 ................................................................
13:02:27 8384 ................................................................
13:02:28 8448 ................................................................
13:02:29 8512 ................................................................
13:02:30 8576 ................................................................
13:02:32 8640 ................................................................
13:02:34 8704 ................................................................
13:02:35 8768 ................................................................
13:02:36 8832 ................................................................
13:02:38 8896 ................................................................
13:02:40 8960 ................................................................
13:02:42 9024 ................................................................
13:02:44 9088 ................................................................
13:02:45 9152 ................................................................
13:02:47 9216 ................................................................
13:02:48 9280 ................................................................
13:02:48 9344 ................................................................
13:02:50 9408 ................................................................
13:02:50 9472 ................................................................
13:02:52 9536 ................................................................
13:02:52 9600 ................................................................
13:02:54 9664 ................................................................
13:02:55 9728 ................................................................
13:02:56 9792 ................................................................
13:02:58 9856 ................................................................
13:02:59 9920 ................................................................
13:03:00 9984 ................................................................
13:03:01 10048 ................................................................
13:03:02 10112 ................................................................
13:03:03 10176 ................................................................
13:03:04 10240 ................................................................
13:03:05 10304 ................................................................
13:03:06 10368 ................................................................
13:03:08 10432 ................................................................
13:03:09 10496 ................................................................
13:03:10 10560 ................................................................
13:03:11 10624 ................................................................
13:03:12 10688 ................................................................
13:03:13 10752 ................................................................
13:03:14 10816 ................................................................
13:03:15 10880 ................................................................
13:03:16 10944 ................................................................
13:03:17 11008 ................................................................
13:03:18 11072 ................................................................
13:03:19 11136 ................................................................
13:03:20 11200 ................................................................
13:03:21 11264 ................................................................
13:03:22 11328 ................................................................
13:03:23 11392 ................................................................
13:03:24 11456 ................................................................
13:03:25 11520 ................................................................
13:05:11 11584 .
done (888s)
13:05:11
WARNING: The following tests exceed 5 minute runtimes. Break them up or rethink them.
13:05:11 303.688: '3987b0c732d12451:ISOLATE=1:NAME=e2e_fees/private_payments yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_fees/private_payments.test.ts'
13:05:11 328.072: '3987b0c732d12451:ISOLATE=1:NAME=p2p/src/client/p2p_client.integration.test.ts LOG_LEVEL=debug yarn-project/scripts/run_test.sh p2p/src/client/p2p_client.integration.test.ts'
13:05:11 332.607: '1213493448839150 noir-projects/scripts/run_test.sh noir-protocol-circuits rollup_lib block_root::block_root_rollup_inputs::tests::correct_blobs_with_non_empty_fields'
13:05:11 365.742: '3987b0c732d12451:ISOLATE=1:NAME=e2e_p2p/data_withholding_slash yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/data_withholding_slash.test.ts'
13:05:11 374.769: '09eb9a230bc48f75:ONLY_TERM_PARENT=1 BOX=vanilla BROWSER=* run_compose_test vanilla-all-browsers box boxes'
13:05:11 383.305: '060f2775b5406036 barretenberg/cpp/scripts/run_test.sh dsl_tests AcirAvm2RecursionConstraint.TestGenerateVKFromConstraintsWithoutWitness'
13:05:11 404.111: '3987b0c732d12451:ISOLATE=1:NAME=e2e_p2p/reex yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/reex.test.ts'
13:05:11 415.385: 'c9ca7c8d418ace7b aztec-up/scripts/run_test.sh amm_flow'
13:05:11 420.244: '3987b0c732d12451:ISOLATE=1:NAME=e2e_l1_with_wall_time yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_l1_with_wall_time.test.ts'
13:05:11 453.738: '3987b0c732d12451:ISOLATE=1:TIMEOUT=15m:NAME=e2e_block_building yarn-project/end-to-end/scripts/run_test.sh simple e2e_block_building'
13:05:11 471.193: '3987b0c732d12451:ISOLATE=1:NAME=prover-client/src/test/bb_prover_full_rollup.test.ts:CPUS=16:MEM=96g LOG_LEVEL=verbose yarn-project/scripts/run_test.sh prover-client/src/test/bb_prover_full_rollup.test.ts'
13:05:11 473.343: '060f2775b5406036:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityPassing'
13:05:11 489.767: '060f2775b5406036:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityFailing'
13:05:11 832.842: '3987b0c732d12451:ISOLATE=1:TIMEOUT=17m:CPUS=16:MEM=96g:NAME=e2e_prover_full_real yarn-project/end-to-end/scripts/run_test.sh simple e2e_prover/full'
13:05:11 Completed run of 11355 tests in 888 seconds.
13:05:11
--- bench all ---
13:05:12 barretenberg/cpp Executing: barretenberg/cpp/bootstrap.sh build_bench (
http://ci.aztec-labs.com/316de5e3f7402a41)
13:05:12 yarn-project/end-to-end Executing: yarn-project/end-to-end/bootstrap.sh build_bench (
http://ci.aztec-labs.com/b08eb257c542b082)
13:05:13 barretenberg/cpp 0 .
done (1s)
13:07:18 yarn-project/end-to-end 0 ................................................................
13:10:21 yarn-project/end-to-end 64 .
done (309s)
13:10:22 Starting parallel run using max 64 cpus...
13:10:22 Test run log id:
http://ci.aztec-labs.com/f20ffee806c7581a
13:15:22 Completed run of 91 tests in 300 seconds.
13:15:25 Completed 6.8 KiB/6.8 KiB (96.4 KiB/s) with 1 file(s) remaining
upload: ../../../tmp/tmp.qJYyznONuy to s3://aztec-ci-artifacts/build-cache/bench-d3bba2d69dbc070d51bcd50607354193573876ba.tar.gz
13:15:25 Cache upload of bench-d3bba2d69dbc070d51bcd50607354193573876ba.tar.gz complete in 1s.
13:15:25 + local code=0
13:15:25 + set +x
13:15:25 dmesg log id:
http://ci.aztec-labs.com/46f55188daba4f9c
13:15:25 cpufile log id:
http://ci.aztec-labs.com/2779d51cfcb94bdb
13:15:25 memfile log id:
http://ci.aztec-labs.com/b8c121003a495048
CI run log id:
http://ci.aztec-labs.com/1749818342549
+ code=0
+ case $code in
+ log_ci_run PASSED 1749818342549
+ exit 0
SSH exited with code: 0
Terminating instance: i-09e979b8ca37b2a7a...