Parent Log:
http://ci.aztec-labs.com/15631050404
Command: bootstrap_ec2 './bootstrap.sh ci-full'
Date: Fri Jun 13 09:56:43 UTC 2025
Status: 0
Took: 2351s
--- request build instance ---
Requesting m6a.32xlarge spot instance (name: pr-15026_amd64_x4-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for instance id for spot request: sir-12jq4kth...
Timeout waiting for spot request.
Requesting m6a.32xlarge on-demand instance (name: pr-15026_amd64_x4-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for SSH at 3.141.26.73...
No tty, running in background...
Loading CRS into tmpfs...
Done in 19 seconds.
Starting devbox...
From
https://github.com/aztecprotocol/aztec-packages
* branch 30660269b33bab8cca354c41659533acf4d48e07 -> FETCH_HEAD
HEAD is now at 3066026 fix: configurable l1tol2 message timeout (#15026)
Switched to a new branch 'gh-readonly-queue/next/pr-15026-d96baf1c44329e8b2e3a432ad803f702f5184a62'
+ ci3/aws_handle_evict run
+ ci3/add_timestamps
+ DUP=1
+ ci3/cache_log 'CI run' 1749806363620
CI run log id:
http://ci.aztec-labs.com/1749806363620
09:19:23 env: REF_NAME=gh-readonly-queue/next/pr-15026-d96baf1c44329e8b2e3a432ad803f702f5184a62 COMMIT_HASH=30660269b33bab8cca354c41659533acf4d48e07 CURRENT_VERSION=0.87.6 TARGET_BRANCH=next
09:19:23 + ./bootstrap.sh ci-full
09:19:32
--- pull submodules ---
09:19:32 Executing: git submodule update --init --recursive (
http://ci.aztec-labs.com/91ce2ad605ee8f04)
09:19:40 0 .
done (8s)
09:19:43
--- noir build ---
09:19:43 Executing: retry install_deps (
http://ci.aztec-labs.com/ba5d5c32b4788076)
09:19:48 0 .
done (5s)
09:19:48 build_native Executing: build_native (
http://ci.aztec-labs.com/a2f301a4975eef27)
09:19:48 build_packages Executing: build_packages (
http://ci.aztec-labs.com/386dde0175613d07)
09:19:49 build_native 0 .
done (1s)
09:19:55 build_packages 0 .
done (7s)
09:19:56
--- bb cpp build ---
09:19:56 build_wasm_threads Executing: build_wasm_threads (
http://ci.aztec-labs.com/6e870ce518e227e1)
09:19:56 build_wasm Executing: build_wasm (
http://ci.aztec-labs.com/a52a2e70ce76dcf2)
09:19:56 build_native Executing: build_native (
http://ci.aztec-labs.com/dd9bf03333e42dd6)
09:19:56 build_nodejs_module Executing: build_nodejs_module (
http://ci.aztec-labs.com/64182f956d40ca06)
09:19:56 build_gcc_syntax_check_only Executing: build_gcc_syntax_check_only (
http://ci.aztec-labs.com/24ea355574f5aa2f)
09:19:56 build_fuzzing_syntax_check_only Executing: build_fuzzing_syntax_check_only (
http://ci.aztec-labs.com/133901282a906acb)
09:19:56 build_asan_fast Executing: build_asan_fast (
http://ci.aztec-labs.com/b33aff44e6af4afb)
09:19:56 build_darwin Executing: build_darwin (
http://ci.aztec-labs.com/4052b020aea90b9d)
09:19:56 build_fuzzing_syntax_check_only 0 .
done (0s)
09:19:56 build_gcc_syntax_check_only 0 .
done (0s)
09:19:56 build_wasm 0 .
done (0s)
09:19:56 build_darwin 0 .
done (0s)
09:19:56 build_wasm_threads 0 .
done (0s)
09:19:57 build_nodejs_module 0 .
done (1s)
09:19:57 build_native 0 .
done (1s)
09:19:58 build_asan_fast 0 .
done (2s)
09:20:02
--- bb.js build ---
09:20:03 Cache download and extraction of node-modules-aa659bb2a892ab4f.zst complete in 0s.
09:20:04 Cache download and extraction of bb.js-ab18610952d0b7f6.tar.gz complete in 1s.
09:20:04
--- acir_tests build ---
09:20:05 Cache download and extraction of barretenberg-acir-tests-978237025a971508.tar.gz complete in 1s.
09:20:06 Cache download and extraction of node-modules-fec19dc5fe5a76d5.zst complete in 1s.
09:20:06 Executing: cd browser-test-app && yarn build (
http://ci.aztec-labs.com/1b0d8fa2054110d9)
09:20:10 0 .
done (4s)
09:20:10 Executing: cd bbjs-test && yarn build (
http://ci.aztec-labs.com/7d896da9508b7ff0)
09:20:13 0 .
done (3s)
09:20:14
--- avm-transpiler build ---
09:20:14 Cache download and extraction of avm-transpiler-2ef373cf3e06b25d.tar.gz complete in 0s.
09:20:14
--- noir-projects build ---
09:20:14 Executing: prep (
http://ci.aztec-labs.com/3e2e07a8502f9487)
09:20:17 0 .
done (3s)
09:20:17 mock-protocol-circuits Executing: ./mock-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/ef57a30dc386b2ca)
09:20:17 noir-protocol-circuits Executing: ./noir-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/99ac238693254795)
09:20:17 noir-contracts Executing: ./noir-contracts/bootstrap.sh (
http://ci.aztec-labs.com/11074431b3c7e3a4)
09:20:17 aztec-nr Executing: ./aztec-nr/bootstrap.sh (
http://ci.aztec-labs.com/753682eb3a91d4bd)
09:20:19 noir-contracts 0 ................................................................
09:20:19 noir-contracts 64 ................................................................
09:20:19 noir-contracts 128 ................................................................
09:20:19 noir-contracts 192 ................................................................
09:20:19 noir-contracts 256 ................................................................
09:20:19 noir-contracts 320 ................................................................
09:20:20 noir-contracts 384 ................................................................
09:20:20 noir-contracts 448 ................................................................
09:20:20 noir-contracts 512 ................................................................
09:20:20 noir-contracts 576 ................................................................
09:20:20 noir-contracts 640 ................................................................
09:20:20 noir-contracts 704 ................................................................
09:20:20 noir-contracts 768 ................................................................
09:20:21 noir-contracts 832 ................................................................
09:20:21 noir-contracts 896 ................................................................
09:20:21 noir-contracts 960 ................................................................
09:20:21 noir-contracts 1024 ................................................................
09:20:21 noir-contracts 1088 ................................................................
09:20:22 noir-contracts 1152 ................................................................
09:20:22 noir-contracts 1216 ................................................................
09:20:22 noir-contracts 1280 ................................................................
09:20:22 noir-contracts 1344 ................................................................
09:20:22 noir-contracts 1408 ................................................................
09:20:22 noir-contracts 1472 ................................................................
09:20:22 noir-protocol-circuits 0 ................................................................
09:20:22 noir-protocol-circuits 64 ................................................................
09:20:22 noir-contracts 1536 ................................................................
09:20:22 noir-contracts 1600 .
done (5s)
09:20:23 noir-protocol-circuits 128 ................................................................
09:20:24 aztec-nr 0 .
done (7s)
09:20:24 mock-protocol-circuits 0 ................................................................
09:20:25 noir-protocol-circuits 192 ................................................................
09:20:26 noir-protocol-circuits 256 ................................................................
09:20:30 noir-protocol-circuits 320 ................................................................
09:20:32 noir-protocol-circuits 384 ................................................................
09:20:34 noir-protocol-circuits 448 ................................................................
09:20:36 mock-protocol-circuits 64 ................................................................
09:20:36 noir-protocol-circuits 512 ................................................................
09:20:58 noir-protocol-circuits 576 ................................................................
09:23:17 mock-protocol-circuits 128 .
done (180s)
09:24:15 noir-protocol-circuits 640 ................................................................
09:24:15 noir-protocol-circuits 704 .
done (238s)
09:24:16
--- l1-contracts build ---
09:24:16 Cache download and extraction of l1-contracts-05472697a2c292f2.tar.gz complete in 0s.
09:24:16
--- yarn-project build ---
09:24:16 Executing: ./bootstrap.sh clean-lite (
http://ci.aztec-labs.com/c7fc6458cb7a91b0)
09:24:16 0 .
done (0s)
09:24:21 Cache download and extraction of node-modules-d160581125851fb0.zst complete in 5s.
09:24:21 Executing: compile_all (
http://ci.aztec-labs.com/5cb6ff16186e60c8)
09:24:31 0 ................................................................
09:26:55 64 .
done (154s)
09:26:55 playground/bootstrap.sh Executing: playground/bootstrap.sh (
http://ci.aztec-labs.com/e76ca591fb51866c)
09:26:55 boxes/bootstrap.sh Executing: boxes/bootstrap.sh (
http://ci.aztec-labs.com/7fd41f71bec0cafd)
09:26:55 docs/bootstrap.sh Executing: docs/bootstrap.sh (
http://ci.aztec-labs.com/c2ec0e05a3cb15c6)
09:26:55 release-image/bootstrap.sh Executing: release-image/bootstrap.sh (
http://ci.aztec-labs.com/36cbce6a860f4d92)
09:26:55 spartan/bootstrap.sh Executing: spartan/bootstrap.sh (
http://ci.aztec-labs.com/e8398322f4fca6e7)
09:26:55 aztec-up/bootstrap.sh Executing: aztec-up/bootstrap.sh (
http://ci.aztec-labs.com/8840dadc787a11fe)
09:26:56 aztec-up/bootstrap.sh 0 .
done (1s)
09:26:58 spartan/bootstrap.sh 0 .
done (3s)
09:27:26 release-image/bootstrap.sh 0 .
done (31s)
09:27:37 boxes/bootstrap.sh 0 .
done (42s)
09:27:47 playground/bootstrap.sh 0 .
done (52s)
09:29:03 docs/bootstrap.sh 0 .
done (128s)
09:29:03
--- test all ---
09:29:03 Waiting for TXE's to start...
09:29:06 Gathering tests to run...
09:30:44 Gathered 11354 tests.
09:30:44 Starting parallel run with max 64 jobs...
09:30:44 Executing: parallel -j64 --memsuspend 64G --line-buffer --joblog joblog.txt --halt now,fail=1 'run_test_cmd {}' (
http://ci.aztec-labs.com/bba6ba24268b9dc1)
09:31:15 0 ................................................................
09:32:38 64 ................................................................
09:33:46 128 ................................................................
09:34:56 192 ................................................................
09:35:26 256 ................................................................
09:35:36 320 ................................................................
09:35:58 384 ................................................................
09:36:12 448 ................................................................
09:36:20 512 ................................................................
09:36:27 576 ................................................................
09:36:38 640 ................................................................
09:36:47 704 ................................................................
09:36:54 768 ................................................................
09:37:01 832 ................................................................
09:37:08 896 ................................................................
09:37:15 960 ................................................................
09:37:21 1024 ................................................................
09:37:25 1088 ................................................................
09:37:37 1152 ................................................................
09:37:41 1216 ................................................................
09:37:45 1280 ................................................................
09:37:49 1344 ................................................................
09:37:53 1408 ................................................................
09:37:56 1472 ................................................................
09:38:00 1536 ................................................................
09:38:13 1600 ................................................................
09:38:38 1664 ................................................................
09:38:56 1728 ................................................................
09:39:05 1792 ................................................................
09:39:11 1856 ................................................................
09:39:14 1920 ................................................................
09:39:15 1984 ................................................................
09:39:18 2048 ................................................................
09:39:19 2112 ................................................................
09:39:21 2176 ................................................................
09:39:23 2240 ................................................................
09:39:25 2304 ................................................................
09:39:27 2368 ................................................................
09:39:28 2432 ................................................................
09:39:29 2496 ................................................................
09:39:31 2560 ................................................................
09:39:40 2624 ................................................................
09:39:42 2688 ................................................................
09:39:43 2752 ................................................................
09:39:44 2816 ................................................................
09:39:46 2880 ................................................................
09:39:49 2944 ................................................................
09:40:11 3008 ................................................................
09:40:17 3072 ................................................................
09:40:20 3136 ................................................................
09:40:21 3200 ................................................................
09:40:23 3264 ................................................................
09:40:24 3328 ................................................................
09:40:26 3392 ................................................................
09:40:28 3456 ................................................................
09:40:31 3520 ................................................................
09:40:34 3584 ................................................................
09:40:36 3648 ................................................................
09:40:38 3712 ................................................................
09:40:39 3776 ................................................................
09:40:41 3840 ................................................................
09:40:42 3904 ................................................................
09:40:43 3968 ................................................................
09:40:45 4032 ................................................................
09:40:46 4096 ................................................................
09:40:48 4160 ................................................................
09:40:52 4224 ................................................................
09:40:57 4288 ................................................................
09:41:00 4352 ................................................................
09:41:03 4416 ................................................................
09:41:05 4480 ................................................................
09:41:08 4544 ................................................................
09:41:10 4608 ................................................................
09:41:13 4672 ................................................................
09:41:15 4736 ................................................................
09:41:17 4800 ................................................................
09:41:20 4864 ................................................................
09:41:22 4928 ................................................................
09:41:24 4992 ................................................................
09:41:26 5056 ................................................................
09:41:28 5120 ................................................................
09:41:30 5184 ................................................................
09:41:32 5248 ................................................................
09:41:33 5312 ................................................................
09:41:35 5376 ................................................................
09:41:38 5440 ................................................................
09:41:41 5504 ................................................................
09:41:44 5568 ................................................................
09:41:47 5632 ................................................................
09:41:49 5696 ................................................................
09:41:52 5760 ................................................................
09:41:54 5824 ................................................................
09:41:56 5888 ................................................................
09:41:59 5952 ................................................................
09:42:01 6016 ................................................................
09:42:03 6080 ................................................................
09:42:06 6144 ................................................................
09:42:09 6208 ................................................................
09:42:12 6272 ................................................................
09:42:15 6336 ................................................................
09:42:19 6400 ................................................................
09:42:21 6464 ................................................................
09:42:24 6528 ................................................................
09:42:27 6592 ................................................................
09:42:29 6656 ................................................................
09:42:31 6720 ................................................................
09:42:33 6784 ................................................................
09:42:35 6848 ................................................................
09:42:37 6912 ................................................................
09:42:39 6976 ................................................................
09:42:41 7040 ................................................................
09:42:43 7104 ................................................................
09:42:44 7168 ................................................................
09:42:45 7232 ................................................................
09:42:46 7296 ................................................................
09:42:48 7360 ................................................................
09:42:49 7424 ................................................................
09:42:50 7488 ................................................................
09:42:51 7552 ................................................................
09:42:53 7616 ................................................................
09:42:54 7680 ................................................................
09:42:56 7744 ................................................................
09:42:57 7808 ................................................................
09:42:58 7872 ................................................................
09:43:00 7936 ................................................................
09:43:01 8000 ................................................................
09:43:02 8064 ................................................................
09:43:03 8128 ................................................................
09:43:05 8192 ................................................................
09:43:06 8256 ................................................................
09:43:07 8320 ................................................................
09:43:08 8384 ................................................................
09:43:10 8448 ................................................................
09:43:11 8512 ................................................................
09:43:13 8576 ................................................................
09:43:14 8640 ................................................................
09:43:16 8704 ................................................................
09:43:17 8768 ................................................................
09:43:19 8832 ................................................................
09:43:20 8896 ................................................................
09:43:22 8960 ................................................................
09:43:24 9024 ................................................................
09:43:26 9088 ................................................................
09:43:28 9152 ................................................................
09:43:29 9216 ................................................................
09:43:30 9280 ................................................................
09:43:31 9344 ................................................................
09:43:32 9408 ................................................................
09:43:33 9472 ................................................................
09:43:34 9536 ................................................................
09:43:35 9600 ................................................................
09:43:36 9664 ................................................................
09:43:37 9728 ................................................................
09:43:39 9792 ................................................................
09:43:40 9856 ................................................................
09:43:42 9920 ................................................................
09:43:43 9984 ................................................................
09:43:44 10048 ................................................................
09:43:45 10112 ................................................................
09:43:46 10176 ................................................................
09:43:47 10240 ................................................................
09:43:48 10304 ................................................................
09:43:49 10368 ................................................................
09:43:50 10432 ................................................................
09:43:51 10496 ................................................................
09:43:52 10560 ................................................................
09:43:53 10624 ................................................................
09:43:54 10688 ................................................................
09:43:55 10752 ................................................................
09:43:56 10816 ................................................................
09:43:57 10880 ................................................................
09:43:58 10944 ................................................................
09:43:59 11008 ................................................................
09:44:00 11072 ................................................................
09:44:01 11136 ................................................................
09:44:02 11200 ................................................................
09:44:04 11264 ................................................................
09:44:05 11328 ................................................................
09:44:06 11392 ................................................................
09:44:07 11456 ................................................................
09:44:08 11520 ................................................................
09:46:22 11584 .
done (938s)
09:46:22
WARNING: The following tests exceed 5 minute runtimes. Break them up or rethink them.
09:46:22 326.482: '1b54ea671a21576c:ISOLATE=1:NAME=e2e_epochs/epochs_proof_fails yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_proof_fails.test.ts'
09:46:22 332.795: '97315bdf9092ca42 noir-projects/scripts/run_test.sh noir-protocol-circuits rollup_lib block_root::block_root_rollup_inputs::tests::correct_blobs_with_non_empty_fields'
09:46:22 364.674: '1b54ea671a21576c:ISOLATE=1:NAME=e2e_p2p/data_withholding_slash yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/data_withholding_slash.test.ts'
09:46:22 374.470: '7faf93f93ad63fc5:ONLY_TERM_PARENT=1 BOX=vanilla BROWSER=* run_compose_test vanilla-all-browsers box boxes'
09:46:22 395.023: '1b54ea671a21576c:ISOLATE=1:NAME=e2e_epochs/epochs_empty_blocks yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_empty_blocks.test.ts'
09:46:22 395.681: '049e4025f7cee894 barretenberg/cpp/scripts/run_test.sh dsl_tests AcirAvm2RecursionConstraint.TestGenerateVKFromConstraintsWithoutWitness'
09:46:22 416.138: '1b54ea671a21576c:ISOLATE=1:NAME=e2e_epochs/epochs_l1_reorgs yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_l1_reorgs.test.ts'
09:46:22 420.207: '1b54ea671a21576c:ISOLATE=1:NAME=e2e_l1_with_wall_time yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_l1_with_wall_time.test.ts'
09:46:22 429.700: '7faf93f93ad63fc5:ONLY_TERM_PARENT=1 BOX=vite BROWSER=webkit run_compose_test vite-webkit box boxes'
09:46:22 432.355: 'b228d2321678a72c aztec-up/scripts/run_test.sh amm_flow'
09:46:22 456.868: '1b54ea671a21576c:ISOLATE=1:NAME=e2e_p2p/reex yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/reex.test.ts'
09:46:22 476.667: '049e4025f7cee894:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityPassing'
09:46:22 482.661: '049e4025f7cee894:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityFailing'
09:46:22 484.486: '1b54ea671a21576c:ISOLATE=1:TIMEOUT=15m:NAME=e2e_block_building yarn-project/end-to-end/scripts/run_test.sh simple e2e_block_building'
09:46:22 501.620: '1b54ea671a21576c:ISOLATE=1:NAME=prover-client/src/test/bb_prover_full_rollup.test.ts:CPUS=16:MEM=96g LOG_LEVEL=verbose yarn-project/scripts/run_test.sh prover-client/src/test/bb_prover_full_rollup.test.ts'
09:46:22 847.018: '1b54ea671a21576c:ISOLATE=1:TIMEOUT=17m:CPUS=16:MEM=96g:NAME=e2e_prover_full_real yarn-project/end-to-end/scripts/run_test.sh simple e2e_prover/full'
09:46:22 Completed run of 11354 tests in 938 seconds.
09:46:22
--- bench all ---
09:46:23 barretenberg/cpp Executing: barretenberg/cpp/bootstrap.sh build_bench (
http://ci.aztec-labs.com/59ddd51649ee9096)
09:46:23 yarn-project/end-to-end Executing: yarn-project/end-to-end/bootstrap.sh build_bench (
http://ci.aztec-labs.com/bbc3a0caf477aa56)
09:46:23 barretenberg/cpp 0 .
done (0s)
09:48:30 yarn-project/end-to-end 0 ................................................................
09:51:33 yarn-project/end-to-end 64 .
done (310s)
09:51:34 Starting parallel run using max 64 cpus...
09:51:34 Test run log id:
http://ci.aztec-labs.com/fcb4af4e403bc3af
09:56:34 Completed run of 91 tests in 300 seconds.
09:56:37 Completed 6.8 KiB/6.8 KiB (119.7 KiB/s) with 1 file(s) remaining
upload: ../../../tmp/tmp.ASCby8xDWI to s3://aztec-ci-artifacts/build-cache/bench-30660269b33bab8cca354c41659533acf4d48e07.tar.gz
09:56:37 Cache upload of bench-30660269b33bab8cca354c41659533acf4d48e07.tar.gz complete in 1s.
09:56:37 + local code=0
09:56:37 + set +x
09:56:37 dmesg log id:
http://ci.aztec-labs.com/3a499144eb0b30e6
09:56:37 cpufile log id:
http://ci.aztec-labs.com/335bc312e4f8e244
09:56:37 memfile log id:
http://ci.aztec-labs.com/a76a9dd811f6d5a4
CI run log id:
http://ci.aztec-labs.com/1749806363620
+ code=0
+ case $code in
+ log_ci_run PASSED 1749806363620
+ exit 0
SSH exited with code: 0
Terminating instance: i-04900649e0ab14498...