Parent Log:
http://ci.aztec-labs.com/15907130769
Command: bootstrap_ec2 './bootstrap.sh ci-full'
Date: Thu Jun 26 16:55:00 UTC 2025
Status: 0
Took: 2150s
--- request build instance ---
Requesting m6a.32xlarge spot instance (name: pr-15315_amd64_x3-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for instance id for spot request: sir-f2nz49ih...
Timeout waiting for spot request.
Requesting m6a.32xlarge on-demand instance (name: pr-15315_amd64_x3-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for SSH at 18.191.213.180...
Stdout is not a tty, running in background...
Loading CRS into tmpfs...
Done in 36 seconds.
Stdout is not a tty, starting build container in background...
Starting devbox...
From
https://github.com/aztecprotocol/aztec-packages
* branch bd28eda782eb6f2e1e5c2101a27104b4ad8796b3 -> FETCH_HEAD
HEAD is now at bd28eda feat: add aztec.mempool to the list of accepted telemetry (#15315)
Switched to a new branch 'gh-readonly-queue/next/pr-15315-634f8607a18c02c1d6e9ab5f302821fa8fc0e833'
+ run
+ ci3/add_timestamps
+ DUP=1
+ ci3/cache_log 'CI run' 1750954878013
CI run log id:
http://ci.aztec-labs.com/1750954878013
16:21:18 + echo 'env: REF_NAME=gh-readonly-queue/next/pr-15315-634f8607a18c02c1d6e9ab5f302821fa8fc0e833 COMMIT_HASH=bd28eda782eb6f2e1e5c2101a27104b4ad8796b3 CURRENT_VERSION=0.87.6 TARGET_BRANCH=next'
16:21:18 env: REF_NAME=gh-readonly-queue/next/pr-15315-634f8607a18c02c1d6e9ab5f302821fa8fc0e833 COMMIT_HASH=bd28eda782eb6f2e1e5c2101a27104b4ad8796b3 CURRENT_VERSION=0.87.6 TARGET_BRANCH=next
16:21:18 + semver check gh-readonly-queue/next/pr-15315-634f8607a18c02c1d6e9ab5f302821fa8fc0e833
16:21:18 + cpu_pid=419
16:21:18 + mpstat 2
16:21:18 + mem_pid=420
16:21:18 + set +e
16:21:18 + set -x
16:21:18 + ./bootstrap.sh ci-full
16:21:18 + vmstat -w -S M 2
16:21:18 ++ cache_log cpufile
16:21:18 ++ cache_log memfile
16:21:18 memfile log id:
http://ci.aztec-labs.com/54b2817a55787812
16:21:18 cpufile log id:
http://ci.aztec-labs.com/26f4d249db998502
16:21:26
--- pull submodules ---
16:21:26 Executing: git submodule update --init --recursive (
http://ci.aztec-labs.com/1f6ac8b5332b2306)
16:21:36 0 .
done (10s)
16:21:41
--- noir build ---
16:21:41 Executing: retry install_deps (
http://ci.aztec-labs.com/b5d17b605f438f60)
16:21:46 0 .
done (5s)
16:21:47 build_native Executing: build_native (
http://ci.aztec-labs.com/dc4bdb971ca9ec4a)
16:21:47 build_packages Executing: build_packages (
http://ci.aztec-labs.com/cb6f61d574a26ab0)
16:21:47 build_native 0 .
done (0s)
16:21:53 build_packages 0 .
done (6s)
16:21:54
--- bb cpp build ---
16:21:55 build_wasm Executing: build_wasm (
http://ci.aztec-labs.com/f16df31863f98409)
16:21:55 build_nodejs_module Executing: build_nodejs_module (
http://ci.aztec-labs.com/3f5526a98b447c21)
16:21:55 build_native Executing: build_native (
http://ci.aztec-labs.com/b9775b71eb1dae3c)
16:21:55 build_wasm_threads Executing: build_wasm_threads (
http://ci.aztec-labs.com/50fca9cc62a167e0)
16:21:55 build_gcc_syntax_check_only Executing: build_gcc_syntax_check_only (
http://ci.aztec-labs.com/db97a1d320fedf07)
16:21:55 build_fuzzing_syntax_check_only Executing: build_fuzzing_syntax_check_only (
http://ci.aztec-labs.com/4824f53927ecdecd)
16:21:55 build_asan_fast Executing: build_asan_fast (
http://ci.aztec-labs.com/b2bbefba602f9532)
16:21:55 build_darwin Executing: build_darwin (
http://ci.aztec-labs.com/bc0e34e226d38431)
16:21:55 build_fuzzing_syntax_check_only 0 .
done (0s)
16:21:55 build_gcc_syntax_check_only 0 .
done (0s)
16:21:55 build_wasm 0 .
done (0s)
16:21:55 build_darwin 0 .
done (0s)
16:21:55 build_wasm_threads 0 .
done (0s)
16:21:56 build_nodejs_module 0 .
done (1s)
16:21:56 build_native 0 .
done (1s)
16:21:56 build_asan_fast 0 .
done (1s)
16:22:01
--- bb.js build ---
16:22:03 Cache download and extraction of node-modules-e85320bda7d59d54.zst complete in 1s.
16:22:03 Cache download and extraction of bb.js-48cfa2a991e70aec.tar.gz complete in 0s.
16:22:04
--- acir_tests build ---
16:22:04 Cache download and extraction of barretenberg-acir-tests-644b5afde41c70af.tar.gz complete in 0s.
16:22:06 Cache download and extraction of node-modules-fec19dc5fe5a76d5.zst complete in 1s.
16:22:06 browser-test-app Executing: yarn build (
http://ci.aztec-labs.com/4e222ea4fecc755e)
16:22:06 bbjs-test Executing: yarn build (
http://ci.aztec-labs.com/bb7f8ef07a60441c)
16:22:09 bbjs-test 0 .
done (3s)
16:22:11 browser-test-app 0 .
done (5s)
16:22:11
--- avm-transpiler build ---
16:22:11 Cache download and extraction of avm-transpiler-bff6096d112435ba.tar.gz complete in 0s.
16:22:11
--- noir-projects build ---
16:22:11 Executing: prep (
http://ci.aztec-labs.com/51b2a12d52ba8018)
16:22:14 0 .
done (3s)
16:22:15 mock-protocol-circuits Executing: ./mock-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/abc5622e3cb5a023)
16:22:15 noir-protocol-circuits Executing: ./noir-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/c9c7a1552e6e85ca)
16:22:15 noir-contracts Executing: ./noir-contracts/bootstrap.sh (
http://ci.aztec-labs.com/111d60b7ec3573a8)
16:22:15 aztec-nr Executing: ./aztec-nr/bootstrap.sh (
http://ci.aztec-labs.com/065507caefced0fa)
16:22:17 noir-contracts 0 ................................................................
16:22:17 noir-contracts 64 ................................................................
16:22:17 noir-contracts 128 ................................................................
16:22:17 noir-contracts 192 ................................................................
16:22:17 noir-contracts 256 ................................................................
16:22:18 noir-contracts 320 ................................................................
16:22:18 noir-contracts 384 ................................................................
16:22:18 noir-contracts 448 ................................................................
16:22:18 noir-contracts 512 ................................................................
16:22:18 noir-contracts 576 ................................................................
16:22:18 noir-contracts 640 ................................................................
16:22:19 noir-contracts 704 ................................................................
16:22:19 noir-contracts 768 ................................................................
16:22:19 noir-contracts 832 ................................................................
16:22:19 noir-contracts 896 ................................................................
16:22:20 noir-contracts 960 ................................................................
16:22:20 noir-contracts 1024 ................................................................
16:22:20 noir-contracts 1088 ................................................................
16:22:20 noir-contracts 1152 ................................................................
16:22:20 noir-protocol-circuits 0 ................................................................
16:22:20 noir-protocol-circuits 64 ................................................................
16:22:21 noir-contracts 1216 ................................................................
16:22:21 noir-contracts 1280 ................................................................
16:22:21 noir-contracts 1344 ................................................................
16:22:21 noir-contracts 1408 ................................................................
16:22:21 noir-contracts 1472 ................................................................
16:22:21 noir-contracts 1536 ................................................................
16:22:21 noir-contracts 1600 .
done (6s)
16:22:21 noir-protocol-circuits 128 ................................................................
16:22:22 noir-protocol-circuits 192 ................................................................
16:22:23 noir-protocol-circuits 256 ................................................................
16:22:23 noir-protocol-circuits 320 ................................................................
16:22:24 aztec-nr 0 .
done (9s)
16:22:24 noir-protocol-circuits 384 ................................................................
16:22:25 mock-protocol-circuits 0 ................................................................
16:22:26 noir-protocol-circuits 448 ................................................................
16:22:27 mock-protocol-circuits 64 ................................................................
16:24:26 noir-protocol-circuits 512 ................................................................
16:24:26 noir-protocol-circuits 576 ................................................................
16:24:26 noir-protocol-circuits 640 .
done (131s)
16:24:28 mock-protocol-circuits 128 .
done (133s)
16:24:29
--- l1-contracts build ---
16:24:29
➤ YN0000: ·
Yarn 4.5.2
16:24:29
➤ YN0000: ┌ Resolution step
16:24:29
➤ YN0000: └ Completed
16:24:29
➤ YN0000: ┌ Fetch step
16:24:30
➤ YN0013: │
134 packages were added to the project (
+ 44.9 MiB).
16:24:30
➤ YN0000: └ Completed in 0s 728ms
16:24:30
➤ YN0000: ┌ Link step
16:24:30
➤ YN0000: └ Completed in 0s 809ms
16:24:30
➤ YN0000: · Done in 1s 601ms
16:24:31 Cache download and extraction of l1-contracts-3ab0e1437eb49b49.tar.gz complete in 0s.
16:24:31
--- yarn-project build ---
16:24:31 Executing: ./bootstrap.sh clean-lite (
http://ci.aztec-labs.com/223517ba584fd945)
16:24:31 0 .
done (0s)
16:24:37 Cache download and extraction of node-modules-34bec2a54a394404.zst complete in 5s.
16:24:37 Executing: compile_all (
http://ci.aztec-labs.com/5cc141935357215a)
16:24:47 0 ................................................................
16:27:10 64 .
done (153s)
16:27:10 playground/bootstrap.sh Executing: playground/bootstrap.sh (
http://ci.aztec-labs.com/2a3d80980e7451b9)
16:27:10 boxes/bootstrap.sh Executing: boxes/bootstrap.sh (
http://ci.aztec-labs.com/f2f330d9a2d140d6)
16:27:10 docs/bootstrap.sh Executing: docs/bootstrap.sh (
http://ci.aztec-labs.com/2a0b6bc4f405f127)
16:27:10 release-image/bootstrap.sh Executing: release-image/bootstrap.sh (
http://ci.aztec-labs.com/1a3c4f5170aede19)
16:27:10 spartan/bootstrap.sh Executing: spartan/bootstrap.sh (
http://ci.aztec-labs.com/37a8208b294d3d83)
16:27:10 aztec-up/bootstrap.sh Executing: aztec-up/bootstrap.sh (
http://ci.aztec-labs.com/3ce3063c40c3480e)
16:27:11 aztec-up/bootstrap.sh 0 .
done (1s)
16:27:14 spartan/bootstrap.sh 0 .
done (4s)
16:27:17 docs/bootstrap.sh 0 .
done (7s)
16:27:42 release-image/bootstrap.sh 0 .
done (32s)
16:27:50 boxes/bootstrap.sh 0 .
done (40s)
16:28:08 playground/bootstrap.sh 0 .
done (58s)
16:28:08
--- test all ---
16:28:08 Waiting for TXE's to start...
16:28:11 Waiting for spartan environment to complete setup...
16:28:11 Spartan environment setup completed successfully.
16:28:11 Gathering tests to run...
16:29:51 Gathered 12214 tests.
16:29:51 Starting parallel run with max 64 jobs...
16:29:51 Executing: parallel -j64 --memsuspend 64G --line-buffer --joblog joblog.txt --halt now,fail=1 'run_test_cmd {}' (
http://ci.aztec-labs.com/9b1548acd97b5e1c)
16:30:22 0 ................................................................
16:31:29 64 ................................................................
16:32:33 128 ................................................................
16:33:33 192 ................................................................
16:34:00 256 ................................................................
16:34:11 320 ................................................................
16:34:30 384 ................................................................
16:34:46 448 ................................................................
16:34:53 512 ................................................................
16:34:59 576 ................................................................
16:35:11 640 ................................................................
16:35:20 704 ................................................................
16:35:27 768 ................................................................
16:35:33 832 ................................................................
16:35:41 896 ................................................................
16:35:47 960 ................................................................
16:35:53 1024 ................................................................
16:35:57 1088 ................................................................
16:36:05 1152 ................................................................
16:36:12 1216 ................................................................
16:36:15 1280 ................................................................
16:36:19 1344 ................................................................
16:36:23 1408 ................................................................
16:36:27 1472 ................................................................
16:36:30 1536 ................................................................
16:36:38 1600 ................................................................
16:36:47 1664 ................................................................
16:37:03 1728 ................................................................
16:37:08 1792 ................................................................
16:37:13 1856 ................................................................
16:37:15 1920 ................................................................
16:37:16 1984 ................................................................
16:37:18 2048 ................................................................
16:37:20 2112 ................................................................
16:37:22 2176 ................................................................
16:37:23 2240 ................................................................
16:37:26 2304 ................................................................
16:37:27 2368 ................................................................
16:37:29 2432 ................................................................
16:37:30 2496 ................................................................
16:37:32 2560 ................................................................
16:37:47 2624 ................................................................
16:37:56 2688 ................................................................
16:37:58 2752 ................................................................
16:38:00 2816 ................................................................
16:38:01 2880 ................................................................
16:38:03 2944 ................................................................
16:38:12 3008 ................................................................
16:38:19 3072 ................................................................
16:38:24 3136 ................................................................
16:38:26 3200 ................................................................
16:38:28 3264 ................................................................
16:38:29 3328 ................................................................
16:38:30 3392 ................................................................
16:38:32 3456 ................................................................
16:38:35 3520 ................................................................
16:38:37 3584 ................................................................
16:38:39 3648 ................................................................
16:38:41 3712 ................................................................
16:38:42 3776 ................................................................
16:38:43 3840 ................................................................
16:38:45 3904 ................................................................
16:38:46 3968 ................................................................
16:38:47 4032 ................................................................
16:38:49 4096 ................................................................
16:38:50 4160 ................................................................
16:38:53 4224 ................................................................
16:38:56 4288 ................................................................
16:39:00 4352 ................................................................
16:39:04 4416 ................................................................
16:39:07 4480 ................................................................
16:39:09 4544 ................................................................
16:39:11 4608 ................................................................
16:39:13 4672 ................................................................
16:39:16 4736 ................................................................
16:39:18 4800 ................................................................
16:39:20 4864 ................................................................
16:39:22 4928 ................................................................
16:39:23 4992 ................................................................
16:39:25 5056 ................................................................
16:39:27 5120 ................................................................
16:39:29 5184 ................................................................
16:39:30 5248 ................................................................
16:39:31 5312 ................................................................
16:39:33 5376 ................................................................
16:39:34 5440 ................................................................
16:39:36 5504 ................................................................
16:39:38 5568 ................................................................
16:39:41 5632 ................................................................
16:39:43 5696 ................................................................
16:39:45 5760 ................................................................
16:39:48 5824 ................................................................
16:39:50 5888 ................................................................
16:39:52 5952 ................................................................
16:39:54 6016 ................................................................
16:39:56 6080 ................................................................
16:39:58 6144 ................................................................
16:40:01 6208 ................................................................
16:40:04 6272 ................................................................
16:40:06 6336 ................................................................
16:40:09 6400 ................................................................
16:40:11 6464 ................................................................
16:40:14 6528 ................................................................
16:40:17 6592 ................................................................
16:40:19 6656 ................................................................
16:40:23 6720 ................................................................
16:40:26 6784 ................................................................
16:40:28 6848 ................................................................
16:40:30 6912 ................................................................
16:40:32 6976 ................................................................
16:40:34 7040 ................................................................
16:40:37 7104 ................................................................
16:40:39 7168 ................................................................
16:40:41 7232 ................................................................
16:40:42 7296 ................................................................
16:40:43 7360 ................................................................
16:40:45 7424 ................................................................
16:40:46 7488 ................................................................
16:40:47 7552 ................................................................
16:40:48 7616 ................................................................
16:40:50 7680 ................................................................
16:40:51 7744 ................................................................
16:40:52 7808 ................................................................
16:40:53 7872 ................................................................
16:40:55 7936 ................................................................
16:40:56 8000 ................................................................
16:40:57 8064 ................................................................
16:40:58 8128 ................................................................
16:41:00 8192 ................................................................
16:41:01 8256 ................................................................
16:41:02 8320 ................................................................
16:41:03 8384 ................................................................
16:41:04 8448 ................................................................
16:41:06 8512 ................................................................
16:41:07 8576 ................................................................
16:41:08 8640 ................................................................
16:41:09 8704 ................................................................
16:41:10 8768 ................................................................
16:41:11 8832 ................................................................
16:41:12 8896 ................................................................
16:41:14 8960 ................................................................
16:41:15 9024 ................................................................
16:41:16 9088 ................................................................
16:41:18 9152 ................................................................
16:41:19 9216 ................................................................
16:41:20 9280 ................................................................
16:41:22 9344 ................................................................
16:41:23 9408 ................................................................
16:41:25 9472 ................................................................
16:41:26 9536 ................................................................
16:41:27 9600 ................................................................
16:41:29 9664 ................................................................
16:41:31 9728 ................................................................
16:41:32 9792 ................................................................
16:41:34 9856 ................................................................
16:41:36 9920 ................................................................
16:41:37 9984 ................................................................
16:41:38 10048 ................................................................
16:41:39 10112 ................................................................
16:41:40 10176 ................................................................
16:41:41 10240 ................................................................
16:41:42 10304 ................................................................
16:41:44 10368 ................................................................
16:41:45 10432 ................................................................
16:41:46 10496 ................................................................
16:41:48 10560 ................................................................
16:41:49 10624 ................................................................
16:41:50 10688 ................................................................
16:41:51 10752 ................................................................
16:41:53 10816 ................................................................
16:41:54 10880 ................................................................
16:41:55 10944 ................................................................
16:41:56 11008 ................................................................
16:41:57 11072 ................................................................
16:41:58 11136 ................................................................
16:41:59 11200 ................................................................
16:42:01 11264 ................................................................
16:42:02 11328 ................................................................
16:42:03 11392 ................................................................
16:42:04 11456 ................................................................
16:42:05 11520 ................................................................
16:42:06 11584 ................................................................
16:42:08 11648 ................................................................
16:42:09 11712 ................................................................
16:42:10 11776 ................................................................
16:42:11 11840 ................................................................
16:42:12 11904 ................................................................
16:42:13 11968 ................................................................
16:42:14 12032 ................................................................
16:42:15 12096 ................................................................
16:42:17 12160 ................................................................
16:42:18 12224 ................................................................
16:42:19 12288 ................................................................
16:42:20 12352 ................................................................
16:44:08 12416 ................................................................
16:44:51 12480 .
done (900s)
16:44:51
WARNING: The following tests exceed 5 minute runtimes. Break them up or rethink them.
16:44:51 305.017: 'd2fcfaaceedeb658:ISOLATE=1:NAME=e2e_p2p/validators_sentinel yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/validators_sentinel.test.ts'
16:44:51 331.023: 'd9d212806114aa4a barretenberg/cpp/scripts/run_test.sh dsl_tests AcirAvm2RecursionConstraint.TestGenerateVKFromConstraintsWithoutWitness'
16:44:51 344.303: 'd2fcfaaceedeb658:ISOLATE=1:NAME=e2e_p2p/data_withholding_slash yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/data_withholding_slash.test.ts'
16:44:51 350.000: 'cc315134097bd358:ONLY_TERM_PARENT=1 BOX=vanilla BROWSER=* run_compose_test vanilla-all-browsers box boxes'
16:44:51 355.931: 'd9d212806114aa4a:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityPassing'
16:44:51 359.258: 'd9d212806114aa4a:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityFailing'
16:44:51 363.863: 'f6fa41634f6079f7 aztec-up/scripts/run_test.sh amm_flow'
16:44:51 386.904: 'd2fcfaaceedeb658:ISOLATE=1:NAME=p2p/src/client/p2p_client.integration.test.ts LOG_LEVEL=debug yarn-project/scripts/run_test.sh p2p/src/client/p2p_client.integration.test.ts'
16:44:51 406.511: 'd2fcfaaceedeb658:ISOLATE=1:TIMEOUT=15m:NAME=e2e_block_building yarn-project/end-to-end/scripts/run_test.sh simple e2e_block_building'
16:44:51 415.419: 'd2fcfaaceedeb658:ISOLATE=1:NAME=prover-client/src/test/bb_prover_full_rollup.test.ts:CPUS=16:MEM=96g LOG_LEVEL=verbose yarn-project/scripts/run_test.sh prover-client/src/test/bb_prover_full_rollup.test.ts'
16:44:51 431.207: 'd2fcfaaceedeb658:ISOLATE=1:NAME=e2e_p2p/reex yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/reex.test.ts'
16:44:51 444.403: 'd2fcfaaceedeb658:ISOLATE=1:NAME=e2e_l1_with_wall_time yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_l1_with_wall_time.test.ts'
16:44:51 736.897: 'd2fcfaaceedeb658:ISOLATE=1:TIMEOUT=15m:CPUS=16:MEM=96g:NAME=e2e_prover_full_real yarn-project/end-to-end/scripts/run_test.sh simple e2e_prover/full'
16:44:51 Completed run of 12214 tests in 900 seconds.
16:44:51
--- bench all ---
16:44:52 barretenberg/cpp Executing: barretenberg/cpp/bootstrap.sh build_bench (
http://ci.aztec-labs.com/9549dbbb31c44db4)
16:44:52 yarn-project/end-to-end Executing: yarn-project/end-to-end/bootstrap.sh build_bench (
http://ci.aztec-labs.com/fb893b26c0a8e088)
16:44:53 barretenberg/cpp 0 .
done (1s)
16:46:57 yarn-project/end-to-end 0 ................................................................
16:49:44 yarn-project/end-to-end 64 .
done (292s)
16:49:46 Starting parallel run using max 64 cpus...
16:49:46 Test run log id:
http://ci.aztec-labs.com/ed6062eed6189c7c
16:54:51 Completed run of 96 tests in 305 seconds.
16:54:53 Completed 7.7 KiB/7.7 KiB (119.7 KiB/s) with 1 file(s) remaining
upload: ../../../tmp/tmp.4M6kPgrl6P to s3://aztec-ci-artifacts/build-cache/bench-bd28eda782eb6f2e1e5c2101a27104b4ad8796b3.tar.gz
16:54:53 Cache upload of bench-bd28eda782eb6f2e1e5c2101a27104b4ad8796b3.tar.gz complete in 1s.
16:54:55 + local code=0
16:54:55 + set +x
16:54:55 dmesg log id:
http://ci.aztec-labs.com/f7826da54274bf10
CI run log id:
http://ci.aztec-labs.com/1750954878013
+ code=0
+ case $code in
+ log_ci_run PASSED 1750954878013
+ exit 0
SSH exited with code: 0
Terminating instance: i-039e0cfd69c31a2bd...