Parent Log:
http://ci.aztec-labs.com/15824286338
Command: bootstrap_ec2 './bootstrap.sh ci-full'
Date: Mon Jun 23 13:00:59 UTC 2025
Status: 0
Took: 1768s
--- request build instance ---
Requesting m6a.32xlarge spot instance (name: pr-15211_amd64_x3-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for instance id for spot request: sir-hp47698g...
Waiting for SSH at 18.217.18.85...
Stdout is not a tty, running in background...
Loading CRS into tmpfs...
Done in 8 seconds.
Stdout is not a tty, starting build container in background...
Starting devbox...
From
https://github.com/aztecprotocol/aztec-packages
* branch 505a3c071181dbc5242dc8b655a9b2d69988c8db -> FETCH_HEAD
HEAD is now at 505a3c0 chore(backport-to-staging): chore: Updated tx pool limit (#15209) (#15211)
Switched to a new branch 'gh-readonly-queue/staging/pr-15211-e8f6c3b7e3e0e72a33e118ddf8e67d11e51464a8'
+ run
+ ci3/add_timestamps
+ DUP=1
+ ci3/cache_log 'CI run' 1750681940610
CI run log id:
http://ci.aztec-labs.com/1750681940610
12:32:20 + echo 'env: REF_NAME=gh-readonly-queue/staging/pr-15211-e8f6c3b7e3e0e72a33e118ddf8e67d11e51464a8 COMMIT_HASH=505a3c071181dbc5242dc8b655a9b2d69988c8db CURRENT_VERSION=0.87.6 TARGET_BRANCH=staging'
12:32:20 env: REF_NAME=gh-readonly-queue/staging/pr-15211-e8f6c3b7e3e0e72a33e118ddf8e67d11e51464a8 COMMIT_HASH=505a3c071181dbc5242dc8b655a9b2d69988c8db CURRENT_VERSION=0.87.6 TARGET_BRANCH=staging
12:32:20 + semver check gh-readonly-queue/staging/pr-15211-e8f6c3b7e3e0e72a33e118ddf8e67d11e51464a8
12:32:20 + cpu_pid=413
12:32:20 + mpstat 2
12:32:20 + mem_pid=417
12:32:20 + set +e
12:32:20 + set -x
12:32:20 + ./bootstrap.sh ci-full
12:32:20 + vmstat -w -S M 2
12:32:20 ++ cache_log cpufile
12:32:20 ++ cache_log memfile
12:32:20 cpufile log id:
http://ci.aztec-labs.com/7e39683bce35c65d
12:32:20 memfile log id:
http://ci.aztec-labs.com/f8f09548cd3120da
12:32:29
--- pull submodules ---
12:32:29 Executing: git submodule update --init --recursive (
http://ci.aztec-labs.com/5acb615b12bd3e1a)
12:32:37 0 .
done (8s)
12:32:39
--- noir build ---
12:32:39 Executing: retry install_deps (
http://ci.aztec-labs.com/d5b22f3b6cc094a4)
12:32:43 0 .
done (4s)
12:32:44 build_native Executing: build_native (
http://ci.aztec-labs.com/b6dfff067743724e)
12:32:44 build_packages Executing: build_packages (
http://ci.aztec-labs.com/eb985663c50e6c93)
12:32:44 build_native 0 .
done (0s)
12:32:50 build_packages 0 .
done (6s)
12:32:51
--- bb cpp build ---
12:32:51 build_nodejs_module Executing: build_nodejs_module (
http://ci.aztec-labs.com/9616b9a338881f86)
12:32:51 build_wasm_threads Executing: build_wasm_threads (
http://ci.aztec-labs.com/4548dc91465542f7)
12:32:51 build_wasm Executing: build_wasm (
http://ci.aztec-labs.com/6a0d70fade35dab1)
12:32:51 build_native Executing: build_native (
http://ci.aztec-labs.com/c1ec3f459a53dc5b)
12:32:51 build_gcc_syntax_check_only Executing: build_gcc_syntax_check_only (
http://ci.aztec-labs.com/3f4f43bdb3d8bf8d)
12:32:51 build_fuzzing_syntax_check_only Executing: build_fuzzing_syntax_check_only (
http://ci.aztec-labs.com/dbc36b3b5751a905)
12:32:51 build_asan_fast Executing: build_asan_fast (
http://ci.aztec-labs.com/1cd068fc4b277d41)
12:32:51 build_darwin Executing: build_darwin (
http://ci.aztec-labs.com/0a8487f2b905b23c)
12:32:51 build_gcc_syntax_check_only 0 .
done (0s)
12:32:51 build_fuzzing_syntax_check_only 0 .
done (0s)
12:32:52 build_wasm 0 .
done (1s)
12:32:52 build_wasm_threads 0 .
done (1s)
12:32:52 build_darwin 0 .
done (1s)
12:32:52 build_nodejs_module 0 .
done (1s)
12:32:53 build_native 0 .
done (2s)
12:32:53 build_asan_fast 0 .
done (2s)
12:32:58
--- bb.js build ---
12:32:59 Cache download and extraction of node-modules-e85320bda7d59d54.zst complete in 1s.
12:32:59 Cache download and extraction of bb.js-93955768547ae31a.tar.gz complete in 0s.
12:33:00
--- acir_tests build ---
12:33:00 Cache download and extraction of barretenberg-acir-tests-000ad54a8a7b4100.tar.gz complete in 0s.
12:33:01 Cache download and extraction of node-modules-fec19dc5fe5a76d5.zst complete in 0s.
12:33:02 browser-test-app Executing: yarn build (
http://ci.aztec-labs.com/d8167e667b3579b0)
12:33:02 bbjs-test Executing: yarn build (
http://ci.aztec-labs.com/e0629cd3cb9061ea)
12:33:05 bbjs-test 0 .
done (3s)
12:33:06 browser-test-app 0 .
done (4s)
12:33:07
--- avm-transpiler build ---
12:33:07 Cache download and extraction of avm-transpiler-6867cd9272ea7ebd.tar.gz complete in 0s.
12:33:07
--- noir-projects build ---
12:33:07 Executing: prep (
http://ci.aztec-labs.com/1f0ab4055d163dc5)
12:33:10 0 .
done (3s)
12:33:10 mock-protocol-circuits Executing: ./mock-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/eb12a9dafaaf8aa8)
12:33:10 noir-protocol-circuits Executing: ./noir-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/6bf08b23062f5d34)
12:33:10 noir-contracts Executing: ./noir-contracts/bootstrap.sh (
http://ci.aztec-labs.com/4ba218318a101add)
12:33:10 aztec-nr Executing: ./aztec-nr/bootstrap.sh (
http://ci.aztec-labs.com/c992c436978cecdf)
12:33:12 noir-contracts 0 ................................................................
12:33:12 noir-contracts 64 ................................................................
12:33:12 noir-contracts 128 ................................................................
12:33:12 noir-contracts 192 ................................................................
12:33:12 noir-contracts 256 ................................................................
12:33:13 noir-contracts 320 ................................................................
12:33:13 noir-contracts 384 ................................................................
12:33:13 noir-contracts 448 ................................................................
12:33:13 noir-contracts 512 ................................................................
12:33:13 noir-contracts 576 ................................................................
12:33:13 noir-contracts 640 ................................................................
12:33:14 noir-contracts 704 ................................................................
12:33:14 noir-contracts 768 ................................................................
12:33:14 noir-contracts 832 ................................................................
12:33:14 noir-contracts 896 ................................................................
12:33:14 noir-contracts 960 ................................................................
12:33:15 noir-contracts 1024 ................................................................
12:33:15 noir-contracts 1088 ................................................................
12:33:15 noir-contracts 1152 ................................................................
12:33:15 noir-contracts 1216 ................................................................
12:33:15 noir-contracts 1280 ................................................................
12:33:15 noir-contracts 1344 ................................................................
12:33:15 noir-contracts 1408 ................................................................
12:33:15 noir-protocol-circuits 0 ................................................................
12:33:15 noir-protocol-circuits 64 ................................................................
12:33:16 noir-contracts 1472 ................................................................
12:33:16 noir-contracts 1536 ................................................................
12:33:16 noir-contracts 1600 .
done (6s)
12:33:16 noir-protocol-circuits 128 ................................................................
12:33:17 noir-protocol-circuits 192 ................................................................
12:33:17 mock-protocol-circuits 0 ................................................................
12:33:18 aztec-nr 0 .
done (8s)
12:33:18 noir-protocol-circuits 256 ................................................................
12:33:19 noir-protocol-circuits 320 ................................................................
12:33:20 mock-protocol-circuits 64 .
done (10s)
12:33:20 noir-protocol-circuits 384 ................................................................
12:33:20 noir-protocol-circuits 448 .
done (10s)
12:33:20
--- l1-contracts build ---
12:33:21 Cache download and extraction of l1-contracts-0a920e2ab51d8ecb.tar.gz complete in 1s.
12:33:21
--- yarn-project build ---
12:33:21 Executing: ./bootstrap.sh clean-lite (
http://ci.aztec-labs.com/ca9e5b469df885f4)
12:33:21 0 .
done (0s)
12:33:26 Cache download and extraction of node-modules-34bec2a54a394404.zst complete in 5s.
12:33:26 Executing: compile_all (
http://ci.aztec-labs.com/554a22c6261ff05f)
12:33:29 0 .
done (3s)
12:33:29 playground/bootstrap.sh Executing: playground/bootstrap.sh (
http://ci.aztec-labs.com/383c7384fc7e1a20)
12:33:29 boxes/bootstrap.sh Executing: boxes/bootstrap.sh (
http://ci.aztec-labs.com/71386beb5a369966)
12:33:29 docs/bootstrap.sh Executing: docs/bootstrap.sh (
http://ci.aztec-labs.com/e75908f83104fe91)
12:33:29 release-image/bootstrap.sh Executing: release-image/bootstrap.sh (
http://ci.aztec-labs.com/d026eb3222f5c655)
12:33:29 spartan/bootstrap.sh Executing: spartan/bootstrap.sh (
http://ci.aztec-labs.com/fdfcdaf17536f47f)
12:33:29 aztec-up/bootstrap.sh Executing: aztec-up/bootstrap.sh (
http://ci.aztec-labs.com/b2942b574c34404f)
12:33:30 aztec-up/bootstrap.sh 0 .
done (1s)
12:33:33 spartan/bootstrap.sh 0 .
done (4s)
12:33:34 boxes/bootstrap.sh 0 .
done (5s)
12:33:35 playground/bootstrap.sh 0 .
done (6s)
12:33:37 docs/bootstrap.sh 0 .
done (8s)
12:34:07 release-image/bootstrap.sh 0 .
done (38s)
12:34:07
--- test all ---
12:34:08 Waiting for TXE's to start...
12:34:11 Gathering tests to run...
12:35:51 Gathered 12158 tests.
12:35:51 Starting parallel run with max 64 jobs...
12:35:51 Executing: parallel -j64 --memsuspend 64G --line-buffer --joblog joblog.txt --halt now,fail=1 'run_test_cmd {}' (
http://ci.aztec-labs.com/47dc0fc4fbd4a898)
12:36:22 0 ................................................................
12:37:28 64 ................................................................
12:38:33 128 ................................................................
12:39:33 192 ................................................................
12:39:57 256 ................................................................
12:40:08 320 ................................................................
12:40:27 384 ................................................................
12:40:43 448 ................................................................
12:40:50 512 ................................................................
12:40:56 576 ................................................................
12:41:08 640 ................................................................
12:41:16 704 ................................................................
12:41:24 768 ................................................................
12:41:29 832 ................................................................
12:41:37 896 ................................................................
12:41:43 960 ................................................................
12:41:48 1024 ................................................................
12:41:52 1088 ................................................................
12:42:01 1152 ................................................................
12:42:08 1216 ................................................................
12:42:12 1280 ................................................................
12:42:15 1344 ................................................................
12:42:19 1408 ................................................................
12:42:22 1472 ................................................................
12:42:26 1536 ................................................................
12:42:34 1600 ................................................................
12:42:44 1664 ................................................................
12:43:00 1728 ................................................................
12:43:05 1792 ................................................................
12:43:10 1856 ................................................................
12:43:13 1920 ................................................................
12:43:15 1984 ................................................................
12:43:16 2048 ................................................................
12:43:18 2112 ................................................................
12:43:20 2176 ................................................................
12:43:22 2240 ................................................................
12:43:24 2304 ................................................................
12:43:25 2368 ................................................................
12:43:27 2432 ................................................................
12:43:28 2496 ................................................................
12:43:29 2560 ................................................................
12:43:45 2624 ................................................................
12:43:53 2688 ................................................................
12:43:55 2752 ................................................................
12:43:56 2816 ................................................................
12:43:58 2880 ................................................................
12:44:00 2944 ................................................................
12:44:10 3008 ................................................................
12:44:16 3072 ................................................................
12:44:20 3136 ................................................................
12:44:22 3200 ................................................................
12:44:24 3264 ................................................................
12:44:25 3328 ................................................................
12:44:27 3392 ................................................................
12:44:29 3456 ................................................................
12:44:32 3520 ................................................................
12:44:34 3584 ................................................................
12:44:36 3648 ................................................................
12:44:38 3712 ................................................................
12:44:39 3776 ................................................................
12:44:40 3840 ................................................................
12:44:42 3904 ................................................................
12:44:43 3968 ................................................................
12:44:45 4032 ................................................................
12:44:46 4096 ................................................................
12:44:48 4160 ................................................................
12:44:51 4224 ................................................................
12:44:56 4288 ................................................................
12:45:00 4352 ................................................................
12:45:02 4416 ................................................................
12:45:06 4480 ................................................................
12:45:08 4544 ................................................................
12:45:10 4608 ................................................................
12:45:12 4672 ................................................................
12:45:15 4736 ................................................................
12:45:17 4800 ................................................................
12:45:18 4864 ................................................................
12:45:20 4928 ................................................................
12:45:22 4992 ................................................................
12:45:23 5056 ................................................................
12:45:25 5120 ................................................................
12:45:26 5184 ................................................................
12:45:28 5248 ................................................................
12:45:29 5312 ................................................................
12:45:30 5376 ................................................................
12:45:32 5440 ................................................................
12:45:34 5504 ................................................................
12:45:36 5568 ................................................................
12:45:38 5632 ................................................................
12:45:41 5696 ................................................................
12:45:43 5760 ................................................................
12:45:45 5824 ................................................................
12:45:47 5888 ................................................................
12:45:49 5952 ................................................................
12:45:51 6016 ................................................................
12:45:54 6080 ................................................................
12:45:56 6144 ................................................................
12:45:59 6208 ................................................................
12:46:01 6272 ................................................................
12:46:03 6336 ................................................................
12:46:06 6400 ................................................................
12:46:08 6464 ................................................................
12:46:11 6528 ................................................................
12:46:14 6592 ................................................................
12:46:18 6656 ................................................................
12:46:20 6720 ................................................................
12:46:23 6784 ................................................................
12:46:25 6848 ................................................................
12:46:27 6912 ................................................................
12:46:29 6976 ................................................................
12:46:31 7040 ................................................................
12:46:33 7104 ................................................................
12:46:36 7168 ................................................................
12:46:37 7232 ................................................................
12:46:38 7296 ................................................................
12:46:40 7360 ................................................................
12:46:41 7424 ................................................................
12:46:42 7488 ................................................................
12:46:43 7552 ................................................................
12:46:45 7616 ................................................................
12:46:46 7680 ................................................................
12:46:47 7744 ................................................................
12:46:48 7808 ................................................................
12:46:50 7872 ................................................................
12:46:51 7936 ................................................................
12:46:52 8000 ................................................................
12:46:53 8064 ................................................................
12:46:55 8128 ................................................................
12:46:56 8192 ................................................................
12:46:57 8256 ................................................................
12:46:58 8320 ................................................................
12:47:00 8384 ................................................................
12:47:01 8448 ................................................................
12:47:02 8512 ................................................................
12:47:03 8576 ................................................................
12:47:04 8640 ................................................................
12:47:06 8704 ................................................................
12:47:07 8768 ................................................................
12:47:08 8832 ................................................................
12:47:09 8896 ................................................................
12:47:10 8960 ................................................................
12:47:12 9024 ................................................................
12:47:13 9088 ................................................................
12:47:14 9152 ................................................................
12:47:16 9216 ................................................................
12:47:17 9280 ................................................................
12:47:19 9344 ................................................................
12:47:20 9408 ................................................................
12:47:21 9472 ................................................................
12:47:23 9536 ................................................................
12:47:24 9600 ................................................................
12:47:26 9664 ................................................................
12:47:28 9728 ................................................................
12:47:29 9792 ................................................................
12:47:31 9856 ................................................................
12:47:33 9920 ................................................................
12:47:34 9984 ................................................................
12:47:35 10048 ................................................................
12:47:36 10112 ................................................................
12:47:37 10176 ................................................................
12:47:38 10240 ................................................................
12:47:39 10304 ................................................................
12:47:40 10368 ................................................................
12:47:41 10432 ................................................................
12:47:43 10496 ................................................................
12:47:44 10560 ................................................................
12:47:45 10624 ................................................................
12:47:47 10688 ................................................................
12:47:48 10752 ................................................................
12:47:49 10816 ................................................................
12:47:50 10880 ................................................................
12:47:51 10944 ................................................................
12:47:52 11008 ................................................................
12:47:53 11072 ................................................................
12:47:54 11136 ................................................................
12:47:55 11200 ................................................................
12:47:57 11264 ................................................................
12:47:58 11328 ................................................................
12:47:59 11392 ................................................................
12:48:00 11456 ................................................................
12:48:01 11520 ................................................................
12:48:02 11584 ................................................................
12:48:03 11648 ................................................................
12:48:05 11712 ................................................................
12:48:06 11776 ................................................................
12:48:07 11840 ................................................................
12:48:08 11904 ................................................................
12:48:09 11968 ................................................................
12:48:10 12032 ................................................................
12:48:11 12096 ................................................................
12:48:12 12160 ................................................................
12:48:13 12224 ................................................................
12:48:14 12288 ................................................................
12:48:44 12352 ................................................................
12:50:43 12416 .
done (892s)
12:50:43
WARNING: The following tests exceed 5 minute runtimes. Break them up or rethink them.
12:50:43 304.255: '582720422b3f4dff:ISOLATE=1:NAME=e2e_p2p/validators_sentinel yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/validators_sentinel.test.ts'
12:50:43 305.275: '6c8b1f2818608a3b noir-projects/scripts/run_test.sh noir-protocol-circuits rollup_lib block_root::block_root_rollup_inputs::tests::correct_blobs_with_non_empty_fields'
12:50:43 322.176: '6c32ccc844d598b0 barretenberg/cpp/scripts/run_test.sh dsl_tests AcirAvm2RecursionConstraint.TestGenerateVKFromConstraintsWithoutWitness'
12:50:43 339.983: '582720422b3f4dff:ISOLATE=1:NAME=e2e_p2p/data_withholding_slash yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/data_withholding_slash.test.ts'
12:50:43 345.957: '38f42676adefc499:ONLY_TERM_PARENT=1 BOX=vanilla BROWSER=* run_compose_test vanilla-all-browsers box boxes'
12:50:43 353.390: '6c32ccc844d598b0:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityPassing'
12:50:43 356.220: '6c32ccc844d598b0:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityFailing'
12:50:43 358.925: 'ae089fd8b717cb3d aztec-up/scripts/run_test.sh amm_flow'
12:50:43 385.861: '582720422b3f4dff:ISOLATE=1:NAME=p2p/src/client/p2p_client.integration.test.ts LOG_LEVEL=debug yarn-project/scripts/run_test.sh p2p/src/client/p2p_client.integration.test.ts'
12:50:43 408.506: '582720422b3f4dff:ISOLATE=1:TIMEOUT=15m:NAME=e2e_block_building yarn-project/end-to-end/scripts/run_test.sh simple e2e_block_building'
12:50:43 427.059: '582720422b3f4dff:ISOLATE=1:NAME=prover-client/src/test/bb_prover_full_rollup.test.ts:CPUS=16:MEM=96g LOG_LEVEL=verbose yarn-project/scripts/run_test.sh prover-client/src/test/bb_prover_full_rollup.test.ts'
12:50:43 429.420: '582720422b3f4dff:ISOLATE=1:NAME=e2e_p2p/reex yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/reex.test.ts'
12:50:43 443.125: '582720422b3f4dff:ISOLATE=1:NAME=e2e_l1_with_wall_time yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_l1_with_wall_time.test.ts'
12:50:43 729.161: '582720422b3f4dff:ISOLATE=1:TIMEOUT=15m:CPUS=16:MEM=96g:NAME=e2e_prover_full_real yarn-project/end-to-end/scripts/run_test.sh simple e2e_prover/full'
12:50:43 Completed run of 12158 tests in 892 seconds.
12:50:43
--- bench all ---
12:50:44 barretenberg/cpp Executing: barretenberg/cpp/bootstrap.sh build_bench (
http://ci.aztec-labs.com/b460a1f038cfa806)
12:50:44 yarn-project/end-to-end Executing: yarn-project/end-to-end/bootstrap.sh build_bench (
http://ci.aztec-labs.com/7263c561cdc0e799)
12:50:45 barretenberg/cpp 0 .
done (1s)
12:52:45 yarn-project/end-to-end 0 ................................................................
12:55:38 yarn-project/end-to-end 64 .
done (294s)
12:55:40 Starting parallel run using max 64 cpus...
12:55:40 Test run log id:
http://ci.aztec-labs.com/216b354fe66f04bc
13:00:46 Completed run of 95 tests in 306 seconds.
13:00:49 Completed 7.6 KiB/7.6 KiB (64.3 KiB/s) with 1 file(s) remaining
upload: ../../../tmp/tmp.eiXlAnoQAo to s3://aztec-ci-artifacts/build-cache/bench-505a3c071181dbc5242dc8b655a9b2d69988c8db.tar.gz
13:00:49 Cache upload of bench-505a3c071181dbc5242dc8b655a9b2d69988c8db.tar.gz complete in 2s.
13:00:49 + local code=0
13:00:49 + set +x
13:00:49 dmesg log id:
http://ci.aztec-labs.com/8a627c0111ba08eb
CI run log id:
http://ci.aztec-labs.com/1750681940610
+ code=0
+ case $code in
+ log_ci_run PASSED 1750681940610
+ exit 0
SSH exited with code: 0
Terminating instance: i-0fdb071c48b3a67f0...