Parent Log:
http://ci.aztec-labs.com/15824286338
Command: bootstrap_ec2 './bootstrap.sh ci-full'
Date: Mon Jun 23 13:01:15 UTC 2025
Status: 0
Took: 1784s
--- request build instance ---
Requesting m6a.32xlarge spot instance (name: pr-15211_amd64_x4-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for instance id for spot request: sir-f5bf61sj...
Timeout waiting for spot request.
Requesting m6a.32xlarge on-demand instance (name: pr-15211_amd64_x4-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for SSH at 18.218.42.81...
Stdout is not a tty, running in background...
Loading CRS into tmpfs...
Done in 11 seconds.
Stdout is not a tty, starting build container in background...
Starting devbox...
From
https://github.com/aztecprotocol/aztec-packages
* branch 505a3c071181dbc5242dc8b655a9b2d69988c8db -> FETCH_HEAD
HEAD is now at 505a3c0 chore(backport-to-staging): chore: Updated tx pool limit (#15209) (#15211)
Switched to a new branch 'gh-readonly-queue/staging/pr-15211-e8f6c3b7e3e0e72a33e118ddf8e67d11e51464a8'
+ run
+ ci3/add_timestamps
+ DUP=1
+ ci3/cache_log 'CI run' 1750681987352
CI run log id:
http://ci.aztec-labs.com/1750681987352
12:33:07 + echo 'env: REF_NAME=gh-readonly-queue/staging/pr-15211-e8f6c3b7e3e0e72a33e118ddf8e67d11e51464a8 COMMIT_HASH=505a3c071181dbc5242dc8b655a9b2d69988c8db CURRENT_VERSION=0.87.6 TARGET_BRANCH=staging'
12:33:07 env: REF_NAME=gh-readonly-queue/staging/pr-15211-e8f6c3b7e3e0e72a33e118ddf8e67d11e51464a8 COMMIT_HASH=505a3c071181dbc5242dc8b655a9b2d69988c8db CURRENT_VERSION=0.87.6 TARGET_BRANCH=staging
12:33:07 + semver check gh-readonly-queue/staging/pr-15211-e8f6c3b7e3e0e72a33e118ddf8e67d11e51464a8
12:33:07 + cpu_pid=424
12:33:07 + mem_pid=425
12:33:07 + set +e
12:33:07 + set -x
12:33:07 + mpstat 2
12:33:07 + ./bootstrap.sh ci-full
12:33:07 + vmstat -w -S M 2
12:33:07 ++ cache_log memfile
12:33:07 ++ cache_log cpufile
12:33:07 memfile log id:
http://ci.aztec-labs.com/cae6e557ab1cd80d
12:33:07 cpufile log id:
http://ci.aztec-labs.com/085182affe97a978
12:33:15
--- pull submodules ---
12:33:15 Executing: git submodule update --init --recursive (
http://ci.aztec-labs.com/afc5f636b90d92bd)
12:33:23 0 .
done (8s)
12:33:25
--- noir build ---
12:33:25 Executing: retry install_deps (
http://ci.aztec-labs.com/0a94225d0115ef62)
12:33:28 0 .
done (3s)
12:33:29 build_native Executing: build_native (
http://ci.aztec-labs.com/f0887141340a746e)
12:33:29 build_packages Executing: build_packages (
http://ci.aztec-labs.com/882262e6f1f2742f)
12:33:30 build_native 0 .
done (0s)
12:33:35 build_packages 0 .
done (6s)
12:33:36
--- bb cpp build ---
12:33:36 build_native Executing: build_native (
http://ci.aztec-labs.com/aa05c1332b959cfd)
12:33:36 build_wasm_threads Executing: build_wasm_threads (
http://ci.aztec-labs.com/115d540e34815563)
12:33:36 build_wasm Executing: build_wasm (
http://ci.aztec-labs.com/ecd3710dcbf1acff)
12:33:36 build_nodejs_module Executing: build_nodejs_module (
http://ci.aztec-labs.com/e19233063264d612)
12:33:36 build_gcc_syntax_check_only Executing: build_gcc_syntax_check_only (
http://ci.aztec-labs.com/9c8b6ba623624cf7)
12:33:36 build_fuzzing_syntax_check_only Executing: build_fuzzing_syntax_check_only (
http://ci.aztec-labs.com/67fb4713f19e103e)
12:33:36 build_asan_fast Executing: build_asan_fast (
http://ci.aztec-labs.com/ac0087ce44ea4d50)
12:33:36 build_darwin Executing: build_darwin (
http://ci.aztec-labs.com/b72267649d508192)
12:33:36 build_gcc_syntax_check_only 0 .
done (0s)
12:33:36 build_fuzzing_syntax_check_only 0 .
done (0s)
12:33:36 build_wasm 0 .
done (0s)
12:33:36 build_darwin 0 .
done (0s)
12:33:36 build_wasm_threads 0 .
done (0s)
12:33:37 build_nodejs_module 0 .
done (1s)
12:33:37 build_native 0 .
done (1s)
12:33:38 build_asan_fast 0 .
done (2s)
12:33:42
--- bb.js build ---
12:33:43 Cache download and extraction of node-modules-e85320bda7d59d54.zst complete in 1s.
12:33:44 Cache download and extraction of bb.js-93955768547ae31a.tar.gz complete in 1s.
12:33:44
--- acir_tests build ---
12:33:44 Cache download and extraction of barretenberg-acir-tests-000ad54a8a7b4100.tar.gz complete in 0s.
12:33:46 Cache download and extraction of node-modules-fec19dc5fe5a76d5.zst complete in 1s.
12:33:46 browser-test-app Executing: yarn build (
http://ci.aztec-labs.com/e953f9811b1de847)
12:33:46 bbjs-test Executing: yarn build (
http://ci.aztec-labs.com/1a9961b6e8848fe1)
12:33:49 bbjs-test 0 .
done (3s)
12:33:50 browser-test-app 0 .
done (4s)
12:33:51
--- avm-transpiler build ---
12:33:51 Cache download and extraction of avm-transpiler-6867cd9272ea7ebd.tar.gz complete in 0s.
12:33:51
--- noir-projects build ---
12:33:51 Executing: prep (
http://ci.aztec-labs.com/516fa49318bc40b1)
12:33:54 0 .
done (3s)
12:33:54 mock-protocol-circuits Executing: ./mock-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/705340ff6215e090)
12:33:54 noir-protocol-circuits Executing: ./noir-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/49f6477bdc8588a1)
12:33:54 noir-contracts Executing: ./noir-contracts/bootstrap.sh (
http://ci.aztec-labs.com/b78501f216772a43)
12:33:54 aztec-nr Executing: ./aztec-nr/bootstrap.sh (
http://ci.aztec-labs.com/f4181fafee8e0bd5)
12:33:55 noir-contracts 0 ................................................................
12:33:55 noir-contracts 64 ................................................................
12:33:55 noir-contracts 128 ................................................................
12:33:55 noir-contracts 192 ................................................................
12:33:56 noir-contracts 256 ................................................................
12:33:56 noir-contracts 320 ................................................................
12:33:56 noir-contracts 384 ................................................................
12:33:56 noir-contracts 448 ................................................................
12:33:56 noir-contracts 512 ................................................................
12:33:56 noir-contracts 576 ................................................................
12:33:56 noir-contracts 640 ................................................................
12:33:57 noir-contracts 704 ................................................................
12:33:57 noir-contracts 768 ................................................................
12:33:57 noir-contracts 832 ................................................................
12:33:57 noir-contracts 896 ................................................................
12:33:57 noir-contracts 960 ................................................................
12:33:58 noir-contracts 1024 ................................................................
12:33:58 noir-contracts 1088 ................................................................
12:33:58 noir-contracts 1152 ................................................................
12:33:58 noir-contracts 1216 ................................................................
12:33:58 noir-contracts 1280 ................................................................
12:33:58 noir-contracts 1344 ................................................................
12:33:58 noir-contracts 1408 ................................................................
12:33:58 noir-contracts 1472 ................................................................
12:33:59 noir-contracts 1536 ................................................................
12:33:59 noir-contracts 1600 .
done (5s)
12:33:59 noir-protocol-circuits 0 ................................................................
12:33:59 noir-protocol-circuits 64 ................................................................
12:34:00 noir-protocol-circuits 128 ................................................................
12:34:00 noir-protocol-circuits 192 ................................................................
12:34:01 mock-protocol-circuits 0 ................................................................
12:34:01 aztec-nr 0 .
done (7s)
12:34:01 noir-protocol-circuits 256 ................................................................
12:34:03 mock-protocol-circuits 64 .
done (9s)
12:34:03 noir-protocol-circuits 320 ................................................................
12:34:03 noir-protocol-circuits 384 ................................................................
12:34:03 noir-protocol-circuits 448 .
done (9s)
12:34:03
--- l1-contracts build ---
12:34:04 Cache download and extraction of l1-contracts-0a920e2ab51d8ecb.tar.gz complete in 1s.
12:34:04
--- yarn-project build ---
12:34:04 Executing: ./bootstrap.sh clean-lite (
http://ci.aztec-labs.com/1c7690bea63a5d5d)
12:34:04 0 .
done (0s)
12:34:09 Cache download and extraction of node-modules-34bec2a54a394404.zst complete in 5s.
12:34:09 Executing: compile_all (
http://ci.aztec-labs.com/e428ae12ad140d52)
12:34:12 0 .
done (3s)
12:34:12 boxes/bootstrap.sh Executing: boxes/bootstrap.sh (
http://ci.aztec-labs.com/0b5a47ea24805339)
12:34:12 playground/bootstrap.sh Executing: playground/bootstrap.sh (
http://ci.aztec-labs.com/25cceab4dd910cb2)
12:34:12 docs/bootstrap.sh Executing: docs/bootstrap.sh (
http://ci.aztec-labs.com/e49263d663b64d24)
12:34:12 release-image/bootstrap.sh Executing: release-image/bootstrap.sh (
http://ci.aztec-labs.com/53ab9a70d00bb552)
12:34:12 spartan/bootstrap.sh Executing: spartan/bootstrap.sh (
http://ci.aztec-labs.com/86fba864581be7e4)
12:34:12 aztec-up/bootstrap.sh Executing: aztec-up/bootstrap.sh (
http://ci.aztec-labs.com/0a3b748fdef3f5ae)
12:34:13 aztec-up/bootstrap.sh 0 .
done (1s)
12:34:16 spartan/bootstrap.sh 0 .
done (4s)
12:34:16 boxes/bootstrap.sh 0 .
done (4s)
12:34:17 playground/bootstrap.sh 0 .
done (5s)
12:34:20 docs/bootstrap.sh 0 .
done (7s)
12:34:49 release-image/bootstrap.sh 0 .
done (37s)
12:34:49
--- test all ---
12:34:49 Waiting for TXE's to start...
12:34:52 Gathering tests to run...
12:36:33 Gathered 12158 tests.
12:36:33 Starting parallel run with max 64 jobs...
12:36:33 Executing: parallel -j64 --memsuspend 64G --line-buffer --joblog joblog.txt --halt now,fail=1 'run_test_cmd {}' (
http://ci.aztec-labs.com/846add91483fe158)
12:37:04 0 ................................................................
12:38:08 64 ................................................................
12:39:12 128 ................................................................
12:40:15 192 ................................................................
12:40:40 256 ................................................................
12:40:52 320 ................................................................
12:41:12 384 ................................................................
12:41:26 448 ................................................................
12:41:33 512 ................................................................
12:41:39 576 ................................................................
12:41:50 640 ................................................................
12:41:58 704 ................................................................
12:42:05 768 ................................................................
12:42:11 832 ................................................................
12:42:18 896 ................................................................
12:42:24 960 ................................................................
12:42:30 1024 ................................................................
12:42:33 1088 ................................................................
12:42:42 1152 ................................................................
12:42:48 1216 ................................................................
12:42:51 1280 ................................................................
12:42:55 1344 ................................................................
12:42:58 1408 ................................................................
12:43:02 1472 ................................................................
12:43:05 1536 ................................................................
12:43:12 1600 ................................................................
12:43:21 1664 ................................................................
12:43:36 1728 ................................................................
12:43:41 1792 ................................................................
12:43:45 1856 ................................................................
12:43:48 1920 ................................................................
12:43:50 1984 ................................................................
12:43:51 2048 ................................................................
12:43:53 2112 ................................................................
12:43:55 2176 ................................................................
12:43:56 2240 ................................................................
12:43:58 2304 ................................................................
12:44:00 2368 ................................................................
12:44:01 2432 ................................................................
12:44:02 2496 ................................................................
12:44:04 2560 ................................................................
12:44:20 2624 ................................................................
12:44:27 2688 ................................................................
12:44:29 2752 ................................................................
12:44:30 2816 ................................................................
12:44:32 2880 ................................................................
12:44:34 2944 ................................................................
12:44:44 3008 ................................................................
12:44:51 3072 ................................................................
12:44:54 3136 ................................................................
12:44:56 3200 ................................................................
12:44:58 3264 ................................................................
12:44:59 3328 ................................................................
12:45:00 3392 ................................................................
12:45:02 3456 ................................................................
12:45:05 3520 ................................................................
12:45:08 3584 ................................................................
12:45:10 3648 ................................................................
12:45:11 3712 ................................................................
12:45:13 3776 ................................................................
12:45:14 3840 ................................................................
12:45:15 3904 ................................................................
12:45:16 3968 ................................................................
12:45:18 4032 ................................................................
12:45:19 4096 ................................................................
12:45:21 4160 ................................................................
12:45:25 4224 ................................................................
12:45:29 4288 ................................................................
12:45:32 4352 ................................................................
12:45:36 4416 ................................................................
12:45:38 4480 ................................................................
12:45:41 4544 ................................................................
12:45:43 4608 ................................................................
12:45:45 4672 ................................................................
12:45:48 4736 ................................................................
12:45:50 4800 ................................................................
12:45:52 4864 ................................................................
12:45:53 4928 ................................................................
12:45:55 4992 ................................................................
12:45:56 5056 ................................................................
12:45:58 5120 ................................................................
12:46:00 5184 ................................................................
12:46:01 5248 ................................................................
12:46:02 5312 ................................................................
12:46:03 5376 ................................................................
12:46:04 5440 ................................................................
12:46:07 5504 ................................................................
12:46:09 5568 ................................................................
12:46:11 5632 ................................................................
12:46:14 5696 ................................................................
12:46:16 5760 ................................................................
12:46:18 5824 ................................................................
12:46:20 5888 ................................................................
12:46:22 5952 ................................................................
12:46:24 6016 ................................................................
12:46:26 6080 ................................................................
12:46:28 6144 ................................................................
12:46:31 6208 ................................................................
12:46:34 6272 ................................................................
12:46:36 6336 ................................................................
12:46:38 6400 ................................................................
12:46:40 6464 ................................................................
12:46:43 6528 ................................................................
12:46:46 6592 ................................................................
12:46:49 6656 ................................................................
12:46:52 6720 ................................................................
12:46:55 6784 ................................................................
12:46:57 6848 ................................................................
12:46:59 6912 ................................................................
12:47:01 6976 ................................................................
12:47:03 7040 ................................................................
12:47:05 7104 ................................................................
12:47:07 7168 ................................................................
12:47:09 7232 ................................................................
12:47:10 7296 ................................................................
12:47:11 7360 ................................................................
12:47:12 7424 ................................................................
12:47:14 7488 ................................................................
12:47:15 7552 ................................................................
12:47:16 7616 ................................................................
12:47:17 7680 ................................................................
12:47:18 7744 ................................................................
12:47:19 7808 ................................................................
12:47:21 7872 ................................................................
12:47:22 7936 ................................................................
12:47:23 8000 ................................................................
12:47:24 8064 ................................................................
12:47:25 8128 ................................................................
12:47:27 8192 ................................................................
12:47:28 8256 ................................................................
12:47:29 8320 ................................................................
12:47:30 8384 ................................................................
12:47:31 8448 ................................................................
12:47:32 8512 ................................................................
12:47:33 8576 ................................................................
12:47:34 8640 ................................................................
12:47:35 8704 ................................................................
12:47:37 8768 ................................................................
12:47:38 8832 ................................................................
12:47:39 8896 ................................................................
12:47:40 8960 ................................................................
12:47:41 9024 ................................................................
12:47:43 9088 ................................................................
12:47:44 9152 ................................................................
12:47:45 9216 ................................................................
12:47:47 9280 ................................................................
12:47:48 9344 ................................................................
12:47:50 9408 ................................................................
12:47:51 9472 ................................................................
12:47:52 9536 ................................................................
12:47:54 9600 ................................................................
12:47:55 9664 ................................................................
12:47:57 9728 ................................................................
12:47:59 9792 ................................................................
12:48:00 9856 ................................................................
12:48:02 9920 ................................................................
12:48:03 9984 ................................................................
12:48:04 10048 ................................................................
12:48:05 10112 ................................................................
12:48:06 10176 ................................................................
12:48:07 10240 ................................................................
12:48:08 10304 ................................................................
12:48:09 10368 ................................................................
12:48:11 10432 ................................................................
12:48:12 10496 ................................................................
12:48:14 10560 ................................................................
12:48:15 10624 ................................................................
12:48:16 10688 ................................................................
12:48:17 10752 ................................................................
12:48:18 10816 ................................................................
12:48:19 10880 ................................................................
12:48:20 10944 ................................................................
12:48:21 11008 ................................................................
12:48:22 11072 ................................................................
12:48:23 11136 ................................................................
12:48:25 11200 ................................................................
12:48:26 11264 ................................................................
12:48:27 11328 ................................................................
12:48:28 11392 ................................................................
12:48:29 11456 ................................................................
12:48:30 11520 ................................................................
12:48:31 11584 ................................................................
12:48:32 11648 ................................................................
12:48:33 11712 ................................................................
12:48:35 11776 ................................................................
12:48:36 11840 ................................................................
12:48:37 11904 ................................................................
12:48:38 11968 ................................................................
12:48:39 12032 ................................................................
12:48:40 12096 ................................................................
12:48:41 12160 ................................................................
12:48:42 12224 ................................................................
12:48:43 12288 ................................................................
12:48:57 12352 ................................................................
12:51:18 12416 .
done (885s)
12:51:18
WARNING: The following tests exceed 5 minute runtimes. Break them up or rethink them.
12:51:18 303.296: '582720422b3f4dff:ISOLATE=1:NAME=e2e_p2p/validators_sentinel yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/validators_sentinel.test.ts'
12:51:18 323.534: '6c32ccc844d598b0 barretenberg/cpp/scripts/run_test.sh dsl_tests AcirAvm2RecursionConstraint.TestGenerateVKFromConstraintsWithoutWitness'
12:51:18 340.698: '582720422b3f4dff:ISOLATE=1:NAME=e2e_p2p/data_withholding_slash yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/data_withholding_slash.test.ts'
12:51:18 347.851: '38f42676adefc499:ONLY_TERM_PARENT=1 BOX=vanilla BROWSER=* run_compose_test vanilla-all-browsers box boxes'
12:51:18 354.490: '6c32ccc844d598b0:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityPassing'
12:51:18 357.795: '6c32ccc844d598b0:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityFailing'
12:51:18 358.526: 'ae089fd8b717cb3d aztec-up/scripts/run_test.sh amm_flow'
12:51:18 385.386: '582720422b3f4dff:ISOLATE=1:NAME=p2p/src/client/p2p_client.integration.test.ts LOG_LEVEL=debug yarn-project/scripts/run_test.sh p2p/src/client/p2p_client.integration.test.ts'
12:51:18 400.371: '582720422b3f4dff:ISOLATE=1:TIMEOUT=15m:NAME=e2e_block_building yarn-project/end-to-end/scripts/run_test.sh simple e2e_block_building'
12:51:18 408.539: '582720422b3f4dff:ISOLATE=1:NAME=prover-client/src/test/bb_prover_full_rollup.test.ts:CPUS=16:MEM=96g LOG_LEVEL=verbose yarn-project/scripts/run_test.sh prover-client/src/test/bb_prover_full_rollup.test.ts'
12:51:18 430.746: '582720422b3f4dff:ISOLATE=1:NAME=e2e_p2p/reex yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/reex.test.ts'
12:51:18 443.248: '582720422b3f4dff:ISOLATE=1:NAME=e2e_l1_with_wall_time yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_l1_with_wall_time.test.ts'
12:51:18 720.417: '582720422b3f4dff:ISOLATE=1:TIMEOUT=15m:CPUS=16:MEM=96g:NAME=e2e_prover_full_real yarn-project/end-to-end/scripts/run_test.sh simple e2e_prover/full'
12:51:18 Completed run of 12158 tests in 885 seconds.
12:51:18
--- bench all ---
12:51:19 barretenberg/cpp Executing: barretenberg/cpp/bootstrap.sh build_bench (
http://ci.aztec-labs.com/681cb255490393fd)
12:51:19 yarn-project/end-to-end Executing: yarn-project/end-to-end/bootstrap.sh build_bench (
http://ci.aztec-labs.com/be11cbd9243fdfba)
12:51:19 barretenberg/cpp 0 .
done (0s)
12:53:21 yarn-project/end-to-end 0 ................................................................
12:55:57 yarn-project/end-to-end 64 .
done (278s)
12:55:58 Starting parallel run using max 64 cpus...
12:55:58 Test run log id:
http://ci.aztec-labs.com/95c9337e78f6a3e0
13:01:04 Completed run of 95 tests in 306 seconds.
13:01:06 Completed 7.6 KiB/7.6 KiB (154.5 KiB/s) with 1 file(s) remaining
upload: ../../../tmp/tmp.dlsjOV83Du to s3://aztec-ci-artifacts/build-cache/bench-505a3c071181dbc5242dc8b655a9b2d69988c8db.tar.gz
13:01:06 Cache upload of bench-505a3c071181dbc5242dc8b655a9b2d69988c8db.tar.gz complete in 1s.
13:01:06 + local code=0
13:01:06 + set +x
13:01:06 dmesg log id:
http://ci.aztec-labs.com/dbdba611c4238e30
CI run log id:
http://ci.aztec-labs.com/1750681987352
+ code=0
+ case $code in
+ log_ci_run PASSED 1750681987352
+ exit 0
SSH exited with code: 0
Terminating instance: i-03e9b228d00039366...