ACI ·

Parent Log: http://ci.aztec-labs.com/15717107798 Command: bootstrap_ec2 './bootstrap.sh ci-full' Date: Tue Jun 17 20:37:41 UTC 2025 Status: 0 Took: 1277s --- request build instance --- Requesting m6a.32xlarge spot instance (name: pr-15117_amd64_x2-full) (type: m6a.32xlarge) (ami: ami-069f88e34f8fb5021) (bid: 5.5424)... Waiting for instance id for spot request: sir-3ycf5mfj... Waiting for SSH at 3.144.122.203... No tty, running in background... Loading CRS into tmpfs... Done in 33 seconds. Starting devbox... From https://github.com/aztecprotocol/aztec-packages * branch 464e1a9d9b40b5188586643b44bc52bffccbc3e6 -> FETCH_HEAD HEAD is now at 464e1a9 fix: Handle missed l1-to-l2 messages in archiver (#15117) Switched to a new branch 'gh-readonly-queue/master/pr-15117-c06f30929f18b85bcea93c0926a8d640a3819f00' + ci3/aws_handle_evict run + ci3/add_timestamps + DUP=1 + ci3/cache_log 'CI run' 1750191458104 CI run log id: http://ci.aztec-labs.com/1750191458104 20:17:38 env: REF_NAME=gh-readonly-queue/master/pr-15117-c06f30929f18b85bcea93c0926a8d640a3819f00 COMMIT_HASH=464e1a9d9b40b5188586643b44bc52bffccbc3e6 CURRENT_VERSION=0.87.8 TARGET_BRANCH=master 20:17:38 + ./bootstrap.sh ci-full 20:17:46 --- pull submodules --- 20:17:46 Executing: git submodule update --init --recursive (http://ci.aztec-labs.com/7777960fd0390b1a) 20:17:54 0 . done (8s) 20:17:57 --- noir build --- 20:17:57 Executing: retry install_deps (http://ci.aztec-labs.com/2f5b755531135e87) 20:18:01 0 . done (4s) 20:18:02 build_native Executing: build_native (http://ci.aztec-labs.com/186c023ee9bb377e) 20:18:02 build_packages Executing: build_packages (http://ci.aztec-labs.com/79856ead66d3a2b4) 20:18:02 build_native 0 . done (0s) 20:18:08 build_packages 0 . done (6s) 20:18:09 --- bb cpp build --- 20:18:09 build_nodejs_module Executing: build_nodejs_module (http://ci.aztec-labs.com/19f0c1b677860d14) 20:18:09 build_wasm Executing: build_wasm (http://ci.aztec-labs.com/9c6ee03102fbec07) 20:18:09 build_native Executing: build_native (http://ci.aztec-labs.com/bda2328cba7b2298) 20:18:09 build_wasm_threads Executing: build_wasm_threads (http://ci.aztec-labs.com/5b25c8dc1b0d9d49) 20:18:09 build_gcc_syntax_check_only Executing: build_gcc_syntax_check_only (http://ci.aztec-labs.com/f39802e51cb3ebbc) 20:18:09 build_fuzzing_syntax_check_only Executing: build_fuzzing_syntax_check_only (http://ci.aztec-labs.com/db6c7d891f56e6c1) 20:18:09 build_asan_fast Executing: build_asan_fast (http://ci.aztec-labs.com/12cc31b7a8b47e6d) 20:18:09 build_darwin Executing: build_darwin (http://ci.aztec-labs.com/bd028e3b903f85cf) 20:18:09 build_fuzzing_syntax_check_only 0 . done (0s) 20:18:09 build_gcc_syntax_check_only 0 . done (0s) 20:18:09 build_darwin 0 . done (0s) 20:18:09 build_wasm_threads 0 . done (0s) 20:18:09 build_wasm 0 . done (0s) 20:18:10 build_nodejs_module 0 . done (1s) 20:18:10 build_native 0 . done (1s) 20:18:11 build_asan_fast 0 . done (2s) 20:18:15 --- bb.js build --- 20:18:16 Cache download and extraction of node-modules-aa659bb2a892ab4f.zst complete in 1s. 20:18:16 Cache download and extraction of bb.js-5630c8ceca74baf6.tar.gz complete in 0s. 20:18:17 --- acir_tests build --- 20:18:18 Cache download and extraction of barretenberg-acir-tests-02f79a599fd31657.tar.gz complete in 1s. 20:18:19 Cache download and extraction of node-modules-fec19dc5fe5a76d5.zst complete in 1s. 20:18:19 Executing: cd browser-test-app && yarn build (http://ci.aztec-labs.com/35294bf4dbc41b8e) 20:18:23 0 . done (4s) 20:18:23 Executing: cd bbjs-test && yarn build (http://ci.aztec-labs.com/f834aed00d9857fd) 20:18:26 0 . done (3s) 20:18:27 --- avm-transpiler build --- 20:18:27 Cache download and extraction of avm-transpiler-10ea3821ff0e6f60.tar.gz complete in 0s. 20:18:27 --- noir-projects build --- 20:18:27 Executing: prep (http://ci.aztec-labs.com/ae1b3415b63fd382) 20:18:30 0 . done (2s) 20:18:30 mock-protocol-circuits Executing: ./mock-protocol-circuits/bootstrap.sh (http://ci.aztec-labs.com/b4d29d3353343822) 20:18:30 noir-protocol-circuits Executing: ./noir-protocol-circuits/bootstrap.sh (http://ci.aztec-labs.com/ff438fd0fc2d7e01) 20:18:30 noir-contracts Executing: ./noir-contracts/bootstrap.sh (http://ci.aztec-labs.com/ea918223d1ab2f0e) 20:18:30 aztec-nr Executing: ./aztec-nr/bootstrap.sh (http://ci.aztec-labs.com/928cc6abc7175467) 20:18:32 noir-contracts 0 ................................................................ 20:18:32 noir-contracts 64 ................................................................ 20:18:32 noir-contracts 128 ................................................................ 20:18:32 noir-contracts 192 ................................................................ 20:18:32 noir-contracts 256 ................................................................ 20:18:33 noir-contracts 320 ................................................................ 20:18:33 noir-contracts 384 ................................................................ 20:18:33 noir-contracts 448 ................................................................ 20:18:33 noir-contracts 512 ................................................................ 20:18:33 noir-contracts 576 ................................................................ 20:18:33 noir-contracts 640 ................................................................ 20:18:34 noir-contracts 704 ................................................................ 20:18:34 noir-contracts 768 ................................................................ 20:18:34 noir-contracts 832 ................................................................ 20:18:34 noir-contracts 896 ................................................................ 20:18:34 noir-contracts 960 ................................................................ 20:18:35 noir-contracts 1024 ................................................................ 20:18:35 noir-contracts 1088 ................................................................ 20:18:35 noir-protocol-circuits 0 ................................................................ 20:18:35 noir-protocol-circuits 64 ................................................................ 20:18:35 noir-contracts 1152 ................................................................ 20:18:35 noir-contracts 1216 ................................................................ 20:18:35 noir-contracts 1280 ................................................................ 20:18:36 noir-contracts 1344 ................................................................ 20:18:36 noir-contracts 1408 . done (6s) 20:18:36 noir-protocol-circuits 128 ................................................................ 20:18:36 aztec-nr 0 . done (6s) 20:18:37 noir-protocol-circuits 192 ................................................................ 20:18:37 mock-protocol-circuits 0 ................................................................ 20:18:38 noir-protocol-circuits 256 ................................................................ 20:18:39 noir-protocol-circuits 320 ................................................................ 20:18:39 mock-protocol-circuits 64 . done (9s) 20:18:39 noir-protocol-circuits 384 ................................................................ 20:18:39 noir-protocol-circuits 448 . done (9s) 20:18:40 --- l1-contracts build --- 20:18:40 Cache download and extraction of l1-contracts-b16c798236bc092e.tar.gz complete in 0s. 20:18:40 --- yarn-project build --- 20:18:40 Executing: ./bootstrap.sh clean-lite (http://ci.aztec-labs.com/e97e2a78fb1ef7d1) 20:18:40 0 . done (0s) 20:18:45 Cache download and extraction of node-modules-45f5b7daac61c7b8.zst complete in 5s. 20:18:45 Executing: compile_all (http://ci.aztec-labs.com/33a08a26621f7691) 20:18:48 0 . done (3s) 20:18:48 boxes/bootstrap.sh Executing: boxes/bootstrap.sh (http://ci.aztec-labs.com/b5cb5d281e20b63c) 20:18:48 playground/bootstrap.sh Executing: playground/bootstrap.sh (http://ci.aztec-labs.com/2bb84a0e60603513) 20:18:48 docs/bootstrap.sh Executing: docs/bootstrap.sh (http://ci.aztec-labs.com/5bcfbbb42a52200e) 20:18:48 release-image/bootstrap.sh Executing: release-image/bootstrap.sh (http://ci.aztec-labs.com/d1b235c30a317632) 20:18:48 spartan/bootstrap.sh Executing: spartan/bootstrap.sh (http://ci.aztec-labs.com/04d55e04e51bae35) 20:18:48 aztec-up/bootstrap.sh Executing: aztec-up/bootstrap.sh (http://ci.aztec-labs.com/1a5762cba17904b8) 20:18:49 aztec-up/bootstrap.sh 0 . done (1s) 20:18:52 spartan/bootstrap.sh 0 . done (4s) 20:18:52 boxes/bootstrap.sh 0 . done (4s) 20:18:54 playground/bootstrap.sh 0 . done (6s) 20:18:56 docs/bootstrap.sh 0 . done (8s) 20:19:27 release-image/bootstrap.sh 0 . done (39s) 20:19:27 --- test all --- 20:19:28 Waiting for TXE's to start... 20:19:31 Gathering tests to run... 20:20:39 Gathered 9399 tests. 20:20:39 Starting parallel run with max 64 jobs... 20:20:39 Executing: parallel -j64 --memsuspend 64G --line-buffer --joblog joblog.txt --halt now,fail=1 'run_test_cmd {}' (http://ci.aztec-labs.com/a6379728c23043a9) 20:21:10 0 ................................................................ 20:22:30 64 ................................................................ 20:23:34 128 ................................................................ 20:24:21 192 ................................................................ 20:24:37 256 ................................................................ 20:24:48 320 ................................................................ 20:25:08 384 ................................................................ 20:25:16 448 ................................................................ 20:25:23 512 ................................................................ 20:25:35 576 ................................................................ 20:25:44 640 ................................................................ 20:25:50 704 ................................................................ 20:25:58 768 ................................................................ 20:26:04 832 ................................................................ 20:26:11 896 ................................................................ 20:26:16 960 ................................................................ 20:26:21 1024 ................................................................ 20:26:27 1088 ................................................................ 20:26:29 1152 ................................................................ 20:26:33 1216 ................................................................ 20:26:36 1280 ................................................................ 20:26:40 1344 ................................................................ 20:26:43 1408 ................................................................ 20:27:05 1472 ................................................................ 20:27:19 1536 ................................................................ 20:27:25 1600 ................................................................ 20:27:31 1664 ................................................................ 20:27:32 1728 ................................................................ 20:27:36 1792 ................................................................ 20:27:38 1856 ................................................................ 20:27:40 1920 ................................................................ 20:27:42 1984 ................................................................ 20:27:44 2048 ................................................................ 20:27:47 2112 ................................................................ 20:27:49 2176 ................................................................ 20:27:50 2240 ................................................................ 20:27:52 2304 ................................................................ 20:27:54 2368 ................................................................ 20:28:03 2432 ................................................................ 20:28:04 2496 ................................................................ 20:28:06 2560 ................................................................ 20:28:07 2624 ................................................................ 20:28:10 2688 ................................................................ 20:28:17 2752 ................................................................ 20:28:27 2816 ................................................................ 20:28:32 2880 ................................................................ 20:28:34 2944 ................................................................ 20:28:36 3008 ................................................................ 20:28:37 3072 ................................................................ 20:28:39 3136 ................................................................ 20:28:41 3200 ................................................................ 20:28:43 3264 ................................................................ 20:28:46 3328 ................................................................ 20:28:48 3392 ................................................................ 20:28:50 3456 ................................................................ 20:28:52 3520 ................................................................ 20:28:53 3584 ................................................................ 20:28:55 3648 ................................................................ 20:28:56 3712 ................................................................ 20:28:57 3776 ................................................................ 20:28:59 3840 ................................................................ 20:29:02 3904 ................................................................ 20:29:05 3968 ................................................................ 20:29:09 4032 ................................................................ 20:29:11 4096 ................................................................ 20:29:14 4160 ................................................................ 20:29:16 4224 ................................................................ 20:29:18 4288 ................................................................ 20:29:20 4352 ................................................................ 20:29:22 4416 ................................................................ 20:29:24 4480 ................................................................ 20:29:25 4544 ................................................................ 20:29:27 4608 ................................................................ 20:29:29 4672 ................................................................ 20:29:31 4736 ................................................................ 20:29:32 4800 ................................................................ 20:29:33 4864 ................................................................ 20:29:35 4928 ................................................................ 20:29:36 4992 ................................................................ 20:29:38 5056 ................................................................ 20:29:41 5120 ................................................................ 20:29:44 5184 ................................................................ 20:29:47 5248 ................................................................ 20:29:50 5312 ................................................................ 20:29:52 5376 ................................................................ 20:29:55 5440 ................................................................ 20:29:57 5504 ................................................................ 20:30:00 5568 ................................................................ 20:30:02 5632 ................................................................ 20:30:04 5696 ................................................................ 20:30:07 5760 ................................................................ 20:30:10 5824 ................................................................ 20:30:12 5888 ................................................................ 20:30:15 5952 ................................................................ 20:30:17 6016 ................................................................ 20:30:20 6080 ................................................................ 20:30:23 6144 ................................................................ 20:30:25 6208 ................................................................ 20:30:27 6272 ................................................................ 20:30:30 6336 ................................................................ 20:30:32 6400 ................................................................ 20:30:34 6464 ................................................................ 20:30:36 6528 ................................................................ 20:30:38 6592 ................................................................ 20:30:40 6656 ................................................................ 20:30:41 6720 ................................................................ 20:30:43 6784 ................................................................ 20:30:44 6848 ................................................................ 20:30:46 6912 ................................................................ 20:30:47 6976 ................................................................ 20:30:48 7040 ................................................................ 20:30:50 7104 ................................................................ 20:30:52 7168 ................................................................ 20:30:54 7232 ................................................................ 20:30:56 7296 ................................................................ 20:30:57 7360 ................................................................ 20:30:58 7424 ................................................................ 20:30:59 7488 ................................................................ 20:31:00 7552 ................................................................ 20:31:01 7616 ................................................................ 20:31:02 7680 ................................................................ 20:31:03 7744 ................................................................ 20:31:04 7808 ................................................................ 20:31:06 7872 ................................................................ 20:31:08 7936 ................................................................ 20:31:09 8000 ................................................................ 20:31:10 8064 ................................................................ 20:31:11 8128 ................................................................ 20:31:13 8192 ................................................................ 20:31:13 8256 ................................................................ 20:31:14 8320 ................................................................ 20:31:15 8384 ................................................................ 20:31:16 8448 ................................................................ 20:31:18 8512 ................................................................ 20:31:19 8576 ................................................................ 20:31:20 8640 ................................................................ 20:31:21 8704 ................................................................ 20:31:22 8768 ................................................................ 20:31:23 8832 ................................................................ 20:31:24 8896 ................................................................ 20:31:25 8960 ................................................................ 20:31:26 9024 ................................................................ 20:31:27 9088 ................................................................ 20:31:28 9152 ................................................................ 20:31:29 9216 ................................................................ 20:31:30 9280 ................................................................ 20:31:31 9344 ................................................................ 20:31:32 9408 ................................................................ 20:31:33 9472 ................................................................ 20:31:34 9536 ................................................................ 20:33:04 9600 . done (745s) 20:33:04 WARNING: The following tests exceed 5 minute runtimes. Break them up or rethink them. 20:33:04 301.152: 'd2a1f586812a792c:ISOLATE=1:NAME=e2e_p2p/add_rollup yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/add_rollup.test.ts' 20:33:04 313.700: 'be2c405bee887888:ONLY_TERM_PARENT=1 BOX=vanilla BROWSER=* run_compose_test vanilla-all-browsers box boxes' 20:33:04 319.289: 'de30be46e225864a barretenberg/cpp/scripts/run_test.sh dsl_tests AcirAvm2RecursionConstraint.TestGenerateVKFromConstraintsWithoutWitness' 20:33:04 321.793: 'd2a1f586812a792c:ISOLATE=1:NAME=e2e_epochs/epochs_proof_fails yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_proof_fails.test.ts' 20:33:04 348.809: 'de30be46e225864a:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityPassing' 20:33:04 351.025: 'de30be46e225864a:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityFailing' 20:33:04 371.835: '8ac06e7dd10216e5 aztec-up/scripts/run_test.sh amm_flow' 20:33:04 397.228: 'd2a1f586812a792c:ISOLATE=1:NAME=e2e_p2p/reex yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/reex.test.ts' 20:33:04 400.580: 'd2a1f586812a792c:ISOLATE=1:TIMEOUT=15m:NAME=e2e_block_building yarn-project/end-to-end/scripts/run_test.sh simple e2e_block_building' 20:33:04 405.809: 'd2a1f586812a792c:ISOLATE=1:NAME=e2e_epochs/epochs_l1_reorgs yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_l1_reorgs.test.ts' 20:33:04 455.040: 'd2a1f586812a792c:ISOLATE=1:NAME=e2e_l1_with_wall_time yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_l1_with_wall_time.test.ts' 20:33:04 466.291: 'd2a1f586812a792c:ISOLATE=1:NAME=prover-client/src/test/bb_prover_full_rollup.test.ts:CPUS=16:MEM=96g LOG_LEVEL=verbose yarn-project/scripts/run_test.sh prover-client/src/test/bb_prover_full_rollup.test.ts' 20:33:04 561.687: 'd2a1f586812a792c:ISOLATE=1:NAME=e2e_epochs/epochs_empty_blocks yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_empty_blocks.test.ts' 20:33:04 710.023: 'd2a1f586812a792c:ISOLATE=1:TIMEOUT=15m:CPUS=16:MEM=96g:NAME=e2e_prover_full_real yarn-project/end-to-end/scripts/run_test.sh simple e2e_prover/full' 20:33:04 Completed run of 9399 tests in 745 seconds. 20:33:04 --- bench all --- 20:33:04 barretenberg/cpp Executing: barretenberg/cpp/bootstrap.sh build_bench (http://ci.aztec-labs.com/e12ccf710c32939f) 20:33:04 yarn-project/end-to-end Executing: yarn-project/end-to-end/bootstrap.sh build_bench (http://ci.aztec-labs.com/b126f7d8756cf393) 20:33:05 barretenberg/cpp 0 . done (1s) 20:33:05 yarn-project/end-to-end 0 . done (1s) 20:33:06 Starting parallel run using max 64 cpus... 20:33:06 Test run log id: http://ci.aztec-labs.com/cfe55d40b4a6454c 20:37:30 Completed run of 90 tests in 264 seconds. 20:37:34 Completed 6.3 KiB/6.3 KiB (96.3 KiB/s) with 1 file(s) remaining upload: ../../../tmp/tmp.rQynQobpJk to s3://aztec-ci-artifacts/build-cache/bench-464e1a9d9b40b5188586643b44bc52bffccbc3e6.tar.gz 20:37:34 Cache upload of bench-464e1a9d9b40b5188586643b44bc52bffccbc3e6.tar.gz complete in 2s. 20:37:34 + local code=0 20:37:34 + set +x 20:37:34 dmesg log id: http://ci.aztec-labs.com/be57a820606382db 20:37:34 cpufile log id: http://ci.aztec-labs.com/d4f25180c77c4906 20:37:34 memfile log id: http://ci.aztec-labs.com/36e46388e0cd448b CI run log id: http://ci.aztec-labs.com/1750191458104 + code=0 + case $code in + log_ci_run PASSED 1750191458104 + exit 0 SSH exited with code: 0 Terminating instance: i-0c992f5b8c3a7e2a0...