Parent Log: http://ci.aztec-labs.com/15717107798 Command: bootstrap_ec2 './bootstrap.sh ci-full' Date: Tue Jun 17 20:37:40 UTC 2025 Status: 0 Took: 1276s --- request build instance --- Requesting m6a.32xlarge spot instance (name: pr-15117_amd64_x1-full) (type: m6a.32xlarge) (ami: ami-069f88e34f8fb5021) (bid: 5.5424)... Waiting for instance id for spot request: sir-qyaq4ybj... Waiting for SSH at 3.141.45.60... No tty, running in background... Loading CRS into tmpfs... Done in 14 seconds. Starting devbox... From https://github.com/aztecprotocol/aztec-packages * branch 464e1a9d9b40b5188586643b44bc52bffccbc3e6 -> FETCH_HEAD HEAD is now at 464e1a9 fix: Handle missed l1-to-l2 messages in archiver (#15117) Switched to a new branch 'gh-readonly-queue/master/pr-15117-c06f30929f18b85bcea93c0926a8d640a3819f00' + ci3/aws_handle_evict run + ci3/add_timestamps + DUP=1 + ci3/cache_log 'CI run' 1750191438582 CI run log id: http://ci.aztec-labs.com/1750191438582 20:17:18 env: REF_NAME=gh-readonly-queue/master/pr-15117-c06f30929f18b85bcea93c0926a8d640a3819f00 COMMIT_HASH=464e1a9d9b40b5188586643b44bc52bffccbc3e6 CURRENT_VERSION=0.87.8 TARGET_BRANCH=master 20:17:18 + ./bootstrap.sh ci-full 20:17:26 --- pull submodules --- 20:17:26 Executing: git submodule update --init --recursive (http://ci.aztec-labs.com/faeecdd8d1cf7dd0) 20:17:34 0 . done (8s) 20:17:36 --- noir build --- 20:17:36 Executing: retry install_deps (http://ci.aztec-labs.com/7a090579b104a365) 20:17:40 0 . done (4s) 20:17:41 build_native Executing: build_native (http://ci.aztec-labs.com/ddc0f676fc1b56fd) 20:17:41 build_packages Executing: build_packages (http://ci.aztec-labs.com/8d7595f1b2f35478) 20:17:41 build_native 0 . done (0s) 20:17:49 build_packages 0 . done (8s) 20:17:50 --- bb cpp build --- 20:17:50 build_wasm_threads Executing: build_wasm_threads (http://ci.aztec-labs.com/ba6a2d6a715351fe) 20:17:50 build_nodejs_module Executing: build_nodejs_module (http://ci.aztec-labs.com/e56770efd7e32764) 20:17:50 build_native Executing: build_native (http://ci.aztec-labs.com/feb4c4fe79189bf9) 20:17:50 build_wasm Executing: build_wasm (http://ci.aztec-labs.com/03b096348db0902b) 20:17:50 build_gcc_syntax_check_only Executing: build_gcc_syntax_check_only (http://ci.aztec-labs.com/aa0b4713a71a142b) 20:17:50 build_fuzzing_syntax_check_only Executing: build_fuzzing_syntax_check_only (http://ci.aztec-labs.com/a4ef50e427c48c2d) 20:17:50 build_asan_fast Executing: build_asan_fast (http://ci.aztec-labs.com/7fbd4681f524b819) 20:17:50 build_darwin Executing: build_darwin (http://ci.aztec-labs.com/d0a5131e863fb768) 20:17:50 build_fuzzing_syntax_check_only 0 . done (0s) 20:17:50 build_gcc_syntax_check_only 0 . done (0s) 20:17:50 build_wasm 0 . done (0s) 20:17:50 build_darwin 0 . done (0s) 20:17:50 build_wasm_threads 0 . done (0s) 20:17:51 build_nodejs_module 0 . done (1s) 20:17:52 build_native 0 . done (2s) 20:17:54 build_asan_fast 0 . done (4s) 20:17:58 --- bb.js build --- 20:18:00 Cache download and extraction of node-modules-aa659bb2a892ab4f.zst complete in 1s. 20:18:00 Cache download and extraction of bb.js-5630c8ceca74baf6.tar.gz complete in 0s. 20:18:01 --- acir_tests build --- 20:18:01 Cache download and extraction of barretenberg-acir-tests-02f79a599fd31657.tar.gz complete in 0s. 20:18:02 Cache download and extraction of node-modules-fec19dc5fe5a76d5.zst complete in 0s. 20:18:02 Executing: cd browser-test-app && yarn build (http://ci.aztec-labs.com/1cbc0f4df04f84d6) 20:18:07 0 . done (5s) 20:18:07 Executing: cd bbjs-test && yarn build (http://ci.aztec-labs.com/7e2248b715125975) 20:18:10 0 . done (3s) 20:18:10 --- avm-transpiler build --- 20:18:10 Cache download and extraction of avm-transpiler-10ea3821ff0e6f60.tar.gz complete in 0s. 20:18:10 --- noir-projects build --- 20:18:10 Executing: prep (http://ci.aztec-labs.com/5f879faab19a1003) 20:18:13 0 . done (3s) 20:18:14 mock-protocol-circuits Executing: ./mock-protocol-circuits/bootstrap.sh (http://ci.aztec-labs.com/b0b9edaa67e38c90) 20:18:14 noir-protocol-circuits Executing: ./noir-protocol-circuits/bootstrap.sh (http://ci.aztec-labs.com/1958e8d33dced560) 20:18:14 noir-contracts Executing: ./noir-contracts/bootstrap.sh (http://ci.aztec-labs.com/a303eca2c7cc89b1) 20:18:14 aztec-nr Executing: ./aztec-nr/bootstrap.sh (http://ci.aztec-labs.com/5c4e6c59beac8e6e) 20:18:15 noir-contracts 0 ................................................................ 20:18:15 noir-contracts 64 ................................................................ 20:18:15 noir-contracts 128 ................................................................ 20:18:15 noir-contracts 192 ................................................................ 20:18:15 noir-contracts 256 ................................................................ 20:18:16 noir-contracts 320 ................................................................ 20:18:16 noir-contracts 384 ................................................................ 20:18:16 noir-contracts 448 ................................................................ 20:18:16 noir-contracts 512 ................................................................ 20:18:16 noir-contracts 576 ................................................................ 20:18:17 noir-contracts 640 ................................................................ 20:18:17 noir-contracts 704 ................................................................ 20:18:17 noir-contracts 768 ................................................................ 20:18:17 noir-contracts 832 ................................................................ 20:18:18 noir-contracts 896 ................................................................ 20:18:18 noir-contracts 960 ................................................................ 20:18:18 noir-contracts 1024 ................................................................ 20:18:18 noir-contracts 1088 ................................................................ 20:18:18 noir-protocol-circuits 0 ................................................................ 20:18:18 noir-protocol-circuits 64 ................................................................ 20:18:18 noir-contracts 1152 ................................................................ 20:18:19 noir-contracts 1216 ................................................................ 20:18:19 noir-contracts 1280 ................................................................ 20:18:19 noir-contracts 1344 ................................................................ 20:18:19 noir-contracts 1408 . done (5s) 20:18:19 noir-protocol-circuits 128 ................................................................ 20:18:20 aztec-nr 0 . done (6s) 20:18:20 noir-protocol-circuits 192 ................................................................ 20:18:20 mock-protocol-circuits 0 ................................................................ 20:18:21 noir-protocol-circuits 256 ................................................................ 20:18:22 noir-protocol-circuits 320 ................................................................ 20:18:23 mock-protocol-circuits 64 . done (9s) 20:18:23 noir-protocol-circuits 384 ................................................................ 20:18:23 noir-protocol-circuits 448 . done (9s) 20:18:23 --- l1-contracts build --- 20:18:23 Cache download and extraction of l1-contracts-b16c798236bc092e.tar.gz complete in 0s. 20:18:23 --- yarn-project build --- 20:18:23 Executing: ./bootstrap.sh clean-lite (http://ci.aztec-labs.com/5acfd9410b4d9f5d) 20:18:23 0 . done (0s) 20:18:31 Cache download and extraction of node-modules-45f5b7daac61c7b8.zst complete in 7s. 20:18:31 Executing: compile_all (http://ci.aztec-labs.com/ae0e5750752da1d1) 20:18:34 0 . done (3s) 20:18:35 boxes/bootstrap.sh Executing: boxes/bootstrap.sh (http://ci.aztec-labs.com/ed5cdecbd3a1c252) 20:18:35 playground/bootstrap.sh Executing: playground/bootstrap.sh (http://ci.aztec-labs.com/87a7ae8e6305cbfc) 20:18:35 docs/bootstrap.sh Executing: docs/bootstrap.sh (http://ci.aztec-labs.com/51296e824b1033a8) 20:18:35 release-image/bootstrap.sh Executing: release-image/bootstrap.sh (http://ci.aztec-labs.com/035951381a83824f) 20:18:35 spartan/bootstrap.sh Executing: spartan/bootstrap.sh (http://ci.aztec-labs.com/25634d50f2d734ec) 20:18:35 aztec-up/bootstrap.sh Executing: aztec-up/bootstrap.sh (http://ci.aztec-labs.com/52de1f18e2471d87) 20:18:36 aztec-up/bootstrap.sh 0 . done (1s) 20:18:38 spartan/bootstrap.sh 0 . done (3s) 20:18:39 boxes/bootstrap.sh 0 . done (4s) 20:18:40 playground/bootstrap.sh 0 . done (5s) 20:18:42 docs/bootstrap.sh 0 . done (7s) 20:19:15 release-image/bootstrap.sh 0 . done (40s) 20:19:15 --- test all --- 20:19:15 Waiting for TXE's to start... 20:19:18 Gathering tests to run... 20:20:27 Gathered 9399 tests. 20:20:27 Starting parallel run with max 64 jobs... 20:20:27 Executing: parallel -j64 --memsuspend 64G --line-buffer --joblog joblog.txt --halt now,fail=1 'run_test_cmd {}' (http://ci.aztec-labs.com/814f01bc2b04ad56) 20:20:59 0 ................................................................ 20:22:16 64 ................................................................ 20:23:23 128 ................................................................ 20:24:08 192 ................................................................ 20:24:26 256 ................................................................ 20:24:38 320 ................................................................ 20:24:57 384 ................................................................ 20:25:06 448 ................................................................ 20:25:13 512 ................................................................ 20:25:23 576 ................................................................ 20:25:34 640 ................................................................ 20:25:41 704 ................................................................ 20:25:48 768 ................................................................ 20:25:55 832 ................................................................ 20:26:01 896 ................................................................ 20:26:06 960 ................................................................ 20:26:11 1024 ................................................................ 20:26:17 1088 ................................................................ 20:26:20 1152 ................................................................ 20:26:23 1216 ................................................................ 20:26:26 1280 ................................................................ 20:26:29 1344 ................................................................ 20:26:33 1408 ................................................................ 20:26:55 1472 ................................................................ 20:27:10 1536 ................................................................ 20:27:17 1600 ................................................................ 20:27:23 1664 ................................................................ 20:27:25 1728 ................................................................ 20:27:27 1792 ................................................................ 20:27:29 1856 ................................................................ 20:27:32 1920 ................................................................ 20:27:34 1984 ................................................................ 20:27:36 2048 ................................................................ 20:27:38 2112 ................................................................ 20:27:40 2176 ................................................................ 20:27:41 2240 ................................................................ 20:27:43 2304 ................................................................ 20:27:44 2368 ................................................................ 20:27:52 2432 ................................................................ 20:27:54 2496 ................................................................ 20:27:55 2560 ................................................................ 20:27:56 2624 ................................................................ 20:27:58 2688 ................................................................ 20:28:05 2752 ................................................................ 20:28:16 2816 ................................................................ 20:28:23 2880 ................................................................ 20:28:25 2944 ................................................................ 20:28:27 3008 ................................................................ 20:28:29 3072 ................................................................ 20:28:31 3136 ................................................................ 20:28:33 3200 ................................................................ 20:28:35 3264 ................................................................ 20:28:38 3328 ................................................................ 20:28:40 3392 ................................................................ 20:28:42 3456 ................................................................ 20:28:44 3520 ................................................................ 20:28:45 3584 ................................................................ 20:28:46 3648 ................................................................ 20:28:48 3712 ................................................................ 20:28:49 3776 ................................................................ 20:28:51 3840 ................................................................ 20:28:54 3904 ................................................................ 20:28:57 3968 ................................................................ 20:29:01 4032 ................................................................ 20:29:03 4096 ................................................................ 20:29:06 4160 ................................................................ 20:29:08 4224 ................................................................ 20:29:10 4288 ................................................................ 20:29:13 4352 ................................................................ 20:29:15 4416 ................................................................ 20:29:17 4480 ................................................................ 20:29:18 4544 ................................................................ 20:29:20 4608 ................................................................ 20:29:22 4672 ................................................................ 20:29:24 4736 ................................................................ 20:29:25 4800 ................................................................ 20:29:26 4864 ................................................................ 20:29:28 4928 ................................................................ 20:29:29 4992 ................................................................ 20:29:31 5056 ................................................................ 20:29:35 5120 ................................................................ 20:29:38 5184 ................................................................ 20:29:40 5248 ................................................................ 20:29:43 5312 ................................................................ 20:29:46 5376 ................................................................ 20:29:48 5440 ................................................................ 20:29:51 5504 ................................................................ 20:29:53 5568 ................................................................ 20:29:55 5632 ................................................................ 20:29:57 5696 ................................................................ 20:30:00 5760 ................................................................ 20:30:03 5824 ................................................................ 20:30:05 5888 ................................................................ 20:30:07 5952 ................................................................ 20:30:10 6016 ................................................................ 20:30:13 6080 ................................................................ 20:30:16 6144 ................................................................ 20:30:18 6208 ................................................................ 20:30:20 6272 ................................................................ 20:30:23 6336 ................................................................ 20:30:24 6400 ................................................................ 20:30:27 6464 ................................................................ 20:30:29 6528 ................................................................ 20:30:31 6592 ................................................................ 20:30:33 6656 ................................................................ 20:30:35 6720 ................................................................ 20:30:36 6784 ................................................................ 20:30:37 6848 ................................................................ 20:30:39 6912 ................................................................ 20:30:40 6976 ................................................................ 20:30:42 7040 ................................................................ 20:30:44 7104 ................................................................ 20:30:46 7168 ................................................................ 20:30:48 7232 ................................................................ 20:30:51 7296 ................................................................ 20:30:52 7360 ................................................................ 20:30:53 7424 ................................................................ 20:30:54 7488 ................................................................ 20:30:55 7552 ................................................................ 20:30:56 7616 ................................................................ 20:30:57 7680 ................................................................ 20:30:58 7744 ................................................................ 20:30:59 7808 ................................................................ 20:31:00 7872 ................................................................ 20:31:02 7936 ................................................................ 20:31:04 8000 ................................................................ 20:31:05 8064 ................................................................ 20:31:06 8128 ................................................................ 20:31:08 8192 ................................................................ 20:31:09 8256 ................................................................ 20:31:10 8320 ................................................................ 20:31:11 8384 ................................................................ 20:31:12 8448 ................................................................ 20:31:13 8512 ................................................................ 20:31:14 8576 ................................................................ 20:31:16 8640 ................................................................ 20:31:17 8704 ................................................................ 20:31:18 8768 ................................................................ 20:31:19 8832 ................................................................ 20:31:20 8896 ................................................................ 20:31:21 8960 ................................................................ 20:31:22 9024 ................................................................ 20:31:23 9088 ................................................................ 20:31:24 9152 ................................................................ 20:31:25 9216 ................................................................ 20:31:26 9280 ................................................................ 20:31:27 9344 ................................................................ 20:31:28 9408 ................................................................ 20:31:30 9472 ................................................................ 20:31:31 9536 ................................................................ 20:33:02 9600 . done (755s) 20:33:02 WARNING: The following tests exceed 5 minute runtimes. Break them up or rethink them. 20:33:02 301.789: 'd2a1f586812a792c:ISOLATE=1:NAME=e2e_p2p/add_rollup yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/add_rollup.test.ts' 20:33:02 313.111: 'be2c405bee887888:ONLY_TERM_PARENT=1 BOX=vanilla BROWSER=* run_compose_test vanilla-all-browsers box boxes' 20:33:02 321.212: 'd2a1f586812a792c:ISOLATE=1:NAME=e2e_epochs/epochs_proof_fails yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_proof_fails.test.ts' 20:33:02 325.450: 'de30be46e225864a barretenberg/cpp/scripts/run_test.sh dsl_tests AcirAvm2RecursionConstraint.TestGenerateVKFromConstraintsWithoutWitness' 20:33:02 349.855: 'de30be46e225864a:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityPassing' 20:33:02 358.601: 'de30be46e225864a:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityFailing' 20:33:02 370.700: 'd2a1f586812a792c:ISOLATE=1:TIMEOUT=15m:NAME=e2e_block_building yarn-project/end-to-end/scripts/run_test.sh simple e2e_block_building' 20:33:02 371.770: '8ac06e7dd10216e5 aztec-up/scripts/run_test.sh amm_flow' 20:33:02 397.368: 'd2a1f586812a792c:ISOLATE=1:NAME=e2e_p2p/reex yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/reex.test.ts' 20:33:02 405.630: 'd2a1f586812a792c:ISOLATE=1:NAME=e2e_epochs/epochs_l1_reorgs yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_l1_reorgs.test.ts' 20:33:02 439.674: 'd2a1f586812a792c:ISOLATE=1:NAME=prover-client/src/test/bb_prover_full_rollup.test.ts:CPUS=16:MEM=96g LOG_LEVEL=verbose yarn-project/scripts/run_test.sh prover-client/src/test/bb_prover_full_rollup.test.ts' 20:33:02 455.385: 'd2a1f586812a792c:ISOLATE=1:NAME=e2e_l1_with_wall_time yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_l1_with_wall_time.test.ts' 20:33:02 561.990: 'd2a1f586812a792c:ISOLATE=1:NAME=e2e_epochs/epochs_empty_blocks yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_empty_blocks.test.ts' 20:33:02 692.289: 'd2a1f586812a792c:ISOLATE=1:TIMEOUT=15m:CPUS=16:MEM=96g:NAME=e2e_prover_full_real yarn-project/end-to-end/scripts/run_test.sh simple e2e_prover/full' 20:33:02 Completed run of 9399 tests in 755 seconds. 20:33:02 --- bench all --- 20:33:02 barretenberg/cpp Executing: barretenberg/cpp/bootstrap.sh build_bench (http://ci.aztec-labs.com/513163ded66f7c21) 20:33:02 yarn-project/end-to-end Executing: yarn-project/end-to-end/bootstrap.sh build_bench (http://ci.aztec-labs.com/da50143c17acd431) 20:33:03 barretenberg/cpp 0 . done (1s) 20:33:03 yarn-project/end-to-end 0 . done (1s) 20:33:04 Starting parallel run using max 64 cpus... 20:33:05 Test run log id: http://ci.aztec-labs.com/28a73dac36a61cd9 20:37:28 Completed run of 90 tests in 264 seconds. 20:37:32 Completed 6.3 KiB/6.3 KiB (90.9 KiB/s) with 1 file(s) remaining upload: ../../../tmp/tmp.bkdiC3Af3D to s3://aztec-ci-artifacts/build-cache/bench-464e1a9d9b40b5188586643b44bc52bffccbc3e6.tar.gz 20:37:32 Cache upload of bench-464e1a9d9b40b5188586643b44bc52bffccbc3e6.tar.gz complete in 2s. 20:37:32 + local code=0 20:37:32 + set +x 20:37:32 dmesg log id: http://ci.aztec-labs.com/677adfa59c5e5bfd 20:37:32 cpufile log id: http://ci.aztec-labs.com/be9282843770880a 20:37:32 memfile log id: http://ci.aztec-labs.com/4aabd7cf7debbdc1 CI run log id: http://ci.aztec-labs.com/1750191438582 + code=0 + case $code in + log_ci_run PASSED 1750191438582 + exit 0 SSH exited with code: 0 Terminating instance: i-054b20077a03191ee...