Parent Log: http://ci.aztec-labs.com/15639858129 Command: bootstrap_ec2 './bootstrap.sh ci-full' Date: Fri Jun 13 17:27:25 UTC 2025 Status: 0 Took: 1822s --- request build instance --- Requesting m6a.32xlarge spot instance (name: pr-15005_amd64_x2-full) (type: m6a.32xlarge) (ami: ami-069f88e34f8fb5021) (bid: 5.5424)... Waiting for instance id for spot request: sir-n68f7qhj... Timeout waiting for spot request. Requesting m6a.32xlarge on-demand instance (name: pr-15005_amd64_x2-full) (type: m6a.32xlarge) (ami: ami-069f88e34f8fb5021) (bid: 5.5424)... Waiting for SSH at 3.143.221.13... No tty, running in background... Loading CRS into tmpfs... Done in 99 seconds. Starting devbox... From https://github.com/aztecprotocol/aztec-packages * branch f4ac84d7ac4041d505399edd8819840bb14d6c9d -> FETCH_HEAD HEAD is now at f4ac84d chore(backport): don't set maximum wasm memory >1GB on ios web, limit SRS (#15001) (#15005) Switched to a new branch 'gh-readonly-queue/master/pr-15005-b1b65bcdbd44a49fbebe5d2265256dc9466e92be' + ci3/add_timestamps + ci3/aws_handle_evict run + DUP=1 + ci3/cache_log 'CI run' 1749834015581 CI run log id: http://ci.aztec-labs.com/1749834015581 17:00:15 env: REF_NAME=gh-readonly-queue/master/pr-15005-b1b65bcdbd44a49fbebe5d2265256dc9466e92be COMMIT_HASH=f4ac84d7ac4041d505399edd8819840bb14d6c9d CURRENT_VERSION=0.87.8 TARGET_BRANCH=master 17:00:15 + ./bootstrap.sh ci-full 17:00:23 --- pull submodules --- 17:00:23 Executing: git submodule update --init --recursive (http://ci.aztec-labs.com/a3f6f0359b54fd33) 17:00:32 0 . done (9s) 17:00:44 --- noir build --- 17:00:44 Executing: retry install_deps (http://ci.aztec-labs.com/c2f1947123a13c6f) 17:00:54 0 . done (10s) 17:00:54 build_native Executing: build_native (http://ci.aztec-labs.com/85d5684078678d96) 17:00:54 build_packages Executing: build_packages (http://ci.aztec-labs.com/352619984b89ebaf) 17:00:55 build_native 0 . done (1s) 17:01:02 build_packages 0 . done (8s) 17:01:03 --- bb cpp build --- 17:01:03 build_wasm_threads Executing: build_wasm_threads (http://ci.aztec-labs.com/dbd95624179e7bf9) 17:01:03 build_native Executing: build_native (http://ci.aztec-labs.com/920091ec2a8d7db8) 17:01:03 build_wasm Executing: build_wasm (http://ci.aztec-labs.com/4dc10a25883c84e0) 17:01:03 build_nodejs_module Executing: build_nodejs_module (http://ci.aztec-labs.com/b0ab0e5bc6c01952) 17:01:03 build_gcc_syntax_check_only Executing: build_gcc_syntax_check_only (http://ci.aztec-labs.com/fb186578dcc9ca1b) 17:01:03 build_fuzzing_syntax_check_only Executing: build_fuzzing_syntax_check_only (http://ci.aztec-labs.com/14caaad24fd3c122) 17:01:03 build_asan_fast Executing: build_asan_fast (http://ci.aztec-labs.com/edf0bae81a635173) 17:01:03 build_darwin Executing: build_darwin (http://ci.aztec-labs.com/3def0dcd89ce8ab7) 17:01:03 build_fuzzing_syntax_check_only 0 . done (0s) 17:01:03 build_gcc_syntax_check_only 0 . done (0s) 17:01:03 build_darwin 0 . done (0s) 17:01:03 build_wasm 0 . done (0s) 17:01:03 build_wasm_threads 0 . done (0s) 17:01:04 build_nodejs_module 0 . done (1s) 17:01:05 build_native 0 . done (2s) 17:01:07 build_asan_fast 0 . done (4s) 17:01:11 --- bb.js build --- 17:01:12 Cache download and extraction of node-modules-aa659bb2a892ab4f.zst complete in 1s. 17:01:12 Cache download of bb.js-5630c8ceca74baf6.tar.gz failed. 17:01:12 ! Corepack is about to download https://repo.yarnpkg.com/4.5.2/packages/yarnpkg-cli/bin/yarn.js 17:01:13 build:cjs denoise "yarn 'build:cjs'" 17:01:13 build:esm denoise "yarn 'build:esm'" 17:01:13 build:browser denoise "yarn 'build:browser'" 17:01:13 build:esm Executing: yarn 'build:esm' (http://ci.aztec-labs.com/99dac39474f7a1c5) 17:01:13 build:cjs Executing: yarn 'build:cjs' (http://ci.aztec-labs.com/7ff60840ad42ad2e) 17:01:13 build:browser Executing: yarn 'build:browser' (http://ci.aztec-labs.com/1754cd4913d827c9) 17:01:15 build:esm 0 . done (2s) 17:01:16 build:browser 0 . done (3s) 17:01:16 build:cjs 0 . done (3s) 17:01:21 Completed 1.0 MiB/10.5 MiB (11.7 MiB/s) with 1 file(s) remaining Completed 2.0 MiB/10.5 MiB (21.4 MiB/s) with 1 file(s) remaining Completed 3.0 MiB/10.5 MiB (30.8 MiB/s) with 1 file(s) remaining Completed 3.5 MiB/10.5 MiB (35.6 MiB/s) with 1 file(s) remaining Completed 4.5 MiB/10.5 MiB (45.4 MiB/s) with 1 file(s) remaining Completed 5.5 MiB/10.5 MiB (42.1 MiB/s) with 1 file(s) remaining Completed 6.5 MiB/10.5 MiB (49.2 MiB/s) with 1 file(s) remaining Completed 7.5 MiB/10.5 MiB (56.2 MiB/s) with 1 file(s) remaining Completed 8.5 MiB/10.5 MiB (63.1 MiB/s) with 1 file(s) remaining Completed 9.5 MiB/10.5 MiB (69.8 MiB/s) with 1 file(s) remaining Completed 10.5 MiB/10.5 MiB (76.5 MiB/s) with 1 file(s) remaining upload: ../../../../../tmp/tmp.VCt96wtfKB to s3://aztec-ci-artifacts/build-cache/bb.js-5630c8ceca74baf6.tar.gz 17:01:21 Cache upload of bb.js-5630c8ceca74baf6.tar.gz complete in 5s. 17:01:21 --- acir_tests build --- 17:01:22 Cache download and extraction of barretenberg-acir-tests-02f79a599fd31657.tar.gz complete in 1s. 17:01:22 Cache download and extraction of node-modules-fec19dc5fe5a76d5.zst complete in 0s. 17:01:22 Executing: cd browser-test-app && yarn build (http://ci.aztec-labs.com/ca9d6e10e11d7e22) 17:01:27 0 . done (5s) 17:01:27 Executing: cd bbjs-test && yarn build (http://ci.aztec-labs.com/3049681f52d2e59f) 17:01:29 0 . done (2s) 17:01:30 --- avm-transpiler build --- 17:01:30 Cache download and extraction of avm-transpiler-10ea3821ff0e6f60.tar.gz complete in 0s. 17:01:30 --- noir-projects build --- 17:01:30 Executing: prep (http://ci.aztec-labs.com/936ce9a9b877f3c3) 17:01:33 0 . done (3s) 17:01:34 mock-protocol-circuits Executing: ./mock-protocol-circuits/bootstrap.sh (http://ci.aztec-labs.com/b71c333cdb0a3aa6) 17:01:34 noir-protocol-circuits Executing: ./noir-protocol-circuits/bootstrap.sh (http://ci.aztec-labs.com/a7ce8d738b592fd0) 17:01:34 noir-contracts Executing: ./noir-contracts/bootstrap.sh (http://ci.aztec-labs.com/8279574e884769a4) 17:01:34 aztec-nr Executing: ./aztec-nr/bootstrap.sh (http://ci.aztec-labs.com/ed0e87f94267ceb5) 17:01:35 noir-contracts 0 ................................................................ 17:01:35 noir-contracts 64 ................................................................ 17:01:35 noir-contracts 128 ................................................................ 17:01:35 noir-contracts 192 ................................................................ 17:01:35 noir-contracts 256 ................................................................ 17:01:35 noir-contracts 320 ................................................................ 17:01:36 noir-contracts 384 ................................................................ 17:01:36 noir-contracts 448 ................................................................ 17:01:36 noir-contracts 512 ................................................................ 17:01:36 noir-contracts 576 ................................................................ 17:01:36 noir-contracts 640 ................................................................ 17:01:36 noir-contracts 704 ................................................................ 17:01:36 noir-contracts 768 ................................................................ 17:01:37 noir-contracts 832 ................................................................ 17:01:37 noir-contracts 896 ................................................................ 17:01:37 noir-contracts 960 ................................................................ 17:01:37 noir-contracts 1024 ................................................................ 17:01:37 noir-contracts 1088 ................................................................ 17:01:37 noir-contracts 1152 ................................................................ 17:01:37 noir-contracts 1216 ................................................................ 17:01:38 noir-contracts 1280 ................................................................ 17:01:38 noir-protocol-circuits 0 ................................................................ 17:01:38 noir-protocol-circuits 64 ................................................................ 17:01:38 noir-contracts 1344 ................................................................ 17:01:38 noir-contracts 1408 . done (4s) 17:01:39 noir-protocol-circuits 128 ................................................................ 17:01:39 aztec-nr 0 . done (5s) 17:01:40 noir-protocol-circuits 192 ................................................................ 17:01:40 mock-protocol-circuits 0 ................................................................ 17:01:40 noir-protocol-circuits 256 ................................................................ 17:01:42 noir-protocol-circuits 320 ................................................................ 17:01:42 mock-protocol-circuits 64 . done (8s) 17:01:42 noir-protocol-circuits 384 ................................................................ 17:01:42 noir-protocol-circuits 448 . done (8s) 17:01:42 --- l1-contracts build --- 17:01:43 Cache download and extraction of l1-contracts-b16c798236bc092e.tar.gz complete in 1s. 17:01:43 --- yarn-project build --- 17:01:43 Executing: ./bootstrap.sh clean-lite (http://ci.aztec-labs.com/d30d9864ada3dbd4) 17:01:43 0 . done (0s) 17:01:51 Cache download and extraction of node-modules-45f5b7daac61c7b8.zst complete in 8s. 17:01:51 Executing: compile_all (http://ci.aztec-labs.com/dea0174b5e5bdeca) 17:01:55 0 ................................................................ 17:01:56 64 ................................................................ 17:01:58 128 ................................................................ 17:04:08 192 . done (137s) 17:04:09 boxes/bootstrap.sh Executing: boxes/bootstrap.sh (http://ci.aztec-labs.com/ee431a67c9a0fcc5) 17:04:09 playground/bootstrap.sh Executing: playground/bootstrap.sh (http://ci.aztec-labs.com/4e83e440221fcb64) 17:04:09 docs/bootstrap.sh Executing: docs/bootstrap.sh (http://ci.aztec-labs.com/2486daddc064e025) 17:04:09 release-image/bootstrap.sh Executing: release-image/bootstrap.sh (http://ci.aztec-labs.com/3e5f97099874d360) 17:04:09 spartan/bootstrap.sh Executing: spartan/bootstrap.sh (http://ci.aztec-labs.com/1de63bcabb449b04) 17:04:09 aztec-up/bootstrap.sh Executing: aztec-up/bootstrap.sh (http://ci.aztec-labs.com/fdeaf6a5c69286cc) 17:04:09 aztec-up/bootstrap.sh 0 . done (0s) 17:04:12 spartan/bootstrap.sh 0 . done (3s) 17:04:15 docs/bootstrap.sh 0 . done (6s) 17:04:43 release-image/bootstrap.sh 0 . done (34s) 17:04:45 boxes/bootstrap.sh 0 . done (36s) 17:04:55 playground/bootstrap.sh 0 . done (46s) 17:04:55 --- test all --- 17:04:55 Waiting for TXE's to start... 17:04:58 Gathering tests to run... 17:06:10 Gathered 9399 tests. 17:06:10 Starting parallel run with max 64 jobs... 17:06:10 Executing: parallel -j64 --memsuspend 64G --line-buffer --joblog joblog.txt --halt now,fail=1 'run_test_cmd {}' (http://ci.aztec-labs.com/bac80ed53a95468a) 17:06:41 0 ................................................................ 17:08:01 64 ................................................................ 17:09:08 128 ................................................................ 17:09:55 192 ................................................................ 17:10:11 256 ................................................................ 17:10:23 320 ................................................................ 17:10:42 384 ................................................................ 17:10:51 448 ................................................................ 17:10:58 512 ................................................................ 17:11:09 576 ................................................................ 17:11:19 640 ................................................................ 17:11:26 704 ................................................................ 17:11:33 768 ................................................................ 17:11:40 832 ................................................................ 17:11:46 896 ................................................................ 17:11:51 960 ................................................................ 17:11:56 1024 ................................................................ 17:12:02 1088 ................................................................ 17:12:05 1152 ................................................................ 17:12:09 1216 ................................................................ 17:12:12 1280 ................................................................ 17:12:15 1344 ................................................................ 17:12:19 1408 ................................................................ 17:12:40 1472 ................................................................ 17:12:56 1536 ................................................................ 17:13:02 1600 ................................................................ 17:13:09 1664 ................................................................ 17:13:11 1728 ................................................................ 17:13:14 1792 ................................................................ 17:13:17 1856 ................................................................ 17:13:19 1920 ................................................................ 17:13:21 1984 ................................................................ 17:13:23 2048 ................................................................ 17:13:26 2112 ................................................................ 17:13:27 2176 ................................................................ 17:13:29 2240 ................................................................ 17:13:31 2304 ................................................................ 17:13:32 2368 ................................................................ 17:13:41 2432 ................................................................ 17:13:42 2496 ................................................................ 17:13:44 2560 ................................................................ 17:13:45 2624 ................................................................ 17:13:47 2688 ................................................................ 17:13:56 2752 ................................................................ 17:14:05 2816 ................................................................ 17:14:10 2880 ................................................................ 17:14:12 2944 ................................................................ 17:14:14 3008 ................................................................ 17:14:16 3072 ................................................................ 17:14:18 3136 ................................................................ 17:14:20 3200 ................................................................ 17:14:23 3264 ................................................................ 17:14:26 3328 ................................................................ 17:14:28 3392 ................................................................ 17:14:30 3456 ................................................................ 17:14:31 3520 ................................................................ 17:14:32 3584 ................................................................ 17:14:34 3648 ................................................................ 17:14:35 3712 ................................................................ 17:14:37 3776 ................................................................ 17:14:38 3840 ................................................................ 17:14:42 3904 ................................................................ 17:14:45 3968 ................................................................ 17:14:48 4032 ................................................................ 17:14:51 4096 ................................................................ 17:14:54 4160 ................................................................ 17:14:56 4224 ................................................................ 17:14:58 4288 ................................................................ 17:15:01 4352 ................................................................ 17:15:03 4416 ................................................................ 17:15:04 4480 ................................................................ 17:15:06 4544 ................................................................ 17:15:08 4608 ................................................................ 17:15:10 4672 ................................................................ 17:15:12 4736 ................................................................ 17:15:14 4800 ................................................................ 17:15:15 4864 ................................................................ 17:15:17 4928 ................................................................ 17:15:18 4992 ................................................................ 17:15:20 5056 ................................................................ 17:15:24 5120 ................................................................ 17:15:27 5184 ................................................................ 17:15:29 5248 ................................................................ 17:15:32 5312 ................................................................ 17:15:34 5376 ................................................................ 17:15:37 5440 ................................................................ 17:15:39 5504 ................................................................ 17:15:42 5568 ................................................................ 17:15:44 5632 ................................................................ 17:15:46 5696 ................................................................ 17:15:49 5760 ................................................................ 17:15:51 5824 ................................................................ 17:15:54 5888 ................................................................ 17:15:56 5952 ................................................................ 17:15:59 6016 ................................................................ 17:16:02 6080 ................................................................ 17:16:04 6144 ................................................................ 17:16:07 6208 ................................................................ 17:16:09 6272 ................................................................ 17:16:11 6336 ................................................................ 17:16:13 6400 ................................................................ 17:16:16 6464 ................................................................ 17:16:18 6528 ................................................................ 17:16:20 6592 ................................................................ 17:16:22 6656 ................................................................ 17:16:24 6720 ................................................................ 17:16:25 6784 ................................................................ 17:16:27 6848 ................................................................ 17:16:28 6912 ................................................................ 17:16:30 6976 ................................................................ 17:16:31 7040 ................................................................ 17:16:33 7104 ................................................................ 17:16:35 7168 ................................................................ 17:16:37 7232 ................................................................ 17:16:39 7296 ................................................................ 17:16:40 7360 ................................................................ 17:16:41 7424 ................................................................ 17:16:43 7488 ................................................................ 17:16:44 7552 ................................................................ 17:16:45 7616 ................................................................ 17:16:46 7680 ................................................................ 17:16:47 7744 ................................................................ 17:16:48 7808 ................................................................ 17:16:49 7872 ................................................................ 17:16:51 7936 ................................................................ 17:16:53 8000 ................................................................ 17:16:54 8064 ................................................................ 17:16:55 8128 ................................................................ 17:16:57 8192 ................................................................ 17:16:58 8256 ................................................................ 17:16:59 8320 ................................................................ 17:17:00 8384 ................................................................ 17:17:01 8448 ................................................................ 17:17:02 8512 ................................................................ 17:17:03 8576 ................................................................ 17:17:05 8640 ................................................................ 17:17:06 8704 ................................................................ 17:17:07 8768 ................................................................ 17:17:08 8832 ................................................................ 17:17:09 8896 ................................................................ 17:17:10 8960 ................................................................ 17:17:12 9024 ................................................................ 17:17:13 9088 ................................................................ 17:17:14 9152 ................................................................ 17:17:15 9216 ................................................................ 17:17:16 9280 ................................................................ 17:17:17 9344 ................................................................ 17:17:18 9408 ................................................................ 17:17:19 9472 ................................................................ 17:17:20 9536 ................................................................ 17:18:42 9600 . done (752s) 17:18:42 WARNING: The following tests exceed 5 minute runtimes. Break them up or rethink them. 17:18:42 318.289: 'ab7b13f96951e5f2:ONLY_TERM_PARENT=1 BOX=vanilla BROWSER=* run_compose_test vanilla-all-browsers box boxes' 17:18:42 318.391: 'de30be46e225864a barretenberg/cpp/scripts/run_test.sh dsl_tests AcirAvm2RecursionConstraint.TestGenerateVKFromConstraintsWithoutWitness' 17:18:42 321.835: '53e9b8d3e8ba3411:ISOLATE=1:NAME=e2e_epochs/epochs_proof_fails yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_proof_fails.test.ts' 17:18:42 360.123: 'de30be46e225864a:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityPassing' 17:18:42 364.832: 'de30be46e225864a:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityFailing' 17:18:42 369.622: '53e9b8d3e8ba3411:ISOLATE=1:NAME=e2e_epochs/epochs_l1_reorgs yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_l1_reorgs.test.ts' 17:18:42 372.575: 'f8cb494e24ff82f1 aztec-up/scripts/run_test.sh amm_flow' 17:18:42 397.963: '53e9b8d3e8ba3411:ISOLATE=1:NAME=e2e_p2p/add_rollup yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/add_rollup.test.ts' 17:18:42 398.167: '53e9b8d3e8ba3411:ISOLATE=1:NAME=e2e_p2p/reex yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/reex.test.ts' 17:18:42 404.274: '53e9b8d3e8ba3411:ISOLATE=1:TIMEOUT=15m:NAME=e2e_block_building yarn-project/end-to-end/scripts/run_test.sh simple e2e_block_building' 17:18:42 453.319: '53e9b8d3e8ba3411:ISOLATE=1:NAME=e2e_l1_with_wall_time yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_l1_with_wall_time.test.ts' 17:18:42 466.271: '53e9b8d3e8ba3411:ISOLATE=1:NAME=prover-client/src/test/bb_prover_full_rollup.test.ts:CPUS=16:MEM=96g LOG_LEVEL=verbose yarn-project/scripts/run_test.sh prover-client/src/test/bb_prover_full_rollup.test.ts' 17:18:42 562.427: '53e9b8d3e8ba3411:ISOLATE=1:NAME=e2e_epochs/epochs_empty_blocks yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_empty_blocks.test.ts' 17:18:42 709.147: '53e9b8d3e8ba3411:ISOLATE=1:TIMEOUT=15m:CPUS=16:MEM=96g:NAME=e2e_prover_full_real yarn-project/end-to-end/scripts/run_test.sh simple e2e_prover/full' 17:18:42 Completed run of 9399 tests in 752 seconds. 17:18:42 --- bench all --- 17:18:42 barretenberg/cpp Executing: barretenberg/cpp/bootstrap.sh build_bench (http://ci.aztec-labs.com/cf2ffac98d2675b1) 17:18:42 yarn-project/end-to-end Executing: yarn-project/end-to-end/bootstrap.sh build_bench (http://ci.aztec-labs.com/8581c528ffbbb255) 17:18:43 barretenberg/cpp 0 . done (1s) 17:20:27 yarn-project/end-to-end 0 ................................................................ 17:22:52 yarn-project/end-to-end 64 . done (250s) 17:22:53 Starting parallel run using max 64 cpus... 17:22:53 Test run log id: http://ci.aztec-labs.com/094cb4196d202695 17:27:17 Completed run of 90 tests in 264 seconds. 17:27:19 Completed 6.3 KiB/6.3 KiB (96.0 KiB/s) with 1 file(s) remaining upload: ../../../tmp/tmp.GCUp1kAM1R to s3://aztec-ci-artifacts/build-cache/bench-f4ac84d7ac4041d505399edd8819840bb14d6c9d.tar.gz 17:27:19 Cache upload of bench-f4ac84d7ac4041d505399edd8819840bb14d6c9d.tar.gz complete in 1s. 17:27:19 + local code=0 17:27:20 + set +x 17:27:20 dmesg log id: http://ci.aztec-labs.com/e5c170a75010c08f 17:27:20 cpufile log id: http://ci.aztec-labs.com/ebf5e04d398ea619 17:27:20 memfile log id: http://ci.aztec-labs.com/41b7a35eae6aaa28 CI run log id: http://ci.aztec-labs.com/1749834015581 + code=0 + case $code in + log_ci_run PASSED 1749834015581 + exit 0 SSH exited with code: 0 Terminating instance: i-08755140eb51d84e1...