Parent Log: http://ci.aztec-labs.com/15870891926 Command: bootstrap_ec2 './bootstrap.sh ci-full' Date: Wed Jun 25 08:39:09 UTC 2025 Status: 0 Took: 1879s --- request build instance --- Requesting m6a.32xlarge spot instance (name: pr-15245_amd64_x4-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)... Waiting for instance id for spot request: sir-q95z42ph... Waiting for SSH at 3.142.40.188... Stdout is not a tty, running in background... Loading CRS into tmpfs... Done in 8 seconds. Stdout is not a tty, starting build container in background... Starting devbox... From https://github.com/aztecprotocol/aztec-packages * branch 1bb4f0588a9dc5b1df622753aab1d907b3f12c7a -> FETCH_HEAD HEAD is now at 1bb4f05 test: add timemath tests (#15245) Switched to a new branch 'gh-readonly-queue/next/pr-15245-534f06e45f48274efd53a2204c90cb0b91a53efb' + run + ci3/add_timestamps + DUP=1 + ci3/cache_log 'CI run' 1750838915439 CI run log id: http://ci.aztec-labs.com/1750838915439 08:08:35 + echo 'env: REF_NAME=gh-readonly-queue/next/pr-15245-534f06e45f48274efd53a2204c90cb0b91a53efb COMMIT_HASH=1bb4f0588a9dc5b1df622753aab1d907b3f12c7a CURRENT_VERSION=0.87.6 TARGET_BRANCH=next' 08:08:35 env: REF_NAME=gh-readonly-queue/next/pr-15245-534f06e45f48274efd53a2204c90cb0b91a53efb COMMIT_HASH=1bb4f0588a9dc5b1df622753aab1d907b3f12c7a CURRENT_VERSION=0.87.6 TARGET_BRANCH=next 08:08:35 + semver check gh-readonly-queue/next/pr-15245-534f06e45f48274efd53a2204c90cb0b91a53efb 08:08:35 + cpu_pid=415 08:08:35 + mpstat 2 08:08:35 + mem_pid=418 08:08:35 + set +e 08:08:35 + set -x 08:08:35 + ./bootstrap.sh ci-full 08:08:35 + vmstat -w -S M 2 08:08:35 ++ cache_log cpufile 08:08:35 ++ cache_log memfile 08:08:35 memfile log id: http://ci.aztec-labs.com/88561835e2253e29 08:08:35 cpufile log id: http://ci.aztec-labs.com/79a92928038be641 08:08:43 --- pull submodules --- 08:08:43 Executing: git submodule update --init --recursive (http://ci.aztec-labs.com/0b81155580f45367) 08:08:51 0 . done (8s) 08:08:53 --- noir build --- 08:08:53 Executing: retry install_deps (http://ci.aztec-labs.com/ae3975dc5bffee89) 08:08:58 0 . done (5s) 08:08:58 build_native Executing: build_native (http://ci.aztec-labs.com/c7594aba655e7b51) 08:08:58 build_packages Executing: build_packages (http://ci.aztec-labs.com/c90fa493cf0f1092) 08:08:59 build_native 0 . done (1s) 08:09:05 build_packages 0 . done (7s) 08:09:05 --- bb cpp build --- 08:09:06 build_nodejs_module Executing: build_nodejs_module (http://ci.aztec-labs.com/071087f5784c6cb8) 08:09:06 build_wasm Executing: build_wasm (http://ci.aztec-labs.com/e1f4115146a005c3) 08:09:06 build_native Executing: build_native (http://ci.aztec-labs.com/6812acd4a3e07a0c) 08:09:06 build_wasm_threads Executing: build_wasm_threads (http://ci.aztec-labs.com/f0fb3a315ef98d82) 08:09:06 build_gcc_syntax_check_only Executing: build_gcc_syntax_check_only (http://ci.aztec-labs.com/ac71e45ec7ddb538) 08:09:06 build_fuzzing_syntax_check_only Executing: build_fuzzing_syntax_check_only (http://ci.aztec-labs.com/df7e9a8b13d129e6) 08:09:06 build_asan_fast Executing: build_asan_fast (http://ci.aztec-labs.com/f831faa4e8f85267) 08:09:06 build_darwin Executing: build_darwin (http://ci.aztec-labs.com/437b01a2a1c8e73e) 08:09:06 build_gcc_syntax_check_only 0 . done (0s) 08:09:06 build_fuzzing_syntax_check_only 0 . done (0s) 08:09:06 build_wasm_threads 0 . done (0s) 08:09:06 build_wasm 0 . done (0s) 08:09:06 build_darwin 0 . done (0s) 08:09:06 build_nodejs_module 0 . done (0s) 08:09:07 build_native 0 . done (1s) 08:09:08 build_asan_fast 0 . done (2s) 08:09:13 --- bb.js build --- 08:09:14 Cache download and extraction of node-modules-e85320bda7d59d54.zst complete in 1s. 08:09:14 Cache download and extraction of bb.js-c648fbb0d0d1fbe2.tar.gz complete in 0s. 08:09:15 --- acir_tests build --- 08:09:15 Cache download and extraction of barretenberg-acir-tests-e9791828d8ef32d7.tar.gz complete in 0s. 08:09:16 Cache download and extraction of node-modules-fec19dc5fe5a76d5.zst complete in 1s. 08:09:17 browser-test-app Executing: yarn build (http://ci.aztec-labs.com/62675fb51ad1e36e) 08:09:17 bbjs-test Executing: yarn build (http://ci.aztec-labs.com/00c89a99e7d11baf) 08:09:20 bbjs-test 0 . done (3s) 08:09:21 browser-test-app 0 . done (4s) 08:09:22 --- avm-transpiler build --- 08:09:22 Cache download and extraction of avm-transpiler-bff6096d112435ba.tar.gz complete in 0s. 08:09:22 --- noir-projects build --- 08:09:22 Executing: prep (http://ci.aztec-labs.com/fb9fabd97e91e9d8) 08:09:25 0 . done (3s) 08:09:25 mock-protocol-circuits Executing: ./mock-protocol-circuits/bootstrap.sh (http://ci.aztec-labs.com/1ea4e3e7f57c1740) 08:09:25 noir-protocol-circuits Executing: ./noir-protocol-circuits/bootstrap.sh (http://ci.aztec-labs.com/c8d542f7b285e061) 08:09:25 noir-contracts Executing: ./noir-contracts/bootstrap.sh (http://ci.aztec-labs.com/6357280afd1c0baf) 08:09:25 aztec-nr Executing: ./aztec-nr/bootstrap.sh (http://ci.aztec-labs.com/d74d2a3c1c288b1f) 08:09:26 noir-contracts 0 ................................................................ 08:09:26 noir-contracts 64 ................................................................ 08:09:26 noir-contracts 128 ................................................................ 08:09:27 noir-contracts 192 ................................................................ 08:09:27 noir-contracts 256 ................................................................ 08:09:27 noir-contracts 320 ................................................................ 08:09:27 noir-contracts 384 ................................................................ 08:09:27 noir-contracts 448 ................................................................ 08:09:27 noir-contracts 512 ................................................................ 08:09:28 noir-contracts 576 ................................................................ 08:09:28 noir-contracts 640 ................................................................ 08:09:28 noir-contracts 704 ................................................................ 08:09:28 noir-contracts 768 ................................................................ 08:09:28 noir-contracts 832 ................................................................ 08:09:28 noir-contracts 896 ................................................................ 08:09:29 noir-contracts 960 ................................................................ 08:09:29 noir-contracts 1024 ................................................................ 08:09:29 noir-contracts 1088 ................................................................ 08:09:29 noir-contracts 1152 ................................................................ 08:09:29 noir-contracts 1216 ................................................................ 08:09:29 noir-contracts 1280 ................................................................ 08:09:30 noir-contracts 1344 ................................................................ 08:09:30 noir-contracts 1408 ................................................................ 08:09:30 noir-contracts 1472 ................................................................ 08:09:30 noir-protocol-circuits 0 ................................................................ 08:09:30 noir-protocol-circuits 64 ................................................................ 08:09:30 noir-contracts 1536 ................................................................ 08:09:30 noir-contracts 1600 . done (5s) 08:09:31 noir-protocol-circuits 128 ................................................................ 08:09:31 noir-protocol-circuits 192 ................................................................ 08:09:32 mock-protocol-circuits 0 ................................................................ 08:09:32 noir-protocol-circuits 256 ................................................................ 08:09:32 aztec-nr 0 . done (7s) 08:09:32 noir-protocol-circuits 320 ................................................................ 08:09:34 noir-protocol-circuits 384 ................................................................ 08:09:35 noir-protocol-circuits 448 ................................................................ 08:09:36 mock-protocol-circuits 64 ................................................................ 08:11:34 noir-protocol-circuits 512 ................................................................ 08:11:34 noir-protocol-circuits 576 ................................................................ 08:11:34 noir-protocol-circuits 640 . done (129s) 08:11:36 mock-protocol-circuits 128 . done (131s) 08:11:37 --- l1-contracts build --- 08:11:37 YN0000: · Yarn 4.5.2 08:11:37 YN0000: ┌ Resolution step 08:11:37 YN0000: └ Completed 08:11:37 YN0000: ┌ Fetch step 08:11:38 YN0013: │ 134 packages were added to the project (+ 44.9 MiB). 08:11:38 YN0000: └ Completed in 0s 746ms 08:11:38 YN0000: ┌ Link step 08:11:39 YN0000: └ Completed in 0s 878ms 08:11:39 YN0000: · Done in 1s 688ms 08:11:39 Cache download and extraction of l1-contracts-5ffa251a50d10a52.tar.gz complete in 0s. 08:11:39 --- yarn-project build --- 08:11:39 Executing: ./bootstrap.sh clean-lite (http://ci.aztec-labs.com/5c15051b556f8525) 08:11:39 0 . done (0s) 08:11:45 Cache download and extraction of node-modules-34bec2a54a394404.zst complete in 5s. 08:11:45 Executing: compile_all (http://ci.aztec-labs.com/ce24c996558eb9a1) 08:11:49 0 . done (4s) 08:11:49 playground/bootstrap.sh Executing: playground/bootstrap.sh (http://ci.aztec-labs.com/3caf1fbcb327d6df) 08:11:49 boxes/bootstrap.sh Executing: boxes/bootstrap.sh (http://ci.aztec-labs.com/8c6a5452475d574e) 08:11:49 docs/bootstrap.sh Executing: docs/bootstrap.sh (http://ci.aztec-labs.com/ee3df509ee8e180c) 08:11:49 release-image/bootstrap.sh Executing: release-image/bootstrap.sh (http://ci.aztec-labs.com/d9ca43a18167671f) 08:11:49 spartan/bootstrap.sh Executing: spartan/bootstrap.sh (http://ci.aztec-labs.com/cf6235d4fc603242) 08:11:49 aztec-up/bootstrap.sh Executing: aztec-up/bootstrap.sh (http://ci.aztec-labs.com/bb406f1d57daa387) 08:11:50 aztec-up/bootstrap.sh 0 . done (1s) 08:11:53 spartan/bootstrap.sh 0 . done (4s) 08:11:54 boxes/bootstrap.sh 0 . done (5s) 08:11:54 playground/bootstrap.sh 0 . done (5s) 08:11:56 docs/bootstrap.sh 0 . done (7s) 08:12:26 release-image/bootstrap.sh 0 . done (37s) 08:12:26 --- test all --- 08:12:26 Waiting for TXE's to start... 08:12:29 Gathering tests to run... 08:14:09 Gathered 12181 tests. 08:14:09 Starting parallel run with max 64 jobs... 08:14:09 Executing: parallel -j64 --memsuspend 64G --line-buffer --joblog joblog.txt --halt now,fail=1 'run_test_cmd {}' (http://ci.aztec-labs.com/3e13a93e0258dba1) 08:14:40 0 ................................................................ 08:15:48 64 ................................................................ 08:16:50 128 ................................................................ 08:17:49 192 ................................................................ 08:18:16 256 ................................................................ 08:18:27 320 ................................................................ 08:18:46 384 ................................................................ 08:19:02 448 ................................................................ 08:19:09 512 ................................................................ 08:19:15 576 ................................................................ 08:19:26 640 ................................................................ 08:19:34 704 ................................................................ 08:19:40 768 ................................................................ 08:19:47 832 ................................................................ 08:19:53 896 ................................................................ 08:19:59 960 ................................................................ 08:20:04 1024 ................................................................ 08:20:07 1088 ................................................................ 08:20:17 1152 ................................................................ 08:20:23 1216 ................................................................ 08:20:26 1280 ................................................................ 08:20:30 1344 ................................................................ 08:20:33 1408 ................................................................ 08:20:36 1472 ................................................................ 08:20:40 1536 ................................................................ 08:20:48 1600 ................................................................ 08:21:02 1664 ................................................................ 08:21:12 1728 ................................................................ 08:21:17 1792 ................................................................ 08:21:21 1856 ................................................................ 08:21:24 1920 ................................................................ 08:21:25 1984 ................................................................ 08:21:27 2048 ................................................................ 08:21:30 2112 ................................................................ 08:21:31 2176 ................................................................ 08:21:33 2240 ................................................................ 08:21:35 2304 ................................................................ 08:21:36 2368 ................................................................ 08:21:38 2432 ................................................................ 08:21:39 2496 ................................................................ 08:21:40 2560 ................................................................ 08:21:56 2624 ................................................................ 08:22:03 2688 ................................................................ 08:22:04 2752 ................................................................ 08:22:06 2816 ................................................................ 08:22:07 2880 ................................................................ 08:22:10 2944 ................................................................ 08:22:22 3008 ................................................................ 08:22:29 3072 ................................................................ 08:22:32 3136 ................................................................ 08:22:34 3200 ................................................................ 08:22:36 3264 ................................................................ 08:22:37 3328 ................................................................ 08:22:39 3392 ................................................................ 08:22:41 3456 ................................................................ 08:22:43 3520 ................................................................ 08:22:46 3584 ................................................................ 08:22:48 3648 ................................................................ 08:22:49 3712 ................................................................ 08:22:50 3776 ................................................................ 08:22:52 3840 ................................................................ 08:22:53 3904 ................................................................ 08:22:55 3968 ................................................................ 08:22:56 4032 ................................................................ 08:22:57 4096 ................................................................ 08:22:59 4160 ................................................................ 08:23:02 4224 ................................................................ 08:23:06 4288 ................................................................ 08:23:10 4352 ................................................................ 08:23:13 4416 ................................................................ 08:23:16 4480 ................................................................ 08:23:18 4544 ................................................................ 08:23:21 4608 ................................................................ 08:23:22 4672 ................................................................ 08:23:25 4736 ................................................................ 08:23:28 4800 ................................................................ 08:23:30 4864 ................................................................ 08:23:31 4928 ................................................................ 08:23:33 4992 ................................................................ 08:23:35 5056 ................................................................ 08:23:37 5120 ................................................................ 08:23:38 5184 ................................................................ 08:23:40 5248 ................................................................ 08:23:41 5312 ................................................................ 08:23:43 5376 ................................................................ 08:23:44 5440 ................................................................ 08:23:46 5504 ................................................................ 08:23:49 5568 ................................................................ 08:23:51 5632 ................................................................ 08:23:53 5696 ................................................................ 08:23:55 5760 ................................................................ 08:23:57 5824 ................................................................ 08:23:59 5888 ................................................................ 08:24:02 5952 ................................................................ 08:24:04 6016 ................................................................ 08:24:06 6080 ................................................................ 08:24:08 6144 ................................................................ 08:24:11 6208 ................................................................ 08:24:14 6272 ................................................................ 08:24:16 6336 ................................................................ 08:24:18 6400 ................................................................ 08:24:21 6464 ................................................................ 08:24:24 6528 ................................................................ 08:24:27 6592 ................................................................ 08:24:30 6656 ................................................................ 08:24:32 6720 ................................................................ 08:24:35 6784 ................................................................ 08:24:37 6848 ................................................................ 08:24:39 6912 ................................................................ 08:24:41 6976 ................................................................ 08:24:43 7040 ................................................................ 08:24:45 7104 ................................................................ 08:24:47 7168 ................................................................ 08:24:49 7232 ................................................................ 08:24:50 7296 ................................................................ 08:24:51 7360 ................................................................ 08:24:53 7424 ................................................................ 08:24:54 7488 ................................................................ 08:24:55 7552 ................................................................ 08:24:56 7616 ................................................................ 08:24:58 7680 ................................................................ 08:24:59 7744 ................................................................ 08:25:00 7808 ................................................................ 08:25:01 7872 ................................................................ 08:25:03 7936 ................................................................ 08:25:04 8000 ................................................................ 08:25:05 8064 ................................................................ 08:25:06 8128 ................................................................ 08:25:08 8192 ................................................................ 08:25:09 8256 ................................................................ 08:25:10 8320 ................................................................ 08:25:12 8384 ................................................................ 08:25:13 8448 ................................................................ 08:25:14 8512 ................................................................ 08:25:15 8576 ................................................................ 08:25:16 8640 ................................................................ 08:25:18 8704 ................................................................ 08:25:19 8768 ................................................................ 08:25:20 8832 ................................................................ 08:25:21 8896 ................................................................ 08:25:23 8960 ................................................................ 08:25:24 9024 ................................................................ 08:25:25 9088 ................................................................ 08:25:27 9152 ................................................................ 08:25:28 9216 ................................................................ 08:25:30 9280 ................................................................ 08:25:31 9344 ................................................................ 08:25:32 9408 ................................................................ 08:25:34 9472 ................................................................ 08:25:35 9536 ................................................................ 08:25:37 9600 ................................................................ 08:25:39 9664 ................................................................ 08:25:40 9728 ................................................................ 08:25:42 9792 ................................................................ 08:25:44 9856 ................................................................ 08:25:46 9920 ................................................................ 08:25:47 9984 ................................................................ 08:25:48 10048 ................................................................ 08:25:49 10112 ................................................................ 08:25:50 10176 ................................................................ 08:25:51 10240 ................................................................ 08:25:52 10304 ................................................................ 08:25:53 10368 ................................................................ 08:25:54 10432 ................................................................ 08:25:56 10496 ................................................................ 08:25:58 10560 ................................................................ 08:25:59 10624 ................................................................ 08:26:00 10688 ................................................................ 08:26:01 10752 ................................................................ 08:26:03 10816 ................................................................ 08:26:04 10880 ................................................................ 08:26:04 10944 ................................................................ 08:26:06 11008 ................................................................ 08:26:07 11072 ................................................................ 08:26:08 11136 ................................................................ 08:26:09 11200 ................................................................ 08:26:10 11264 ................................................................ 08:26:12 11328 ................................................................ 08:26:13 11392 ................................................................ 08:26:14 11456 ................................................................ 08:26:15 11520 ................................................................ 08:26:16 11584 ................................................................ 08:26:17 11648 ................................................................ 08:26:18 11712 ................................................................ 08:26:19 11776 ................................................................ 08:26:20 11840 ................................................................ 08:26:22 11904 ................................................................ 08:26:23 11968 ................................................................ 08:26:24 12032 ................................................................ 08:26:25 12096 ................................................................ 08:26:26 12160 ................................................................ 08:26:27 12224 ................................................................ 08:26:28 12288 ................................................................ 08:26:29 12352 ................................................................ 08:29:02 12416 . done (893s) 08:29:02 WARNING: The following tests exceed 5 minute runtimes. Break them up or rethink them. 08:29:02 300.527: '00e30236cef41b3c noir-projects/scripts/run_test.sh noir-protocol-circuits rollup_lib block_root::block_root_rollup_inputs::tests::correct_blobs_with_non_empty_fields' 08:29:02 304.368: '47858aa9bf665f8a:ISOLATE=1:NAME=e2e_p2p/validators_sentinel yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/validators_sentinel.test.ts' 08:29:02 320.933: 'f6f1e598082a1c18 barretenberg/cpp/scripts/run_test.sh dsl_tests AcirAvm2RecursionConstraint.TestGenerateVKFromConstraintsWithoutWitness' 08:29:02 341.186: '47858aa9bf665f8a:ISOLATE=1:NAME=e2e_p2p/data_withholding_slash yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/data_withholding_slash.test.ts' 08:29:02 344.979: '7263e7f682128fb1:ONLY_TERM_PARENT=1 BOX=vanilla BROWSER=* run_compose_test vanilla-all-browsers box boxes' 08:29:02 355.243: 'f6f1e598082a1c18:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityPassing' 08:29:02 360.348: 'f6f1e598082a1c18:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityFailing' 08:29:02 364.532: '977f2d0db8427c66 aztec-up/scripts/run_test.sh amm_flow' 08:29:02 407.117: '47858aa9bf665f8a:ISOLATE=1:TIMEOUT=15m:NAME=e2e_block_building yarn-project/end-to-end/scripts/run_test.sh simple e2e_block_building' 08:29:02 426.799: '47858aa9bf665f8a:ISOLATE=1:NAME=prover-client/src/test/bb_prover_full_rollup.test.ts:CPUS=16:MEM=96g LOG_LEVEL=verbose yarn-project/scripts/run_test.sh prover-client/src/test/bb_prover_full_rollup.test.ts' 08:29:02 429.439: '47858aa9bf665f8a:ISOLATE=1:NAME=e2e_p2p/reex yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/reex.test.ts' 08:29:02 442.822: '47858aa9bf665f8a:ISOLATE=1:NAME=e2e_l1_with_wall_time yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_l1_with_wall_time.test.ts' 08:29:02 721.810: '47858aa9bf665f8a:ISOLATE=1:TIMEOUT=15m:CPUS=16:MEM=96g:NAME=e2e_prover_full_real yarn-project/end-to-end/scripts/run_test.sh simple e2e_prover/full' 08:29:02 Completed run of 12181 tests in 893 seconds. 08:29:02 --- bench all --- 08:29:02 barretenberg/cpp Executing: barretenberg/cpp/bootstrap.sh build_bench (http://ci.aztec-labs.com/01f450edd1353f85) 08:29:02 yarn-project/end-to-end Executing: yarn-project/end-to-end/bootstrap.sh build_bench (http://ci.aztec-labs.com/a4f3e62a6c936db3) 08:29:03 barretenberg/cpp 0 . done (1s) 08:31:05 yarn-project/end-to-end 0 ................................................................ 08:33:54 yarn-project/end-to-end 64 . done (292s) 08:33:55 Starting parallel run using max 64 cpus... 08:33:55 Test run log id: http://ci.aztec-labs.com/965bda66d51208fe 08:38:59 Completed run of 95 tests in 304 seconds. 08:39:02 Completed 7.6 KiB/7.6 KiB (128.3 KiB/s) with 1 file(s) remaining upload: ../../../tmp/tmp.CgDDxoCyTg to s3://aztec-ci-artifacts/build-cache/bench-1bb4f0588a9dc5b1df622753aab1d907b3f12c7a.tar.gz 08:39:02 Cache upload of bench-1bb4f0588a9dc5b1df622753aab1d907b3f12c7a.tar.gz complete in 2s. 08:39:02 + local code=0 08:39:02 + set +x 08:39:02 dmesg log id: http://ci.aztec-labs.com/607eef0347384b1f CI run log id: http://ci.aztec-labs.com/1750838915439 + code=0 + case $code in + log_ci_run PASSED 1750838915439 + exit 0 SSH exited with code: 0 Terminating instance: i-003e84fcd7b8de188...