ACI ·

Parent Log: http://ci.aztec-labs.com/15776413690 Command: bootstrap_ec2 './bootstrap.sh ci-full' Date: Fri Jun 20 10:34:39 UTC 2025 Status: 0 Took: 1985s --- request build instance --- Requesting m6a.32xlarge spot instance (name: pr-15151_amd64_x3-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)... Waiting for instance id for spot request: sir-9km76vkg... Timeout waiting for spot request. Requesting m6a.32xlarge on-demand instance (name: pr-15151_amd64_x3-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)... Waiting for SSH at 3.22.168.232... Stdout is not a tty, running in background... Loading CRS into tmpfs... Done in 9 seconds. Stdout is not a tty, starting build container in background... Starting devbox... From https://github.com/aztecprotocol/aztec-packages * branch f29a038c58fc1f3ad95ad05d18aea321f0f598b2 -> FETCH_HEAD HEAD is now at f29a038 refactor: offchain effects (#15151) Switched to a new branch 'gh-readonly-queue/next/pr-15151-be1fa8aacb33d330cf496352bb1446439e34c51a' + run + ci3/add_timestamps + DUP=1 + ci3/cache_log 'CI run' 1750413792688 CI run log id: http://ci.aztec-labs.com/1750413792688 10:03:12 + echo 'env: REF_NAME=gh-readonly-queue/next/pr-15151-be1fa8aacb33d330cf496352bb1446439e34c51a COMMIT_HASH=f29a038c58fc1f3ad95ad05d18aea321f0f598b2 CURRENT_VERSION=0.87.6 TARGET_BRANCH=next' 10:03:12 env: REF_NAME=gh-readonly-queue/next/pr-15151-be1fa8aacb33d330cf496352bb1446439e34c51a COMMIT_HASH=f29a038c58fc1f3ad95ad05d18aea321f0f598b2 CURRENT_VERSION=0.87.6 TARGET_BRANCH=next 10:03:12 + semver check gh-readonly-queue/next/pr-15151-be1fa8aacb33d330cf496352bb1446439e34c51a 10:03:12 + cpu_pid=419 10:03:12 + mem_pid=420 10:03:12 + set +e 10:03:12 + set -x 10:03:12 + ./bootstrap.sh ci-full 10:03:12 + mpstat 2 10:03:12 + vmstat -w -S M 2 10:03:12 ++ cache_log cpufile 10:03:12 ++ cache_log memfile 10:03:12 memfile log id: http://ci.aztec-labs.com/49e61aa80f7819fe 10:03:12 cpufile log id: http://ci.aztec-labs.com/31ed8ee264e202c4 10:03:20 --- pull submodules --- 10:03:20 Executing: git submodule update --init --recursive (http://ci.aztec-labs.com/26429febc49c15e9) 10:03:28 0 . done (8s) 10:03:30 --- noir build --- 10:03:30 Executing: retry install_deps (http://ci.aztec-labs.com/fad5f51c6fa5d4bc) 10:03:34 0 . done (4s) 10:03:35 build_native Executing: build_native (http://ci.aztec-labs.com/909d00ea6c39a160) 10:03:35 build_packages Executing: build_packages (http://ci.aztec-labs.com/d471824804d5637a) 10:03:35 build_native 0 . done (0s) 10:03:41 build_packages 0 . done (6s) 10:03:42 --- bb cpp build --- 10:03:43 build_wasm Executing: build_wasm (http://ci.aztec-labs.com/2bbab0590a362dab) 10:03:43 build_native Executing: build_native (http://ci.aztec-labs.com/e46d36d5b3c4b2e9) 10:03:43 build_nodejs_module Executing: build_nodejs_module (http://ci.aztec-labs.com/1ba8e657f9b47afd) 10:03:43 build_wasm_threads Executing: build_wasm_threads (http://ci.aztec-labs.com/de8db9adbd97adf1) 10:03:43 build_gcc_syntax_check_only Executing: build_gcc_syntax_check_only (http://ci.aztec-labs.com/0e9f1e751a692442) 10:03:43 build_fuzzing_syntax_check_only Executing: build_fuzzing_syntax_check_only (http://ci.aztec-labs.com/19e2ea9dad948143) 10:03:43 build_asan_fast Executing: build_asan_fast (http://ci.aztec-labs.com/ab06122d380a3ff0) 10:03:43 build_darwin Executing: build_darwin (http://ci.aztec-labs.com/9ee82aa38656fa36) 10:03:43 build_fuzzing_syntax_check_only 0 . done (0s) 10:03:43 build_gcc_syntax_check_only 0 . done (0s) 10:03:43 build_darwin 0 . done (0s) 10:03:43 build_wasm 0 . done (1s) 10:03:43 build_wasm_threads 0 . done (1s) 10:03:43 build_nodejs_module 0 . done (1s) 10:03:44 build_native 0 . done (2s) 10:03:45 build_asan_fast 0 . done (2s) 10:03:49 --- bb.js build --- 10:03:50 Cache download and extraction of node-modules-e85320bda7d59d54.zst complete in 1s. 10:03:51 Cache download and extraction of bb.js-5ac88d7ddad49cc2.tar.gz complete in 1s. 10:03:52 --- acir_tests build --- 10:03:52 Cache download and extraction of barretenberg-acir-tests-0f6e63ff1582529d.tar.gz complete in 0s. 10:03:53 Cache download and extraction of node-modules-fec19dc5fe5a76d5.zst complete in 1s. 10:03:54 browser-test-app Executing: yarn build (http://ci.aztec-labs.com/0672bb53de33f062) 10:03:54 bbjs-test Executing: yarn build (http://ci.aztec-labs.com/d41f953b28e706b4) 10:03:57 bbjs-test 0 . done (3s) 10:03:58 browser-test-app 0 . done (4s) 10:03:59 --- avm-transpiler build --- 10:03:59 Cache download and extraction of avm-transpiler-6867cd9272ea7ebd.tar.gz complete in 0s. 10:03:59 --- noir-projects build --- 10:03:59 Executing: prep (http://ci.aztec-labs.com/93ca94b5222b04a6) 10:04:02 0 . done (3s) 10:04:02 mock-protocol-circuits Executing: ./mock-protocol-circuits/bootstrap.sh (http://ci.aztec-labs.com/f282bb7338bbecdf) 10:04:02 noir-protocol-circuits Executing: ./noir-protocol-circuits/bootstrap.sh (http://ci.aztec-labs.com/0bfd6d7045b92e18) 10:04:02 noir-contracts Executing: ./noir-contracts/bootstrap.sh (http://ci.aztec-labs.com/68587595e2d9323a) 10:04:02 aztec-nr Executing: ./aztec-nr/bootstrap.sh (http://ci.aztec-labs.com/e0dafea5d8f5e49f) 10:04:04 noir-contracts 0 ................................................................ 10:04:04 noir-contracts 64 ................................................................ 10:04:04 noir-contracts 128 ................................................................ 10:04:04 noir-contracts 192 ................................................................ 10:04:05 noir-contracts 256 ................................................................ 10:04:05 noir-contracts 320 ................................................................ 10:04:05 noir-contracts 384 ................................................................ 10:04:05 noir-contracts 448 ................................................................ 10:04:05 noir-contracts 512 ................................................................ 10:04:05 noir-contracts 576 ................................................................ 10:04:05 noir-contracts 640 ................................................................ 10:04:06 noir-contracts 704 ................................................................ 10:04:06 noir-contracts 768 ................................................................ 10:04:06 noir-contracts 832 ................................................................ 10:04:06 noir-contracts 896 ................................................................ 10:04:07 noir-contracts 960 ................................................................ 10:04:07 noir-contracts 1024 ................................................................ 10:04:07 noir-contracts 1088 ................................................................ 10:04:07 noir-contracts 1152 ................................................................ 10:04:07 noir-protocol-circuits 0 ................................................................ 10:04:07 noir-protocol-circuits 64 ................................................................ 10:04:07 noir-contracts 1216 ................................................................ 10:04:07 noir-contracts 1280 ................................................................ 10:04:08 noir-contracts 1344 ................................................................ 10:04:08 noir-contracts 1408 ................................................................ 10:04:08 noir-contracts 1472 ................................................................ 10:04:08 noir-protocol-circuits 128 ................................................................ 10:04:08 noir-contracts 1536 ................................................................ 10:04:08 noir-contracts 1600 . done (6s) 10:04:09 noir-protocol-circuits 192 ................................................................ 10:04:09 noir-protocol-circuits 256 ................................................................ 10:04:10 mock-protocol-circuits 0 ................................................................ 10:04:10 aztec-nr 0 . done (8s) 10:04:11 noir-protocol-circuits 320 ................................................................ 10:04:12 noir-protocol-circuits 384 ................................................................ 10:04:13 noir-protocol-circuits 448 ................................................................ 10:04:15 mock-protocol-circuits 64 ................................................................ 10:06:46 mock-protocol-circuits 128 . done (164s) 10:06:47 noir-protocol-circuits 512 ................................................................ 10:06:47 noir-protocol-circuits 576 ................................................................ 10:06:47 noir-protocol-circuits 640 . done (165s) 10:06:48 --- l1-contracts build --- 10:06:48 Cache download and extraction of l1-contracts-4ea23e356a55c2a8.tar.gz complete in 0s. 10:06:48 --- yarn-project build --- 10:06:48 Executing: ./bootstrap.sh clean-lite (http://ci.aztec-labs.com/01691d1503fbec57) 10:06:48 0 . done (0s) 10:06:54 Cache download and extraction of node-modules-34bec2a54a394404.zst complete in 5s. 10:06:54 Executing: compile_all (http://ci.aztec-labs.com/805eb4412aa87590) 10:06:57 0 . done (3s) 10:06:57 boxes/bootstrap.sh Executing: boxes/bootstrap.sh (http://ci.aztec-labs.com/e906be61d7b15875) 10:06:57 playground/bootstrap.sh Executing: playground/bootstrap.sh (http://ci.aztec-labs.com/82874f788653d98a) 10:06:57 docs/bootstrap.sh Executing: docs/bootstrap.sh (http://ci.aztec-labs.com/6746e5087ebc2214) 10:06:57 release-image/bootstrap.sh Executing: release-image/bootstrap.sh (http://ci.aztec-labs.com/2f74042baff9bb03) 10:06:57 spartan/bootstrap.sh Executing: spartan/bootstrap.sh (http://ci.aztec-labs.com/b2807ad43dfaaaec) 10:06:57 aztec-up/bootstrap.sh Executing: aztec-up/bootstrap.sh (http://ci.aztec-labs.com/d93cf26930b3ee0c) 10:06:58 aztec-up/bootstrap.sh 0 . done (1s) 10:07:01 spartan/bootstrap.sh 0 . done (4s) 10:07:01 boxes/bootstrap.sh 0 . done (4s) 10:07:02 playground/bootstrap.sh 0 . done (5s) 10:07:05 docs/bootstrap.sh 0 . done (8s) 10:07:32 release-image/bootstrap.sh 0 . done (35s) 10:07:32 --- test all --- 10:07:32 Waiting for TXE's to start... 10:07:35 Gathering tests to run... 10:09:17 Gathered 12122 tests. 10:09:17 Starting parallel run with max 64 jobs... 10:09:17 Executing: parallel -j64 --memsuspend 64G --line-buffer --joblog joblog.txt --halt now,fail=1 'run_test_cmd {}' (http://ci.aztec-labs.com/ed67305435d8b25f) 10:09:49 0 ................................................................ 10:10:58 64 ................................................................ 10:12:00 128 ................................................................ 10:13:04 192 ................................................................ 10:13:29 256 ................................................................ 10:13:40 320 ................................................................ 10:14:00 384 ................................................................ 10:14:14 448 ................................................................ 10:14:21 512 ................................................................ 10:14:27 576 ................................................................ 10:14:40 640 ................................................................ 10:14:48 704 ................................................................ 10:14:55 768 ................................................................ 10:15:00 832 ................................................................ 10:15:09 896 ................................................................ 10:15:15 960 ................................................................ 10:15:20 1024 ................................................................ 10:15:24 1088 ................................................................ 10:15:33 1152 ................................................................ 10:15:41 1216 ................................................................ 10:15:44 1280 ................................................................ 10:15:48 1344 ................................................................ 10:15:51 1408 ................................................................ 10:15:54 1472 ................................................................ 10:15:58 1536 ................................................................ 10:16:05 1600 ................................................................ 10:16:20 1664 ................................................................ 10:16:31 1728 ................................................................ 10:16:36 1792 ................................................................ 10:16:41 1856 ................................................................ 10:16:43 1920 ................................................................ 10:16:45 1984 ................................................................ 10:16:47 2048 ................................................................ 10:16:49 2112 ................................................................ 10:16:50 2176 ................................................................ 10:16:52 2240 ................................................................ 10:16:54 2304 ................................................................ 10:16:56 2368 ................................................................ 10:16:57 2432 ................................................................ 10:16:59 2496 ................................................................ 10:17:00 2560 ................................................................ 10:17:10 2624 ................................................................ 10:17:13 2688 ................................................................ 10:17:14 2752 ................................................................ 10:17:15 2816 ................................................................ 10:17:18 2880 ................................................................ 10:17:21 2944 ................................................................ 10:17:42 3008 ................................................................ 10:17:45 3072 ................................................................ 10:17:48 3136 ................................................................ 10:17:50 3200 ................................................................ 10:17:51 3264 ................................................................ 10:17:53 3328 ................................................................ 10:17:54 3392 ................................................................ 10:17:56 3456 ................................................................ 10:18:00 3520 ................................................................ 10:18:02 3584 ................................................................ 10:18:04 3648 ................................................................ 10:18:06 3712 ................................................................ 10:18:07 3776 ................................................................ 10:18:09 3840 ................................................................ 10:18:10 3904 ................................................................ 10:18:11 3968 ................................................................ 10:18:13 4032 ................................................................ 10:18:14 4096 ................................................................ 10:18:17 4160 ................................................................ 10:18:21 4224 ................................................................ 10:18:25 4288 ................................................................ 10:18:28 4352 ................................................................ 10:18:31 4416 ................................................................ 10:18:34 4480 ................................................................ 10:18:37 4544 ................................................................ 10:18:39 4608 ................................................................ 10:18:42 4672 ................................................................ 10:18:44 4736 ................................................................ 10:18:46 4800 ................................................................ 10:18:48 4864 ................................................................ 10:18:50 4928 ................................................................ 10:18:52 4992 ................................................................ 10:18:54 5056 ................................................................ 10:18:56 5120 ................................................................ 10:18:58 5184 ................................................................ 10:18:59 5248 ................................................................ 10:19:01 5312 ................................................................ 10:19:02 5376 ................................................................ 10:19:04 5440 ................................................................ 10:19:08 5504 ................................................................ 10:19:10 5568 ................................................................ 10:19:12 5632 ................................................................ 10:19:15 5696 ................................................................ 10:19:17 5760 ................................................................ 10:19:19 5824 ................................................................ 10:19:21 5888 ................................................................ 10:19:23 5952 ................................................................ 10:19:26 6016 ................................................................ 10:19:28 6080 ................................................................ 10:19:30 6144 ................................................................ 10:19:33 6208 ................................................................ 10:19:36 6272 ................................................................ 10:19:38 6336 ................................................................ 10:19:41 6400 ................................................................ 10:19:43 6464 ................................................................ 10:19:47 6528 ................................................................ 10:19:49 6592 ................................................................ 10:19:52 6656 ................................................................ 10:19:55 6720 ................................................................ 10:19:57 6784 ................................................................ 10:19:59 6848 ................................................................ 10:20:01 6912 ................................................................ 10:20:03 6976 ................................................................ 10:20:05 7040 ................................................................ 10:20:07 7104 ................................................................ 10:20:09 7168 ................................................................ 10:20:10 7232 ................................................................ 10:20:12 7296 ................................................................ 10:20:13 7360 ................................................................ 10:20:14 7424 ................................................................ 10:20:16 7488 ................................................................ 10:20:17 7552 ................................................................ 10:20:18 7616 ................................................................ 10:20:19 7680 ................................................................ 10:20:21 7744 ................................................................ 10:20:22 7808 ................................................................ 10:20:23 7872 ................................................................ 10:20:25 7936 ................................................................ 10:20:26 8000 ................................................................ 10:20:27 8064 ................................................................ 10:20:29 8128 ................................................................ 10:20:30 8192 ................................................................ 10:20:31 8256 ................................................................ 10:20:32 8320 ................................................................ 10:20:34 8384 ................................................................ 10:20:35 8448 ................................................................ 10:20:36 8512 ................................................................ 10:20:38 8576 ................................................................ 10:20:39 8640 ................................................................ 10:20:40 8704 ................................................................ 10:20:41 8768 ................................................................ 10:20:42 8832 ................................................................ 10:20:44 8896 ................................................................ 10:20:45 8960 ................................................................ 10:20:47 9024 ................................................................ 10:20:48 9088 ................................................................ 10:20:49 9152 ................................................................ 10:20:51 9216 ................................................................ 10:20:52 9280 ................................................................ 10:20:54 9344 ................................................................ 10:20:55 9408 ................................................................ 10:20:57 9472 ................................................................ 10:20:58 9536 ................................................................ 10:20:59 9600 ................................................................ 10:21:01 9664 ................................................................ 10:21:03 9728 ................................................................ 10:21:05 9792 ................................................................ 10:21:06 9856 ................................................................ 10:21:07 9920 ................................................................ 10:21:08 9984 ................................................................ 10:21:10 10048 ................................................................ 10:21:11 10112 ................................................................ 10:21:12 10176 ................................................................ 10:21:13 10240 ................................................................ 10:21:14 10304 ................................................................ 10:21:15 10368 ................................................................ 10:21:16 10432 ................................................................ 10:21:19 10496 ................................................................ 10:21:20 10560 ................................................................ 10:21:21 10624 ................................................................ 10:21:22 10688 ................................................................ 10:21:24 10752 ................................................................ 10:21:25 10816 ................................................................ 10:21:26 10880 ................................................................ 10:21:27 10944 ................................................................ 10:21:28 11008 ................................................................ 10:21:29 11072 ................................................................ 10:21:30 11136 ................................................................ 10:21:31 11200 ................................................................ 10:21:33 11264 ................................................................ 10:21:34 11328 ................................................................ 10:21:35 11392 ................................................................ 10:21:36 11456 ................................................................ 10:21:38 11520 ................................................................ 10:21:39 11584 ................................................................ 10:21:40 11648 ................................................................ 10:21:41 11712 ................................................................ 10:21:42 11776 ................................................................ 10:21:43 11840 ................................................................ 10:21:44 11904 ................................................................ 10:21:46 11968 ................................................................ 10:21:47 12032 ................................................................ 10:21:48 12096 ................................................................ 10:21:49 12160 ................................................................ 10:21:50 12224 ................................................................ 10:21:51 12288 ................................................................ 10:24:23 12352 . done (906s) 10:24:23 WARNING: The following tests exceed 5 minute runtimes. Break them up or rethink them. 10:24:23 304.896: 'a5511b51e55ea9c0:ISOLATE=1:NAME=e2e_p2p/validators_sentinel yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/validators_sentinel.test.ts' 10:24:23 306.092: 'f6d0f30efb64f09d noir-projects/scripts/run_test.sh noir-protocol-circuits rollup_lib block_root::block_root_rollup_inputs::tests::correct_blobs_with_non_empty_fields' 10:24:23 340.142: 'a5511b51e55ea9c0:ISOLATE=1:NAME=e2e_p2p/data_withholding_slash yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/data_withholding_slash.test.ts' 10:24:23 345.682: '6879ad4207267e3b barretenberg/cpp/scripts/run_test.sh dsl_tests AcirAvm2RecursionConstraint.TestGenerateVKFromConstraintsWithoutWitness' 10:24:23 367.217: 'ee15b3c3da7fa429:ONLY_TERM_PARENT=1 BOX=vanilla BROWSER=* run_compose_test vanilla-all-browsers box boxes' 10:24:23 369.501: '4bb34b921306bced aztec-up/scripts/run_test.sh amm_flow' 10:24:23 376.605: '6879ad4207267e3b:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityPassing' 10:24:23 385.864: '6879ad4207267e3b:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityFailing' 10:24:23 402.417: 'a5511b51e55ea9c0:ISOLATE=1:NAME=p2p/src/client/p2p_client.integration.test.ts LOG_LEVEL=debug yarn-project/scripts/run_test.sh p2p/src/client/p2p_client.integration.test.ts' 10:24:23 404.914: 'a5511b51e55ea9c0:ISOLATE=1:TIMEOUT=15m:NAME=e2e_block_building yarn-project/end-to-end/scripts/run_test.sh simple e2e_block_building' 10:24:23 429.855: 'a5511b51e55ea9c0:ISOLATE=1:NAME=e2e_p2p/reex yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/reex.test.ts' 10:24:23 444.061: 'a5511b51e55ea9c0:ISOLATE=1:NAME=e2e_l1_with_wall_time yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_l1_with_wall_time.test.ts' 10:24:23 444.165: 'a5511b51e55ea9c0:ISOLATE=1:NAME=prover-client/src/test/bb_prover_full_rollup.test.ts:CPUS=16:MEM=96g LOG_LEVEL=verbose yarn-project/scripts/run_test.sh prover-client/src/test/bb_prover_full_rollup.test.ts' 10:24:23 762.218: 'a5511b51e55ea9c0:ISOLATE=1:TIMEOUT=15m:CPUS=16:MEM=96g:NAME=e2e_prover_full_real yarn-project/end-to-end/scripts/run_test.sh simple e2e_prover/full' 10:24:23 Completed run of 12122 tests in 906 seconds. 10:24:23 --- bench all --- 10:24:23 barretenberg/cpp Executing: barretenberg/cpp/bootstrap.sh build_bench (http://ci.aztec-labs.com/d2d265f04cb0fa46) 10:24:23 yarn-project/end-to-end Executing: yarn-project/end-to-end/bootstrap.sh build_bench (http://ci.aztec-labs.com/bfba0101e8ff7349) 10:24:24 barretenberg/cpp 0 . done (1s) 10:26:31 yarn-project/end-to-end 0 ................................................................ 10:26:31 yarn-project/end-to-end 64 ................................................................ 10:26:31 yarn-project/end-to-end 128 ................................................................ 10:26:32 yarn-project/end-to-end 192 ................................................................ 10:26:32 yarn-project/end-to-end 256 ................................................................ 10:26:32 yarn-project/end-to-end 320 ................................................................ 10:26:32 yarn-project/end-to-end 384 ................................................................ 10:26:32 yarn-project/end-to-end 448 ................................................................ 10:26:32 yarn-project/end-to-end 512 ................................................................ 10:26:32 yarn-project/end-to-end 576 ................................................................ 10:26:32 yarn-project/end-to-end 640 ................................................................ 10:26:32 yarn-project/end-to-end 704 ................................................................ 10:29:15 yarn-project/end-to-end 768 . done (292s) 10:29:16 Starting parallel run using max 64 cpus... 10:29:17 Test run log id: http://ci.aztec-labs.com/32a68b086c6621e4 10:34:28 Completed run of 95 tests in 312 seconds. 10:34:31 Completed 7.6 KiB/7.6 KiB (115.0 KiB/s) with 1 file(s) remaining upload: ../../../tmp/tmp.Gc2ENe5NUw to s3://aztec-ci-artifacts/build-cache/bench-f29a038c58fc1f3ad95ad05d18aea321f0f598b2.tar.gz 10:34:31 Cache upload of bench-f29a038c58fc1f3ad95ad05d18aea321f0f598b2.tar.gz complete in 2s. 10:34:31 + local code=0 10:34:31 + set +x 10:34:31 dmesg log id: http://ci.aztec-labs.com/c94c56e4d6fb58de CI run log id: http://ci.aztec-labs.com/1750413792688 + code=0 + case $code in + log_ci_run PASSED 1750413792688 + exit 0 SSH exited with code: 0 Terminating instance: i-072bc1f6096c57386...