Parent Log:
http://ci.aztec-labs.com/15731374977
Command: bootstrap_ec2 './bootstrap.sh ci-full'
Date: Wed Jun 18 11:55:29 UTC 2025
Status: 0
Took: 2224s
--- request build instance ---
Requesting m6a.32xlarge spot instance (name: pr-14921_amd64_x4-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for instance id for spot request: sir-nhvf4rgj...
Waiting for SSH at 3.147.78.12...
No tty, running in background...
Loading CRS into tmpfs...
Done in 18 seconds.
Starting devbox...
From
https://github.com/aztecprotocol/aztec-packages
* branch 8cc8a56892d36191eefb49254ebbe49ea99ef4b8 -> FETCH_HEAD
HEAD is now at 8cc8a56 chore: Limit IVC verification concurrency (#14921)
Switched to a new branch 'gh-readonly-queue/next/pr-14921-78d87cb88633aee537d022d6fd8e57ceb74a3a95'
+ ci3/aws_handle_evict run
+ ci3/add_timestamps
+ DUP=1
+ ci3/cache_log 'CI run' 1750245563383
CI run log id:
http://ci.aztec-labs.com/1750245563383
11:19:23 env: REF_NAME=gh-readonly-queue/next/pr-14921-78d87cb88633aee537d022d6fd8e57ceb74a3a95 COMMIT_HASH=8cc8a56892d36191eefb49254ebbe49ea99ef4b8 CURRENT_VERSION=0.87.6 TARGET_BRANCH=next
11:19:23 + ./bootstrap.sh ci-full
11:19:31
--- pull submodules ---
11:19:31 Executing: git submodule update --init --recursive (
http://ci.aztec-labs.com/823bd66cf021326f)
11:19:40 0 .
done (9s)
11:19:42
--- noir build ---
11:19:42 Executing: retry install_deps (
http://ci.aztec-labs.com/2192a33391c9d7a8)
11:19:46 0 .
done (4s)
11:19:47 build_native Executing: build_native (
http://ci.aztec-labs.com/43a9e3468ccaf89a)
11:19:47 build_packages Executing: build_packages (
http://ci.aztec-labs.com/a6aa744db8a52246)
11:19:47 build_native 0 .
done (0s)
11:19:53 build_packages 0 .
done (6s)
11:19:54
--- bb cpp build ---
11:19:54 build_wasm_threads Executing: build_wasm_threads (
http://ci.aztec-labs.com/08ffd8a87295663e)
11:19:54 build_native Executing: build_native (
http://ci.aztec-labs.com/918c72d420684580)
11:19:54 build_nodejs_module Executing: build_nodejs_module (
http://ci.aztec-labs.com/c90141a2bbcc020e)
11:19:54 build_wasm Executing: build_wasm (
http://ci.aztec-labs.com/01173d2ab27d8bf1)
11:19:54 build_gcc_syntax_check_only Executing: build_gcc_syntax_check_only (
http://ci.aztec-labs.com/08cd4ed2034347c8)
11:19:54 build_fuzzing_syntax_check_only Executing: build_fuzzing_syntax_check_only (
http://ci.aztec-labs.com/2ffa6b022abd7a1d)
11:19:54 build_asan_fast Executing: build_asan_fast (
http://ci.aztec-labs.com/5a7a6f39087f2882)
11:19:54 build_darwin Executing: build_darwin (
http://ci.aztec-labs.com/d36dac29efea0b25)
11:19:54 build_fuzzing_syntax_check_only 0 .
done (0s)
11:19:54 build_gcc_syntax_check_only 0 .
done (0s)
11:19:54 build_wasm_threads 0 .
done (0s)
11:19:54 build_wasm 0 .
done (0s)
11:19:54 build_darwin 0 .
done (0s)
11:19:55 build_nodejs_module 0 .
done (1s)
11:19:55 build_native 0 .
done (1s)
11:19:56 build_asan_fast 0 .
done (2s)
11:20:00
--- bb.js build ---
11:20:01 Cache download and extraction of node-modules-e85320bda7d59d54.zst complete in 1s.
11:20:01 Cache download and extraction of bb.js-a4d1fce58d939e86.tar.gz complete in 0s.
11:20:02
--- acir_tests build ---
11:20:02 Cache download and extraction of barretenberg-acir-tests-7435b7d717fa5ea6.tar.gz complete in 0s.
11:20:03 Cache download and extraction of node-modules-fec19dc5fe5a76d5.zst complete in 1s.
11:20:03 Executing: cd browser-test-app && yarn build (
http://ci.aztec-labs.com/05964ae89ac74db3)
11:20:08 0 .
done (5s)
11:20:08 Executing: cd bbjs-test && yarn build (
http://ci.aztec-labs.com/ef6ab073c9a5d8c4)
11:20:11 0 .
done (3s)
11:20:11
--- avm-transpiler build ---
11:20:11 Cache download and extraction of avm-transpiler-d7aa7d339b410ee2.tar.gz complete in 0s.
11:20:11
--- noir-projects build ---
11:20:11 Executing: prep (
http://ci.aztec-labs.com/bf41bea4d98c79e5)
11:20:14 0 .
done (3s)
11:20:14 mock-protocol-circuits Executing: ./mock-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/50f8d15e6ab2ba64)
11:20:14 noir-protocol-circuits Executing: ./noir-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/6571b92f082c280f)
11:20:14 noir-contracts Executing: ./noir-contracts/bootstrap.sh (
http://ci.aztec-labs.com/535f24b0bba1733a)
11:20:14 aztec-nr Executing: ./aztec-nr/bootstrap.sh (
http://ci.aztec-labs.com/a7bc10f115c06031)
11:20:15 noir-contracts 0 ................................................................
11:20:16 noir-contracts 64 ................................................................
11:20:16 noir-contracts 128 ................................................................
11:20:16 noir-contracts 192 ................................................................
11:20:16 noir-contracts 256 ................................................................
11:20:16 noir-contracts 320 ................................................................
11:20:16 noir-contracts 384 ................................................................
11:20:17 noir-contracts 448 ................................................................
11:20:17 noir-contracts 512 ................................................................
11:20:17 noir-contracts 576 ................................................................
11:20:17 noir-contracts 640 ................................................................
11:20:17 noir-contracts 704 ................................................................
11:20:17 noir-contracts 768 ................................................................
11:20:17 noir-contracts 832 ................................................................
11:20:18 noir-contracts 896 ................................................................
11:20:18 noir-contracts 960 ................................................................
11:20:18 noir-contracts 1024 ................................................................
11:20:18 noir-contracts 1088 ................................................................
11:20:18 noir-contracts 1152 ................................................................
11:20:18 noir-contracts 1216 ................................................................
11:20:19 noir-contracts 1280 ................................................................
11:20:19 noir-contracts 1344 ................................................................
11:20:19 noir-contracts 1408 ................................................................
11:20:19 noir-contracts 1472 ................................................................
11:20:19 noir-contracts 1536 ................................................................
11:20:19 noir-contracts 1600 .
done (5s)
11:20:19 noir-protocol-circuits 0 ................................................................
11:20:19 noir-protocol-circuits 64 ................................................................
11:20:20 noir-protocol-circuits 128 ................................................................
11:20:21 aztec-nr 0 .
done (7s)
11:20:21 mock-protocol-circuits 0 ................................................................
11:20:22 noir-protocol-circuits 192 ................................................................
11:20:23 noir-protocol-circuits 256 ................................................................
11:20:27 noir-protocol-circuits 320 ................................................................
11:20:29 noir-protocol-circuits 384 ................................................................
11:20:30 noir-protocol-circuits 448 ................................................................
11:20:33 mock-protocol-circuits 64 ................................................................
11:20:33 noir-protocol-circuits 512 ................................................................
11:21:26 noir-protocol-circuits 576 ................................................................
11:23:02 mock-protocol-circuits 128 .
done (168s)
11:24:09 noir-protocol-circuits 640 ................................................................
11:24:09 noir-protocol-circuits 704 .
done (235s)
11:24:09
--- l1-contracts build ---
11:24:09 Cache download and extraction of l1-contracts-086fc344fc430142.tar.gz complete in 0s.
11:24:09
--- yarn-project build ---
11:24:09 Executing: ./bootstrap.sh clean-lite (
http://ci.aztec-labs.com/873bc5fd387152e0)
11:24:09 0 .
done (0s)
11:24:15 Cache download and extraction of node-modules-759d401ab6f7f5f6.zst complete in 5s.
11:24:15 Executing: compile_all (
http://ci.aztec-labs.com/27f10b30c0d34267)
11:24:25 0 ................................................................
11:26:37 64 .
done (142s)
11:26:37 playground/bootstrap.sh Executing: playground/bootstrap.sh (
http://ci.aztec-labs.com/a81729c0212ff066)
11:26:37 boxes/bootstrap.sh Executing: boxes/bootstrap.sh (
http://ci.aztec-labs.com/ad657c157bf12950)
11:26:37 docs/bootstrap.sh Executing: docs/bootstrap.sh (
http://ci.aztec-labs.com/d1b53ec04d38e9bd)
11:26:37 release-image/bootstrap.sh Executing: release-image/bootstrap.sh (
http://ci.aztec-labs.com/db61259350df9003)
11:26:37 spartan/bootstrap.sh Executing: spartan/bootstrap.sh (
http://ci.aztec-labs.com/7e38fd7573f7dfb3)
11:26:37 aztec-up/bootstrap.sh Executing: aztec-up/bootstrap.sh (
http://ci.aztec-labs.com/e528664f615a018d)
11:26:38 aztec-up/bootstrap.sh 0 .
done (1s)
11:26:41 spartan/bootstrap.sh 0 .
done (4s)
11:26:45 docs/bootstrap.sh 0 .
done (7s)
11:27:09 release-image/bootstrap.sh 0 .
done (32s)
11:27:16 boxes/bootstrap.sh 0 .
done (39s)
11:27:34 playground/bootstrap.sh 0 .
done (57s)
11:27:34
--- test all ---
11:27:34 Waiting for TXE's to start...
11:27:37 Gathering tests to run...
11:29:18 Gathered 12064 tests.
11:29:18 Starting parallel run with max 64 jobs...
11:29:18 Executing: parallel -j64 --memsuspend 64G --line-buffer --joblog joblog.txt --halt now,fail=1 'run_test_cmd {}' (
http://ci.aztec-labs.com/88fdb72b2f06aef3)
11:29:49 0 ................................................................
11:31:02 64 ................................................................
11:32:17 128 ................................................................
11:33:21 192 ................................................................
11:33:49 256 ................................................................
11:33:59 320 ................................................................
11:34:19 384 ................................................................
11:34:34 448 ................................................................
11:34:41 512 ................................................................
11:34:49 576 ................................................................
11:35:01 640 ................................................................
11:35:09 704 ................................................................
11:35:16 768 ................................................................
11:35:23 832 ................................................................
11:35:29 896 ................................................................
11:35:36 960 ................................................................
11:35:41 1024 ................................................................
11:35:45 1088 ................................................................
11:35:56 1152 ................................................................
11:36:01 1216 ................................................................
11:36:04 1280 ................................................................
11:36:08 1344 ................................................................
11:36:11 1408 ................................................................
11:36:14 1472 ................................................................
11:36:17 1536 ................................................................
11:36:29 1600 ................................................................
11:36:51 1664 ................................................................
11:37:09 1728 ................................................................
11:37:16 1792 ................................................................
11:37:22 1856 ................................................................
11:37:25 1920 ................................................................
11:37:26 1984 ................................................................
11:37:28 2048 ................................................................
11:37:30 2112 ................................................................
11:37:32 2176 ................................................................
11:37:33 2240 ................................................................
11:37:35 2304 ................................................................
11:37:37 2368 ................................................................
11:37:38 2432 ................................................................
11:37:40 2496 ................................................................
11:37:41 2560 ................................................................
11:37:49 2624 ................................................................
11:37:51 2688 ................................................................
11:37:53 2752 ................................................................
11:37:54 2816 ................................................................
11:37:56 2880 ................................................................
11:38:00 2944 ................................................................
11:38:21 3008 ................................................................
11:38:24 3072 ................................................................
11:38:27 3136 ................................................................
11:38:29 3200 ................................................................
11:38:31 3264 ................................................................
11:38:32 3328 ................................................................
11:38:34 3392 ................................................................
11:38:36 3456 ................................................................
11:38:40 3520 ................................................................
11:38:42 3584 ................................................................
11:38:44 3648 ................................................................
11:38:46 3712 ................................................................
11:38:47 3776 ................................................................
11:38:49 3840 ................................................................
11:38:50 3904 ................................................................
11:38:52 3968 ................................................................
11:38:53 4032 ................................................................
11:38:55 4096 ................................................................
11:38:57 4160 ................................................................
11:39:01 4224 ................................................................
11:39:05 4288 ................................................................
11:39:08 4352 ................................................................
11:39:11 4416 ................................................................
11:39:14 4480 ................................................................
11:39:16 4544 ................................................................
11:39:19 4608 ................................................................
11:39:21 4672 ................................................................
11:39:24 4736 ................................................................
11:39:26 4800 ................................................................
11:39:28 4864 ................................................................
11:39:30 4928 ................................................................
11:39:32 4992 ................................................................
11:39:34 5056 ................................................................
11:39:36 5120 ................................................................
11:39:38 5184 ................................................................
11:39:39 5248 ................................................................
11:39:41 5312 ................................................................
11:39:43 5376 ................................................................
11:39:44 5440 ................................................................
11:39:47 5504 ................................................................
11:39:50 5568 ................................................................
11:39:52 5632 ................................................................
11:39:54 5696 ................................................................
11:39:57 5760 ................................................................
11:39:59 5824 ................................................................
11:40:01 5888 ................................................................
11:40:03 5952 ................................................................
11:40:05 6016 ................................................................
11:40:07 6080 ................................................................
11:40:10 6144 ................................................................
11:40:13 6208 ................................................................
11:40:16 6272 ................................................................
11:40:18 6336 ................................................................
11:40:21 6400 ................................................................
11:40:24 6464 ................................................................
11:40:27 6528 ................................................................
11:40:29 6592 ................................................................
11:40:32 6656 ................................................................
11:40:34 6720 ................................................................
11:40:36 6784 ................................................................
11:40:38 6848 ................................................................
11:40:40 6912 ................................................................
11:40:42 6976 ................................................................
11:40:44 7040 ................................................................
11:40:46 7104 ................................................................
11:40:49 7168 ................................................................
11:40:50 7232 ................................................................
11:40:51 7296 ................................................................
11:40:52 7360 ................................................................
11:40:53 7424 ................................................................
11:40:55 7488 ................................................................
11:40:56 7552 ................................................................
11:40:57 7616 ................................................................
11:40:58 7680 ................................................................
11:40:59 7744 ................................................................
11:41:01 7808 ................................................................
11:41:02 7872 ................................................................
11:41:03 7936 ................................................................
11:41:05 8000 ................................................................
11:41:06 8064 ................................................................
11:41:07 8128 ................................................................
11:41:08 8192 ................................................................
11:41:10 8256 ................................................................
11:41:11 8320 ................................................................
11:41:12 8384 ................................................................
11:41:14 8448 ................................................................
11:41:15 8512 ................................................................
11:41:16 8576 ................................................................
11:41:17 8640 ................................................................
11:41:18 8704 ................................................................
11:41:20 8768 ................................................................
11:41:21 8832 ................................................................
11:41:22 8896 ................................................................
11:41:23 8960 ................................................................
11:41:25 9024 ................................................................
11:41:26 9088 ................................................................
11:41:28 9152 ................................................................
11:41:29 9216 ................................................................
11:41:31 9280 ................................................................
11:41:32 9344 ................................................................
11:41:33 9408 ................................................................
11:41:35 9472 ................................................................
11:41:36 9536 ................................................................
11:41:38 9600 ................................................................
11:41:40 9664 ................................................................
11:41:41 9728 ................................................................
11:41:43 9792 ................................................................
11:41:45 9856 ................................................................
11:41:45 9920 ................................................................
11:41:46 9984 ................................................................
11:41:48 10048 ................................................................
11:41:49 10112 ................................................................
11:41:50 10176 ................................................................
11:41:51 10240 ................................................................
11:41:52 10304 ................................................................
11:41:53 10368 ................................................................
11:41:55 10432 ................................................................
11:41:56 10496 ................................................................
11:41:58 10560 ................................................................
11:41:59 10624 ................................................................
11:42:00 10688 ................................................................
11:42:02 10752 ................................................................
11:42:03 10816 ................................................................
11:42:04 10880 ................................................................
11:42:05 10944 ................................................................
11:42:06 11008 ................................................................
11:42:07 11072 ................................................................
11:42:08 11136 ................................................................
11:42:10 11200 ................................................................
11:42:11 11264 ................................................................
11:42:12 11328 ................................................................
11:42:13 11392 ................................................................
11:42:14 11456 ................................................................
11:42:15 11520 ................................................................
11:42:16 11584 ................................................................
11:42:17 11648 ................................................................
11:42:18 11712 ................................................................
11:42:20 11776 ................................................................
11:42:21 11840 ................................................................
11:42:22 11904 ................................................................
11:42:23 11968 ................................................................
11:42:24 12032 ................................................................
11:42:25 12096 ................................................................
11:42:26 12160 ................................................................
11:42:27 12224 ................................................................
11:42:40 12288 ................................................................
11:45:00 12352 .
done (942s)
11:45:00
WARNING: The following tests exceed 5 minute runtimes. Break them up or rethink them.
11:45:00 309.296: '1c4b0bdf550ede4a noir-projects/scripts/run_test.sh noir-protocol-circuits rollup_lib block_root::block_root_rollup_inputs::tests::correct_blobs_with_non_empty_fields'
11:45:00 309.552: '24e90b7895ff1ed6:ISOLATE=1:NAME=e2e_fees/private_payments yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_fees/private_payments.test.ts'
11:45:00 340.916: '17f1ce0a127de26d barretenberg/cpp/scripts/run_test.sh dsl_tests AcirAvm2RecursionConstraint.TestGenerateVKFromConstraintsWithoutWitness'
11:45:00 341.315: '24e90b7895ff1ed6:ISOLATE=1:NAME=e2e_p2p/data_withholding_slash yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/data_withholding_slash.test.ts'
11:45:00 346.789: '8c27b04c159445e9:ONLY_TERM_PARENT=1 BOX=vanilla BROWSER=* run_compose_test vanilla-all-browsers box boxes'
11:45:00 367.631: '17f1ce0a127de26d:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityPassing'
11:45:00 375.967: '17f1ce0a127de26d:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityFailing'
11:45:00 397.790: '24e90b7895ff1ed6:ISOLATE=1:NAME=p2p/src/client/p2p_client.integration.test.ts LOG_LEVEL=debug yarn-project/scripts/run_test.sh p2p/src/client/p2p_client.integration.test.ts'
11:45:00 400.266: '392b0236741bc79f aztec-up/scripts/run_test.sh amm_flow'
11:45:00 432.681: '24e90b7895ff1ed6:ISOLATE=1:NAME=e2e_p2p/reex yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/reex.test.ts'
11:45:00 439.065: '24e90b7895ff1ed6:ISOLATE=1:TIMEOUT=15m:NAME=e2e_block_building yarn-project/end-to-end/scripts/run_test.sh simple e2e_block_building'
11:45:00 444.513: '24e90b7895ff1ed6:ISOLATE=1:NAME=e2e_l1_with_wall_time yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_l1_with_wall_time.test.ts'
11:45:00 454.229: '24e90b7895ff1ed6:ISOLATE=1:NAME=prover-client/src/test/bb_prover_full_rollup.test.ts:CPUS=16:MEM=96g LOG_LEVEL=verbose yarn-project/scripts/run_test.sh prover-client/src/test/bb_prover_full_rollup.test.ts'
11:45:00 782.314: '24e90b7895ff1ed6:ISOLATE=1:TIMEOUT=15m:CPUS=16:MEM=96g:NAME=e2e_prover_full_real yarn-project/end-to-end/scripts/run_test.sh simple e2e_prover/full'
11:45:00 Completed run of 12064 tests in 942 seconds.
11:45:00
--- bench all ---
11:45:00 barretenberg/cpp Executing: barretenberg/cpp/bootstrap.sh build_bench (
http://ci.aztec-labs.com/cde9696be968d755)
11:45:00 yarn-project/end-to-end Executing: yarn-project/end-to-end/bootstrap.sh build_bench (
http://ci.aztec-labs.com/de5cd77f41b8d37e)
11:45:01 barretenberg/cpp 0 .
done (1s)
11:47:08 yarn-project/end-to-end 0 ................................................................
11:50:04 yarn-project/end-to-end 64 ................................................................
11:50:04 yarn-project/end-to-end 128 ................................................................
11:50:04 yarn-project/end-to-end 192 ................................................................
11:50:04 yarn-project/end-to-end 256 ................................................................
11:50:04 yarn-project/end-to-end 320 ................................................................
11:50:04 yarn-project/end-to-end 384 ................................................................
11:50:04 yarn-project/end-to-end 448 ................................................................
11:50:04 yarn-project/end-to-end 512 ................................................................
11:50:07 yarn-project/end-to-end 576 .
done (307s)
11:50:08 Starting parallel run using max 64 cpus...
11:50:08 Test run log id:
http://ci.aztec-labs.com/25920f21aea2a61d
11:55:20 Completed run of 94 tests in 312 seconds.
11:55:23 Completed 7.4 KiB/7.4 KiB (108.5 KiB/s) with 1 file(s) remaining
upload: ../../../tmp/tmp.bAf5BXsZGK to s3://aztec-ci-artifacts/build-cache/bench-8cc8a56892d36191eefb49254ebbe49ea99ef4b8.tar.gz
11:55:23 Cache upload of bench-8cc8a56892d36191eefb49254ebbe49ea99ef4b8.tar.gz complete in 1s.
11:55:23 + local code=0
11:55:23 + set +x
11:55:23 dmesg log id:
http://ci.aztec-labs.com/3e2882ba846db4b1
11:55:23 cpufile log id:
http://ci.aztec-labs.com/31c14925e248de07
11:55:24 memfile log id:
http://ci.aztec-labs.com/0f7bef2b3b66e512
CI run log id:
http://ci.aztec-labs.com/1750245563383
+ code=0
+ case $code in
+ log_ci_run PASSED 1750245563383
+ exit 0
SSH exited with code: 0
Terminating instance: i-0f9c00b21636eab09...