Parent Log:
http://ci.aztec-labs.com/15616423343
Command: bootstrap_ec2 './bootstrap.sh ci-full'
Date: Thu Jun 12 17:27:40 UTC 2025
Status: 0
Took: 2336s
--- request build instance ---
Requesting m6a.32xlarge spot instance (name: pr-14988_amd64_x4-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for instance id for spot request: sir-4867743h...
Timeout waiting for spot request.
Requesting m6a.32xlarge on-demand instance (name: pr-14988_amd64_x4-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for SSH at 13.58.51.212...
No tty, running in background...
Loading CRS into tmpfs...
Done in 93 seconds.
Starting devbox...
From
https://github.com/aztecprotocol/aztec-packages
* branch 2731d9a8aebf63d05db1a786296abdf897c49490 -> FETCH_HEAD
HEAD is now at 2731d9a refactor: use bitmap in outbox (#14988)
Switched to a new branch 'gh-readonly-queue/next/pr-14988-420e0a54fb4bfe8b04d7dd479f59ed0fe3ad3b74'
+ ci3/aws_handle_evict run
+ ci3/add_timestamps
+ DUP=1
+ ci3/cache_log 'CI run' 1749747110674
CI run log id:
http://ci.aztec-labs.com/1749747110674
16:51:51 env: REF_NAME=gh-readonly-queue/next/pr-14988-420e0a54fb4bfe8b04d7dd479f59ed0fe3ad3b74 COMMIT_HASH=2731d9a8aebf63d05db1a786296abdf897c49490 CURRENT_VERSION=0.87.6 TARGET_BRANCH=next
16:51:51 + ./bootstrap.sh ci-full
16:51:58
--- pull submodules ---
16:51:58 Executing: git submodule update --init --recursive (
http://ci.aztec-labs.com/f9558f4477dff128)
16:52:07 0 .
done (9s)
16:52:25
--- noir build ---
16:52:25 Executing: retry install_deps (
http://ci.aztec-labs.com/f80fc90c98a2e538)
16:52:34 0 .
done (9s)
16:52:34 build_native Executing: build_native (
http://ci.aztec-labs.com/ca9f3ed8faa8c092)
16:52:34 build_packages Executing: build_packages (
http://ci.aztec-labs.com/9bef321927870e2b)
16:52:35 build_native 0 .
done (1s)
16:52:41 build_packages 0 .
done (7s)
16:52:42
--- bb cpp build ---
16:52:42 build_nodejs_module Executing: build_nodejs_module (
http://ci.aztec-labs.com/6f0c5a664a3f4afb)
16:52:42 build_native Executing: build_native (
http://ci.aztec-labs.com/0dbcaeea7dd956e1)
16:52:42 build_wasm_threads Executing: build_wasm_threads (
http://ci.aztec-labs.com/c6680ee996e4020a)
16:52:42 build_wasm Executing: build_wasm (
http://ci.aztec-labs.com/5e2e7e70ad87227a)
16:52:42 build_gcc_syntax_check_only Executing: build_gcc_syntax_check_only (
http://ci.aztec-labs.com/62c0e3f0f6d3df18)
16:52:42 build_fuzzing_syntax_check_only Executing: build_fuzzing_syntax_check_only (
http://ci.aztec-labs.com/88bf126cc25c3073)
16:52:42 build_asan_fast Executing: build_asan_fast (
http://ci.aztec-labs.com/c4e6fb00a8f41158)
16:52:42 build_darwin Executing: build_darwin (
http://ci.aztec-labs.com/62e521b4ca15be92)
16:52:42 build_gcc_syntax_check_only 0 .
done (0s)
16:52:42 build_fuzzing_syntax_check_only 0 .
done (0s)
16:52:42 build_darwin 0 .
done (0s)
16:52:42 build_wasm 0 .
done (0s)
16:52:42 build_wasm_threads 0 .
done (0s)
16:52:43 build_native 0 .
done (1s)
16:52:44 build_asan_fast 0 .
done (1s)
16:52:44 build_nodejs_module 0 .
done (2s)
16:52:48
--- bb.js build ---
16:52:49 Cache download and extraction of node-modules-aa659bb2a892ab4f.zst complete in 1s.
16:52:49 Cache download and extraction of bb.js-c5fff6e2ed9b0114.tar.gz complete in 0s.
16:52:49
--- acir_tests build ---
16:52:50 Cache download and extraction of barretenberg-acir-tests-fec94dfeff94833e.tar.gz complete in 1s.
16:52:51 Cache download and extraction of node-modules-fec19dc5fe5a76d5.zst complete in 1s.
16:52:51 Executing: cd browser-test-app && yarn build (
http://ci.aztec-labs.com/13a3fea644776271)
16:52:55 0 .
done (4s)
16:52:55 Executing: cd bbjs-test && yarn build (
http://ci.aztec-labs.com/b941cdc99f32addc)
16:52:58 0 .
done (3s)
16:52:58
--- avm-transpiler build ---
16:52:58 Cache download and extraction of avm-transpiler-2ef373cf3e06b25d.tar.gz complete in 0s.
16:52:58
--- noir-projects build ---
16:52:58 Executing: prep (
http://ci.aztec-labs.com/1f98201830f62a7e)
16:53:01 0 .
done (3s)
16:53:02 mock-protocol-circuits Executing: ./mock-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/e8560204acb10e1e)
16:53:02 noir-protocol-circuits Executing: ./noir-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/e78cb67b1bf213a2)
16:53:02 noir-contracts Executing: ./noir-contracts/bootstrap.sh (
http://ci.aztec-labs.com/e69ba654459413a4)
16:53:02 aztec-nr Executing: ./aztec-nr/bootstrap.sh (
http://ci.aztec-labs.com/1756fc9fcfedcd48)
16:53:03 noir-contracts 0 ................................................................
16:53:03 noir-contracts 64 ................................................................
16:53:03 noir-contracts 128 ................................................................
16:53:03 noir-contracts 192 ................................................................
16:53:03 noir-contracts 256 ................................................................
16:53:04 noir-contracts 320 ................................................................
16:53:04 noir-contracts 384 ................................................................
16:53:04 noir-contracts 448 ................................................................
16:53:04 noir-contracts 512 ................................................................
16:53:04 noir-contracts 576 ................................................................
16:53:04 noir-contracts 640 ................................................................
16:53:04 noir-contracts 704 ................................................................
16:53:05 noir-contracts 768 ................................................................
16:53:05 noir-contracts 832 ................................................................
16:53:05 noir-contracts 896 ................................................................
16:53:05 noir-contracts 960 ................................................................
16:53:05 noir-contracts 1024 ................................................................
16:53:05 noir-contracts 1088 ................................................................
16:53:06 noir-contracts 1152 ................................................................
16:53:06 noir-contracts 1216 ................................................................
16:53:06 noir-contracts 1280 ................................................................
16:53:06 noir-contracts 1344 ................................................................
16:53:06 noir-contracts 1408 ................................................................
16:53:06 noir-contracts 1472 ................................................................
16:53:06 noir-contracts 1536 ................................................................
16:53:06 noir-contracts 1600 .
done (4s)
16:53:06 noir-protocol-circuits 0 ................................................................
16:53:07 noir-protocol-circuits 64 ................................................................
16:53:08 noir-protocol-circuits 128 ................................................................
16:53:08 aztec-nr 0 .
done (6s)
16:53:08 mock-protocol-circuits 0 ................................................................
16:53:09 noir-protocol-circuits 192 ................................................................
16:53:11 noir-protocol-circuits 256 ................................................................
16:53:15 noir-protocol-circuits 320 ................................................................
16:53:17 noir-protocol-circuits 384 ................................................................
16:53:19 noir-protocol-circuits 448 ................................................................
16:53:20 mock-protocol-circuits 64 ................................................................
16:53:21 noir-protocol-circuits 512 ................................................................
16:53:43 noir-protocol-circuits 576 ................................................................
16:55:59 mock-protocol-circuits 128 .
done (177s)
16:56:59 noir-protocol-circuits 640 ................................................................
16:56:59 noir-protocol-circuits 704 .
done (237s)
16:56:59
--- l1-contracts build ---
16:57:00 Cache download and extraction of l1-contracts-969950f7bb6e9ce2.tar.gz complete in 1s.
16:57:00
--- yarn-project build ---
16:57:00 Executing: ./bootstrap.sh clean-lite (
http://ci.aztec-labs.com/bd6d7f0e358472e9)
16:57:00 0 .
done (0s)
16:57:04 Cache download and extraction of node-modules-d160581125851fb0.zst complete in 4s.
16:57:04 Executing: compile_all (
http://ci.aztec-labs.com/e5a3ca9e97a0a32d)
16:57:15 0 ................................................................
16:59:36 64 .
done (152s)
16:59:36 playground/bootstrap.sh Executing: playground/bootstrap.sh (
http://ci.aztec-labs.com/46b86b10ff1eb119)
16:59:36 boxes/bootstrap.sh Executing: boxes/bootstrap.sh (
http://ci.aztec-labs.com/b7cec3b319f8d268)
16:59:36 docs/bootstrap.sh Executing: docs/bootstrap.sh (
http://ci.aztec-labs.com/f262df0a316de861)
16:59:36 release-image/bootstrap.sh Executing: release-image/bootstrap.sh (
http://ci.aztec-labs.com/4c966af03f7ab2e6)
16:59:36 spartan/bootstrap.sh Executing: spartan/bootstrap.sh (
http://ci.aztec-labs.com/29aa7f68c4462128)
16:59:36 aztec-up/bootstrap.sh Executing: aztec-up/bootstrap.sh (
http://ci.aztec-labs.com/9221dae7fc2a5f95)
16:59:37 aztec-up/bootstrap.sh 0 .
done (1s)
16:59:39 spartan/bootstrap.sh 0 .
done (3s)
16:59:40 boxes/bootstrap.sh 0 .
done (4s)
16:59:43 docs/bootstrap.sh 0 .
done (7s)
17:00:08 release-image/bootstrap.sh 0 .
done (32s)
17:00:33 playground/bootstrap.sh 0 .
done (57s)
17:00:33
--- test all ---
17:00:33 Waiting for TXE's to start...
17:00:37 Gathering tests to run...
17:02:19 Gathered 11355 tests.
17:02:19 Starting parallel run with max 64 jobs...
17:02:19 Executing: parallel -j64 --memsuspend 64G --line-buffer --joblog joblog.txt --halt now,fail=1 'run_test_cmd {}' (
http://ci.aztec-labs.com/7746b03b335715b3)
17:02:50 0 ................................................................
17:04:19 64 ................................................................
17:05:26 128 ................................................................
17:06:30 192 ................................................................
17:07:03 256 ................................................................
17:07:13 320 ................................................................
17:07:36 384 ................................................................
17:07:51 448 ................................................................
17:07:59 512 ................................................................
17:08:06 576 ................................................................
17:08:18 640 ................................................................
17:08:26 704 ................................................................
17:08:33 768 ................................................................
17:08:41 832 ................................................................
17:08:49 896 ................................................................
17:08:56 960 ................................................................
17:09:01 1024 ................................................................
17:09:05 1088 ................................................................
17:09:16 1152 ................................................................
17:09:21 1216 ................................................................
17:09:24 1280 ................................................................
17:09:29 1344 ................................................................
17:09:32 1408 ................................................................
17:09:36 1472 ................................................................
17:09:40 1536 ................................................................
17:09:52 1600 ................................................................
17:10:18 1664 ................................................................
17:10:36 1728 ................................................................
17:10:44 1792 ................................................................
17:10:49 1856 ................................................................
17:10:51 1920 ................................................................
17:10:52 1984 ................................................................
17:10:54 2048 ................................................................
17:10:56 2112 ................................................................
17:10:58 2176 ................................................................
17:10:59 2240 ................................................................
17:11:01 2304 ................................................................
17:11:03 2368 ................................................................
17:11:04 2432 ................................................................
17:11:06 2496 ................................................................
17:11:07 2560 ................................................................
17:11:16 2624 ................................................................
17:11:18 2688 ................................................................
17:11:19 2752 ................................................................
17:11:20 2816 ................................................................
17:11:23 2880 ................................................................
17:11:27 2944 ................................................................
17:11:50 3008 ................................................................
17:11:53 3072 ................................................................
17:11:56 3136 ................................................................
17:11:58 3200 ................................................................
17:12:00 3264 ................................................................
17:12:02 3328 ................................................................
17:12:03 3392 ................................................................
17:12:05 3456 ................................................................
17:12:09 3520 ................................................................
17:12:12 3584 ................................................................
17:12:15 3648 ................................................................
17:12:17 3712 ................................................................
17:12:18 3776 ................................................................
17:12:19 3840 ................................................................
17:12:21 3904 ................................................................
17:12:22 3968 ................................................................
17:12:23 4032 ................................................................
17:12:25 4096 ................................................................
17:12:27 4160 ................................................................
17:12:30 4224 ................................................................
17:12:35 4288 ................................................................
17:12:39 4352 ................................................................
17:12:41 4416 ................................................................
17:12:44 4480 ................................................................
17:12:46 4544 ................................................................
17:12:48 4608 ................................................................
17:12:51 4672 ................................................................
17:12:53 4736 ................................................................
17:12:55 4800 ................................................................
17:12:57 4864 ................................................................
17:12:59 4928 ................................................................
17:13:01 4992 ................................................................
17:13:03 5056 ................................................................
17:13:05 5120 ................................................................
17:13:07 5184 ................................................................
17:13:08 5248 ................................................................
17:13:10 5312 ................................................................
17:13:11 5376 ................................................................
17:13:14 5440 ................................................................
17:13:17 5504 ................................................................
17:13:20 5568 ................................................................
17:13:23 5632 ................................................................
17:13:26 5696 ................................................................
17:13:29 5760 ................................................................
17:13:31 5824 ................................................................
17:13:33 5888 ................................................................
17:13:36 5952 ................................................................
17:13:37 6016 ................................................................
17:13:40 6080 ................................................................
17:13:44 6144 ................................................................
17:13:46 6208 ................................................................
17:13:49 6272 ................................................................
17:13:52 6336 ................................................................
17:13:55 6400 ................................................................
17:13:58 6464 ................................................................
17:14:01 6528 ................................................................
17:14:03 6592 ................................................................
17:14:05 6656 ................................................................
17:14:07 6720 ................................................................
17:14:09 6784 ................................................................
17:14:11 6848 ................................................................
17:14:13 6912 ................................................................
17:14:15 6976 ................................................................
17:14:18 7040 ................................................................
17:14:19 7104 ................................................................
17:14:20 7168 ................................................................
17:14:21 7232 ................................................................
17:14:23 7296 ................................................................
17:14:24 7360 ................................................................
17:14:25 7424 ................................................................
17:14:26 7488 ................................................................
17:14:28 7552 ................................................................
17:14:29 7616 ................................................................
17:14:30 7680 ................................................................
17:14:32 7744 ................................................................
17:14:33 7808 ................................................................
17:14:34 7872 ................................................................
17:14:35 7936 ................................................................
17:14:37 8000 ................................................................
17:14:38 8064 ................................................................
17:14:39 8128 ................................................................
17:14:40 8192 ................................................................
17:14:42 8256 ................................................................
17:14:43 8320 ................................................................
17:14:44 8384 ................................................................
17:14:45 8448 ................................................................
17:14:47 8512 ................................................................
17:14:48 8576 ................................................................
17:14:50 8640 ................................................................
17:14:51 8704 ................................................................
17:14:53 8768 ................................................................
17:14:54 8832 ................................................................
17:14:56 8896 ................................................................
17:14:58 8960 ................................................................
17:15:00 9024 ................................................................
17:15:01 9088 ................................................................
17:15:03 9152 ................................................................
17:15:04 9216 ................................................................
17:15:05 9280 ................................................................
17:15:06 9344 ................................................................
17:15:07 9408 ................................................................
17:15:08 9472 ................................................................
17:15:09 9536 ................................................................
17:15:11 9600 ................................................................
17:15:12 9664 ................................................................
17:15:13 9728 ................................................................
17:15:15 9792 ................................................................
17:15:16 9856 ................................................................
17:15:17 9920 ................................................................
17:15:18 9984 ................................................................
17:15:20 10048 ................................................................
17:15:21 10112 ................................................................
17:15:21 10176 ................................................................
17:15:22 10240 ................................................................
17:15:23 10304 ................................................................
17:15:24 10368 ................................................................
17:15:26 10432 ................................................................
17:15:27 10496 ................................................................
17:15:28 10560 ................................................................
17:15:29 10624 ................................................................
17:15:30 10688 ................................................................
17:15:31 10752 ................................................................
17:15:32 10816 ................................................................
17:15:33 10880 ................................................................
17:15:34 10944 ................................................................
17:15:35 11008 ................................................................
17:15:36 11072 ................................................................
17:15:37 11136 ................................................................
17:15:38 11200 ................................................................
17:15:39 11264 ................................................................
17:15:40 11328 ................................................................
17:15:41 11392 ................................................................
17:15:42 11456 ................................................................
17:15:43 11520 ................................................................
17:17:23 11584 .
done (904s)
17:17:23
WARNING: The following tests exceed 5 minute runtimes. Break them up or rethink them.
17:17:23 324.898: 'a2f2725b601ede1f:ISOLATE=1:NAME=e2e_fees/dapp_subscription yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_fees/dapp_subscription.test.ts'
17:17:23 326.091: 'a2f2725b601ede1f:ISOLATE=1:NAME=e2e_epochs/epochs_proof_fails yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_proof_fails.test.ts'
17:17:23 326.164: '537d507d5b54152c noir-projects/scripts/run_test.sh noir-protocol-circuits rollup_lib block_root::block_root_rollup_inputs::tests::correct_blobs_with_non_empty_fields'
17:17:23 365.085: '90a95e5840d6a771:ONLY_TERM_PARENT=1 BOX=vanilla BROWSER=* run_compose_test vanilla-all-browsers box boxes'
17:17:23 365.723: 'a2f2725b601ede1f:ISOLATE=1:NAME=e2e_p2p/data_withholding_slash yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/data_withholding_slash.test.ts'
17:17:23 373.569: 'a2f2725b601ede1f:ISOLATE=1:NAME=e2e_p2p/add_rollup yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/add_rollup.test.ts'
17:17:23 382.602: 'b65330ebb7ef0b78 barretenberg/cpp/scripts/run_test.sh dsl_tests AcirAvm2RecursionConstraint.TestGenerateVKFromConstraintsWithoutWitness'
17:17:23 398.000: 'a2f2725b601ede1f:ISOLATE=1:NAME=e2e_epochs/epochs_empty_blocks yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_empty_blocks.test.ts'
17:17:23 408.815: 'a2f2725b601ede1f:ISOLATE=1:NAME=e2e_epochs/epochs_l1_reorgs yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_l1_reorgs.test.ts'
17:17:23 417.608: 'a2f2725b601ede1f:ISOLATE=1:NAME=e2e_p2p/reex yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/reex.test.ts'
17:17:23 419.253: 'a2f2725b601ede1f:ISOLATE=1:NAME=e2e_l1_with_wall_time yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_l1_with_wall_time.test.ts'
17:17:23 433.039: 'd4e9e1433145238c aztec-up/scripts/run_test.sh amm_flow'
17:17:23 482.371: 'a2f2725b601ede1f:ISOLATE=1:TIMEOUT=15m:NAME=e2e_block_building yarn-project/end-to-end/scripts/run_test.sh simple e2e_block_building'
17:17:23 487.844: 'b65330ebb7ef0b78:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityPassing'
17:17:23 491.165: 'a2f2725b601ede1f:ISOLATE=1:NAME=prover-client/src/test/bb_prover_full_rollup.test.ts:CPUS=16:MEM=96g LOG_LEVEL=verbose yarn-project/scripts/run_test.sh prover-client/src/test/bb_prover_full_rollup.test.ts'
17:17:23 494.566: 'b65330ebb7ef0b78:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityFailing'
17:17:23 852.496: 'a2f2725b601ede1f:ISOLATE=1:TIMEOUT=17m:CPUS=16:MEM=96g:NAME=e2e_prover_full_real yarn-project/end-to-end/scripts/run_test.sh simple e2e_prover/full'
17:17:23 Completed run of 11355 tests in 904 seconds.
17:17:23
--- bench all ---
17:17:23 barretenberg/cpp Executing: barretenberg/cpp/bootstrap.sh build_bench (
http://ci.aztec-labs.com/59337e8eea700cd4)
17:17:23 yarn-project/end-to-end Executing: yarn-project/end-to-end/bootstrap.sh build_bench (
http://ci.aztec-labs.com/6d9a8d80b3821f8c)
17:17:24 barretenberg/cpp 0 .
done (1s)
17:19:26 yarn-project/end-to-end 0 ................................................................
17:22:26 yarn-project/end-to-end 64 ................................................................
17:22:26 yarn-project/end-to-end 128 ................................................................
17:22:26 yarn-project/end-to-end 192 ................................................................
17:22:26 yarn-project/end-to-end 256 ................................................................
17:22:26 yarn-project/end-to-end 320 ................................................................
17:22:26 yarn-project/end-to-end 384 ................................................................
17:22:26 yarn-project/end-to-end 448 ................................................................
17:22:26 yarn-project/end-to-end 512 ................................................................
17:22:26 yarn-project/end-to-end 576 ................................................................
17:22:29 yarn-project/end-to-end 640 .
done (306s)
17:22:30 Starting parallel run using max 64 cpus...
17:22:31 Test run log id:
http://ci.aztec-labs.com/003e655fdba93d60
17:27:31 Completed run of 91 tests in 301 seconds.
17:27:34 Completed 6.8 KiB/6.8 KiB (115.9 KiB/s) with 1 file(s) remaining
upload: ../../../tmp/tmp.mEJrYa1kSV to s3://aztec-ci-artifacts/build-cache/bench-2731d9a8aebf63d05db1a786296abdf897c49490.tar.gz
17:27:34 Cache upload of bench-2731d9a8aebf63d05db1a786296abdf897c49490.tar.gz complete in 1s.
17:27:34 + local code=0
17:27:34 + set +x
17:27:34 dmesg log id:
http://ci.aztec-labs.com/bcb751ee9111a9c7
17:27:35 cpufile log id:
http://ci.aztec-labs.com/cff97c2df0fc452a
17:27:35 memfile log id:
http://ci.aztec-labs.com/fbad7cef1b45122f
CI run log id:
http://ci.aztec-labs.com/1749747110674
+ code=0
+ case $code in
+ log_ci_run PASSED 1749747110674
+ exit 0
SSH exited with code: 0
Terminating instance: i-02d83f24f6376d259...