Parent Log:
http://ci.aztec-labs.com/15717108001
Command: bootstrap_ec2 './bootstrap.sh ci-full'
Date: Tue Jun 17 20:50:42 UTC 2025
Status: 0
Took: 2054s
--- request build instance ---
Requesting m6a.32xlarge spot instance (name: pr-15116_amd64_x2-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for instance id for spot request: sir-d1sz5vnh...
Timeout waiting for spot request.
Requesting m6a.32xlarge on-demand instance (name: pr-15116_amd64_x2-full) (type: m6a.32xlarge) (ami: ami-051d99fd9abf53087) (bid: 5.5424)...
Waiting for SSH at 18.218.240.199...
No tty, running in background...
Loading CRS into tmpfs...
Done in 35 seconds.
Starting devbox...
From
https://github.com/aztecprotocol/aztec-packages
* branch 4b0e4dc09fa55f0bc808fa0c7c3e95e8fa997069 -> FETCH_HEAD
HEAD is now at 4b0e4dc fix: Handle missed l1-to-l2 messages in archiver (#15116)
Switched to a new branch 'gh-readonly-queue/next/pr-15116-433ba6218aed45169029991a493e4232b30b8ec6'
+ ci3/aws_handle_evict run
+ ci3/add_timestamps
+ DUP=1
+ ci3/cache_log 'CI run' 1750191509631
CI run log id:
http://ci.aztec-labs.com/1750191509631
20:18:29 env: REF_NAME=gh-readonly-queue/next/pr-15116-433ba6218aed45169029991a493e4232b30b8ec6 COMMIT_HASH=4b0e4dc09fa55f0bc808fa0c7c3e95e8fa997069 CURRENT_VERSION=0.87.6 TARGET_BRANCH=next
20:18:29 + ./bootstrap.sh ci-full
20:18:38
--- pull submodules ---
20:18:38 Executing: git submodule update --init --recursive (
http://ci.aztec-labs.com/3706deab93a264ca)
20:18:46 0 .
done (8s)
20:18:50
--- noir build ---
20:18:50 Executing: retry install_deps (
http://ci.aztec-labs.com/bf4e6d95af33add9)
20:18:55 0 .
done (5s)
20:18:56 build_native Executing: build_native (
http://ci.aztec-labs.com/478ca3c66fbb1550)
20:18:56 build_packages Executing: build_packages (
http://ci.aztec-labs.com/5111dae77b42616c)
20:18:56 build_native 0 .
done (0s)
20:19:02 build_packages 0 .
done (6s)
20:19:02
--- bb cpp build ---
20:19:03 build_wasm_threads Executing: build_wasm_threads (
http://ci.aztec-labs.com/f59acbb93812ee8c)
20:19:03 build_nodejs_module Executing: build_nodejs_module (
http://ci.aztec-labs.com/8617218d8a33e93a)
20:19:03 build_native Executing: build_native (
http://ci.aztec-labs.com/bb299c542370837b)
20:19:03 build_wasm Executing: build_wasm (
http://ci.aztec-labs.com/b577baf9a612ad2c)
20:19:03 build_gcc_syntax_check_only Executing: build_gcc_syntax_check_only (
http://ci.aztec-labs.com/afc3e4f6bbeb59c6)
20:19:03 build_fuzzing_syntax_check_only Executing: build_fuzzing_syntax_check_only (
http://ci.aztec-labs.com/997c0715edf3fad8)
20:19:03 build_asan_fast Executing: build_asan_fast (
http://ci.aztec-labs.com/cf817d3d3c43c741)
20:19:03 build_darwin Executing: build_darwin (
http://ci.aztec-labs.com/0ad417cc17c034c3)
20:19:03 build_fuzzing_syntax_check_only 0 .
done (0s)
20:19:03 build_gcc_syntax_check_only 0 .
done (0s)
20:19:03 build_darwin 0 .
done (0s)
20:19:03 build_wasm_threads 0 .
done (0s)
20:19:03 build_wasm 0 .
done (0s)
20:19:04 build_nodejs_module 0 .
done (1s)
20:19:04 build_native 0 .
done (1s)
20:19:04 build_asan_fast 0 .
done (1s)
20:19:09
--- bb.js build ---
20:19:10 Cache download and extraction of node-modules-27a69dd9b9012b6d.zst complete in 1s.
20:19:10 Cache download and extraction of bb.js-157cc0fdeb6ded07.tar.gz complete in 0s.
20:19:11
--- acir_tests build ---
20:19:11 Cache download and extraction of barretenberg-acir-tests-da8c082c6b93ab98.tar.gz complete in 0s.
20:19:12 Cache download and extraction of node-modules-fec19dc5fe5a76d5.zst complete in 1s.
20:19:12 Executing: cd browser-test-app && yarn build (
http://ci.aztec-labs.com/ac6895e50d349f0a)
20:19:17 0 .
done (5s)
20:19:17 Executing: cd bbjs-test && yarn build (
http://ci.aztec-labs.com/f37e360c2391bbe2)
20:19:19 0 .
done (2s)
20:19:20
--- avm-transpiler build ---
20:19:20 Cache download and extraction of avm-transpiler-2ef373cf3e06b25d.tar.gz complete in 0s.
20:19:20
--- noir-projects build ---
20:19:20 Executing: prep (
http://ci.aztec-labs.com/bbe546aa546e263b)
20:19:23 0 .
done (3s)
20:19:23 mock-protocol-circuits Executing: ./mock-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/99cb50574b1dfcff)
20:19:23 noir-protocol-circuits Executing: ./noir-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/2336b5494c5c41b7)
20:19:23 noir-contracts Executing: ./noir-contracts/bootstrap.sh (
http://ci.aztec-labs.com/523d81a5a10340ea)
20:19:23 aztec-nr Executing: ./aztec-nr/bootstrap.sh (
http://ci.aztec-labs.com/49fb8af4101d02e7)
20:19:24 noir-contracts 0 ................................................................
20:19:24 noir-contracts 64 ................................................................
20:19:25 noir-contracts 128 ................................................................
20:19:25 noir-contracts 192 ................................................................
20:19:25 noir-contracts 256 ................................................................
20:19:25 noir-contracts 320 ................................................................
20:19:25 noir-contracts 384 ................................................................
20:19:25 noir-contracts 448 ................................................................
20:19:25 noir-contracts 512 ................................................................
20:19:26 noir-contracts 576 ................................................................
20:19:26 noir-contracts 640 ................................................................
20:19:26 noir-contracts 704 ................................................................
20:19:26 noir-contracts 768 ................................................................
20:19:26 noir-contracts 832 ................................................................
20:19:26 noir-contracts 896 ................................................................
20:19:27 noir-contracts 960 ................................................................
20:19:27 noir-contracts 1024 ................................................................
20:19:27 noir-contracts 1088 ................................................................
20:19:27 noir-contracts 1152 ................................................................
20:19:27 noir-contracts 1216 ................................................................
20:19:27 noir-contracts 1280 ................................................................
20:19:27 noir-contracts 1344 ................................................................
20:19:27 noir-contracts 1408 ................................................................
20:19:28 noir-contracts 1472 ................................................................
20:19:28 noir-contracts 1536 ................................................................
20:19:28 noir-contracts 1600 .
done (5s)
20:19:28 noir-protocol-circuits 0 ................................................................
20:19:28 noir-protocol-circuits 64 ................................................................
20:19:29 noir-protocol-circuits 128 ................................................................
20:19:30 aztec-nr 0 .
done (7s)
20:19:30 mock-protocol-circuits 0 ................................................................
20:19:30 noir-protocol-circuits 192 ................................................................
20:19:32 noir-protocol-circuits 256 ................................................................
20:19:36 noir-protocol-circuits 320 ................................................................
20:19:38 noir-protocol-circuits 384 ................................................................
20:19:39 noir-protocol-circuits 448 ................................................................
20:19:41 mock-protocol-circuits 64 ................................................................
20:19:42 noir-protocol-circuits 512 ................................................................
20:20:10 noir-protocol-circuits 576 ................................................................
20:22:13 mock-protocol-circuits 128 .
done (170s)
20:23:17 noir-protocol-circuits 640 ................................................................
20:23:17 noir-protocol-circuits 704 .
done (234s)
20:23:17
--- l1-contracts build ---
20:23:18 Cache download and extraction of l1-contracts-e0fa28fe7172270f.tar.gz complete in 1s.
20:23:18
--- yarn-project build ---
20:23:18 Executing: ./bootstrap.sh clean-lite (
http://ci.aztec-labs.com/e2a3f08fb9733d2b)
20:23:18 0 .
done (0s)
20:23:24 Cache download and extraction of node-modules-3f56c01a081488bc.zst complete in 6s.
20:23:24 Executing: compile_all (
http://ci.aztec-labs.com/15dfd93e10b70d2d)
20:23:27 0 .
done (3s)
20:23:27 boxes/bootstrap.sh Executing: boxes/bootstrap.sh (
http://ci.aztec-labs.com/3c2c15a00fdb7d09)
20:23:27 playground/bootstrap.sh Executing: playground/bootstrap.sh (
http://ci.aztec-labs.com/37ac46be7ba623b1)
20:23:27 docs/bootstrap.sh Executing: docs/bootstrap.sh (
http://ci.aztec-labs.com/0b1e2ac398f92c04)
20:23:27 release-image/bootstrap.sh Executing: release-image/bootstrap.sh (
http://ci.aztec-labs.com/f2b5c78363f1d0da)
20:23:27 spartan/bootstrap.sh Executing: spartan/bootstrap.sh (
http://ci.aztec-labs.com/6bc7f80b76aef331)
20:23:27 aztec-up/bootstrap.sh Executing: aztec-up/bootstrap.sh (
http://ci.aztec-labs.com/59ccd5472957259b)
20:23:28 aztec-up/bootstrap.sh 0 .
done (1s)
20:23:31 spartan/bootstrap.sh 0 .
done (4s)
20:23:32 playground/bootstrap.sh 0 .
done (5s)
20:23:32 boxes/bootstrap.sh 0 .
done (5s)
20:23:34 docs/bootstrap.sh 0 .
done (7s)
20:24:05 release-image/bootstrap.sh 0 .
done (38s)
20:24:05
--- test all ---
20:24:05 Waiting for TXE's to start...
20:24:08 Gathering tests to run...
20:25:46 Gathered 11361 tests.
20:25:46 Starting parallel run with max 64 jobs...
20:25:46 Executing: parallel -j64 --memsuspend 64G --line-buffer --joblog joblog.txt --halt now,fail=1 'run_test_cmd {}' (
http://ci.aztec-labs.com/20565fb19cf53bed)
20:26:18 0 ................................................................
20:27:29 64 ................................................................
20:28:45 128 ................................................................
20:29:51 192 ................................................................
20:30:20 256 ................................................................
20:30:31 320 ................................................................
20:30:49 384 ................................................................
20:31:03 448 ................................................................
20:31:10 512 ................................................................
20:31:17 576 ................................................................
20:31:30 640 ................................................................
20:31:38 704 ................................................................
20:31:46 768 ................................................................
20:31:53 832 ................................................................
20:31:59 896 ................................................................
20:32:06 960 ................................................................
20:32:11 1024 ................................................................
20:32:14 1088 ................................................................
20:32:26 1152 ................................................................
20:32:31 1216 ................................................................
20:32:34 1280 ................................................................
20:32:38 1344 ................................................................
20:32:41 1408 ................................................................
20:32:44 1472 ................................................................
20:32:47 1536 ................................................................
20:33:00 1600 ................................................................
20:33:20 1664 ................................................................
20:33:38 1728 ................................................................
20:33:46 1792 ................................................................
20:33:50 1856 ................................................................
20:33:54 1920 ................................................................
20:33:55 1984 ................................................................
20:33:57 2048 ................................................................
20:33:59 2112 ................................................................
20:34:00 2176 ................................................................
20:34:02 2240 ................................................................
20:34:04 2304 ................................................................
20:34:05 2368 ................................................................
20:34:07 2432 ................................................................
20:34:08 2496 ................................................................
20:34:09 2560 ................................................................
20:34:17 2624 ................................................................
20:34:20 2688 ................................................................
20:34:21 2752 ................................................................
20:34:22 2816 ................................................................
20:34:25 2880 ................................................................
20:34:27 2944 ................................................................
20:34:48 3008 ................................................................
20:34:54 3072 ................................................................
20:34:57 3136 ................................................................
20:34:59 3200 ................................................................
20:35:00 3264 ................................................................
20:35:02 3328 ................................................................
20:35:03 3392 ................................................................
20:35:05 3456 ................................................................
20:35:08 3520 ................................................................
20:35:11 3584 ................................................................
20:35:13 3648 ................................................................
20:35:15 3712 ................................................................
20:35:16 3776 ................................................................
20:35:18 3840 ................................................................
20:35:19 3904 ................................................................
20:35:21 3968 ................................................................
20:35:22 4032 ................................................................
20:35:23 4096 ................................................................
20:35:26 4160 ................................................................
20:35:29 4224 ................................................................
20:35:33 4288 ................................................................
20:35:36 4352 ................................................................
20:35:39 4416 ................................................................
20:35:42 4480 ................................................................
20:35:44 4544 ................................................................
20:35:47 4608 ................................................................
20:35:50 4672 ................................................................
20:35:52 4736 ................................................................
20:35:53 4800 ................................................................
20:35:55 4864 ................................................................
20:35:57 4928 ................................................................
20:35:58 4992 ................................................................
20:36:00 5056 ................................................................
20:36:02 5120 ................................................................
20:36:04 5184 ................................................................
20:36:05 5248 ................................................................
20:36:07 5312 ................................................................
20:36:09 5376 ................................................................
20:36:12 5440 ................................................................
20:36:14 5504 ................................................................
20:36:17 5568 ................................................................
20:36:19 5632 ................................................................
20:36:22 5696 ................................................................
20:36:24 5760 ................................................................
20:36:27 5824 ................................................................
20:36:29 5888 ................................................................
20:36:31 5952 ................................................................
20:36:33 6016 ................................................................
20:36:35 6080 ................................................................
20:36:38 6144 ................................................................
20:36:41 6208 ................................................................
20:36:43 6272 ................................................................
20:36:46 6336 ................................................................
20:36:49 6400 ................................................................
20:36:52 6464 ................................................................
20:36:55 6528 ................................................................
20:36:58 6592 ................................................................
20:37:00 6656 ................................................................
20:37:02 6720 ................................................................
20:37:04 6784 ................................................................
20:37:06 6848 ................................................................
20:37:08 6912 ................................................................
20:37:10 6976 ................................................................
20:37:12 7040 ................................................................
20:37:14 7104 ................................................................
20:37:15 7168 ................................................................
20:37:16 7232 ................................................................
20:37:17 7296 ................................................................
20:37:19 7360 ................................................................
20:37:20 7424 ................................................................
20:37:21 7488 ................................................................
20:37:22 7552 ................................................................
20:37:23 7616 ................................................................
20:37:25 7680 ................................................................
20:37:26 7744 ................................................................
20:37:27 7808 ................................................................
20:37:28 7872 ................................................................
20:37:29 7936 ................................................................
20:37:31 8000 ................................................................
20:37:32 8064 ................................................................
20:37:33 8128 ................................................................
20:37:34 8192 ................................................................
20:37:35 8256 ................................................................
20:37:36 8320 ................................................................
20:37:38 8384 ................................................................
20:37:39 8448 ................................................................
20:37:40 8512 ................................................................
20:37:41 8576 ................................................................
20:37:43 8640 ................................................................
20:37:44 8704 ................................................................
20:37:46 8768 ................................................................
20:37:47 8832 ................................................................
20:37:49 8896 ................................................................
20:37:50 8960 ................................................................
20:37:52 9024 ................................................................
20:37:54 9088 ................................................................
20:37:55 9152 ................................................................
20:37:56 9216 ................................................................
20:37:57 9280 ................................................................
20:37:58 9344 ................................................................
20:37:59 9408 ................................................................
20:38:00 9472 ................................................................
20:38:01 9536 ................................................................
20:38:02 9600 ................................................................
20:38:03 9664 ................................................................
20:38:04 9728 ................................................................
20:38:06 9792 ................................................................
20:38:07 9856 ................................................................
20:38:09 9920 ................................................................
20:38:10 9984 ................................................................
20:38:11 10048 ................................................................
20:38:12 10112 ................................................................
20:38:13 10176 ................................................................
20:38:14 10240 ................................................................
20:38:15 10304 ................................................................
20:38:16 10368 ................................................................
20:38:17 10432 ................................................................
20:38:18 10496 ................................................................
20:38:19 10560 ................................................................
20:38:21 10624 ................................................................
20:38:22 10688 ................................................................
20:38:23 10752 ................................................................
20:38:24 10816 ................................................................
20:38:25 10880 ................................................................
20:38:26 10944 ................................................................
20:38:27 11008 ................................................................
20:38:28 11072 ................................................................
20:38:29 11136 ................................................................
20:38:30 11200 ................................................................
20:38:31 11264 ................................................................
20:38:32 11328 ................................................................
20:38:33 11392 ................................................................
20:38:34 11456 ................................................................
20:38:35 11520 ................................................................
20:39:20 11584 ................................................................
20:40:02 11648 .
done (856s)
20:40:02
WARNING: The following tests exceed 5 minute runtimes. Break them up or rethink them.
20:40:02 323.843: '58da07d366dfbabc noir-projects/scripts/run_test.sh noir-protocol-circuits rollup_lib block_root::block_root_rollup_inputs::tests::correct_blobs_with_non_empty_fields'
20:40:02 337.389: '557c108a8ed544a3:ISOLATE=1:NAME=e2e_p2p/data_withholding_slash yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/data_withholding_slash.test.ts'
20:40:02 340.376: 'e1fc0c30883c3dd9:ONLY_TERM_PARENT=1 BOX=vanilla BROWSER=* run_compose_test vanilla-all-browsers box boxes'
20:40:02 341.944: '8a172cd719fd94be barretenberg/cpp/scripts/run_test.sh dsl_tests AcirAvm2RecursionConstraint.TestGenerateVKFromConstraintsWithoutWitness'
20:40:02 375.134: '8a172cd719fd94be:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityFailing'
20:40:02 377.785: '8a172cd719fd94be:CPUS=4:MEM=8g barretenberg/cpp/scripts/run_test.sh client_ivc_tests ClientIVCKernelCapacity.MaxCapacityPassing'
20:40:02 407.177: '10e0079ac3d7b0d4 aztec-up/scripts/run_test.sh amm_flow'
20:40:02 409.167: '557c108a8ed544a3:ISOLATE=1:NAME=p2p/src/client/p2p_client.integration.test.ts LOG_LEVEL=debug yarn-project/scripts/run_test.sh p2p/src/client/p2p_client.integration.test.ts'
20:40:02 432.829: '557c108a8ed544a3:ISOLATE=1:NAME=e2e_p2p/reex yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/reex.test.ts'
20:40:02 436.653: '557c108a8ed544a3:ISOLATE=1:TIMEOUT=15m:NAME=e2e_block_building yarn-project/end-to-end/scripts/run_test.sh simple e2e_block_building'
20:40:02 444.959: '557c108a8ed544a3:ISOLATE=1:NAME=e2e_l1_with_wall_time yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_l1_with_wall_time.test.ts'
20:40:02 454.054: '557c108a8ed544a3:ISOLATE=1:NAME=prover-client/src/test/bb_prover_full_rollup.test.ts:CPUS=16:MEM=96g LOG_LEVEL=verbose yarn-project/scripts/run_test.sh prover-client/src/test/bb_prover_full_rollup.test.ts'
20:40:02 788.050: '557c108a8ed544a3:ISOLATE=1:TIMEOUT=15m:CPUS=16:MEM=96g:NAME=e2e_prover_full_real yarn-project/end-to-end/scripts/run_test.sh simple e2e_prover/full'
20:40:02 Completed run of 11361 tests in 856 seconds.
20:40:02
--- bench all ---
20:40:03 barretenberg/cpp Executing: barretenberg/cpp/bootstrap.sh build_bench (
http://ci.aztec-labs.com/7e5673ebfab0e6c0)
20:40:03 yarn-project/end-to-end Executing: yarn-project/end-to-end/bootstrap.sh build_bench (
http://ci.aztec-labs.com/6ac37ad8b9e85cde)
20:40:03 barretenberg/cpp 0 .
done (0s)
20:42:13 yarn-project/end-to-end 0 ................................................................
20:45:17 yarn-project/end-to-end 64 .
done (314s)
20:45:18 Starting parallel run using max 64 cpus...
20:45:18 Test run log id:
http://ci.aztec-labs.com/d7976c4439cfde5e
20:50:33 Completed run of 94 tests in 315 seconds.
20:50:36 Completed 7.4 KiB/7.4 KiB (127.5 KiB/s) with 1 file(s) remaining
upload: ../../../tmp/tmp.ANhKqnmKUS to s3://aztec-ci-artifacts/build-cache/bench-4b0e4dc09fa55f0bc808fa0c7c3e95e8fa997069.tar.gz
20:50:36 Cache upload of bench-4b0e4dc09fa55f0bc808fa0c7c3e95e8fa997069.tar.gz complete in 1s.
20:50:36 + local code=0
20:50:36 + set +x
20:50:36 dmesg log id:
http://ci.aztec-labs.com/23c553d4b3ce409d
20:50:37 cpufile log id:
http://ci.aztec-labs.com/b45351df01e9387a
20:50:37 memfile log id:
http://ci.aztec-labs.com/0de56a8959998236
CI run log id:
http://ci.aztec-labs.com/1750191509631
+ code=0
+ case $code in
+ log_ci_run PASSED 1750191509631
+ exit 0
SSH exited with code: 0
Terminating instance: i-0778569f89966141c...