Parent Log:
http://ci.aztec-labs.com/b06799846ea6075b
19:02:37 + echo 'env: REF_NAME=gh-readonly-queue/next/pr-16345-6c594c42a60c5304c8aa1f8a2e376f42d4a72b1b COMMIT_HASH=5cc430b80ce91a6cc0a3ef264802ef83aec09b29 CURRENT_VERSION=1.2.1 TARGET_BRANCH=next'
19:02:37 env: REF_NAME=gh-readonly-queue/next/pr-16345-6c594c42a60c5304c8aa1f8a2e376f42d4a72b1b COMMIT_HASH=5cc430b80ce91a6cc0a3ef264802ef83aec09b29 CURRENT_VERSION=1.2.1 TARGET_BRANCH=next
19:02:37 + semver check gh-readonly-queue/next/pr-16345-6c594c42a60c5304c8aa1f8a2e376f42d4a72b1b
19:02:37 + cpu_pid=409
19:02:37 + mpstat 2
19:02:37 + mem_pid=411
19:02:37 + set +e
19:02:37 + set -x
19:02:37 + ./bootstrap.sh ci-full
19:02:37 + vmstat -w -S M 2
19:02:37 ++ cache_log cpufile
19:02:37 ++ cache_log memfile
19:02:37 cpufile log id:
http://ci.aztec-labs.com/29c9e161d8081393
19:02:37 memfile log id:
http://ci.aztec-labs.com/44a17f48b00e67f6
19:02:41
--- pull submodules ---
19:02:41 Executing: git submodule update --init --recursive (
http://ci.aztec-labs.com/4bbe39684cd1d780)
19:02:49 0 .
done (8s)
19:02:53
--- noir build ---
19:02:53 Executing: retry install_deps (
http://ci.aztec-labs.com/55afbb7c410f4e3e)
19:03:00 0 .
done (7s)
19:03:00 build_native Executing: build_native (
http://ci.aztec-labs.com/983ed5ca620497fb)
19:03:00 build_packages Executing: build_packages (
http://ci.aztec-labs.com/0e5d9e9c2d814f0d)
19:03:01 build_native 0 .
done (1s)
19:03:06 build_packages 0 .
done (6s)
19:03:07
--- bb cpp build ---
19:03:07 build_nodejs_module Executing: build_nodejs_module (
http://ci.aztec-labs.com/93d774c06a34d8f2)
19:03:07 build_native Executing: build_native (
http://ci.aztec-labs.com/9635620906fd6f1b)
19:03:07 build_wasm Executing: build_wasm (
http://ci.aztec-labs.com/9afc19292283f395)
19:03:07 build_wasm_threads Executing: build_wasm_threads (
http://ci.aztec-labs.com/4075c39f831c651b)
19:03:07 build_gcc_syntax_check_only Executing: build_gcc_syntax_check_only (
http://ci.aztec-labs.com/bcf877e123bdebcc)
19:03:07 build_fuzzing_syntax_check_only Executing: build_fuzzing_syntax_check_only (
http://ci.aztec-labs.com/de7ca56cb3fde8d1)
19:03:07 build_asan_fast Executing: build_asan_fast (
http://ci.aztec-labs.com/16ae66e583089360)
19:03:07 build_darwin Executing: build_darwin (
http://ci.aztec-labs.com/6093204d112621e9)
19:03:07 build_gcc_syntax_check_only 0 .
done (0s)
19:03:07 build_fuzzing_syntax_check_only 0 .
done (0s)
19:03:07 build_wasm 0 .
done (0s)
19:03:07 build_wasm_threads 0 .
done (0s)
19:03:07 build_darwin 0 .
done (0s)
19:03:08 build_nodejs_module 0 .
done (1s)
19:03:09 build_native 0 .
done (2s)
19:03:09 build_asan_fast 0 .
done (2s)
19:03:15
--- bb.js build ---
19:03:16 Cache download and extraction of node-modules-55762ef1223e7c5b.zst complete in 1s.
19:03:16 Cache download and extraction of bb.js-29265a024affeb1c.tar.gz complete in 0s.
19:03:18
--- acir_tests build ---
19:03:18 Cache download and extraction of barretenberg-acir-tests-3cc59e386a4329d0.tar.gz complete in 0s.
19:03:19 Cache download and extraction of node-modules-fec19dc5fe5a76d5.zst complete in 1s.
19:03:19 browser-test-app Executing: yarn build (
http://ci.aztec-labs.com/60084ae893bf963a)
19:03:19 bbjs-test Executing: yarn build (
http://ci.aztec-labs.com/a550507abe9eed29)
19:03:22 bbjs-test 0 .
done (3s)
19:03:23 browser-test-app 0 .
done (4s)
19:03:24 hash=3a78993a7cbadbe3
19:03:24
--- build bb docs ---
19:03:25 Cache download and extraction of bb-docs-3a78993a7cbadbe3.tar.gz complete in 1s.
19:03:25 Skipping deployment - no bb doc changes compared to cache.
19:03:25
--- barretenberg/sol building ---
19:03:25 Generating keys for add2 circuit (mem: 5.00 MiB)
19:03:26 VK contract written to: ./src/honk/keys/Add2HonkVerificationKey.sol (mem: 136.00 MiB)
19:03:26 Generating keys for blake circuit (mem: 5.00 MiB)
19:03:26 VK contract written to: ./src/honk/keys/BlakeHonkVerificationKey.sol (mem: 148.82 MiB)
19:03:26 Generating keys for ecdsa circuit (mem: 5.00 MiB)
19:03:26 (Experimental) WARNING: Builder failure when we have real witnesses! (mem: 6.00 MiB)
19:03:26 VK contract written to: ./src/honk/keys/EcdsaHonkVerificationKey.sol (mem: 196.13 MiB)
19:03:26 Generating keys for recursive circuit (mem: 4.00 MiB)
19:03:29 VK contract written to: ./src/honk/keys/RecursiveHonkVerificationKey.sol (mem: 1511.62 MiB)
19:03:29
--- barretenberg/sol building sol ---
19:03:29 Cache download and extraction of barretenberg-sol-88635bb82c19b066.zst complete in 0s.
19:03:29
--- avm-transpiler build ---
19:03:29 Cache download and extraction of avm-transpiler-c5cff37a532edbec.tar.gz complete in 0s.
19:03:29
--- noir-projects build ---
19:03:29 Executing: prep (
http://ci.aztec-labs.com/3578406dc2381e2f)
19:03:32 0 .
done (3s)
19:03:32 mock-protocol-circuits Executing: ./mock-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/f994a0d0f741f990)
19:03:32 noir-protocol-circuits Executing: ./noir-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/b01e8c4e42b56297)
19:03:32 noir-contracts Executing: ./noir-contracts/bootstrap.sh (
http://ci.aztec-labs.com/dc5607df295334cf)
19:03:32 aztec-nr Executing: ./aztec-nr/bootstrap.sh (
http://ci.aztec-labs.com/9c011ec96ce30d1d)
19:03:34 noir-contracts 0 ................................................................
19:03:34 noir-contracts 64 ................................................................
19:03:34 noir-contracts 128 ................................................................
19:03:34 noir-contracts 192 ................................................................
19:03:35 noir-contracts 256 ................................................................
19:03:35 noir-contracts 320 ................................................................
19:03:35 noir-contracts 384 ................................................................
19:03:35 noir-contracts 448 ................................................................
19:03:35 noir-contracts 512 ................................................................
19:03:35 noir-contracts 576 ................................................................
19:03:35 noir-contracts 640 ................................................................
19:03:36 noir-contracts 704 ................................................................
19:03:36 noir-contracts 768 ................................................................
19:03:36 noir-contracts 832 ................................................................
19:03:36 noir-contracts 896 ................................................................
19:03:36 noir-contracts 960 ................................................................
19:03:37 noir-contracts 1024 ................................................................
19:03:37 noir-contracts 1088 ................................................................
19:03:37 aztec-nr 0 .
done (5s)
19:03:37 noir-contracts 1152 ................................................................
19:03:37 noir-contracts 1216 ................................................................
19:03:37 noir-contracts 1280 ................................................................
19:03:37 noir-contracts 1344 ................................................................
19:03:37 noir-contracts 1408 ................................................................
19:03:37 noir-protocol-circuits 0 ................................................................
19:03:37 noir-protocol-circuits 64 ................................................................
19:03:38 noir-protocol-circuits 128 ................................................................
19:03:38 noir-contracts 1472 ................................................................
19:03:38 noir-contracts 1536 .
done (6s)
19:03:38 noir-protocol-circuits 192 ................................................................
19:03:39 noir-protocol-circuits 256 ................................................................
19:03:39 noir-protocol-circuits 320 ................................................................
19:03:39 mock-protocol-circuits 0 ................................................................
19:03:40 noir-protocol-circuits 384 ................................................................
19:03:41 noir-protocol-circuits 448 ................................................................
19:03:43 mock-protocol-circuits 64 ................................................................
19:05:49 noir-protocol-circuits 512 ................................................................
19:05:49 noir-protocol-circuits 576 ................................................................
19:05:49 noir-protocol-circuits 640 .
done (137s)
19:05:49 mock-protocol-circuits 128 .
done (137s)
19:05:49
--- l1-contracts build ---
19:05:50
➤ YN0000: ·
Yarn 4.5.2
19:05:50
➤ YN0000: ┌ Resolution step
19:05:50
➤ YN0000: └ Completed
19:05:50
➤ YN0000: ┌ Fetch step
19:05:50
➤ YN0013: │
134 packages were added to the project (
+ 44.9 MiB).
19:05:50
➤ YN0000: └ Completed in 0s 654ms
19:05:50
➤ YN0000: ┌ Link step
19:05:51
➤ YN0000: └ Completed in 0s 568ms
19:05:51
➤ YN0000: · Done in 1s 270ms
19:05:51 Cache download and extraction of l1-contracts-6ced485037b8e5a3.tar.gz complete in 0s.
19:05:51
--- yarn-project build ---
19:05:51 Executing: ./bootstrap.sh clean-lite (
http://ci.aztec-labs.com/af43c11c72f01932)
19:05:51 0 .
done (0s)
19:05:55 Cache download and extraction of node-modules-3b05c7a8ae1b5ee8.zst complete in 3s.
19:05:55 Executing: compile_all (
http://ci.aztec-labs.com/0881f9f2f2788ed9)
19:05:59 0 .
done (4s)
19:05:59 boxes/bootstrap.sh Executing: boxes/bootstrap.sh (
http://ci.aztec-labs.com/1e3b32445e9777a0)
19:05:59 playground/bootstrap.sh Executing: playground/bootstrap.sh (
http://ci.aztec-labs.com/fac4a307e3f56011)
19:05:59 docs/bootstrap.sh Executing: docs/bootstrap.sh (
http://ci.aztec-labs.com/b0649cee101051db)
19:05:59 release-image/bootstrap.sh Executing: release-image/bootstrap.sh (
http://ci.aztec-labs.com/fce04c4da0208fe9)
19:05:59 spartan/bootstrap.sh Executing: spartan/bootstrap.sh (
http://ci.aztec-labs.com/1a386cffb81841d1)
19:05:59 aztec-up/bootstrap.sh Executing: aztec-up/bootstrap.sh (
http://ci.aztec-labs.com/2fda89da31a6ced7)
19:06:02 aztec-up/bootstrap.sh 0 .
done (3s)
19:06:03 boxes/bootstrap.sh 0 .
done (4s)
19:06:05 playground/bootstrap.sh 0 .
done (6s)
19:06:07 docs/bootstrap.sh 0 .
done (8s)
19:06:14 spartan/bootstrap.sh 0 .
done (15s)
19:06:31 release-image/bootstrap.sh 0 .
done (32s)
19:06:31
--- test all ---
19:06:31 Waiting for TXE's to start...
19:06:34 Waiting for spartan environment to complete setup...
19:06:35 Spartan environment setup completed successfully.
19:06:35 Gathering tests to run...
19:06:36 WARNING: Noticed changes to rebuild patterns: spartan/scripts/kubectl
19:09:16 Gathered 14014 tests.
19:09:16 Starting parallel run with max 64 jobs...
19:09:16 Executing: parallel -j64 --memsuspend 64G --line-buffer --joblog joblog.txt --halt now,fail=1 'run_test_cmd {}' (
http://ci.aztec-labs.com/f7b5c2fe8a595556)
19:09:47 0 ................................................................
19:10:33 64 ................................................................
19:11:29 128 ................................................................
19:12:18 192 ................................................................
19:12:32 256 ................................................................
19:12:41 320 ................................................................
19:12:57 384 ................................................................
19:13:14 448 ................................................................
19:13:21 512 ................................................................
19:13:26 576 ................................................................
19:13:35 640 ................................................................
19:13:42 704 ................................................................
19:13:48 768 ................................................................
19:13:52 832 ................................................................
19:13:57 896 ................................................................
19:14:01 960 ................................................................
19:14:05 1024 ................................................................
19:14:08 1088 ................................................................
19:14:11 1152 ................................................................
19:14:13 1216 ................................................................
19:14:21 1280 ................................................................
19:14:24 1344 ................................................................
19:14:27 1408 ................................................................
19:14:29 1472 ................................................................
19:14:33 1536 ................................................................
19:14:35 1600 ................................................................
19:14:37 1664 ................................................................
19:14:46 1728 ................................................................
19:14:53 1792 ................................................................
19:15:03 1856 ................................................................
19:15:07 1920 ................................................................
19:15:11 1984 ................................................................
19:15:14 2048 ................................................................
19:15:15 2112 ................................................................
19:15:17 2176 ................................................................
19:15:19 2240 ................................................................
19:15:20 2304 ................................................................
19:15:22 2368 ................................................................
19:15:23 2432 ................................................................
19:15:25 2496 ................................................................
19:15:26 2560 ................................................................
19:15:28 2624 ................................................................
19:15:29 2688 ................................................................
19:15:30 2752 ................................................................
19:15:37 2816 ................................................................
19:15:44 2880 ................................................................
19:15:45 2944 ................................................................
19:15:46 3008 ................................................................
19:15:47 3072 ................................................................
19:15:48 3136 ................................................................
19:15:51 3200 ................................................................
19:16:00 3264 ................................................................
19:16:03 3328 ................................................................
19:16:05 3392 ................................................................
19:16:06 3456 ................................................................
19:16:08 3520 ................................................................
19:16:09 3584 ................................................................
19:16:11 3648 ................................................................
19:16:14 3712 ................................................................
19:16:15 3776 ................................................................
19:16:19 3840 ................................................................
19:16:20 3904 ................................................................
19:16:22 3968 ................................................................
19:16:23 4032 ................................................................
19:16:24 4096 ................................................................
19:16:25 4160 ................................................................
19:16:26 4224 ................................................................
19:16:27 4288 ................................................................
19:16:28 4352 ................................................................
19:16:29 4416 ................................................................
19:16:30 4480 ................................................................
19:16:31 4544 ................................................................
19:16:33 4608 ................................................................
19:16:34 4672 ................................................................
19:16:35 4736 ................................................................
19:16:36 4800 ................................................................
19:16:37 4864 ................................................................
19:16:38 4928 ................................................................
19:16:39 4992 ................................................................
19:16:40 5056 ................................................................
19:16:41 5120 ................................................................
19:16:41 5184 ................................................................
19:16:43 5248 ................................................................
19:16:46 5312 ................................................................
19:16:48 5376 ................................................................
19:16:50 5440 ................................................................
19:16:52 5504 ................................................................
19:16:54 5568 ................................................................
19:16:55 5632 ................................................................
19:16:56 5696 ................................................................
19:16:57 5760 ................................................................
19:16:59 5824 ................................................................
19:17:00 5888 ................................................................
19:17:02 5952 ................................................................
19:17:04 6016 ................................................................
19:17:06 6080 ................................................................
19:17:08 6144 ................................................................
19:17:09 6208 ................................................................
19:17:11 6272 ................................................................
19:17:13 6336 ................................................................
19:17:14 6400 ................................................................
19:17:15 6464 ................................................................
19:17:16 6528 ................................................................
19:17:17 6592 ................................................................
19:17:18 6656 ................................................................
19:17:20 6720 ................................................................
19:17:22 6784 ................................................................
19:17:24 6848 ................................................................
19:17:25 6912 ................................................................
19:17:27 6976 ................................................................
19:17:29 7040 ................................................................
19:17:31 7104 ................................................................
19:17:33 7168 ................................................................
19:17:35 7232 ................................................................
19:17:37 7296 ................................................................
19:17:38 7360 ................................................................
19:17:41 7424 ................................................................
19:17:43 7488 ................................................................
19:17:45 7552 ................................................................
19:17:48 7616 ................................................................
19:17:50 7680 ................................................................
19:17:52 7744 ................................................................
19:17:55 7808 ................................................................
19:17:57 7872 ................................................................
19:17:59 7936 ................................................................
19:18:01 8000 ................................................................
19:18:03 8064 ................................................................
19:18:04 8128 ................................................................
19:18:06 8192 ................................................................
19:18:08 8256 ................................................................
19:18:09 8320 ................................................................
19:18:11 8384 ................................................................
19:18:13 8448 ................................................................
19:18:14 8512 ................................................................
19:18:16 8576 ................................................................
19:18:17 8640 ................................................................
19:18:18 8704 ................................................................
19:18:19 8768 ................................................................
19:18:20 8832 ................................................................
19:18:21 8896 ................................................................
19:18:22 8960 ................................................................
19:18:23 9024 ................................................................
19:18:24 9088 ................................................................
19:18:25 9152 ................................................................
19:18:26 9216 ................................................................
19:18:27 9280 ................................................................
19:18:28 9344 ................................................................
19:18:29 9408 ................................................................
19:18:30 9472 ................................................................
19:18:31 9536 ................................................................
19:18:32 9600 ................................................................
19:18:33 9664 ................................................................
19:18:34 9728 ................................................................
19:18:35 9792 ................................................................
19:18:36 9856 ................................................................
19:18:37 9920 ................................................................
19:18:38 9984 ................................................................
19:18:39 10048 ................................................................
19:18:40 10112 ................................................................
19:18:41 10176 ................................................................
19:18:42 10240 ................................................................
19:18:44 10304 ................................................................
19:18:44 10368 ................................................................
19:18:45 10432 ................................................................
19:18:47 10496 ................................................................
19:18:48 10560 ................................................................
19:18:49 10624 ................................................................
19:18:50 10688 ................................................................
19:18:51 10752 ................................................................
19:18:52 10816 ................................................................
19:18:54 10880 ................................................................
19:18:55 10944 ................................................................
19:18:56 11008 ................................................................
19:18:57 11072 ................................................................
19:18:58 11136 ................................................................
19:18:59 11200 ................................................................
19:19:01 11264 ................................................................
19:19:02 11328 ................................................................
19:19:03 11392 ................................................................
19:19:05 11456 ................................................................
19:19:06 11520 ................................................................
19:19:07 11584 ................................................................
19:19:08 11648 ................................................................
19:19:09 11712 ................................................................
19:19:10 11776 ................................................................
19:19:11 11840 ................................................................
19:19:12 11904 ................................................................
19:19:13 11968 ................................................................
19:19:14 12032 ................................................................
19:19:15 12096 ................................................................
19:19:16 12160 ................................................................
19:19:17 12224 ................................................................
19:19:19 12288 ................................................................
19:19:20 12352 ................................................................
19:19:21 12416 ................................................................
19:19:22 12480 ................................................................
19:19:23 12544 ................................................................
19:19:23 12608 ................................................................
19:19:24 12672 ................................................................
19:19:25 12736 ................................................................
19:19:26 12800 ................................................................
19:19:27 12864 ................................................................
19:19:29 12928 ................................................................
19:19:30 12992 ................................................................
19:19:31 13056 ................................................................
19:19:32 13120 ................................................................
19:19:33 13184 ................................................................
19:19:34 13248 ................................................................
19:19:35 13312 ................................................................
19:19:36 13376 ................................................................
19:19:37 13440 ................................................................
19:19:38 13504 ................................................................
19:19:39 13568 ................................................................
19:19:40 13632 ................................................................
19:19:41 13696 ................................................................
19:19:42 13760 ................................................................
19:19:43 13824 ................................................................
19:19:44 13888 ................................................................
19:19:45 13952 ................................................................
19:19:46 14016 ................................................................
19:19:46 14080 ................................................................
19:19:47 14144 ................................................................
19:22:28 14208 .
done (792s)
19:22:28
WARNING: The following tests exceed 5 minute runtimes. Break them up or rethink them.
19:22:28 320.009: '4a6bf0e2546ff0aa:ISOLATE=1:NAME=prover-client/src/test/bb_prover_full_rollup.test.ts:CPUS=16:MEM=96g LOG_LEVEL=verbose HARDWARE_CONCURRENCY=16 yarn-project/scripts/run_test.sh prover-client/src/test/bb_prover_full_rollup.test.ts'
19:22:28 340.046: '4a6bf0e2546ff0aa:ISOLATE=1:NAME=e2e_p2p/data_withholding_slash yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/data_withholding_slash.test.ts'
19:22:28 373.967: '4a6bf0e2546ff0aa:ISOLATE=1:NAME=e2e_epochs/epochs_empty_blocks yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_empty_blocks.test.ts'
19:22:28 380.923: '4a6bf0e2546ff0aa:ISOLATE=1:NAME=e2e_epochs/epochs_long_proving_time yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_long_proving_time.test.ts'
19:22:28 387.680: '4a6bf0e2546ff0aa:ISOLATE=1:NAME=e2e_l1_with_wall_time yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_l1_with_wall_time.test.ts'
19:22:28 402.098: '4a6bf0e2546ff0aa:ISOLATE=1:NAME=e2e_p2p/slash_veto_demo yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/slash_veto_demo.test.ts'
19:22:28 403.702: '4a6bf0e2546ff0aa:ISOLATE=1:TIMEOUT=15m:NAME=e2e_block_building yarn-project/end-to-end/scripts/run_test.sh simple e2e_block_building'
19:22:28 436.710: '4a6bf0e2546ff0aa:ISOLATE=1:NAME=e2e_p2p/reex yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/reex.test.ts'
19:22:28 592.378: '4a6bf0e2546ff0aa:ISOLATE=1:TIMEOUT=15m:CPUS=16:MEM=96g:NAME=e2e_prover_full_real yarn-project/end-to-end/scripts/run_test.sh simple e2e_prover/full'
19:22:28 Completed run of 14014 tests in 792 seconds.
19:22:28
--- bench all ---
19:22:28 barretenberg/cpp Executing: barretenberg/cpp/bootstrap.sh build_bench (
http://ci.aztec-labs.com/f270b8c60ad9d718)
19:22:28 yarn-project/end-to-end Executing: yarn-project/end-to-end/bootstrap.sh build_bench (
http://ci.aztec-labs.com/d031b370e5791256)
19:22:29 barretenberg/cpp 0 .
done (1s)
19:22:30 yarn-project/end-to-end 0 .
done (2s)
19:22:31 Starting parallel run using max 64 cpus...
19:22:32 Test run log id:
http://ci.aztec-labs.com/8eb2ad8d935a9df6
19:29:22 Completed run of 102 tests in 411 seconds.
19:29:24 Completed 10.5 KiB/10.5 KiB (204.8 KiB/s) with 1 file(s) remaining
upload: ../../../tmp/tmp.3m51N3iubn to s3://aztec-ci-artifacts/build-cache/bench-5cc430b80ce91a6cc0a3ef264802ef83aec09b29.tar.gz
19:29:24 Cache upload of bench-5cc430b80ce91a6cc0a3ef264802ef83aec09b29.tar.gz complete in 1s.
19:29:25 WARNING: Noticed changes to rebuild patterns: spartan/scripts/kubectl
19:29:28 + local code=0
19:29:28 + set +x
19:29:28 dmesg log id:
http://ci.aztec-labs.com/2f1560e00ae9648e