Parent Log:
http://ci.aztec-labs.com/2752a41a93339468
19:02:13 + echo 'env: REF_NAME=gh-readonly-queue/next/pr-16345-6c594c42a60c5304c8aa1f8a2e376f42d4a72b1b COMMIT_HASH=5cc430b80ce91a6cc0a3ef264802ef83aec09b29 CURRENT_VERSION=1.2.1 TARGET_BRANCH=next'
19:02:13 env: REF_NAME=gh-readonly-queue/next/pr-16345-6c594c42a60c5304c8aa1f8a2e376f42d4a72b1b COMMIT_HASH=5cc430b80ce91a6cc0a3ef264802ef83aec09b29 CURRENT_VERSION=1.2.1 TARGET_BRANCH=next
19:02:13 + semver check gh-readonly-queue/next/pr-16345-6c594c42a60c5304c8aa1f8a2e376f42d4a72b1b
19:02:13 + cpu_pid=410
19:02:13 + mpstat 2
19:02:13 + mem_pid=411
19:02:13 + set +e
19:02:13 + set -x
19:02:13 + ./bootstrap.sh ci-full
19:02:13 + vmstat -w -S M 2
19:02:13 ++ cache_log cpufile
19:02:13 ++ cache_log memfile
19:02:13 cpufile log id:
http://ci.aztec-labs.com/361781897342ffb7
19:02:13 memfile log id:
http://ci.aztec-labs.com/18ea27dc2e466730
19:02:20
--- pull submodules ---
19:02:20 Executing: git submodule update --init --recursive (
http://ci.aztec-labs.com/cb00a174a18cd549)
19:02:28 0 .
done (8s)
19:02:31
--- noir build ---
19:02:31 Executing: retry install_deps (
http://ci.aztec-labs.com/5a392174079a12c2)
19:02:36 0 .
done (5s)
19:02:36 build_native Executing: build_native (
http://ci.aztec-labs.com/05c923c2057f8584)
19:02:36 build_packages Executing: build_packages (
http://ci.aztec-labs.com/838e40c3cd700570)
19:02:37 build_native 0 .
done (1s)
19:02:41 build_packages 0 .
done (5s)
19:02:42
--- bb cpp build ---
19:02:43 build_native Executing: build_native (
http://ci.aztec-labs.com/e7456cff0f977dd0)
19:02:43 build_wasm Executing: build_wasm (
http://ci.aztec-labs.com/0cc5add0b946ec36)
19:02:43 build_wasm_threads Executing: build_wasm_threads (
http://ci.aztec-labs.com/f4b45cf94ad955dd)
19:02:43 build_nodejs_module Executing: build_nodejs_module (
http://ci.aztec-labs.com/884728e2bf2457bb)
19:02:43 build_gcc_syntax_check_only Executing: build_gcc_syntax_check_only (
http://ci.aztec-labs.com/64bcc003e86f53b6)
19:02:43 build_fuzzing_syntax_check_only Executing: build_fuzzing_syntax_check_only (
http://ci.aztec-labs.com/537147c771500ef0)
19:02:43 build_asan_fast Executing: build_asan_fast (
http://ci.aztec-labs.com/87133881f0253555)
19:02:43 build_darwin Executing: build_darwin (
http://ci.aztec-labs.com/cd6bf65b8763ea10)
19:02:43 build_gcc_syntax_check_only 0 .
done (0s)
19:02:43 build_fuzzing_syntax_check_only 0 .
done (0s)
19:02:43 build_wasm_threads 0 .
done (0s)
19:02:43 build_darwin 0 .
done (0s)
19:02:43 build_wasm 0 .
done (0s)
19:02:43 build_nodejs_module 0 .
done (0s)
19:02:44 build_native 0 .
done (1s)
19:02:45 build_asan_fast 0 .
done (1s)
19:02:50
--- bb.js build ---
19:02:51 Cache download and extraction of node-modules-55762ef1223e7c5b.zst complete in 0s.
19:02:51 Cache download and extraction of bb.js-29265a024affeb1c.tar.gz complete in 0s.
19:02:53
--- acir_tests build ---
19:02:53 Cache download and extraction of barretenberg-acir-tests-3cc59e386a4329d0.tar.gz complete in 0s.
19:02:54 Cache download and extraction of node-modules-fec19dc5fe5a76d5.zst complete in 1s.
19:02:54 bbjs-test Executing: yarn build (
http://ci.aztec-labs.com/400901ecd0801da1)
19:02:54 browser-test-app Executing: yarn build (
http://ci.aztec-labs.com/80c77c4e1a0d2bba)
19:02:57 bbjs-test 0 .
done (3s)
19:02:58 browser-test-app 0 .
done (4s)
19:02:59 hash=3a78993a7cbadbe3
19:02:59
--- build bb docs ---
19:03:00 Cache download and extraction of bb-docs-3a78993a7cbadbe3.tar.gz complete in 1s.
19:03:00 Skipping deployment - no bb doc changes compared to cache.
19:03:00
--- barretenberg/sol building ---
19:03:00 Generating keys for add2 circuit (mem: 5.00 MiB)
19:03:00 VK contract written to: ./src/honk/keys/Add2HonkVerificationKey.sol (mem: 136.00 MiB)
19:03:00 Generating keys for blake circuit (mem: 5.00 MiB)
19:03:00 VK contract written to: ./src/honk/keys/BlakeHonkVerificationKey.sol (mem: 148.82 MiB)
19:03:00 Generating keys for ecdsa circuit (mem: 5.00 MiB)
19:03:00 (Experimental) WARNING: Builder failure when we have real witnesses! (mem: 6.00 MiB)
19:03:01 VK contract written to: ./src/honk/keys/EcdsaHonkVerificationKey.sol (mem: 193.75 MiB)
19:03:01 Generating keys for recursive circuit (mem: 5.00 MiB)
19:03:03 VK contract written to: ./src/honk/keys/RecursiveHonkVerificationKey.sol (mem: 1513.73 MiB)
19:03:03
--- barretenberg/sol building sol ---
19:03:03 Cache download and extraction of barretenberg-sol-88635bb82c19b066.zst complete in 0s.
19:03:04
--- avm-transpiler build ---
19:03:04 Cache download and extraction of avm-transpiler-c5cff37a532edbec.tar.gz complete in 0s.
19:03:04
--- noir-projects build ---
19:03:04 Executing: prep (
http://ci.aztec-labs.com/1969bae4ed8692ae)
19:03:06 0 .
done (2s)
19:03:07 mock-protocol-circuits Executing: ./mock-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/adca12027c7272a1)
19:03:07 noir-protocol-circuits Executing: ./noir-protocol-circuits/bootstrap.sh (
http://ci.aztec-labs.com/5cda24c27144b5e8)
19:03:07 noir-contracts Executing: ./noir-contracts/bootstrap.sh (
http://ci.aztec-labs.com/659520fa717dcc35)
19:03:07 aztec-nr Executing: ./aztec-nr/bootstrap.sh (
http://ci.aztec-labs.com/4514c043ca5c1fc1)
19:03:08 noir-contracts 0 ................................................................
19:03:08 noir-contracts 64 ................................................................
19:03:08 noir-contracts 128 ................................................................
19:03:08 noir-contracts 192 ................................................................
19:03:09 noir-contracts 256 ................................................................
19:03:09 noir-contracts 320 ................................................................
19:03:09 noir-contracts 384 ................................................................
19:03:09 noir-contracts 448 ................................................................
19:03:09 noir-contracts 512 ................................................................
19:03:09 noir-contracts 576 ................................................................
19:03:10 noir-contracts 640 ................................................................
19:03:10 noir-contracts 704 ................................................................
19:03:10 noir-contracts 768 ................................................................
19:03:10 noir-contracts 832 ................................................................
19:03:10 noir-contracts 896 ................................................................
19:03:11 noir-contracts 960 ................................................................
19:03:11 noir-contracts 1024 ................................................................
19:03:11 noir-contracts 1088 ................................................................
19:03:11 noir-contracts 1152 ................................................................
19:03:11 noir-contracts 1216 ................................................................
19:03:12 aztec-nr 0 .
done (4s)
19:03:12 noir-contracts 1280 ................................................................
19:03:12 noir-contracts 1344 ................................................................
19:03:12 noir-contracts 1408 ................................................................
19:03:12 noir-protocol-circuits 0 ................................................................
19:03:12 noir-protocol-circuits 64 ................................................................
19:03:12 noir-contracts 1472 ................................................................
19:03:12 noir-contracts 1536 .
done (5s)
19:03:12 noir-protocol-circuits 128 ................................................................
19:03:13 noir-protocol-circuits 192 ................................................................
19:03:13 noir-protocol-circuits 256 ................................................................
19:03:13 mock-protocol-circuits 0 ................................................................
19:03:14 noir-protocol-circuits 320 ................................................................
19:03:14 noir-protocol-circuits 384 ................................................................
19:03:15 noir-protocol-circuits 448 ................................................................
19:03:17 mock-protocol-circuits 64 ................................................................
19:05:25 mock-protocol-circuits 128 .
done (138s)
19:05:26 noir-protocol-circuits 512 ................................................................
19:05:26 noir-protocol-circuits 576 ................................................................
19:05:26 noir-protocol-circuits 640 .
done (139s)
19:05:27
--- l1-contracts build ---
19:05:27
➤ YN0000: ·
Yarn 4.5.2
19:05:27
➤ YN0000: ┌ Resolution step
19:05:27
➤ YN0000: └ Completed
19:05:27
➤ YN0000: ┌ Fetch step
19:05:28
➤ YN0013: │
134 packages were added to the project (
+ 44.9 MiB).
19:05:28
➤ YN0000: └ Completed in 0s 658ms
19:05:28
➤ YN0000: ┌ Link step
19:05:28
➤ YN0000: └ Completed in 0s 573ms
19:05:28
➤ YN0000: · Done in 1s 281ms
19:05:29 Cache download and extraction of l1-contracts-6ced485037b8e5a3.tar.gz complete in 1s.
19:05:29
--- yarn-project build ---
19:05:29 Executing: ./bootstrap.sh clean-lite (
http://ci.aztec-labs.com/3b3ac939199558fd)
19:05:29 0 .
done (0s)
19:05:33 Cache download and extraction of node-modules-3b05c7a8ae1b5ee8.zst complete in 4s.
19:05:33 Executing: compile_all (
http://ci.aztec-labs.com/cd9ad9f55132647c)
19:05:37 0 .
done (4s)
19:05:37 boxes/bootstrap.sh Executing: boxes/bootstrap.sh (
http://ci.aztec-labs.com/57a4dc59cbdd275b)
19:05:37 playground/bootstrap.sh Executing: playground/bootstrap.sh (
http://ci.aztec-labs.com/7cca78920cc8c11e)
19:05:37 docs/bootstrap.sh Executing: docs/bootstrap.sh (
http://ci.aztec-labs.com/5a6233874f701bc8)
19:05:37 release-image/bootstrap.sh Executing: release-image/bootstrap.sh (
http://ci.aztec-labs.com/c98646c93b5d8ab3)
19:05:37 spartan/bootstrap.sh Executing: spartan/bootstrap.sh (
http://ci.aztec-labs.com/2bda3ede9757121e)
19:05:37 aztec-up/bootstrap.sh Executing: aztec-up/bootstrap.sh (
http://ci.aztec-labs.com/82d93d57a5695f2d)
19:05:39 aztec-up/bootstrap.sh 0 .
done (2s)
19:05:40 boxes/bootstrap.sh 0 .
done (3s)
19:05:42 playground/bootstrap.sh 0 .
done (5s)
19:05:44 docs/bootstrap.sh 0 .
done (7s)
19:05:48 spartan/bootstrap.sh 0 .
done (11s)
19:06:09 release-image/bootstrap.sh 0 .
done (32s)
19:06:09
--- test all ---
19:06:09 Waiting for TXE's to start...
19:06:12 Waiting for spartan environment to complete setup...
19:06:13 Spartan environment setup completed successfully.
19:06:13 Gathering tests to run...
19:06:13 WARNING: Noticed changes to rebuild patterns: spartan/scripts/kubectl
19:08:21 Gathered 14014 tests.
19:08:21 Starting parallel run with max 64 jobs...
19:08:21 Executing: parallel -j64 --memsuspend 64G --line-buffer --joblog joblog.txt --halt now,fail=1 'run_test_cmd {}' (
http://ci.aztec-labs.com/3a7294721f0be6ff)
19:08:52 0 ................................................................
19:09:39 64 ................................................................
19:10:34 128 ................................................................
19:11:21 192 ................................................................
19:11:37 256 ................................................................
19:11:45 320 ................................................................
19:12:04 384 ................................................................
19:12:18 448 ................................................................
19:12:25 512 ................................................................
19:12:30 576 ................................................................
19:12:39 640 ................................................................
19:12:46 704 ................................................................
19:12:52 768 ................................................................
19:12:56 832 ................................................................
19:13:01 896 ................................................................
19:13:05 960 ................................................................
19:13:09 1024 ................................................................
19:13:12 1088 ................................................................
19:13:15 1152 ................................................................
19:13:17 1216 ................................................................
19:13:25 1280 ................................................................
19:13:29 1344 ................................................................
19:13:31 1408 ................................................................
19:13:33 1472 ................................................................
19:13:36 1536 ................................................................
19:13:39 1600 ................................................................
19:13:41 1664 ................................................................
19:13:49 1728 ................................................................
19:13:59 1792 ................................................................
19:14:07 1856 ................................................................
19:14:11 1920 ................................................................
19:14:14 1984 ................................................................
19:14:17 2048 ................................................................
19:14:19 2112 ................................................................
19:14:20 2176 ................................................................
19:14:22 2240 ................................................................
19:14:24 2304 ................................................................
19:14:26 2368 ................................................................
19:14:27 2432 ................................................................
19:14:29 2496 ................................................................
19:14:31 2560 ................................................................
19:14:32 2624 ................................................................
19:14:33 2688 ................................................................
19:14:34 2752 ................................................................
19:14:41 2816 ................................................................
19:14:47 2880 ................................................................
19:14:49 2944 ................................................................
19:14:50 3008 ................................................................
19:14:51 3072 ................................................................
19:14:53 3136 ................................................................
19:14:55 3200 ................................................................
19:15:04 3264 ................................................................
19:15:07 3328 ................................................................
19:15:09 3392 ................................................................
19:15:11 3456 ................................................................
19:15:12 3520 ................................................................
19:15:13 3584 ................................................................
19:15:15 3648 ................................................................
19:15:17 3712 ................................................................
19:15:19 3776 ................................................................
19:15:23 3840 ................................................................
19:15:24 3904 ................................................................
19:15:25 3968 ................................................................
19:15:26 4032 ................................................................
19:15:27 4096 ................................................................
19:15:28 4160 ................................................................
19:15:29 4224 ................................................................
19:15:30 4288 ................................................................
19:15:32 4352 ................................................................
19:15:33 4416 ................................................................
19:15:34 4480 ................................................................
19:15:35 4544 ................................................................
19:15:36 4608 ................................................................
19:15:37 4672 ................................................................
19:15:39 4736 ................................................................
19:15:40 4800 ................................................................
19:15:41 4864 ................................................................
19:15:42 4928 ................................................................
19:15:43 4992 ................................................................
19:15:44 5056 ................................................................
19:15:46 5120 ................................................................
19:15:47 5184 ................................................................
19:15:49 5248 ................................................................
19:15:52 5312 ................................................................
19:15:54 5376 ................................................................
19:15:56 5440 ................................................................
19:15:58 5504 ................................................................
19:16:00 5568 ................................................................
19:16:01 5632 ................................................................
19:16:02 5696 ................................................................
19:16:04 5760 ................................................................
19:16:05 5824 ................................................................
19:16:07 5888 ................................................................
19:16:09 5952 ................................................................
19:16:11 6016 ................................................................
19:16:13 6080 ................................................................
19:16:15 6144 ................................................................
19:16:16 6208 ................................................................
19:16:18 6272 ................................................................
19:16:20 6336 ................................................................
19:16:21 6400 ................................................................
19:16:22 6464 ................................................................
19:16:23 6528 ................................................................
19:16:25 6592 ................................................................
19:16:26 6656 ................................................................
19:16:28 6720 ................................................................
19:16:30 6784 ................................................................
19:16:31 6848 ................................................................
19:16:33 6912 ................................................................
19:16:35 6976 ................................................................
19:16:36 7040 ................................................................
19:16:39 7104 ................................................................
19:16:40 7168 ................................................................
19:16:43 7232 ................................................................
19:16:44 7296 ................................................................
19:16:47 7360 ................................................................
19:16:50 7424 ................................................................
19:16:52 7488 ................................................................
19:16:54 7552 ................................................................
19:16:56 7616 ................................................................
19:16:58 7680 ................................................................
19:17:01 7744 ................................................................
19:17:02 7808 ................................................................
19:17:05 7872 ................................................................
19:17:07 7936 ................................................................
19:17:09 8000 ................................................................
19:17:10 8064 ................................................................
19:17:12 8128 ................................................................
19:17:14 8192 ................................................................
19:17:15 8256 ................................................................
19:17:17 8320 ................................................................
19:17:19 8384 ................................................................
19:17:20 8448 ................................................................
19:17:22 8512 ................................................................
19:17:24 8576 ................................................................
19:17:24 8640 ................................................................
19:17:25 8704 ................................................................
19:17:26 8768 ................................................................
19:17:28 8832 ................................................................
19:17:29 8896 ................................................................
19:17:30 8960 ................................................................
19:17:31 9024 ................................................................
19:17:32 9088 ................................................................
19:17:33 9152 ................................................................
19:17:34 9216 ................................................................
19:17:35 9280 ................................................................
19:17:37 9344 ................................................................
19:17:38 9408 ................................................................
19:17:39 9472 ................................................................
19:17:40 9536 ................................................................
19:17:41 9600 ................................................................
19:17:42 9664 ................................................................
19:17:43 9728 ................................................................
19:17:44 9792 ................................................................
19:17:45 9856 ................................................................
19:17:46 9920 ................................................................
19:17:47 9984 ................................................................
19:17:48 10048 ................................................................
19:17:49 10112 ................................................................
19:17:50 10176 ................................................................
19:17:52 10240 ................................................................
19:17:53 10304 ................................................................
19:17:54 10368 ................................................................
19:17:55 10432 ................................................................
19:17:56 10496 ................................................................
19:17:57 10560 ................................................................
19:17:58 10624 ................................................................
19:18:00 10688 ................................................................
19:18:01 10752 ................................................................
19:18:02 10816 ................................................................
19:18:03 10880 ................................................................
19:18:04 10944 ................................................................
19:18:06 11008 ................................................................
19:18:07 11072 ................................................................
19:18:08 11136 ................................................................
19:18:09 11200 ................................................................
19:18:11 11264 ................................................................
19:18:12 11328 ................................................................
19:18:13 11392 ................................................................
19:18:15 11456 ................................................................
19:18:16 11520 ................................................................
19:18:17 11584 ................................................................
19:18:18 11648 ................................................................
19:18:19 11712 ................................................................
19:18:20 11776 ................................................................
19:18:21 11840 ................................................................
19:18:21 11904 ................................................................
19:18:22 11968 ................................................................
19:18:23 12032 ................................................................
19:18:24 12096 ................................................................
19:18:26 12160 ................................................................
19:18:27 12224 ................................................................
19:18:28 12288 ................................................................
19:18:29 12352 ................................................................
19:18:31 12416 ................................................................
19:18:32 12480 ................................................................
19:18:33 12544 ................................................................
19:18:33 12608 ................................................................
19:18:34 12672 ................................................................
19:18:35 12736 ................................................................
19:18:36 12800 ................................................................
19:18:38 12864 ................................................................
19:18:39 12928 ................................................................
19:18:40 12992 ................................................................
19:18:41 13056 ................................................................
19:18:42 13120 ................................................................
19:18:43 13184 ................................................................
19:18:44 13248 ................................................................
19:18:45 13312 ................................................................
19:18:46 13376 ................................................................
19:18:47 13440 ................................................................
19:18:48 13504 ................................................................
19:18:49 13568 ................................................................
19:18:50 13632 ................................................................
19:18:51 13696 ................................................................
19:18:52 13760 ................................................................
19:18:53 13824 ................................................................
19:18:54 13888 ................................................................
19:18:55 13952 ................................................................
19:18:55 14016 ................................................................
19:18:56 14080 ................................................................
19:18:57 14144 ................................................................
19:21:34 14208 .
done (793s)
19:21:34
WARNING: The following tests exceed 5 minute runtimes. Break them up or rethink them.
19:21:34 300.822: '4a6bf0e2546ff0aa:ISOLATE=1:NAME=e2e_p2p/validators_sentinel yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/validators_sentinel.test.ts'
19:21:34 311.464: '4a6bf0e2546ff0aa:ISOLATE=1:NAME=prover-client/src/test/bb_prover_full_rollup.test.ts:CPUS=16:MEM=96g LOG_LEVEL=verbose HARDWARE_CONCURRENCY=16 yarn-project/scripts/run_test.sh prover-client/src/test/bb_prover_full_rollup.test.ts'
19:21:34 320.707: '5bced18400ad3fa7 barretenberg/cpp/scripts/run_test.sh dsl_tests AcirAvm2RecursionConstraint.TestGenerateVKFromConstraintsWithoutWitness'
19:21:34 339.499: '4a6bf0e2546ff0aa:ISOLATE=1:NAME=e2e_p2p/data_withholding_slash yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/data_withholding_slash.test.ts'
19:21:34 373.663: '4a6bf0e2546ff0aa:ISOLATE=1:NAME=e2e_epochs/epochs_empty_blocks yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_empty_blocks.test.ts'
19:21:34 380.829: '4a6bf0e2546ff0aa:ISOLATE=1:NAME=e2e_epochs/epochs_long_proving_time yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_epochs/epochs_long_proving_time.test.ts'
19:21:34 383.137: '4a6bf0e2546ff0aa:ISOLATE=1:NAME=e2e_l1_with_wall_time yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_l1_with_wall_time.test.ts'
19:21:34 399.905: '4a6bf0e2546ff0aa:ISOLATE=1:TIMEOUT=15m:NAME=e2e_block_building yarn-project/end-to-end/scripts/run_test.sh simple e2e_block_building'
19:21:34 402.332: '4a6bf0e2546ff0aa:ISOLATE=1:NAME=e2e_p2p/slash_veto_demo yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/slash_veto_demo.test.ts'
19:21:34 436.909: '4a6bf0e2546ff0aa:ISOLATE=1:NAME=e2e_p2p/reex yarn-project/end-to-end/scripts/run_test.sh simple src/e2e_p2p/reex.test.ts'
19:21:34 581.322: '4a6bf0e2546ff0aa:ISOLATE=1:TIMEOUT=15m:CPUS=16:MEM=96g:NAME=e2e_prover_full_real yarn-project/end-to-end/scripts/run_test.sh simple e2e_prover/full'
19:21:34 Completed run of 14014 tests in 793 seconds.
19:21:34
--- bench all ---
19:21:35 barretenberg/cpp Executing: barretenberg/cpp/bootstrap.sh build_bench (
http://ci.aztec-labs.com/39b3278a60c88adc)
19:21:35 yarn-project/end-to-end Executing: yarn-project/end-to-end/bootstrap.sh build_bench (
http://ci.aztec-labs.com/22cafc23a76b3920)
19:21:35 barretenberg/cpp 0 .
done (0s)
19:21:36 yarn-project/end-to-end 0 .
done (1s)
19:21:37 Starting parallel run using max 64 cpus...
19:21:38 Test run log id:
http://ci.aztec-labs.com/3c352b03dac8a08a
19:28:27 Completed run of 102 tests in 410 seconds.
19:28:30 Completed 10.5 KiB/10.5 KiB (183.8 KiB/s) with 1 file(s) remaining
upload: ../../../tmp/tmp.McarGTyQDN to s3://aztec-ci-artifacts/build-cache/bench-5cc430b80ce91a6cc0a3ef264802ef83aec09b29.tar.gz
19:28:30 Cache upload of bench-5cc430b80ce91a6cc0a3ef264802ef83aec09b29.tar.gz complete in 1s.
19:28:30 WARNING: Noticed changes to rebuild patterns: spartan/scripts/kubectl
19:28:33 + local code=0
19:28:33 + set +x
19:28:33 dmesg log id:
http://ci.aztec-labs.com/a6da19c94edeabcf