Parent Log: http://ci.aztec-labs.com/f69a1713c602d5eb Command: bdb887914394d73a yarn-project/scripts/run_test.sh blob-sink/src/client/http.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/47c749527b1c3cce3edd9defedc46e89ea00c69e Env: REF_NAME=gh-readonly-queue/next/pr-15009-00cd67e98e76d3202a0219baf301d59ef4211872 CURRENT_VERSION=0.87.6 CI_FULL=1 Date: Fri Jun 13 15:54:22 UTC 2025 System: ARCH=amd64 CPUS=128 MEM=493Gi HOSTNAME=pr-15009_amd64_x4-full Resources: CPU_LIST=0-127 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_ed69c995f9b9d850_next 15:54:27 [15:54:27.277] INFO: blob-sink:server Server is running on http://localhost:38895 15:54:27 [15:54:27.560] INFO: blob-sink:server Received blob sidecar for block 0x1234 15:54:27 [15:54:27.562] INFO: blob-sink:server Blob sidecar stored successfully for block 0x1234 15:54:27 [15:54:27.609] INFO: blob-sink:server Stopping blob sink 15:54:27 [15:54:27.611] INFO: blob-sink:server Blob sink stopped 15:54:27 [15:54:27.614] INFO: blob-sink:server Server is running on http://localhost:37147 15:54:27 [15:54:27.665] INFO: blob-sink:server Received blob sidecar for block 0x5678 15:54:27 [15:54:27.668] INFO: blob-sink:server Blob sidecar stored successfully for block 0x5678 15:54:27 [15:54:27.767] INFO: blob-sink:server Stopping blob sink 15:54:27 [15:54:27.768] INFO: blob-sink:server Blob sink stopped 15:54:27 [15:54:27.771] INFO: blob-sink:server Server is running on http://localhost:37987 15:54:27 [15:54:27.777] WARN: blob-sink:client Unable to get blob sidecar for 0xnonexistent: Bad Request (400) {"status":400,"statusText":"Bad Request","body":"{\"error\":\"Invalid block_id parameter\"}"} 15:54:27 [15:54:27.778] WARN: blob-sink:client Failed to fetch blobs for 0xnonexistent from all blob sources {"blobSinkUrl":"http://localhost:37987"} 15:54:27 [15:54:27.779] INFO: blob-sink:server Stopping blob sink 15:54:27 [15:54:27.779] INFO: blob-sink:server Blob sink stopped 15:54:27 [15:54:27.781] INFO: blob-sink:server Server is running on http://localhost:41533 15:54:32 [15:54:32.876] WARN: blob-sink:client Blob sink url configured, but unable to send blobs {"blobSinkUrl":"http://localhost:12345","blockHash":"0x1234"} 15:54:37 [15:54:37.895] WARN: blob-sink:client Error getting blob sidecar from http://localhost:12345: fetch failed 15:54:37 [15:54:37.895] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"blobSinkUrl":"http://localhost:12345"} 15:54:37 [15:54:37.896] INFO: blob-sink:server Stopping blob sink 15:54:37 [15:54:37.897] INFO: blob-sink:server Blob sink stopped 15:54:37 [15:54:37.900] INFO: blob-sink:server Server is running on http://localhost:33787 15:54:37 [15:54:37.938] INFO: blob-sink:server Server is running on http://localhost:34513 15:54:37 [15:54:37.949] INFO: blob-sink:server Received blob sidecar for block 0x1234 15:54:37 [15:54:37.955] INFO: blob-sink:server Blob sidecar stored successfully for block 0x1234 15:54:39 [15:54:39.813] INFO: blob-sink:server Stopping blob sink 15:54:39 [15:54:39.814] INFO: blob-sink:server Blob sink stopped 15:54:39 [15:54:39.815] INFO: blob-sink:server Stopping blob sink 15:54:39 [15:54:39.815] INFO: blob-sink:server Blob sink stopped 15:54:39 [15:54:39.817] INFO: blob-sink:server Server is running on http://localhost:46745 15:54:41 [15:54:41.356] INFO: blob-sink:server Stopping blob sink 15:54:41 [15:54:41.358] INFO: blob-sink:server Blob sink already stopped 15:54:41 [15:54:41.359] INFO: blob-sink:server Stopping blob sink 15:54:41 [15:54:41.359] INFO: blob-sink:server Blob sink stopped 15:54:41 [15:54:41.364] INFO: blob-sink:server Server is running on http://localhost:36877 15:54:46 [15:54:46.500] ERROR: blob-sink:client Error getting slot number: TypeError: Failed to parse URL from invalidURL/eth/v1/beacon/headers/0x1234 15:54:46 at node:internal/deps/undici/undici:13510:13 { 15:54:46 [cause]: TypeError: Invalid URL 15:54:46 at new URL (node:internal/url:818:25) 15:54:46 at new Request (node:internal/deps/undici/undici:9586:25) 15:54:46 at fetch (node:internal/deps/undici/undici:10315:25) 15:54:46 at fetch (node:internal/deps/undici/undici:13508:10) 15:54:46 at fetch (node:internal/bootstrap/web/exposed-window-or-worker:75:12) 15:54:46 at fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:34:15) 15:54:46 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:26) 15:54:46 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 15:54:46 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 15:54:46 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 15:54:46 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:224:30) { 15:54:46 code: 'ERR_INVALID_URL', 15:54:46 input: 'invalidURL/eth/v1/beacon/headers/0x1234' 15:54:46 } 15:54:46 } 15:54:51 [15:54:51.512] WARN: blob-sink:client Error getting blob sidecar from invalidURL: Failed to parse URL from invalidURL/eth/v1/beacon/blob_sidecars/2 15:54:53 [15:54:53.157] INFO: blob-sink:server Stopping blob sink 15:54:53 [15:54:53.159] INFO: blob-sink:server Blob sink already stopped 15:54:53 [15:54:53.160] INFO: blob-sink:server Stopping blob sink 15:54:53 [15:54:53.161] INFO: blob-sink:server Blob sink stopped 15:54:53 [15:54:53.165] INFO: blob-sink:server Server is running on http://localhost:33453 15:54:54 [15:54:54.670] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:43247"]} 15:54:54 [15:54:54.676] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:43247"]} 15:54:54 [15:54:54.677] INFO: blob-sink:server Stopping blob sink 15:54:54 [15:54:54.677] INFO: blob-sink:server Blob sink already stopped 15:54:54 [15:54:54.678] INFO: blob-sink:server Stopping blob sink 15:54:54 [15:54:54.678] INFO: blob-sink:server Blob sink stopped 15:54:54 [15:54:54.680] INFO: blob-sink:server Server is running on http://localhost:44165 15:54:56 [15:54:56.356] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:33443"]} 15:54:56 [15:54:56.361] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:33443"]} 15:54:56 [15:54:56.362] INFO: blob-sink:server Stopping blob sink 15:54:56 [15:54:56.363] INFO: blob-sink:server Blob sink already stopped 15:54:56 [15:54:56.363] INFO: blob-sink:server Stopping blob sink 15:54:56 [15:54:56.363] INFO: blob-sink:server Blob sink stopped 15:54:56 [15:54:56.366] INFO: blob-sink:server Server is running on http://localhost:36939 15:55:03 [15:55:03.072] ERROR: blob-sink:client Error getting slot number: TypeError: fetch failed 15:55:03 at node:internal/deps/undici/undici:13510:13 15:55:03 at processTicksAndRejections (node:internal/process/task_queues:105:5) 15:55:03 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:20) 15:55:03 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 15:55:03 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 15:55:03 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 15:55:03 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:336:24) { 15:55:03 [cause]: AggregateError: 15:55:03 at internalConnectMultiple (node:net:1139:18) 15:55:03 at afterConnectMultiple (node:net:1714:7) { 15:55:03 code: 'ECONNREFUSED', 15:55:03 [errors]: [ [Error], [Error] ] 15:55:03 } 15:55:03 } 15:55:08 [15:55:08.256] WARN: blob-sink:client Error getting blob sidecar from http://localhost:45455: fetch failed 15:55:14 [15:55:14.678] ERROR: blob-sink:client Error getting slot number: TypeError: fetch failed 15:55:14 at node:internal/deps/undici/undici:13510:13 15:55:14 at processTicksAndRejections (node:internal/process/task_queues:105:5) 15:55:14 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:20) 15:55:14 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 15:55:14 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 15:55:14 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 15:55:14 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:352:24) { 15:55:14 [cause]: AggregateError: 15:55:14 at internalConnectMultiple (node:net:1139:18) 15:55:14 at afterConnectMultiple (node:net:1714:7) { 15:55:14 code: 'ECONNREFUSED', 15:55:14 [errors]: [ [Error], [Error] ] 15:55:14 } 15:55:14 } 15:55:19 [15:55:19.689] ERROR: blob-sink:client Error getting slot number: TypeError: fetch failed 15:55:19 at node:internal/deps/undici/undici:13510:13 15:55:19 at processTicksAndRejections (node:internal/process/task_queues:105:5) 15:55:19 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:20) 15:55:19 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 15:55:19 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 15:55:19 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 15:55:19 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:352:24) { 15:55:19 [cause]: AggregateError: 15:55:19 at internalConnectMultiple (node:net:1139:18) 15:55:19 at afterConnectMultiple (node:net:1714:7) { 15:55:19 code: 'ECONNREFUSED', 15:55:19 [errors]: [ [Error], [Error] ] 15:55:19 } 15:55:19 } 15:55:24 [15:55:24.806] WARN: blob-sink:client Error getting blob sidecar from http://localhost:45455: fetch failed 15:55:29 [15:55:29.853] WARN: blob-sink:client Error getting blob sidecar from http://localhost:38159: fetch failed 15:55:31 [15:55:31.340] INFO: blob-sink:server Stopping blob sink 15:55:31 [15:55:31.340] INFO: blob-sink:server Blob sink already stopped 15:55:31 [15:55:31.341] INFO: blob-sink:server Stopping blob sink 15:55:31 [15:55:31.341] INFO: blob-sink:server Blob sink stopped 15:55:31 [15:55:31.343] INFO: blob-sink:server Server is running on http://localhost:33507 15:55:31 [15:55:31.399] WARN: blob-sink:client Failed to deserialise blob {"commitment":"0x9538068c345bebb3c3600cfc2f73efe7105331af5f172f986a22e4633bb41abb8e5600c4d8b4678a7c51e71b31f82959"} 15:55:32 [15:55:32.962] INFO: blob-sink:server Stopping blob sink 15:55:32 [15:55:32.963] INFO: blob-sink:server Blob sink already stopped 15:55:32 [15:55:32.963] INFO: blob-sink:server Stopping blob sink 15:55:32 [15:55:32.964] INFO: blob-sink:server Blob sink stopped 15:55:32 [15:55:32.966] INFO: blob-sink:server Server is running on http://localhost:35051 15:55:34 [15:55:34.390] INFO: blob-sink:server Stopping blob sink 15:55:34 [15:55:34.391] INFO: blob-sink:server Blob sink already stopped 15:55:34 [15:55:34.392] INFO: blob-sink:server Stopping blob sink 15:55:34 [15:55:34.392] INFO: blob-sink:server Blob sink stopped 15:55:34 [15:55:34.395] INFO: blob-sink:server Server is running on http://localhost:34579 15:55:35 [15:55:35.842] INFO: blob-sink:server Stopping blob sink 15:55:35 [15:55:35.842] INFO: blob-sink:server Blob sink already stopped 15:55:35 [15:55:35.843] INFO: blob-sink:server Stopping blob sink 15:55:35 [15:55:35.843] INFO: blob-sink:server Blob sink stopped 15:55:35 PASS src/client/http.test.ts (72.064 s) 15:55:35 HttpBlobSinkClient 15:55:35 should send and retrieve blobs (343 ms) 15:55:35 should handle multiple blobs (156 ms) 15:55:35 should return empty array for non-existent block (11 ms) 15:55:35 should handle server connection errors gracefully (10117 ms) 15:55:35 Mock Ethereum Clients 15:55:35 should handle no consensus host (1917 ms) 15:55:35 should request based on slot where consensus host is provided (1544 ms) 15:55:35 should handle when multiple consensus hosts are provided (11799 ms) 15:55:35 should handle API keys without headers (1517 ms) 15:55:35 should handle API keys in headers (1685 ms) 15:55:35 should handle multiple consensus hosts with different API key methods (34977 ms) 15:55:35 even if we ask for non-encoded blobs, we should only get encoded blobs (1622 ms) 15:55:35 should handle L1 missed slots (1427 ms) 15:55:35 should fall back to archive client (1450 ms) 15:55:35 15:55:35 Test Suites: 1 passed, 1 total 15:55:35 Tests: 13 passed, 13 total 15:55:35 Snapshots: 0 total 15:55:35 Time: 72.152 s 15:55:35 Ran all test suites matching /blob-sink\/src\/client\/http.test.ts/i. 15:55:35 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?