Parent Log: http://ci.aztec-labs.com/9b7174caf3ef97da Command: 816a8a0e28c14627 yarn-project/scripts/run_test.sh blob-sink/src/client/http.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/7d223783d91db15002a09abc1b52d1455eb3e3da Env: REF_NAME=gh-readonly-queue/next/pr-14161-97080f178c0a3e244c64b3c17bf255bed63fc3cf CURRENT_VERSION=0.87.6 CI_FULL=1 Date: Mon Jun 16 10:39:55 UTC 2025 System: ARCH=amd64 CPUS=128 MEM=493Gi HOSTNAME=pr-14161_amd64_x3-full Resources: CPU_LIST=0-127 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_ed69c995f9b9d850_next 10:40:00 [10:40:00.513] INFO: blob-sink:server Server is running on http://localhost:44969 10:40:00 [10:40:00.856] INFO: blob-sink:server Received blob sidecar for block 0x1234 10:40:00 [10:40:00.859] INFO: blob-sink:server Blob sidecar stored successfully for block 0x1234 10:40:00 [10:40:00.914] INFO: blob-sink:server Stopping blob sink 10:40:00 [10:40:00.915] INFO: blob-sink:server Blob sink stopped 10:40:00 [10:40:00.920] INFO: blob-sink:server Server is running on http://localhost:33327 10:40:00 [10:40:00.970] INFO: blob-sink:server Received blob sidecar for block 0x5678 10:40:00 [10:40:00.974] INFO: blob-sink:server Blob sidecar stored successfully for block 0x5678 10:40:01 [10:40:01.129] INFO: blob-sink:server Stopping blob sink 10:40:01 [10:40:01.131] INFO: blob-sink:server Blob sink stopped 10:40:01 [10:40:01.139] INFO: blob-sink:server Server is running on http://localhost:36819 10:40:01 [10:40:01.157] WARN: blob-sink:client Unable to get blob sidecar for 0xnonexistent: Bad Request (400) {"status":400,"statusText":"Bad Request","body":"{\"error\":\"Invalid block_id parameter\"}"} 10:40:01 [10:40:01.162] WARN: blob-sink:client Failed to fetch blobs for 0xnonexistent from all blob sources {"blobSinkUrl":"http://localhost:36819"} 10:40:01 [10:40:01.165] INFO: blob-sink:server Stopping blob sink 10:40:01 [10:40:01.170] INFO: blob-sink:server Blob sink stopped 10:40:01 [10:40:01.172] INFO: blob-sink:server Server is running on http://localhost:33757 10:40:06 [10:40:06.220] WARN: blob-sink:client Blob sink url configured, but unable to send blobs {"blobSinkUrl":"http://localhost:12345","blockHash":"0x1234"} 10:40:11 [10:40:11.316] WARN: blob-sink:client Error getting blob sidecar from http://localhost:12345: fetch failed 10:40:11 [10:40:11.319] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"blobSinkUrl":"http://localhost:12345"} 10:40:11 [10:40:11.321] INFO: blob-sink:server Stopping blob sink 10:40:11 [10:40:11.322] INFO: blob-sink:server Blob sink stopped 10:40:11 [10:40:11.336] INFO: blob-sink:server Server is running on http://localhost:45259 10:40:11 [10:40:11.427] INFO: blob-sink:server Server is running on http://localhost:44825 10:40:11 [10:40:11.434] INFO: blob-sink:server Received blob sidecar for block 0x1234 10:40:11 [10:40:11.436] INFO: blob-sink:server Blob sidecar stored successfully for block 0x1234 10:40:13 [10:40:13.141] INFO: blob-sink:server Stopping blob sink 10:40:13 [10:40:13.143] INFO: blob-sink:server Blob sink stopped 10:40:13 [10:40:13.145] INFO: blob-sink:server Stopping blob sink 10:40:13 [10:40:13.145] INFO: blob-sink:server Blob sink stopped 10:40:13 [10:40:13.149] INFO: blob-sink:server Server is running on http://localhost:41291 10:40:14 [10:40:14.575] INFO: blob-sink:server Stopping blob sink 10:40:14 [10:40:14.575] INFO: blob-sink:server Blob sink already stopped 10:40:14 [10:40:14.576] INFO: blob-sink:server Stopping blob sink 10:40:14 [10:40:14.576] INFO: blob-sink:server Blob sink stopped 10:40:14 [10:40:14.577] INFO: blob-sink:server Server is running on http://localhost:38111 10:40:19 [10:40:19.636] ERROR: blob-sink:client Error getting slot number: TypeError: Failed to parse URL from invalidURL/eth/v1/beacon/headers/0x1234 10:40:19 at node:internal/deps/undici/undici:13510:13 { 10:40:19 [cause]: TypeError: Invalid URL 10:40:19 at new URL (node:internal/url:818:25) 10:40:19 at new Request (node:internal/deps/undici/undici:9586:25) 10:40:19 at fetch (node:internal/deps/undici/undici:10315:25) 10:40:19 at fetch (node:internal/deps/undici/undici:13508:10) 10:40:19 at fetch (node:internal/bootstrap/web/exposed-window-or-worker:75:12) 10:40:19 at fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:34:15) 10:40:19 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:26) 10:40:19 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 10:40:19 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 10:40:19 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 10:40:19 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:224:30) { 10:40:19 code: 'ERR_INVALID_URL', 10:40:19 input: 'invalidURL/eth/v1/beacon/headers/0x1234' 10:40:19 } 10:40:19 } 10:40:24 [10:40:24.642] WARN: blob-sink:client Error getting blob sidecar from invalidURL: Failed to parse URL from invalidURL/eth/v1/beacon/blob_sidecars/2 10:40:26 [10:40:26.131] INFO: blob-sink:server Stopping blob sink 10:40:26 [10:40:26.133] INFO: blob-sink:server Blob sink already stopped 10:40:26 [10:40:26.133] INFO: blob-sink:server Stopping blob sink 10:40:26 [10:40:26.134] INFO: blob-sink:server Blob sink stopped 10:40:26 [10:40:26.141] INFO: blob-sink:server Server is running on http://localhost:42751 10:40:27 [10:40:27.573] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:45389"]} 10:40:27 [10:40:27.578] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:45389"]} 10:40:27 [10:40:27.579] INFO: blob-sink:server Stopping blob sink 10:40:27 [10:40:27.580] INFO: blob-sink:server Blob sink already stopped 10:40:27 [10:40:27.581] INFO: blob-sink:server Stopping blob sink 10:40:27 [10:40:27.581] INFO: blob-sink:server Blob sink stopped 10:40:27 [10:40:27.584] INFO: blob-sink:server Server is running on http://localhost:45045 10:40:29 [10:40:29.218] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:42995"]} 10:40:29 [10:40:29.222] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:42995"]} 10:40:29 [10:40:29.223] INFO: blob-sink:server Stopping blob sink 10:40:29 [10:40:29.223] INFO: blob-sink:server Blob sink already stopped 10:40:29 [10:40:29.224] INFO: blob-sink:server Stopping blob sink 10:40:29 [10:40:29.224] INFO: blob-sink:server Blob sink stopped 10:40:29 [10:40:29.225] INFO: blob-sink:server Server is running on http://localhost:39637 10:40:35 [10:40:35.787] ERROR: blob-sink:client Error getting slot number: TypeError: fetch failed 10:40:35 at node:internal/deps/undici/undici:13510:13 10:40:35 at processTicksAndRejections (node:internal/process/task_queues:105:5) 10:40:35 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:20) 10:40:35 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 10:40:35 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 10:40:35 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 10:40:35 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:336:24) { 10:40:35 [cause]: AggregateError: 10:40:35 at internalConnectMultiple (node:net:1139:18) 10:40:35 at afterConnectMultiple (node:net:1714:7) { 10:40:35 code: 'ECONNREFUSED', 10:40:35 [errors]: [ [Error], [Error] ] 10:40:35 } 10:40:35 } 10:40:40 [10:40:40.803] WARN: blob-sink:client Error getting blob sidecar from http://localhost:46555: fetch failed 10:40:47 [10:40:47.425] ERROR: blob-sink:client Error getting slot number: TypeError: fetch failed 10:40:47 at node:internal/deps/undici/undici:13510:13 10:40:47 at processTicksAndRejections (node:internal/process/task_queues:105:5) 10:40:47 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:20) 10:40:47 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 10:40:47 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 10:40:47 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 10:40:47 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:352:24) { 10:40:47 [cause]: AggregateError: 10:40:47 at internalConnectMultiple (node:net:1139:18) 10:40:47 at afterConnectMultiple (node:net:1714:7) { 10:40:47 code: 'ECONNREFUSED', 10:40:47 [errors]: [ [Error], [Error] ] 10:40:47 } 10:40:47 } 10:40:52 [10:40:52.435] ERROR: blob-sink:client Error getting slot number: TypeError: fetch failed 10:40:52 at node:internal/deps/undici/undici:13510:13 10:40:52 at processTicksAndRejections (node:internal/process/task_queues:105:5) 10:40:52 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:20) 10:40:52 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 10:40:52 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 10:40:52 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 10:40:52 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:352:24) { 10:40:52 [cause]: AggregateError: 10:40:52 at internalConnectMultiple (node:net:1139:18) 10:40:52 at afterConnectMultiple (node:net:1714:7) { 10:40:52 code: 'ECONNREFUSED', 10:40:52 [errors]: [ [Error], [Error] ] 10:40:52 } 10:40:52 } 10:40:57 [10:40:57.481] WARN: blob-sink:client Error getting blob sidecar from http://localhost:46555: fetch failed 10:41:02 [10:41:02.535] WARN: blob-sink:client Error getting blob sidecar from http://localhost:45001: fetch failed 10:41:03 [10:41:03.997] INFO: blob-sink:server Stopping blob sink 10:41:03 [10:41:03.998] INFO: blob-sink:server Blob sink already stopped 10:41:03 [10:41:03.999] INFO: blob-sink:server Stopping blob sink 10:41:03 [10:41:04.000] INFO: blob-sink:server Blob sink stopped 10:41:04 [10:41:04.002] INFO: blob-sink:server Server is running on http://localhost:33853 10:41:04 [10:41:04.058] WARN: blob-sink:client Failed to deserialise blob {"commitment":"0x8365fed8ef125454b65e65b27f2ef34c764638b8d00a90eb52b933e940deff1492d62d8a62390683b9ebe0a5b8336914"} 10:41:05 [10:41:05.681] INFO: blob-sink:server Stopping blob sink 10:41:05 [10:41:05.683] INFO: blob-sink:server Blob sink already stopped 10:41:05 [10:41:05.684] INFO: blob-sink:server Stopping blob sink 10:41:05 [10:41:05.685] INFO: blob-sink:server Blob sink stopped 10:41:05 [10:41:05.689] INFO: blob-sink:server Server is running on http://localhost:37597 10:41:07 [10:41:07.548] INFO: blob-sink:server Stopping blob sink 10:41:07 [10:41:07.549] INFO: blob-sink:server Blob sink already stopped 10:41:07 [10:41:07.550] INFO: blob-sink:server Stopping blob sink 10:41:07 [10:41:07.551] INFO: blob-sink:server Blob sink stopped 10:41:07 [10:41:07.553] INFO: blob-sink:server Server is running on http://localhost:43225 10:41:09 [10:41:09.001] INFO: blob-sink:server Stopping blob sink 10:41:09 [10:41:09.002] INFO: blob-sink:server Blob sink already stopped 10:41:09 [10:41:09.002] INFO: blob-sink:server Stopping blob sink 10:41:09 [10:41:09.003] INFO: blob-sink:server Blob sink stopped 10:41:09 PASS src/client/http.test.ts (72.357 s) 10:41:09 HttpBlobSinkClient 10:41:09 should send and retrieve blobs (422 ms) 10:41:09 should handle multiple blobs (212 ms) 10:41:09 should return empty array for non-existent block (38 ms) 10:41:09 should handle server connection errors gracefully (10151 ms) 10:41:09 Mock Ethereum Clients 10:41:09 should handle no consensus host (1811 ms) 10:41:09 should request based on slot where consensus host is provided (1429 ms) 10:41:09 should handle when multiple consensus hosts are provided (11558 ms) 10:41:09 should handle API keys without headers (1444 ms) 10:41:09 should handle API keys in headers (1642 ms) 10:41:09 should handle multiple consensus hosts with different API key methods (34776 ms) 10:41:09 even if we ask for non-encoded blobs, we should only get encoded blobs (1685 ms) 10:41:09 should handle L1 missed slots (1864 ms) 10:41:09 should fall back to archive client (1451 ms) 10:41:09 10:41:09 Test Suites: 1 passed, 1 total 10:41:09 Tests: 13 passed, 13 total 10:41:09 Snapshots: 0 total 10:41:09 Time: 72.444 s 10:41:09 Ran all test suites matching /blob-sink\/src\/client\/http.test.ts/i. 10:41:09 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?