Parent Log: http://ci.aztec-labs.com/ae044bbb1e4daaae Command: ebf67495dae0c068 yarn-project/scripts/run_test.sh blob-sink/src/client/http.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/10badd24359b04680068afd9ca24407383374db1 Env: REF_NAME=gh-readonly-queue/next/pr-15019-7d223783d91db15002a09abc1b52d1455eb3e3da CURRENT_VERSION=0.87.6 CI_FULL=1 Date: Mon Jun 16 11:07:06 UTC 2025 System: ARCH=amd64 CPUS=128 MEM=493Gi HOSTNAME=pr-15019_amd64_x2-full Resources: CPU_LIST=0-127 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_ed69c995f9b9d850_next 11:07:10 [11:07:10.522] INFO: blob-sink:server Server is running on http://localhost:39171 11:07:10 [11:07:10.830] INFO: blob-sink:server Received blob sidecar for block 0x1234 11:07:10 [11:07:10.836] INFO: blob-sink:server Blob sidecar stored successfully for block 0x1234 11:07:10 [11:07:10.887] INFO: blob-sink:server Stopping blob sink 11:07:10 [11:07:10.890] INFO: blob-sink:server Blob sink stopped 11:07:10 [11:07:10.895] INFO: blob-sink:server Server is running on http://localhost:37097 11:07:10 [11:07:10.949] INFO: blob-sink:server Received blob sidecar for block 0x5678 11:07:10 [11:07:10.953] INFO: blob-sink:server Blob sidecar stored successfully for block 0x5678 11:07:11 [11:07:11.071] INFO: blob-sink:server Stopping blob sink 11:07:11 [11:07:11.073] INFO: blob-sink:server Blob sink stopped 11:07:11 [11:07:11.076] INFO: blob-sink:server Server is running on http://localhost:37517 11:07:11 [11:07:11.087] WARN: blob-sink:client Unable to get blob sidecar for 0xnonexistent: Bad Request (400) {"status":400,"statusText":"Bad Request","body":"{\"error\":\"Invalid block_id parameter\"}"} 11:07:11 [11:07:11.088] WARN: blob-sink:client Failed to fetch blobs for 0xnonexistent from all blob sources {"blobSinkUrl":"http://localhost:37517"} 11:07:11 [11:07:11.090] INFO: blob-sink:server Stopping blob sink 11:07:11 [11:07:11.091] INFO: blob-sink:server Blob sink stopped 11:07:11 [11:07:11.092] INFO: blob-sink:server Server is running on http://localhost:43119 11:07:16 [11:07:16.140] WARN: blob-sink:client Blob sink url configured, but unable to send blobs {"blobSinkUrl":"http://localhost:12345","blockHash":"0x1234"} 11:07:21 [11:07:21.170] WARN: blob-sink:client Error getting blob sidecar from http://localhost:12345: fetch failed 11:07:21 [11:07:21.171] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"blobSinkUrl":"http://localhost:12345"} 11:07:21 [11:07:21.173] INFO: blob-sink:server Stopping blob sink 11:07:21 [11:07:21.173] INFO: blob-sink:server Blob sink stopped 11:07:21 [11:07:21.177] INFO: blob-sink:server Server is running on http://localhost:43311 11:07:21 [11:07:21.221] INFO: blob-sink:server Server is running on http://localhost:34371 11:07:21 [11:07:21.241] INFO: blob-sink:server Received blob sidecar for block 0x1234 11:07:21 [11:07:21.245] INFO: blob-sink:server Blob sidecar stored successfully for block 0x1234 11:07:23 [11:07:23.176] INFO: blob-sink:server Stopping blob sink 11:07:23 [11:07:23.177] INFO: blob-sink:server Blob sink stopped 11:07:23 [11:07:23.178] INFO: blob-sink:server Stopping blob sink 11:07:23 [11:07:23.178] INFO: blob-sink:server Blob sink stopped 11:07:23 [11:07:23.180] INFO: blob-sink:server Server is running on http://localhost:33941 11:07:25 [11:07:25.207] INFO: blob-sink:server Stopping blob sink 11:07:25 [11:07:25.209] INFO: blob-sink:server Blob sink already stopped 11:07:25 [11:07:25.211] INFO: blob-sink:server Stopping blob sink 11:07:25 [11:07:25.212] INFO: blob-sink:server Blob sink stopped 11:07:25 [11:07:25.217] INFO: blob-sink:server Server is running on http://localhost:42977 11:07:30 [11:07:30.317] ERROR: blob-sink:client Error getting slot number: TypeError: Failed to parse URL from invalidURL/eth/v1/beacon/headers/0x1234 11:07:30 at node:internal/deps/undici/undici:13510:13 { 11:07:30 [cause]: TypeError: Invalid URL 11:07:30 at new URL (node:internal/url:818:25) 11:07:30 at new Request (node:internal/deps/undici/undici:9586:25) 11:07:30 at fetch (node:internal/deps/undici/undici:10315:25) 11:07:30 at fetch (node:internal/deps/undici/undici:13508:10) 11:07:30 at fetch (node:internal/bootstrap/web/exposed-window-or-worker:75:12) 11:07:30 at fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:34:15) 11:07:30 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:26) 11:07:30 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 11:07:30 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 11:07:30 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 11:07:30 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:224:30) { 11:07:30 code: 'ERR_INVALID_URL', 11:07:30 input: 'invalidURL/eth/v1/beacon/headers/0x1234' 11:07:30 } 11:07:30 } 11:07:35 [11:07:35.323] WARN: blob-sink:client Error getting blob sidecar from invalidURL: Failed to parse URL from invalidURL/eth/v1/beacon/blob_sidecars/2 11:07:36 [11:07:36.871] INFO: blob-sink:server Stopping blob sink 11:07:36 [11:07:36.873] INFO: blob-sink:server Blob sink already stopped 11:07:36 [11:07:36.873] INFO: blob-sink:server Stopping blob sink 11:07:36 [11:07:36.874] INFO: blob-sink:server Blob sink stopped 11:07:36 [11:07:36.878] INFO: blob-sink:server Server is running on http://localhost:38897 11:07:38 [11:07:38.352] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:36693"]} 11:07:38 [11:07:38.356] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:36693"]} 11:07:38 [11:07:38.356] INFO: blob-sink:server Stopping blob sink 11:07:38 [11:07:38.356] INFO: blob-sink:server Blob sink already stopped 11:07:38 [11:07:38.357] INFO: blob-sink:server Stopping blob sink 11:07:38 [11:07:38.357] INFO: blob-sink:server Blob sink stopped 11:07:38 [11:07:38.358] INFO: blob-sink:server Server is running on http://localhost:38771 11:07:40 [11:07:40.009] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:46429"]} 11:07:40 [11:07:40.012] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:46429"]} 11:07:40 [11:07:40.013] INFO: blob-sink:server Stopping blob sink 11:07:40 [11:07:40.013] INFO: blob-sink:server Blob sink already stopped 11:07:40 [11:07:40.014] INFO: blob-sink:server Stopping blob sink 11:07:40 [11:07:40.014] INFO: blob-sink:server Blob sink stopped 11:07:40 [11:07:40.015] INFO: blob-sink:server Server is running on http://localhost:40643 11:07:46 [11:07:46.617] ERROR: blob-sink:client Error getting slot number: TypeError: fetch failed 11:07:46 at node:internal/deps/undici/undici:13510:13 11:07:46 at processTicksAndRejections (node:internal/process/task_queues:105:5) 11:07:46 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:20) 11:07:46 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 11:07:46 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 11:07:46 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 11:07:46 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:336:24) { 11:07:46 [cause]: AggregateError: 11:07:46 at internalConnectMultiple (node:net:1139:18) 11:07:46 at afterConnectMultiple (node:net:1714:7) { 11:07:46 code: 'ECONNREFUSED', 11:07:46 [errors]: [ [Error], [Error] ] 11:07:46 } 11:07:46 } 11:07:51 [11:07:51.635] WARN: blob-sink:client Error getting blob sidecar from http://localhost:36873: fetch failed 11:07:58 [11:07:58.003] ERROR: blob-sink:client Error getting slot number: TypeError: fetch failed 11:07:58 at node:internal/deps/undici/undici:13510:13 11:07:58 at processTicksAndRejections (node:internal/process/task_queues:105:5) 11:07:58 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:20) 11:07:58 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 11:07:58 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 11:07:58 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 11:07:58 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:352:24) { 11:07:58 [cause]: AggregateError: 11:07:58 at internalConnectMultiple (node:net:1139:18) 11:07:58 at afterConnectMultiple (node:net:1714:7) { 11:07:58 code: 'ECONNREFUSED', 11:07:58 [errors]: [ [Error], [Error] ] 11:07:58 } 11:07:58 } 11:08:03 [11:08:03.021] ERROR: blob-sink:client Error getting slot number: TypeError: fetch failed 11:08:03 at node:internal/deps/undici/undici:13510:13 11:08:03 at processTicksAndRejections (node:internal/process/task_queues:105:5) 11:08:03 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:20) 11:08:03 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 11:08:03 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 11:08:03 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 11:08:03 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:352:24) { 11:08:03 [cause]: AggregateError: 11:08:03 at internalConnectMultiple (node:net:1139:18) 11:08:03 at afterConnectMultiple (node:net:1714:7) { 11:08:03 code: 'ECONNREFUSED', 11:08:03 [errors]: [ [Error], [Error] ] 11:08:03 } 11:08:03 } 11:08:08 [11:08:08.046] WARN: blob-sink:client Error getting blob sidecar from http://localhost:36873: fetch failed 11:08:13 [11:08:13.057] WARN: blob-sink:client Error getting blob sidecar from http://localhost:35027: fetch failed 11:08:14 [11:08:14.636] INFO: blob-sink:server Stopping blob sink 11:08:14 [11:08:14.637] INFO: blob-sink:server Blob sink already stopped 11:08:14 [11:08:14.637] INFO: blob-sink:server Stopping blob sink 11:08:14 [11:08:14.638] INFO: blob-sink:server Blob sink stopped 11:08:14 [11:08:14.639] INFO: blob-sink:server Server is running on http://localhost:45553 11:08:14 [11:08:14.695] WARN: blob-sink:client Failed to deserialise blob {"commitment":"0x95a361abd7bb4bad2560b74d3a03d0e5b49304b97a65b58f668d9cd6039ed5e411975ef5c01773730515ba54c060580f"} 11:08:16 [11:08:16.012] INFO: blob-sink:server Stopping blob sink 11:08:16 [11:08:16.012] INFO: blob-sink:server Blob sink already stopped 11:08:16 [11:08:16.013] INFO: blob-sink:server Stopping blob sink 11:08:16 [11:08:16.013] INFO: blob-sink:server Blob sink stopped 11:08:16 [11:08:16.014] INFO: blob-sink:server Server is running on http://localhost:34641 11:08:17 [11:08:17.329] INFO: blob-sink:server Stopping blob sink 11:08:17 [11:08:17.330] INFO: blob-sink:server Blob sink already stopped 11:08:17 [11:08:17.330] INFO: blob-sink:server Stopping blob sink 11:08:17 [11:08:17.330] INFO: blob-sink:server Blob sink stopped 11:08:17 [11:08:17.332] INFO: blob-sink:server Server is running on http://localhost:39145 11:08:18 [11:08:18.910] INFO: blob-sink:server Stopping blob sink 11:08:18 [11:08:18.910] INFO: blob-sink:server Blob sink already stopped 11:08:18 [11:08:18.911] INFO: blob-sink:server Stopping blob sink 11:08:18 [11:08:18.911] INFO: blob-sink:server Blob sink stopped 11:08:18 PASS src/client/http.test.ts (71.241 s) 11:08:18 HttpBlobSinkClient 11:08:18 should send and retrieve blobs (376 ms) 11:08:18 should handle multiple blobs (182 ms) 11:08:18 should return empty array for non-existent block (17 ms) 11:08:18 should handle server connection errors gracefully (10083 ms) 11:08:18 Mock Ethereum Clients 11:08:18 should handle no consensus host (2003 ms) 11:08:18 should request based on slot where consensus host is provided (2034 ms) 11:08:18 should handle when multiple consensus hosts are provided (11660 ms) 11:08:18 should handle API keys without headers (1481 ms) 11:08:18 should handle API keys in headers (1657 ms) 11:08:18 should handle multiple consensus hosts with different API key methods (34623 ms) 11:08:18 even if we ask for non-encoded blobs, we should only get encoded blobs (1376 ms) 11:08:18 should handle L1 missed slots (1317 ms) 11:08:18 should fall back to archive client (1581 ms) 11:08:18 11:08:18 Test Suites: 1 passed, 1 total 11:08:18 Tests: 13 passed, 13 total 11:08:18 Snapshots: 0 total 11:08:18 Time: 71.327 s 11:08:18 Ran all test suites matching /blob-sink\/src\/client\/http.test.ts/i. 11:08:18 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?