Parent Log: http://ci.aztec-labs.com/090e33d2919b194d Command: 3aa3a54f792fc08a yarn-project/scripts/run_test.sh blob-sink/src/client/http.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/2868628b6ae039db35b4267ab3975abc64a5d9b4 Env: REF_NAME=gh-readonly-queue/next/pr-15179-227fd751f8d3e07a96e4c1564665f0676f8222af CURRENT_VERSION=0.87.6 CI_FULL=1 Date: Mon Jun 23 12:41:15 UTC 2025 System: ARCH=amd64 CPUS=128 MEM=493Gi HOSTNAME=pr-15179_amd64_x3-full Resources: CPU_LIST=0-127 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_ed69c995f9b9d850_next 12:41:19 [12:41:19.959] INFO: blob-sink:server Server is running on http://localhost:35695 12:41:20 [12:41:20.242] INFO: blob-sink:server Received blob sidecar for block 0x1234 12:41:20 [12:41:20.245] INFO: blob-sink:server Blob sidecar stored successfully for block 0x1234 12:41:20 [12:41:20.294] INFO: blob-sink:server Stopping blob sink 12:41:20 [12:41:20.295] INFO: blob-sink:server Blob sink stopped 12:41:20 [12:41:20.300] INFO: blob-sink:server Server is running on http://localhost:45485 12:41:20 [12:41:20.349] INFO: blob-sink:server Received blob sidecar for block 0x5678 12:41:20 [12:41:20.352] INFO: blob-sink:server Blob sidecar stored successfully for block 0x5678 12:41:20 [12:41:20.464] INFO: blob-sink:server Stopping blob sink 12:41:20 [12:41:20.466] INFO: blob-sink:server Blob sink stopped 12:41:20 [12:41:20.469] INFO: blob-sink:server Server is running on http://localhost:35381 12:41:20 [12:41:20.479] WARN: blob-sink:client Unable to get blob sidecar for 0xnonexistent: Bad Request (400) {"status":400,"statusText":"Bad Request","body":"{\"error\":\"Invalid block_id parameter\"}"} 12:41:20 [12:41:20.480] WARN: blob-sink:client Failed to fetch blobs for 0xnonexistent from all blob sources {"blobSinkUrl":"http://localhost:35381"} 12:41:20 [12:41:20.481] INFO: blob-sink:server Stopping blob sink 12:41:20 [12:41:20.482] INFO: blob-sink:server Blob sink stopped 12:41:20 [12:41:20.484] INFO: blob-sink:server Server is running on http://localhost:44733 12:41:25 [12:41:25.537] WARN: blob-sink:client Blob sink url configured, but unable to send blobs {"blobSinkUrl":"http://localhost:12345","blockHash":"0x1234"} 12:41:30 [12:41:30.574] WARN: blob-sink:client Error getting blob sidecar from http://localhost:12345: fetch failed 12:41:30 [12:41:30.575] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"blobSinkUrl":"http://localhost:12345"} 12:41:30 [12:41:30.576] INFO: blob-sink:server Stopping blob sink 12:41:30 [12:41:30.577] INFO: blob-sink:server Blob sink stopped 12:41:30 [12:41:30.579] INFO: blob-sink:server Server is running on http://localhost:35049 12:41:30 [12:41:30.630] INFO: blob-sink:server Server is running on http://localhost:33363 12:41:30 [12:41:30.639] INFO: blob-sink:server Received blob sidecar for block 0x1234 12:41:30 [12:41:30.641] INFO: blob-sink:server Blob sidecar stored successfully for block 0x1234 12:41:31 [12:41:31.027] INFO: blob-sink:server Stopping blob sink 12:41:31 [12:41:31.029] INFO: blob-sink:server Blob sink stopped 12:41:31 [12:41:31.030] INFO: blob-sink:server Stopping blob sink 12:41:31 [12:41:31.030] INFO: blob-sink:server Blob sink stopped 12:41:31 [12:41:31.033] INFO: blob-sink:server Server is running on http://localhost:34089 12:41:31 [12:41:31.466] INFO: blob-sink:server Stopping blob sink 12:41:31 [12:41:31.467] INFO: blob-sink:server Blob sink already stopped 12:41:31 [12:41:31.468] INFO: blob-sink:server Stopping blob sink 12:41:31 [12:41:31.469] INFO: blob-sink:server Blob sink stopped 12:41:31 [12:41:31.471] INFO: blob-sink:server Server is running on http://localhost:36027 12:41:36 [12:41:36.559] ERROR: blob-sink:client Error getting slot number: TypeError: Failed to parse URL from invalidURL/eth/v1/beacon/headers/0x1234 12:41:36 at node:internal/deps/undici/undici:13510:13 12:41:36 at runNextTicks (node:internal/process/task_queues:65:5) 12:41:36 at processTimers (node:internal/timers:520:9) { 12:41:36 [cause]: TypeError: Invalid URL 12:41:36 at new URL (node:internal/url:818:25) 12:41:36 at new Request (node:internal/deps/undici/undici:9586:25) 12:41:36 at fetch (node:internal/deps/undici/undici:10315:25) 12:41:36 at fetch (node:internal/deps/undici/undici:13508:10) 12:41:36 at fetch (node:internal/bootstrap/web/exposed-window-or-worker:75:12) 12:41:36 at fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:34:15) 12:41:36 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:26) 12:41:36 at runNextTicks (node:internal/process/task_queues:65:5) 12:41:36 at processTimers (node:internal/timers:520:9) 12:41:36 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 12:41:36 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 12:41:36 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 12:41:36 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:225:30) { 12:41:36 code: 'ERR_INVALID_URL', 12:41:36 input: 'invalidURL/eth/v1/beacon/headers/0x1234' 12:41:36 } 12:41:36 } 12:41:41 [12:41:41.566] WARN: blob-sink:client Error getting blob sidecar from invalidURL: Failed to parse URL from invalidURL/eth/v1/beacon/blob_sidecars/2 12:41:42 [12:41:42.038] INFO: blob-sink:server Stopping blob sink 12:41:42 [12:41:42.039] INFO: blob-sink:server Blob sink already stopped 12:41:42 [12:41:42.040] INFO: blob-sink:server Stopping blob sink 12:41:42 [12:41:42.040] INFO: blob-sink:server Blob sink stopped 12:41:42 [12:41:42.044] INFO: blob-sink:server Server is running on http://localhost:35829 12:41:42 [12:41:42.405] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:41867"]} 12:41:42 [12:41:42.411] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:41867"]} 12:41:42 [12:41:42.412] INFO: blob-sink:server Stopping blob sink 12:41:42 [12:41:42.413] INFO: blob-sink:server Blob sink already stopped 12:41:42 [12:41:42.413] INFO: blob-sink:server Stopping blob sink 12:41:42 [12:41:42.414] INFO: blob-sink:server Blob sink stopped 12:41:42 [12:41:42.416] INFO: blob-sink:server Server is running on http://localhost:42625 12:41:42 [12:41:42.770] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:34413"]} 12:41:42 [12:41:42.775] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:34413"]} 12:41:42 [12:41:42.777] INFO: blob-sink:server Stopping blob sink 12:41:42 [12:41:42.777] INFO: blob-sink:server Blob sink already stopped 12:41:42 [12:41:42.778] INFO: blob-sink:server Stopping blob sink 12:41:42 [12:41:42.778] INFO: blob-sink:server Blob sink stopped 12:41:42 [12:41:42.780] INFO: blob-sink:server Server is running on http://localhost:44557 12:41:48 [12:41:48.150] ERROR: blob-sink:client Error getting slot number: TypeError: fetch failed 12:41:48 at node:internal/deps/undici/undici:13510:13 12:41:48 at processTicksAndRejections (node:internal/process/task_queues:105:5) 12:41:48 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:20) 12:41:48 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 12:41:48 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 12:41:48 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 12:41:48 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:337:24) { 12:41:48 [cause]: AggregateError: 12:41:48 at internalConnectMultiple (node:net:1139:18) 12:41:48 at afterConnectMultiple (node:net:1714:7) { 12:41:48 code: 'ECONNREFUSED', 12:41:48 [errors]: [ [Error], [Error] ] 12:41:48 } 12:41:48 } 12:41:53 [12:41:53.179] WARN: blob-sink:client Error getting blob sidecar from http://localhost:38359: fetch failed 12:41:58 [12:41:58.477] ERROR: blob-sink:client Error getting slot number: TypeError: fetch failed 12:41:58 at node:internal/deps/undici/undici:13510:13 12:41:58 at processTicksAndRejections (node:internal/process/task_queues:105:5) 12:41:58 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:20) 12:41:58 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 12:41:58 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 12:41:58 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 12:41:58 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:353:24) { 12:41:58 [cause]: AggregateError: 12:41:58 at internalConnectMultiple (node:net:1139:18) 12:41:58 at afterConnectMultiple (node:net:1714:7) { 12:41:58 code: 'ECONNREFUSED', 12:41:58 [errors]: [ [Error], [Error] ] 12:41:58 } 12:41:58 } 12:42:03 [12:42:03.488] ERROR: blob-sink:client Error getting slot number: TypeError: fetch failed 12:42:03 at node:internal/deps/undici/undici:13510:13 12:42:03 at processTicksAndRejections (node:internal/process/task_queues:105:5) 12:42:03 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:20) 12:42:03 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 12:42:03 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 12:42:03 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 12:42:03 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:353:24) { 12:42:03 [cause]: AggregateError: 12:42:03 at internalConnectMultiple (node:net:1139:18) 12:42:03 at afterConnectMultiple (node:net:1714:7) { 12:42:03 code: 'ECONNREFUSED', 12:42:03 [errors]: [ [Error], [Error] ] 12:42:03 } 12:42:03 } 12:42:08 [12:42:08.515] WARN: blob-sink:client Error getting blob sidecar from http://localhost:38359: fetch failed 12:42:13 [12:42:13.528] WARN: blob-sink:client Error getting blob sidecar from http://localhost:38979: fetch failed 12:42:13 [12:42:13.837] INFO: blob-sink:server Stopping blob sink 12:42:13 [12:42:13.838] INFO: blob-sink:server Blob sink already stopped 12:42:13 [12:42:13.840] INFO: blob-sink:server Stopping blob sink 12:42:13 [12:42:13.840] INFO: blob-sink:server Blob sink stopped 12:42:13 [12:42:13.842] INFO: blob-sink:server Server is running on http://localhost:33321 12:42:13 [12:42:13.906] WARN: blob-sink:client Failed to deserialise blob {"commitment":"0xa05dfa339a49a6d80c9b66b2bf2b7c6b3c5e595209764f5f2979751c87bd8cd08b16fcca22eb4ba1de8b4b903c308847"} 12:42:14 [12:42:14.175] INFO: blob-sink:server Stopping blob sink 12:42:14 [12:42:14.175] INFO: blob-sink:server Blob sink already stopped 12:42:14 [12:42:14.176] INFO: blob-sink:server Stopping blob sink 12:42:14 [12:42:14.176] INFO: blob-sink:server Blob sink stopped 12:42:14 [12:42:14.177] INFO: blob-sink:server Server is running on http://localhost:33911 12:42:14 [12:42:14.490] INFO: blob-sink:server Stopping blob sink 12:42:14 [12:42:14.491] INFO: blob-sink:server Blob sink already stopped 12:42:14 [12:42:14.492] INFO: blob-sink:server Stopping blob sink 12:42:14 [12:42:14.492] INFO: blob-sink:server Blob sink stopped 12:42:14 [12:42:14.494] INFO: blob-sink:server Server is running on http://localhost:41965 12:42:14 [12:42:14.800] INFO: blob-sink:server Stopping blob sink 12:42:14 [12:42:14.800] INFO: blob-sink:server Blob sink already stopped 12:42:14 [12:42:14.800] INFO: blob-sink:server Stopping blob sink 12:42:14 [12:42:14.801] INFO: blob-sink:server Blob sink stopped 12:42:14 PASS src/client/http.test.ts (57.93 s) 12:42:14 HttpBlobSinkClient 12:42:14 should send and retrieve blobs (346 ms) 12:42:14 should handle multiple blobs (169 ms) 12:42:14 should return empty array for non-existent block (14 ms) 12:42:14 should handle server connection errors gracefully (10094 ms) 12:42:14 Mock Ethereum Clients 12:42:14 should handle no consensus host (452 ms) 12:42:14 should request based on slot where consensus host is provided (438 ms) 12:42:14 should handle when multiple consensus hosts are provided (10571 ms) 12:42:14 should handle API keys without headers (372 ms) 12:42:14 should handle API keys in headers (364 ms) 12:42:14 should handle multiple consensus hosts with different API key methods (31062 ms) 12:42:14 even if we ask for non-encoded blobs, we should only get encoded blobs (336 ms) 12:42:14 should handle L1 missed slots (316 ms) 12:42:14 should fall back to archive client (308 ms) 12:42:14 12:42:14 Test Suites: 1 passed, 1 total 12:42:14 Tests: 13 passed, 13 total 12:42:14 Snapshots: 0 total 12:42:14 Time: 58.005 s 12:42:14 Ran all test suites matching blob-sink/src/client/http.test.ts. 12:42:14 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?