Parent Log: http://ci.aztec-labs.com/88a1010f314e27f0 Command: d2fcfaaceedeb658 yarn-project/scripts/run_test.sh blob-sink/src/client/http.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/7dcba16a1a8b286f0e20ac38acd8c97103e573de Env: REF_NAME=gh-readonly-queue/next/pr-15314-bd28eda782eb6f2e1e5c2101a27104b4ad8796b3 CURRENT_VERSION=0.87.6 CI_FULL=1 Date: Thu Jun 26 17:48:52 UTC 2025 System: ARCH=amd64 CPUS=128 MEM=493Gi HOSTNAME=pr-15314_amd64_x1-full Resources: CPU_LIST=0-127 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_ed69c995f9b9d850_next 17:48:56 [17:48:56.868] INFO: blob-sink:server Server is running on http://localhost:43213 17:48:57 [17:48:57.152] INFO: blob-sink:server Received blob sidecar for block 0x1234 17:48:57 [17:48:57.155] INFO: blob-sink:server Blob sidecar stored successfully for block 0x1234 17:48:57 [17:48:57.211] INFO: blob-sink:server Stopping blob sink 17:48:57 [17:48:57.213] INFO: blob-sink:server Blob sink stopped 17:48:57 [17:48:57.217] INFO: blob-sink:server Server is running on http://localhost:45783 17:48:57 [17:48:57.266] INFO: blob-sink:server Received blob sidecar for block 0x5678 17:48:57 [17:48:57.269] INFO: blob-sink:server Blob sidecar stored successfully for block 0x5678 17:48:57 [17:48:57.366] INFO: blob-sink:server Stopping blob sink 17:48:57 [17:48:57.367] INFO: blob-sink:server Blob sink stopped 17:48:57 [17:48:57.370] INFO: blob-sink:server Server is running on http://localhost:37681 17:48:57 [17:48:57.376] WARN: blob-sink:client Unable to get blob sidecar for 0xnonexistent: Bad Request (400) {"status":400,"statusText":"Bad Request","body":"{\"error\":\"Invalid block_id parameter\"}"} 17:48:57 [17:48:57.376] WARN: blob-sink:client Failed to fetch blobs for 0xnonexistent from all blob sources {"blobSinkUrl":"http://localhost:37681"} 17:48:57 [17:48:57.378] INFO: blob-sink:server Stopping blob sink 17:48:57 [17:48:57.378] INFO: blob-sink:server Blob sink stopped 17:48:57 [17:48:57.380] INFO: blob-sink:server Server is running on http://localhost:45637 17:49:02 [17:49:02.433] WARN: blob-sink:client Blob sink url configured, but unable to send blobs {"blobSinkUrl":"http://localhost:12345","blockHash":"0x1234"} 17:49:07 [17:49:07.460] WARN: blob-sink:client Error getting blob sidecar from http://localhost:12345: fetch failed 17:49:07 [17:49:07.461] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"blobSinkUrl":"http://localhost:12345"} 17:49:07 [17:49:07.462] INFO: blob-sink:server Stopping blob sink 17:49:07 [17:49:07.462] INFO: blob-sink:server Blob sink stopped 17:49:07 [17:49:07.478] INFO: blob-sink:server Server is running on http://localhost:37003 17:49:07 [17:49:07.556] INFO: blob-sink:server Server is running on http://localhost:44387 17:49:07 [17:49:07.562] INFO: blob-sink:server Received blob sidecar for block 0x1234 17:49:07 [17:49:07.564] INFO: blob-sink:server Blob sidecar stored successfully for block 0x1234 17:49:07 [17:49:07.972] INFO: blob-sink:server Stopping blob sink 17:49:07 [17:49:07.973] INFO: blob-sink:server Blob sink stopped 17:49:07 [17:49:07.973] INFO: blob-sink:server Stopping blob sink 17:49:07 [17:49:07.973] INFO: blob-sink:server Blob sink stopped 17:49:07 [17:49:07.975] INFO: blob-sink:server Server is running on http://localhost:34309 17:49:08 [17:49:08.725] INFO: blob-sink:server Stopping blob sink 17:49:08 [17:49:08.727] INFO: blob-sink:server Blob sink already stopped 17:49:08 [17:49:08.728] INFO: blob-sink:server Stopping blob sink 17:49:08 [17:49:08.729] INFO: blob-sink:server Blob sink stopped 17:49:08 [17:49:08.734] INFO: blob-sink:server Server is running on http://localhost:44295 17:49:13 [17:49:13.817] ERROR: blob-sink:client Error getting slot number: TypeError: Failed to parse URL from invalidURL/eth/v1/beacon/headers/0x1234 17:49:13 at node:internal/deps/undici/undici:13510:13 { 17:49:13 [cause]: TypeError: Invalid URL 17:49:13 at new URL (node:internal/url:818:25) 17:49:13 at new Request (node:internal/deps/undici/undici:9586:25) 17:49:13 at fetch (node:internal/deps/undici/undici:10315:25) 17:49:13 at fetch (node:internal/deps/undici/undici:13508:10) 17:49:13 at fetch (node:internal/bootstrap/web/exposed-window-or-worker:75:12) 17:49:13 at fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:34:15) 17:49:13 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:26) 17:49:13 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 17:49:13 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 17:49:13 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 17:49:13 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:225:30) { 17:49:13 code: 'ERR_INVALID_URL', 17:49:13 input: 'invalidURL/eth/v1/beacon/headers/0x1234' 17:49:13 } 17:49:13 } 17:49:18 [17:49:18.826] WARN: blob-sink:client Error getting blob sidecar from invalidURL: Failed to parse URL from invalidURL/eth/v1/beacon/blob_sidecars/2 17:49:19 [17:49:19.127] INFO: blob-sink:server Stopping blob sink 17:49:19 [17:49:19.127] INFO: blob-sink:server Blob sink already stopped 17:49:19 [17:49:19.128] INFO: blob-sink:server Stopping blob sink 17:49:19 [17:49:19.128] INFO: blob-sink:server Blob sink stopped 17:49:19 [17:49:19.130] INFO: blob-sink:server Server is running on http://localhost:33575 17:49:19 [17:49:19.474] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:34015"]} 17:49:19 [17:49:19.483] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:34015"]} 17:49:19 [17:49:19.484] INFO: blob-sink:server Stopping blob sink 17:49:19 [17:49:19.484] INFO: blob-sink:server Blob sink already stopped 17:49:19 [17:49:19.485] INFO: blob-sink:server Stopping blob sink 17:49:19 [17:49:19.486] INFO: blob-sink:server Blob sink stopped 17:49:19 [17:49:19.488] INFO: blob-sink:server Server is running on http://localhost:40871 17:49:19 [17:49:19.828] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:41789"]} 17:49:19 [17:49:19.832] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:41789"]} 17:49:19 [17:49:19.832] INFO: blob-sink:server Stopping blob sink 17:49:19 [17:49:19.833] INFO: blob-sink:server Blob sink already stopped 17:49:19 [17:49:19.833] INFO: blob-sink:server Stopping blob sink 17:49:19 [17:49:19.834] INFO: blob-sink:server Blob sink stopped 17:49:19 [17:49:19.835] INFO: blob-sink:server Server is running on http://localhost:38853 17:49:25 [17:49:25.219] ERROR: blob-sink:client Error getting slot number: TypeError: fetch failed 17:49:25 at node:internal/deps/undici/undici:13510:13 17:49:25 at processTicksAndRejections (node:internal/process/task_queues:105:5) 17:49:25 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:20) 17:49:25 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 17:49:25 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 17:49:25 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 17:49:25 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:337:24) { 17:49:25 [cause]: AggregateError: 17:49:25 at internalConnectMultiple (node:net:1139:18) 17:49:25 at afterConnectMultiple (node:net:1714:7) { 17:49:25 code: 'ECONNREFUSED', 17:49:25 [errors]: [ [Error], [Error] ] 17:49:25 } 17:49:25 } 17:49:30 [17:49:30.315] WARN: blob-sink:client Error getting blob sidecar from http://localhost:43447: fetch failed 17:49:35 [17:49:35.640] ERROR: blob-sink:client Error getting slot number: TypeError: fetch failed 17:49:35 at node:internal/deps/undici/undici:13510:13 17:49:35 at processTicksAndRejections (node:internal/process/task_queues:105:5) 17:49:35 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:20) 17:49:35 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 17:49:35 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 17:49:35 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 17:49:35 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:353:24) { 17:49:35 [cause]: AggregateError: 17:49:35 at internalConnectMultiple (node:net:1139:18) 17:49:35 at afterConnectMultiple (node:net:1714:7) { 17:49:35 code: 'ECONNREFUSED', 17:49:35 [errors]: [ [Error], [Error] ] 17:49:35 } 17:49:35 } 17:49:40 [17:49:40.651] ERROR: blob-sink:client Error getting slot number: TypeError: fetch failed 17:49:40 at node:internal/deps/undici/undici:13510:13 17:49:40 at processTicksAndRejections (node:internal/process/task_queues:105:5) 17:49:40 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:20) 17:49:40 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 17:49:40 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 17:49:40 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 17:49:40 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:353:24) { 17:49:40 [cause]: AggregateError: 17:49:40 at internalConnectMultiple (node:net:1139:18) 17:49:40 at afterConnectMultiple (node:net:1714:7) { 17:49:40 code: 'ECONNREFUSED', 17:49:40 [errors]: [ [Error], [Error] ] 17:49:40 } 17:49:40 } 17:49:45 [17:49:45.666] WARN: blob-sink:client Error getting blob sidecar from http://localhost:43447: fetch failed 17:49:50 [17:49:50.680] WARN: blob-sink:client Error getting blob sidecar from http://localhost:44163: fetch failed 17:49:51 [17:49:51.042] INFO: blob-sink:server Stopping blob sink 17:49:51 [17:49:51.042] INFO: blob-sink:server Blob sink already stopped 17:49:51 [17:49:51.043] INFO: blob-sink:server Stopping blob sink 17:49:51 [17:49:51.043] INFO: blob-sink:server Blob sink stopped 17:49:51 [17:49:51.045] INFO: blob-sink:server Server is running on http://localhost:42163 17:49:51 [17:49:51.116] WARN: blob-sink:client Failed to deserialise blob {"commitment":"0x817cd97aee265cffb6cc915283e8d1ab49771941abd40b369163e2f29df0ad956b1e0b1c3fe744117452e8fb7e909a44"} 17:49:51 [17:49:51.475] INFO: blob-sink:server Stopping blob sink 17:49:51 [17:49:51.476] INFO: blob-sink:server Blob sink already stopped 17:49:51 [17:49:51.476] INFO: blob-sink:server Stopping blob sink 17:49:51 [17:49:51.477] INFO: blob-sink:server Blob sink stopped 17:49:51 [17:49:51.478] INFO: blob-sink:server Server is running on http://localhost:36963 17:49:51 [17:49:51.801] INFO: blob-sink:server Stopping blob sink 17:49:51 [17:49:51.802] INFO: blob-sink:server Blob sink already stopped 17:49:51 [17:49:51.803] INFO: blob-sink:server Stopping blob sink 17:49:51 [17:49:51.804] INFO: blob-sink:server Blob sink stopped 17:49:51 [17:49:51.807] INFO: blob-sink:server Server is running on http://localhost:43803 17:49:52 [17:49:52.152] INFO: blob-sink:server Stopping blob sink 17:49:52 [17:49:52.152] INFO: blob-sink:server Blob sink already stopped 17:49:52 [17:49:52.153] INFO: blob-sink:server Stopping blob sink 17:49:52 [17:49:52.153] INFO: blob-sink:server Blob sink stopped 17:49:52 PASS src/client/http.test.ts (58.27 s) 17:49:52 HttpBlobSinkClient 17:49:52 should send and retrieve blobs (354 ms) 17:49:52 should handle multiple blobs (153 ms) 17:49:52 should return empty array for non-existent block (11 ms) 17:49:52 should handle server connection errors gracefully (10084 ms) 17:49:52 Mock Ethereum Clients 17:49:52 should handle no consensus host (503 ms) 17:49:52 should request based on slot where consensus host is provided (756 ms) 17:49:52 should handle when multiple consensus hosts are provided (10397 ms) 17:49:52 should handle API keys without headers (357 ms) 17:49:52 should handle API keys in headers (347 ms) 17:49:52 should handle multiple consensus hosts with different API key methods (31209 ms) 17:49:52 even if we ask for non-encoded blobs, we should only get encoded blobs (433 ms) 17:49:52 should handle L1 missed slots (328 ms) 17:49:52 should fall back to archive client (348 ms) 17:49:52 17:49:52 Test Suites: 1 passed, 1 total 17:49:52 Tests: 13 passed, 13 total 17:49:52 Snapshots: 0 total 17:49:52 Time: 58.36 s 17:49:52 Ran all test suites matching blob-sink/src/client/http.test.ts. 17:49:52 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?