Parent Log: http://ci.aztec-labs.com/a124b8066e3d7f5d Command: 80c2da90db94773b yarn-project/scripts/run_test.sh blob-sink/src/client/http.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/634f8607a18c02c1d6e9ab5f302821fa8fc0e833 Env: REF_NAME=gh-readonly-queue/next/pr-15235-1107a5aec5cc4c3884ed30df5e1e4c4417fa4588 CURRENT_VERSION=0.87.6 CI_FULL=1 Date: Thu Jun 26 16:06:36 UTC 2025 System: ARCH=amd64 CPUS=128 MEM=493Gi HOSTNAME=pr-15235_amd64_x1-full Resources: CPU_LIST=0-127 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_ed69c995f9b9d850_next 16:06:40 [16:06:40.432] INFO: blob-sink:server Server is running on http://localhost:41391 16:06:41 [16:06:41.028] INFO: blob-sink:server Received blob sidecar for block 0x1234 16:06:41 [16:06:41.035] INFO: blob-sink:server Blob sidecar stored successfully for block 0x1234 16:06:41 [16:06:41.198] INFO: blob-sink:server Stopping blob sink 16:06:41 [16:06:41.200] INFO: blob-sink:server Blob sink stopped 16:06:41 [16:06:41.205] INFO: blob-sink:server Server is running on http://localhost:41489 16:06:41 [16:06:41.282] INFO: blob-sink:server Received blob sidecar for block 0x5678 16:06:41 [16:06:41.285] INFO: blob-sink:server Blob sidecar stored successfully for block 0x5678 16:06:41 [16:06:41.454] INFO: blob-sink:server Stopping blob sink 16:06:41 [16:06:41.458] INFO: blob-sink:server Blob sink stopped 16:06:41 [16:06:41.460] INFO: blob-sink:server Server is running on http://localhost:43457 16:06:41 [16:06:41.467] WARN: blob-sink:client Unable to get blob sidecar for 0xnonexistent: Bad Request (400) {"status":400,"statusText":"Bad Request","body":"{\"error\":\"Invalid block_id parameter\"}"} 16:06:41 [16:06:41.469] WARN: blob-sink:client Failed to fetch blobs for 0xnonexistent from all blob sources {"blobSinkUrl":"http://localhost:43457"} 16:06:41 [16:06:41.470] INFO: blob-sink:server Stopping blob sink 16:06:41 [16:06:41.471] INFO: blob-sink:server Blob sink stopped 16:06:41 [16:06:41.473] INFO: blob-sink:server Server is running on http://localhost:35561 16:06:46 [16:06:46.519] WARN: blob-sink:client Blob sink url configured, but unable to send blobs {"blobSinkUrl":"http://localhost:12345","blockHash":"0x1234"} 16:06:51 [16:06:51.551] WARN: blob-sink:client Error getting blob sidecar from http://localhost:12345: fetch failed 16:06:51 [16:06:51.552] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"blobSinkUrl":"http://localhost:12345"} 16:06:51 [16:06:51.552] INFO: blob-sink:server Stopping blob sink 16:06:51 [16:06:51.553] INFO: blob-sink:server Blob sink stopped 16:06:51 [16:06:51.554] INFO: blob-sink:server Server is running on http://localhost:44817 16:06:51 [16:06:51.587] INFO: blob-sink:server Server is running on http://localhost:38101 16:06:51 [16:06:51.633] INFO: blob-sink:server Received blob sidecar for block 0x1234 16:06:51 [16:06:51.634] INFO: blob-sink:server Blob sidecar stored successfully for block 0x1234 16:06:52 [16:06:52.074] INFO: blob-sink:server Stopping blob sink 16:06:52 [16:06:52.074] INFO: blob-sink:server Blob sink stopped 16:06:52 [16:06:52.075] INFO: blob-sink:server Stopping blob sink 16:06:52 [16:06:52.075] INFO: blob-sink:server Blob sink stopped 16:06:52 [16:06:52.077] INFO: blob-sink:server Server is running on http://localhost:38469 16:06:52 [16:06:52.615] INFO: blob-sink:server Stopping blob sink 16:06:52 [16:06:52.617] INFO: blob-sink:server Blob sink already stopped 16:06:52 [16:06:52.619] INFO: blob-sink:server Stopping blob sink 16:06:52 [16:06:52.620] INFO: blob-sink:server Blob sink stopped 16:06:52 [16:06:52.622] INFO: blob-sink:server Server is running on http://localhost:46493 16:06:57 [16:06:57.710] ERROR: blob-sink:client Error getting slot number: TypeError: Failed to parse URL from invalidURL/eth/v1/beacon/headers/0x1234 16:06:57 at node:internal/deps/undici/undici:13510:13 { 16:06:57 [cause]: TypeError: Invalid URL 16:06:57 at new URL (node:internal/url:818:25) 16:06:57 at new Request (node:internal/deps/undici/undici:9586:25) 16:06:57 at fetch (node:internal/deps/undici/undici:10315:25) 16:06:57 at fetch (node:internal/deps/undici/undici:13508:10) 16:06:57 at fetch (node:internal/bootstrap/web/exposed-window-or-worker:75:12) 16:06:57 at fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:34:15) 16:06:57 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:26) 16:06:57 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 16:06:57 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 16:06:57 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 16:06:57 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:225:30) { 16:06:57 code: 'ERR_INVALID_URL', 16:06:57 input: 'invalidURL/eth/v1/beacon/headers/0x1234' 16:06:57 } 16:06:57 } 16:07:02 [16:07:02.729] WARN: blob-sink:client Error getting blob sidecar from invalidURL: Failed to parse URL from invalidURL/eth/v1/beacon/blob_sidecars/2 16:07:03 [16:07:03.062] INFO: blob-sink:server Stopping blob sink 16:07:03 [16:07:03.062] INFO: blob-sink:server Blob sink already stopped 16:07:03 [16:07:03.063] INFO: blob-sink:server Stopping blob sink 16:07:03 [16:07:03.064] INFO: blob-sink:server Blob sink stopped 16:07:03 [16:07:03.066] INFO: blob-sink:server Server is running on http://localhost:40317 16:07:03 [16:07:03.475] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:44875"]} 16:07:03 [16:07:03.478] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:44875"]} 16:07:03 [16:07:03.479] INFO: blob-sink:server Stopping blob sink 16:07:03 [16:07:03.479] INFO: blob-sink:server Blob sink already stopped 16:07:03 [16:07:03.480] INFO: blob-sink:server Stopping blob sink 16:07:03 [16:07:03.480] INFO: blob-sink:server Blob sink stopped 16:07:03 [16:07:03.481] INFO: blob-sink:server Server is running on http://localhost:44845 16:07:03 [16:07:03.865] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:43161"]} 16:07:03 [16:07:03.868] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:43161"]} 16:07:03 [16:07:03.868] INFO: blob-sink:server Stopping blob sink 16:07:03 [16:07:03.869] INFO: blob-sink:server Blob sink already stopped 16:07:03 [16:07:03.869] INFO: blob-sink:server Stopping blob sink 16:07:03 [16:07:03.869] INFO: blob-sink:server Blob sink stopped 16:07:03 [16:07:03.871] INFO: blob-sink:server Server is running on http://localhost:38133 16:07:09 [16:07:09.204] ERROR: blob-sink:client Error getting slot number: TypeError: fetch failed 16:07:09 at node:internal/deps/undici/undici:13510:13 16:07:09 at processTicksAndRejections (node:internal/process/task_queues:105:5) 16:07:09 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:20) 16:07:09 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 16:07:09 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 16:07:09 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 16:07:09 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:337:24) { 16:07:09 [cause]: AggregateError: 16:07:09 at internalConnectMultiple (node:net:1139:18) 16:07:09 at afterConnectMultiple (node:net:1714:7) { 16:07:09 code: 'ECONNREFUSED', 16:07:09 [errors]: [ [Error], [Error] ] 16:07:09 } 16:07:09 } 16:07:14 [16:07:14.225] WARN: blob-sink:client Error getting blob sidecar from http://localhost:36717: fetch failed 16:07:19 [16:07:19.565] ERROR: blob-sink:client Error getting slot number: TypeError: fetch failed 16:07:19 at node:internal/deps/undici/undici:13510:13 16:07:19 at processTicksAndRejections (node:internal/process/task_queues:105:5) 16:07:19 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:20) 16:07:19 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 16:07:19 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 16:07:19 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 16:07:19 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:353:24) { 16:07:19 [cause]: AggregateError: 16:07:19 at internalConnectMultiple (node:net:1139:18) 16:07:19 at afterConnectMultiple (node:net:1714:7) { 16:07:19 code: 'ECONNREFUSED', 16:07:19 [errors]: [ [Error], [Error] ] 16:07:19 } 16:07:19 } 16:07:24 [16:07:24.575] ERROR: blob-sink:client Error getting slot number: TypeError: fetch failed 16:07:24 at node:internal/deps/undici/undici:13510:13 16:07:24 at processTicksAndRejections (node:internal/process/task_queues:105:5) 16:07:24 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:20) 16:07:24 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 16:07:24 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 16:07:24 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 16:07:24 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:353:24) { 16:07:24 [cause]: AggregateError: 16:07:24 at internalConnectMultiple (node:net:1139:18) 16:07:24 at afterConnectMultiple (node:net:1714:7) { 16:07:24 code: 'ECONNREFUSED', 16:07:24 [errors]: [ [Error], [Error] ] 16:07:24 } 16:07:24 } 16:07:29 [16:07:29.587] WARN: blob-sink:client Error getting blob sidecar from http://localhost:36717: fetch failed 16:07:34 [16:07:34.596] WARN: blob-sink:client Error getting blob sidecar from http://localhost:46009: fetch failed 16:07:35 [16:07:35.036] INFO: blob-sink:server Stopping blob sink 16:07:35 [16:07:35.037] INFO: blob-sink:server Blob sink already stopped 16:07:35 [16:07:35.038] INFO: blob-sink:server Stopping blob sink 16:07:35 [16:07:35.038] INFO: blob-sink:server Blob sink stopped 16:07:35 [16:07:35.040] INFO: blob-sink:server Server is running on http://localhost:39023 16:07:35 [16:07:35.102] WARN: blob-sink:client Failed to deserialise blob {"commitment":"0xac9b33f88693a12edf4f329f70bd5566667010ec76b68c7e1f8e29e6b7fda98568f6a9fd6a66f2d20bd5be080e3921aa"} 16:07:35 [16:07:35.529] INFO: blob-sink:server Stopping blob sink 16:07:35 [16:07:35.530] INFO: blob-sink:server Blob sink already stopped 16:07:35 [16:07:35.530] INFO: blob-sink:server Stopping blob sink 16:07:35 [16:07:35.531] INFO: blob-sink:server Blob sink stopped 16:07:35 [16:07:35.533] INFO: blob-sink:server Server is running on http://localhost:46365 16:07:35 [16:07:35.884] INFO: blob-sink:server Stopping blob sink 16:07:35 [16:07:35.884] INFO: blob-sink:server Blob sink already stopped 16:07:35 [16:07:35.885] INFO: blob-sink:server Stopping blob sink 16:07:35 [16:07:35.885] INFO: blob-sink:server Blob sink stopped 16:07:35 [16:07:35.886] INFO: blob-sink:server Server is running on http://localhost:41293 16:07:36 [16:07:36.213] INFO: blob-sink:server Stopping blob sink 16:07:36 [16:07:36.214] INFO: blob-sink:server Blob sink already stopped 16:07:36 [16:07:36.214] INFO: blob-sink:server Stopping blob sink 16:07:36 [16:07:36.214] INFO: blob-sink:server Blob sink stopped 16:07:36 PASS src/client/http.test.ts (59.1 s) 16:07:36 HttpBlobSinkClient 16:07:36 should send and retrieve blobs (780 ms) 16:07:36 should handle multiple blobs (256 ms) 16:07:36 should return empty array for non-existent block (12 ms) 16:07:36 should handle server connection errors gracefully (10081 ms) 16:07:36 Mock Ethereum Clients 16:07:36 should handle no consensus host (522 ms) 16:07:36 should request based on slot where consensus host is provided (544 ms) 16:07:36 should handle when multiple consensus hosts are provided (10443 ms) 16:07:36 should handle API keys without headers (415 ms) 16:07:36 should handle API keys in headers (390 ms) 16:07:36 should handle multiple consensus hosts with different API key methods (31168 ms) 16:07:36 even if we ask for non-encoded blobs, we should only get encoded blobs (492 ms) 16:07:36 should handle L1 missed slots (353 ms) 16:07:36 should fall back to archive client (330 ms) 16:07:36 16:07:36 Test Suites: 1 passed, 1 total 16:07:36 Tests: 13 passed, 13 total 16:07:36 Snapshots: 0 total 16:07:36 Time: 59.197 s 16:07:36 Ran all test suites matching blob-sink/src/client/http.test.ts. 16:07:36 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?