Parent Log: http://ci.aztec-labs.com/95979217b3f59e6f Command: 2f76ae4bba915073 yarn-project/scripts/run_test.sh blob-sink/src/client/http.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/87c4b689268afecc86ab007c3587e45110daa43d Env: REF_NAME=gh-readonly-queue/next/pr-15220-282da3bd25d49b92970e6fc85f110092e8566299 CURRENT_VERSION=0.87.6 CI_FULL=1 Date: Tue Jun 24 16:34:17 UTC 2025 System: ARCH=amd64 CPUS=128 MEM=493Gi HOSTNAME=pr-15220_amd64_x4-full Resources: CPU_LIST=0-127 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_ed69c995f9b9d850_next 16:34:21 [16:34:21.386] INFO: blob-sink:server Server is running on http://localhost:40733 16:34:21 [16:34:21.677] INFO: blob-sink:server Received blob sidecar for block 0x1234 16:34:21 [16:34:21.681] INFO: blob-sink:server Blob sidecar stored successfully for block 0x1234 16:34:21 [16:34:21.733] INFO: blob-sink:server Stopping blob sink 16:34:21 [16:34:21.735] INFO: blob-sink:server Blob sink stopped 16:34:21 [16:34:21.739] INFO: blob-sink:server Server is running on http://localhost:46791 16:34:21 [16:34:21.791] INFO: blob-sink:server Received blob sidecar for block 0x5678 16:34:21 [16:34:21.795] INFO: blob-sink:server Blob sidecar stored successfully for block 0x5678 16:34:21 [16:34:21.913] INFO: blob-sink:server Stopping blob sink 16:34:21 [16:34:21.915] INFO: blob-sink:server Blob sink stopped 16:34:21 [16:34:21.917] INFO: blob-sink:server Server is running on http://localhost:45687 16:34:21 [16:34:21.923] WARN: blob-sink:client Unable to get blob sidecar for 0xnonexistent: Bad Request (400) {"status":400,"statusText":"Bad Request","body":"{\"error\":\"Invalid block_id parameter\"}"} 16:34:21 [16:34:21.924] WARN: blob-sink:client Failed to fetch blobs for 0xnonexistent from all blob sources {"blobSinkUrl":"http://localhost:45687"} 16:34:21 [16:34:21.925] INFO: blob-sink:server Stopping blob sink 16:34:21 [16:34:21.925] INFO: blob-sink:server Blob sink stopped 16:34:21 [16:34:21.927] INFO: blob-sink:server Server is running on http://localhost:37453 16:34:26 [16:34:26.970] WARN: blob-sink:client Blob sink url configured, but unable to send blobs {"blobSinkUrl":"http://localhost:12345","blockHash":"0x1234"} 16:34:31 [16:34:31.997] WARN: blob-sink:client Error getting blob sidecar from http://localhost:12345: fetch failed 16:34:32 [16:34:31.999] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"blobSinkUrl":"http://localhost:12345"} 16:34:32 [16:34:32.001] INFO: blob-sink:server Stopping blob sink 16:34:32 [16:34:32.001] INFO: blob-sink:server Blob sink stopped 16:34:32 [16:34:32.005] INFO: blob-sink:server Server is running on http://localhost:44325 16:34:32 [16:34:32.048] INFO: blob-sink:server Server is running on http://localhost:45941 16:34:32 [16:34:32.059] INFO: blob-sink:server Received blob sidecar for block 0x1234 16:34:32 [16:34:32.062] INFO: blob-sink:server Blob sidecar stored successfully for block 0x1234 16:34:32 [16:34:32.442] INFO: blob-sink:server Stopping blob sink 16:34:32 [16:34:32.443] INFO: blob-sink:server Blob sink stopped 16:34:32 [16:34:32.444] INFO: blob-sink:server Stopping blob sink 16:34:32 [16:34:32.444] INFO: blob-sink:server Blob sink stopped 16:34:32 [16:34:32.446] INFO: blob-sink:server Server is running on http://localhost:40579 16:34:32 [16:34:32.969] INFO: blob-sink:server Stopping blob sink 16:34:32 [16:34:32.971] INFO: blob-sink:server Blob sink already stopped 16:34:32 [16:34:32.974] INFO: blob-sink:server Stopping blob sink 16:34:32 [16:34:32.976] INFO: blob-sink:server Blob sink stopped 16:34:32 [16:34:32.983] INFO: blob-sink:server Server is running on http://localhost:33493 16:34:38 [16:34:38.056] ERROR: blob-sink:client Error getting slot number: TypeError: Failed to parse URL from invalidURL/eth/v1/beacon/headers/0x1234 16:34:38 at node:internal/deps/undici/undici:13510:13 16:34:38 at runNextTicks (node:internal/process/task_queues:65:5) 16:34:38 at processTimers (node:internal/timers:520:9) { 16:34:38 [cause]: TypeError: Invalid URL 16:34:38 at new URL (node:internal/url:818:25) 16:34:38 at new Request (node:internal/deps/undici/undici:9586:25) 16:34:38 at fetch (node:internal/deps/undici/undici:10315:25) 16:34:38 at fetch (node:internal/deps/undici/undici:13508:10) 16:34:38 at fetch (node:internal/bootstrap/web/exposed-window-or-worker:75:12) 16:34:38 at fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:34:15) 16:34:38 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:26) 16:34:38 at runNextTicks (node:internal/process/task_queues:65:5) 16:34:38 at processTimers (node:internal/timers:520:9) 16:34:38 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 16:34:38 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 16:34:38 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 16:34:38 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:225:30) { 16:34:38 code: 'ERR_INVALID_URL', 16:34:38 input: 'invalidURL/eth/v1/beacon/headers/0x1234' 16:34:38 } 16:34:38 } 16:34:43 [16:34:43.063] WARN: blob-sink:client Error getting blob sidecar from invalidURL: Failed to parse URL from invalidURL/eth/v1/beacon/blob_sidecars/2 16:34:43 [16:34:43.397] INFO: blob-sink:server Stopping blob sink 16:34:43 [16:34:43.398] INFO: blob-sink:server Blob sink already stopped 16:34:43 [16:34:43.399] INFO: blob-sink:server Stopping blob sink 16:34:43 [16:34:43.399] INFO: blob-sink:server Blob sink stopped 16:34:43 [16:34:43.401] INFO: blob-sink:server Server is running on http://localhost:33057 16:34:43 [16:34:43.807] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:37625"]} 16:34:43 [16:34:43.814] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:37625"]} 16:34:43 [16:34:43.815] INFO: blob-sink:server Stopping blob sink 16:34:43 [16:34:43.815] INFO: blob-sink:server Blob sink already stopped 16:34:43 [16:34:43.815] INFO: blob-sink:server Stopping blob sink 16:34:43 [16:34:43.816] INFO: blob-sink:server Blob sink stopped 16:34:43 [16:34:43.817] INFO: blob-sink:server Server is running on http://localhost:44247 16:34:44 [16:34:44.244] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:38581"]} 16:34:44 [16:34:44.249] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:38581"]} 16:34:44 [16:34:44.250] INFO: blob-sink:server Stopping blob sink 16:34:44 [16:34:44.250] INFO: blob-sink:server Blob sink already stopped 16:34:44 [16:34:44.251] INFO: blob-sink:server Stopping blob sink 16:34:44 [16:34:44.251] INFO: blob-sink:server Blob sink stopped 16:34:44 [16:34:44.253] INFO: blob-sink:server Server is running on http://localhost:32933 16:34:49 [16:34:49.647] ERROR: blob-sink:client Error getting slot number: TypeError: fetch failed 16:34:49 at node:internal/deps/undici/undici:13510:13 16:34:49 at processTicksAndRejections (node:internal/process/task_queues:105:5) 16:34:49 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:20) 16:34:49 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 16:34:49 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 16:34:49 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 16:34:49 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:337:24) { 16:34:49 [cause]: AggregateError: 16:34:49 at internalConnectMultiple (node:net:1139:18) 16:34:49 at afterConnectMultiple (node:net:1714:7) { 16:34:49 code: 'ECONNREFUSED', 16:34:49 [errors]: [ [Error], [Error] ] 16:34:49 } 16:34:49 } 16:34:54 [16:34:54.659] WARN: blob-sink:client Error getting blob sidecar from http://localhost:40279: fetch failed 16:35:00 [16:35:00.032] ERROR: blob-sink:client Error getting slot number: TypeError: fetch failed 16:35:00 at node:internal/deps/undici/undici:13510:13 16:35:00 at processTicksAndRejections (node:internal/process/task_queues:105:5) 16:35:00 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:20) 16:35:00 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 16:35:00 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 16:35:00 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 16:35:00 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:353:24) { 16:35:00 [cause]: AggregateError: 16:35:00 at internalConnectMultiple (node:net:1139:18) 16:35:00 at afterConnectMultiple (node:net:1714:7) { 16:35:00 code: 'ECONNREFUSED', 16:35:00 [errors]: [ [Error], [Error] ] 16:35:00 } 16:35:00 } 16:35:05 [16:35:05.041] ERROR: blob-sink:client Error getting slot number: TypeError: fetch failed 16:35:05 at node:internal/deps/undici/undici:13510:13 16:35:05 at processTicksAndRejections (node:internal/process/task_queues:105:5) 16:35:05 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:20) 16:35:05 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 16:35:05 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 16:35:05 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 16:35:05 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:353:24) { 16:35:05 [cause]: AggregateError: 16:35:05 at internalConnectMultiple (node:net:1139:18) 16:35:05 at afterConnectMultiple (node:net:1714:7) { 16:35:05 code: 'ECONNREFUSED', 16:35:05 [errors]: [ [Error], [Error] ] 16:35:05 } 16:35:05 } 16:35:10 [16:35:10.051] WARN: blob-sink:client Error getting blob sidecar from http://localhost:40279: fetch failed 16:35:15 [16:35:15.061] WARN: blob-sink:client Error getting blob sidecar from http://localhost:40341: fetch failed 16:35:15 [16:35:15.467] INFO: blob-sink:server Stopping blob sink 16:35:15 [16:35:15.468] INFO: blob-sink:server Blob sink already stopped 16:35:15 [16:35:15.470] INFO: blob-sink:server Stopping blob sink 16:35:15 [16:35:15.470] INFO: blob-sink:server Blob sink stopped 16:35:15 [16:35:15.472] INFO: blob-sink:server Server is running on http://localhost:39987 16:35:15 [16:35:15.704] WARN: blob-sink:client Failed to deserialise blob {"commitment":"0x90460d39cc908117979b95c26aaebfcda5387f3e08ab0dd647df026393da0d233ef1479d72c77b768605cf3289ad23f7"} 16:35:16 [16:35:16.016] INFO: blob-sink:server Stopping blob sink 16:35:16 [16:35:16.016] INFO: blob-sink:server Blob sink already stopped 16:35:16 [16:35:16.017] INFO: blob-sink:server Stopping blob sink 16:35:16 [16:35:16.018] INFO: blob-sink:server Blob sink stopped 16:35:16 [16:35:16.019] INFO: blob-sink:server Server is running on http://localhost:41633 16:35:16 [16:35:16.319] INFO: blob-sink:server Stopping blob sink 16:35:16 [16:35:16.320] INFO: blob-sink:server Blob sink already stopped 16:35:16 [16:35:16.320] INFO: blob-sink:server Stopping blob sink 16:35:16 [16:35:16.321] INFO: blob-sink:server Blob sink stopped 16:35:16 [16:35:16.322] INFO: blob-sink:server Server is running on http://localhost:39987 16:35:16 [16:35:16.634] INFO: blob-sink:server Stopping blob sink 16:35:16 [16:35:16.635] INFO: blob-sink:server Blob sink already stopped 16:35:16 [16:35:16.635] INFO: blob-sink:server Stopping blob sink 16:35:16 [16:35:16.636] INFO: blob-sink:server Blob sink stopped 16:35:16 PASS src/client/http.test.ts (58.298 s) 16:35:16 HttpBlobSinkClient 16:35:16 should send and retrieve blobs (358 ms) 16:35:16 should handle multiple blobs (177 ms) 16:35:16 should return empty array for non-existent block (10 ms) 16:35:16 should handle server connection errors gracefully (10076 ms) 16:35:16 Mock Ethereum Clients 16:35:16 should handle no consensus host (441 ms) 16:35:16 should request based on slot where consensus host is provided (532 ms) 16:35:16 should handle when multiple consensus hosts are provided (10421 ms) 16:35:16 should handle API keys without headers (416 ms) 16:35:16 should handle API keys in headers (436 ms) 16:35:16 should handle multiple consensus hosts with different API key methods (31219 ms) 16:35:16 even if we ask for non-encoded blobs, we should only get encoded blobs (547 ms) 16:35:16 should handle L1 missed slots (302 ms) 16:35:16 should fall back to archive client (315 ms) 16:35:16 16:35:16 Test Suites: 1 passed, 1 total 16:35:16 Tests: 13 passed, 13 total 16:35:16 Snapshots: 0 total 16:35:16 Time: 58.38 s 16:35:16 Ran all test suites matching blob-sink/src/client/http.test.ts. 16:35:16 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?