Parent Log: http://ci.aztec-labs.com/fc0133061c7951d2 Command: abf2df8792edab68 yarn-project/scripts/run_test.sh blob-sink/src/client/http.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/15da5b0f4fc17ee864697604093cf1ff2bd900d2 Env: REF_NAME=gh-readonly-queue/staging/pr-15174-a1fcc6d25d2ef5242bc875b44f6b8c627357a0d1 CURRENT_VERSION=0.87.6 CI_FULL=1 Date: Fri Jun 20 12:50:55 UTC 2025 System: ARCH=amd64 CPUS=128 MEM=493Gi HOSTNAME=pr-15174_amd64_x3-full Resources: CPU_LIST=0-127 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_ed69c995f9b9d850_staging 12:51:01 [12:51:01.434] INFO: blob-sink:server Server is running on http://localhost:40859 12:51:01 [12:51:01.723] INFO: blob-sink:server Received blob sidecar for block 0x1234 12:51:01 [12:51:01.725] INFO: blob-sink:server Blob sidecar stored successfully for block 0x1234 12:51:01 [12:51:01.777] INFO: blob-sink:server Stopping blob sink 12:51:01 [12:51:01.778] INFO: blob-sink:server Blob sink stopped 12:51:01 [12:51:01.783] INFO: blob-sink:server Server is running on http://localhost:40667 12:51:01 [12:51:01.830] INFO: blob-sink:server Received blob sidecar for block 0x5678 12:51:01 [12:51:01.833] INFO: blob-sink:server Blob sidecar stored successfully for block 0x5678 12:51:01 [12:51:01.958] INFO: blob-sink:server Stopping blob sink 12:51:01 [12:51:01.960] INFO: blob-sink:server Blob sink stopped 12:51:01 [12:51:01.962] INFO: blob-sink:server Server is running on http://localhost:35337 12:51:01 [12:51:01.973] WARN: blob-sink:client Unable to get blob sidecar for 0xnonexistent: Bad Request (400) {"status":400,"statusText":"Bad Request","body":"{\"error\":\"Invalid block_id parameter\"}"} 12:51:01 [12:51:01.975] WARN: blob-sink:client Failed to fetch blobs for 0xnonexistent from all blob sources {"blobSinkUrl":"http://localhost:35337"} 12:51:01 [12:51:01.977] INFO: blob-sink:server Stopping blob sink 12:51:01 [12:51:01.978] INFO: blob-sink:server Blob sink stopped 12:51:01 [12:51:01.980] INFO: blob-sink:server Server is running on http://localhost:35801 12:51:07 [12:51:07.011] WARN: blob-sink:client Blob sink url configured, but unable to send blobs {"blobSinkUrl":"http://localhost:12345","blockHash":"0x1234"} 12:51:12 [12:51:12.023] WARN: blob-sink:client Error getting blob sidecar from http://localhost:12345: fetch failed 12:51:12 [12:51:12.024] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"blobSinkUrl":"http://localhost:12345"} 12:51:12 [12:51:12.025] INFO: blob-sink:server Stopping blob sink 12:51:12 [12:51:12.026] INFO: blob-sink:server Blob sink stopped 12:51:12 [12:51:12.028] INFO: blob-sink:server Server is running on http://localhost:35607 12:51:12 [12:51:12.064] INFO: blob-sink:server Server is running on http://localhost:33013 12:51:12 [12:51:12.071] INFO: blob-sink:server Received blob sidecar for block 0x1234 12:51:12 [12:51:12.073] INFO: blob-sink:server Blob sidecar stored successfully for block 0x1234 12:51:12 [12:51:12.471] INFO: blob-sink:server Stopping blob sink 12:51:12 [12:51:12.472] INFO: blob-sink:server Blob sink stopped 12:51:12 [12:51:12.473] INFO: blob-sink:server Stopping blob sink 12:51:12 [12:51:12.473] INFO: blob-sink:server Blob sink stopped 12:51:12 [12:51:12.475] INFO: blob-sink:server Server is running on http://localhost:36933 12:51:12 [12:51:12.839] INFO: blob-sink:server Stopping blob sink 12:51:12 [12:51:12.839] INFO: blob-sink:server Blob sink already stopped 12:51:12 [12:51:12.840] INFO: blob-sink:server Stopping blob sink 12:51:12 [12:51:12.841] INFO: blob-sink:server Blob sink stopped 12:51:12 [12:51:12.842] INFO: blob-sink:server Server is running on http://localhost:45463 12:51:17 [12:51:17.912] ERROR: blob-sink:client Error getting slot number: TypeError: Failed to parse URL from invalidURL/eth/v1/beacon/headers/0x1234 12:51:17 at node:internal/deps/undici/undici:13510:13 12:51:17 at runNextTicks (node:internal/process/task_queues:65:5) 12:51:17 at processTimers (node:internal/timers:520:9) { 12:51:17 [cause]: TypeError: Invalid URL 12:51:17 at new URL (node:internal/url:818:25) 12:51:17 at new Request (node:internal/deps/undici/undici:9586:25) 12:51:17 at fetch (node:internal/deps/undici/undici:10315:25) 12:51:17 at fetch (node:internal/deps/undici/undici:13508:10) 12:51:17 at fetch (node:internal/bootstrap/web/exposed-window-or-worker:75:12) 12:51:17 at fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:34:15) 12:51:17 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:26) 12:51:17 at runNextTicks (node:internal/process/task_queues:65:5) 12:51:17 at processTimers (node:internal/timers:520:9) 12:51:17 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 12:51:17 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 12:51:17 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 12:51:17 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:225:30) { 12:51:17 code: 'ERR_INVALID_URL', 12:51:17 input: 'invalidURL/eth/v1/beacon/headers/0x1234' 12:51:17 } 12:51:17 } 12:51:22 [12:51:22.921] WARN: blob-sink:client Error getting blob sidecar from invalidURL: Failed to parse URL from invalidURL/eth/v1/beacon/blob_sidecars/2 12:51:23 [12:51:23.372] INFO: blob-sink:server Stopping blob sink 12:51:23 [12:51:23.373] INFO: blob-sink:server Blob sink already stopped 12:51:23 [12:51:23.373] INFO: blob-sink:server Stopping blob sink 12:51:23 [12:51:23.374] INFO: blob-sink:server Blob sink stopped 12:51:23 [12:51:23.376] INFO: blob-sink:server Server is running on http://localhost:34657 12:51:23 [12:51:23.775] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:35809"]} 12:51:23 [12:51:23.780] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:35809"]} 12:51:23 [12:51:23.780] INFO: blob-sink:server Stopping blob sink 12:51:23 [12:51:23.780] INFO: blob-sink:server Blob sink already stopped 12:51:23 [12:51:23.781] INFO: blob-sink:server Stopping blob sink 12:51:23 [12:51:23.781] INFO: blob-sink:server Blob sink stopped 12:51:23 [12:51:23.783] INFO: blob-sink:server Server is running on http://localhost:42993 12:51:24 [12:51:24.219] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:36703"]} 12:51:24 [12:51:24.224] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:36703"]} 12:51:24 [12:51:24.225] INFO: blob-sink:server Stopping blob sink 12:51:24 [12:51:24.225] INFO: blob-sink:server Blob sink already stopped 12:51:24 [12:51:24.226] INFO: blob-sink:server Stopping blob sink 12:51:24 [12:51:24.226] INFO: blob-sink:server Blob sink stopped 12:51:24 [12:51:24.228] INFO: blob-sink:server Server is running on http://localhost:35363 12:51:29 [12:51:29.650] ERROR: blob-sink:client Error getting slot number: TypeError: fetch failed 12:51:29 at node:internal/deps/undici/undici:13510:13 12:51:29 at processTicksAndRejections (node:internal/process/task_queues:105:5) 12:51:29 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:20) 12:51:29 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 12:51:29 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 12:51:29 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 12:51:29 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:337:24) { 12:51:29 [cause]: AggregateError: 12:51:29 at internalConnectMultiple (node:net:1139:18) 12:51:29 at afterConnectMultiple (node:net:1714:7) { 12:51:29 code: 'ECONNREFUSED', 12:51:29 [errors]: [ [Error], [Error] ] 12:51:29 } 12:51:29 } 12:51:34 [12:51:34.673] WARN: blob-sink:client Error getting blob sidecar from http://localhost:45183: fetch failed 12:51:40 [12:51:40.042] ERROR: blob-sink:client Error getting slot number: TypeError: fetch failed 12:51:40 at node:internal/deps/undici/undici:13510:13 12:51:40 at processTicksAndRejections (node:internal/process/task_queues:105:5) 12:51:40 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:20) 12:51:40 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 12:51:40 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 12:51:40 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 12:51:40 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:353:24) { 12:51:40 [cause]: AggregateError: 12:51:40 at internalConnectMultiple (node:net:1139:18) 12:51:40 at afterConnectMultiple (node:net:1714:7) { 12:51:40 code: 'ECONNREFUSED', 12:51:40 [errors]: [ [Error], [Error] ] 12:51:40 } 12:51:40 } 12:51:45 [12:51:45.062] ERROR: blob-sink:client Error getting slot number: TypeError: fetch failed 12:51:45 at node:internal/deps/undici/undici:13510:13 12:51:45 at processTicksAndRejections (node:internal/process/task_queues:105:5) 12:51:45 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:20) 12:51:45 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 12:51:45 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 12:51:45 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 12:51:45 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:353:24) { 12:51:45 [cause]: AggregateError: 12:51:45 at internalConnectMultiple (node:net:1139:18) 12:51:45 at afterConnectMultiple (node:net:1714:7) { 12:51:45 code: 'ECONNREFUSED', 12:51:45 [errors]: [ [Error], [Error] ] 12:51:45 } 12:51:45 } 12:51:50 [12:51:50.073] WARN: blob-sink:client Error getting blob sidecar from http://localhost:45183: fetch failed 12:51:55 [12:51:55.084] WARN: blob-sink:client Error getting blob sidecar from http://localhost:41361: fetch failed 12:51:55 [12:51:55.553] INFO: blob-sink:server Stopping blob sink 12:51:55 [12:51:55.553] INFO: blob-sink:server Blob sink already stopped 12:51:55 [12:51:55.554] INFO: blob-sink:server Stopping blob sink 12:51:55 [12:51:55.554] INFO: blob-sink:server Blob sink stopped 12:51:55 [12:51:55.557] INFO: blob-sink:server Server is running on http://localhost:43927 12:51:55 [12:51:55.620] WARN: blob-sink:client Failed to deserialise blob {"commitment":"0x88d22aab7ce0478dce96a0a13a6f1602df4b1d1f5af4155e477d015434b435b13450fd74438ba717e6f884a04801ce58"} 12:51:56 [12:51:56.073] INFO: blob-sink:server Stopping blob sink 12:51:56 [12:51:56.073] INFO: blob-sink:server Blob sink already stopped 12:51:56 [12:51:56.074] INFO: blob-sink:server Stopping blob sink 12:51:56 [12:51:56.074] INFO: blob-sink:server Blob sink stopped 12:51:56 [12:51:56.076] INFO: blob-sink:server Server is running on http://localhost:45605 12:51:56 [12:51:56.515] INFO: blob-sink:server Stopping blob sink 12:51:56 [12:51:56.515] INFO: blob-sink:server Blob sink already stopped 12:51:56 [12:51:56.516] INFO: blob-sink:server Stopping blob sink 12:51:56 [12:51:56.516] INFO: blob-sink:server Blob sink stopped 12:51:56 [12:51:56.517] INFO: blob-sink:server Server is running on http://localhost:34801 12:51:56 [12:51:56.844] INFO: blob-sink:server Stopping blob sink 12:51:56 [12:51:56.844] INFO: blob-sink:server Blob sink already stopped 12:51:56 [12:51:56.844] INFO: blob-sink:server Stopping blob sink 12:51:56 [12:51:56.845] INFO: blob-sink:server Blob sink stopped 12:51:56 PASS src/client/http.test.ts (59.842 s) 12:51:56 HttpBlobSinkClient 12:51:56 should send and retrieve blobs (353 ms) 12:51:56 should handle multiple blobs (180 ms) 12:51:56 should return empty array for non-existent block (17 ms) 12:51:56 should handle server connection errors gracefully (10047 ms) 12:51:56 Mock Ethereum Clients 12:51:56 should handle no consensus host (446 ms) 12:51:56 should request based on slot where consensus host is provided (367 ms) 12:51:56 should handle when multiple consensus hosts are provided (10533 ms) 12:51:56 should handle API keys without headers (407 ms) 12:51:56 should handle API keys in headers (444 ms) 12:51:56 should handle multiple consensus hosts with different API key methods (31328 ms) 12:51:56 even if we ask for non-encoded blobs, we should only get encoded blobs (520 ms) 12:51:56 should handle L1 missed slots (441 ms) 12:51:56 should fall back to archive client (329 ms) 12:51:56 12:51:56 Test Suites: 1 passed, 1 total 12:51:56 Tests: 13 passed, 13 total 12:51:56 Snapshots: 0 total 12:51:56 Time: 59.939 s 12:51:56 Ran all test suites matching blob-sink/src/client/http.test.ts. 12:51:56 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?