Parent Log: http://ci.aztec-labs.com/b22a7a04add8e9da Command: 1fec7f5307cfdb51 yarn-project/scripts/run_test.sh blob-sink/src/client/http.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/7e505bcd7fcd90a7d5fe893194272157cc9ec848 Env: REF_NAME=gh-readonly-queue/next/pr-15159-88a99fb5fb938035dfeff0d9ed0cfd81b9eb2c5a CURRENT_VERSION=0.87.6 CI_FULL=1 Date: Thu Jun 19 16:34:59 UTC 2025 System: ARCH=amd64 CPUS=128 MEM=493Gi HOSTNAME=pr-15159_amd64_x1-full Resources: CPU_LIST=0-127 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_ed69c995f9b9d850_next 16:35:06 [16:35:06.547] INFO: blob-sink:server Server is running on http://localhost:32881 16:35:06 [16:35:06.845] INFO: blob-sink:server Received blob sidecar for block 0x1234 16:35:06 [16:35:06.848] INFO: blob-sink:server Blob sidecar stored successfully for block 0x1234 16:35:06 [16:35:06.906] INFO: blob-sink:server Stopping blob sink 16:35:06 [16:35:06.908] INFO: blob-sink:server Blob sink stopped 16:35:06 [16:35:06.912] INFO: blob-sink:server Server is running on http://localhost:36181 16:35:07 [16:35:07.002] INFO: blob-sink:server Received blob sidecar for block 0x5678 16:35:07 [16:35:07.005] INFO: blob-sink:server Blob sidecar stored successfully for block 0x5678 16:35:07 [16:35:07.154] INFO: blob-sink:server Stopping blob sink 16:35:07 [16:35:07.156] INFO: blob-sink:server Blob sink stopped 16:35:07 [16:35:07.158] INFO: blob-sink:server Server is running on http://localhost:38245 16:35:07 [16:35:07.165] WARN: blob-sink:client Unable to get blob sidecar for 0xnonexistent: Bad Request (400) {"status":400,"statusText":"Bad Request","body":"{\"error\":\"Invalid block_id parameter\"}"} 16:35:07 [16:35:07.166] WARN: blob-sink:client Failed to fetch blobs for 0xnonexistent from all blob sources {"blobSinkUrl":"http://localhost:38245"} 16:35:07 [16:35:07.167] INFO: blob-sink:server Stopping blob sink 16:35:07 [16:35:07.168] INFO: blob-sink:server Blob sink stopped 16:35:07 [16:35:07.169] INFO: blob-sink:server Server is running on http://localhost:36493 16:35:12 [16:35:12.211] WARN: blob-sink:client Blob sink url configured, but unable to send blobs {"blobSinkUrl":"http://localhost:12345","blockHash":"0x1234"} 16:35:17 [16:35:17.227] WARN: blob-sink:client Error getting blob sidecar from http://localhost:12345: fetch failed 16:35:17 [16:35:17.229] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"blobSinkUrl":"http://localhost:12345"} 16:35:17 [16:35:17.230] INFO: blob-sink:server Stopping blob sink 16:35:17 [16:35:17.230] INFO: blob-sink:server Blob sink stopped 16:35:17 [16:35:17.233] INFO: blob-sink:server Server is running on http://localhost:39239 16:35:17 [16:35:17.281] INFO: blob-sink:server Server is running on http://localhost:40351 16:35:17 [16:35:17.300] INFO: blob-sink:server Received blob sidecar for block 0x1234 16:35:17 [16:35:17.303] INFO: blob-sink:server Blob sidecar stored successfully for block 0x1234 16:35:17 [16:35:17.690] INFO: blob-sink:server Stopping blob sink 16:35:17 [16:35:17.691] INFO: blob-sink:server Blob sink stopped 16:35:17 [16:35:17.694] INFO: blob-sink:server Stopping blob sink 16:35:17 [16:35:17.695] INFO: blob-sink:server Blob sink stopped 16:35:17 [16:35:17.697] INFO: blob-sink:server Server is running on http://localhost:35327 16:35:18 [16:35:18.131] INFO: blob-sink:server Stopping blob sink 16:35:18 [16:35:18.133] INFO: blob-sink:server Blob sink already stopped 16:35:18 [16:35:18.133] INFO: blob-sink:server Stopping blob sink 16:35:18 [16:35:18.134] INFO: blob-sink:server Blob sink stopped 16:35:18 [16:35:18.135] INFO: blob-sink:server Server is running on http://localhost:37583 16:35:23 [16:35:23.212] ERROR: blob-sink:client Error getting slot number: TypeError: Failed to parse URL from invalidURL/eth/v1/beacon/headers/0x1234 16:35:23 at node:internal/deps/undici/undici:13510:13 { 16:35:23 [cause]: TypeError: Invalid URL 16:35:23 at new URL (node:internal/url:818:25) 16:35:23 at new Request (node:internal/deps/undici/undici:9586:25) 16:35:23 at fetch (node:internal/deps/undici/undici:10315:25) 16:35:23 at fetch (node:internal/deps/undici/undici:13508:10) 16:35:23 at fetch (node:internal/bootstrap/web/exposed-window-or-worker:75:12) 16:35:23 at fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:34:15) 16:35:23 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:26) 16:35:23 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 16:35:23 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 16:35:23 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 16:35:23 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:225:30) { 16:35:23 code: 'ERR_INVALID_URL', 16:35:23 input: 'invalidURL/eth/v1/beacon/headers/0x1234' 16:35:23 } 16:35:23 } 16:35:28 [16:35:28.219] WARN: blob-sink:client Error getting blob sidecar from invalidURL: Failed to parse URL from invalidURL/eth/v1/beacon/blob_sidecars/2 16:35:28 [16:35:28.618] INFO: blob-sink:server Stopping blob sink 16:35:28 [16:35:28.618] INFO: blob-sink:server Blob sink already stopped 16:35:28 [16:35:28.619] INFO: blob-sink:server Stopping blob sink 16:35:28 [16:35:28.619] INFO: blob-sink:server Blob sink stopped 16:35:28 [16:35:28.622] INFO: blob-sink:server Server is running on http://localhost:39175 16:35:28 [16:35:28.993] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:34819"]} 16:35:28 [16:35:28.997] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:34819"]} 16:35:28 [16:35:28.998] INFO: blob-sink:server Stopping blob sink 16:35:28 [16:35:28.998] INFO: blob-sink:server Blob sink already stopped 16:35:28 [16:35:28.999] INFO: blob-sink:server Stopping blob sink 16:35:28 [16:35:28.999] INFO: blob-sink:server Blob sink stopped 16:35:29 [16:35:29.001] INFO: blob-sink:server Server is running on http://localhost:34253 16:35:29 [16:35:29.304] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:37795"]} 16:35:29 [16:35:29.308] WARN: blob-sink:client Failed to fetch blobs for 0x1234 from all blob sources {"l1ConsensusHostUrls":["http://localhost:37795"]} 16:35:29 [16:35:29.309] INFO: blob-sink:server Stopping blob sink 16:35:29 [16:35:29.309] INFO: blob-sink:server Blob sink already stopped 16:35:29 [16:35:29.310] INFO: blob-sink:server Stopping blob sink 16:35:29 [16:35:29.310] INFO: blob-sink:server Blob sink stopped 16:35:29 [16:35:29.312] INFO: blob-sink:server Server is running on http://localhost:39191 16:35:34 [16:35:34.710] ERROR: blob-sink:client Error getting slot number: TypeError: fetch failed 16:35:34 at node:internal/deps/undici/undici:13510:13 16:35:34 at processTicksAndRejections (node:internal/process/task_queues:105:5) 16:35:34 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:20) 16:35:34 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 16:35:34 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 16:35:34 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 16:35:34 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:337:24) { 16:35:34 [cause]: AggregateError: 16:35:34 at internalConnectMultiple (node:net:1139:18) 16:35:34 at afterConnectMultiple (node:net:1714:7) { 16:35:34 code: 'ECONNREFUSED', 16:35:34 [errors]: [ [Error], [Error] ] 16:35:34 } 16:35:34 } 16:35:39 [16:35:39.733] WARN: blob-sink:client Error getting blob sidecar from http://localhost:42437: fetch failed 16:35:45 [16:35:45.030] ERROR: blob-sink:client Error getting slot number: TypeError: fetch failed 16:35:45 at node:internal/deps/undici/undici:13510:13 16:35:45 at processTicksAndRejections (node:internal/process/task_queues:105:5) 16:35:45 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:20) 16:35:45 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 16:35:45 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 16:35:45 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 16:35:45 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:353:24) { 16:35:45 [cause]: AggregateError: 16:35:45 at internalConnectMultiple (node:net:1139:18) 16:35:45 at afterConnectMultiple (node:net:1714:7) { 16:35:45 code: 'ECONNREFUSED', 16:35:45 [errors]: [ [Error], [Error] ] 16:35:45 } 16:35:45 } 16:35:50 [16:35:50.040] ERROR: blob-sink:client Error getting slot number: TypeError: fetch failed 16:35:50 at node:internal/deps/undici/undici:13510:13 16:35:50 at processTicksAndRejections (node:internal/process/task_queues:105:5) 16:35:50 at retry (/home/aztec-dev/aztec-packages/yarn-project/foundation/dest/retry/index.js:54:20) 16:35:50 at HttpBlobSinkClient.fetch (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:33:14) 16:35:50 at HttpBlobSinkClient.getSlotNumber (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:340:21) 16:35:50 at HttpBlobSinkClient.getBlobSidecar (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.ts:187:26) 16:35:50 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/blob-sink/src/client/http.test.ts:353:24) { 16:35:50 [cause]: AggregateError: 16:35:50 at internalConnectMultiple (node:net:1139:18) 16:35:50 at afterConnectMultiple (node:net:1714:7) { 16:35:50 code: 'ECONNREFUSED', 16:35:50 [errors]: [ [Error], [Error] ] 16:35:50 } 16:35:50 } 16:35:55 [16:35:55.051] WARN: blob-sink:client Error getting blob sidecar from http://localhost:42437: fetch failed 16:36:00 [16:36:00.061] WARN: blob-sink:client Error getting blob sidecar from http://localhost:33483: fetch failed 16:36:00 [16:36:00.446] INFO: blob-sink:server Stopping blob sink 16:36:00 [16:36:00.447] INFO: blob-sink:server Blob sink already stopped 16:36:00 [16:36:00.447] INFO: blob-sink:server Stopping blob sink 16:36:00 [16:36:00.448] INFO: blob-sink:server Blob sink stopped 16:36:00 [16:36:00.449] INFO: blob-sink:server Server is running on http://localhost:40363 16:36:00 [16:36:00.517] WARN: blob-sink:client Failed to deserialise blob {"commitment":"0x986fa001fa047a49e6c6de326bc08ef93397ea31bc18e58626bc15ad3b62b4332328dbb61aa88a03a05da4156afc93ba"} 16:36:00 [16:36:00.829] INFO: blob-sink:server Stopping blob sink 16:36:00 [16:36:00.830] INFO: blob-sink:server Blob sink already stopped 16:36:00 [16:36:00.830] INFO: blob-sink:server Stopping blob sink 16:36:00 [16:36:00.831] INFO: blob-sink:server Blob sink stopped 16:36:00 [16:36:00.832] INFO: blob-sink:server Server is running on http://localhost:38167 16:36:01 [16:36:01.257] INFO: blob-sink:server Stopping blob sink 16:36:01 [16:36:01.257] INFO: blob-sink:server Blob sink already stopped 16:36:01 [16:36:01.258] INFO: blob-sink:server Stopping blob sink 16:36:01 [16:36:01.258] INFO: blob-sink:server Blob sink stopped 16:36:01 [16:36:01.259] INFO: blob-sink:server Server is running on http://localhost:33541 16:36:01 [16:36:01.623] INFO: blob-sink:server Stopping blob sink 16:36:01 [16:36:01.624] INFO: blob-sink:server Blob sink already stopped 16:36:01 [16:36:01.624] INFO: blob-sink:server Stopping blob sink 16:36:01 [16:36:01.625] INFO: blob-sink:server Blob sink stopped 16:36:01 PASS src/client/http.test.ts (60.515 s) 16:36:01 HttpBlobSinkClient 16:36:01 should send and retrieve blobs (372 ms) 16:36:01 should handle multiple blobs (247 ms) 16:36:01 should return empty array for non-existent block (11 ms) 16:36:01 should handle server connection errors gracefully (10063 ms) 16:36:01 Mock Ethereum Clients 16:36:01 should handle no consensus host (463 ms) 16:36:01 should request based on slot where consensus host is provided (438 ms) 16:36:01 should handle when multiple consensus hosts are provided (10485 ms) 16:36:01 should handle API keys without headers (380 ms) 16:36:01 should handle API keys in headers (311 ms) 16:36:01 should handle multiple consensus hosts with different API key methods (31137 ms) 16:36:01 even if we ask for non-encoded blobs, we should only get encoded blobs (382 ms) 16:36:01 should handle L1 missed slots (427 ms) 16:36:01 should fall back to archive client (367 ms) 16:36:01 16:36:01 Test Suites: 1 passed, 1 total 16:36:01 Tests: 13 passed, 13 total 16:36:01 Snapshots: 0 total 16:36:01 Time: 60.607 s 16:36:01 Ran all test suites matching blob-sink/src/client/http.test.ts. 16:36:01 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?