Parent Log: http://ci.aztec-labs.com/3faf212eece173a6 Command: 71ec8227227d28e6 yarn-project/scripts/run_test.sh validator-client/src/validator.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/a45107e7f95b675cb2768b6bcb06483b511141f4 Env: REF_NAME=v1.0.0-nightly.20250613 CURRENT_VERSION=0.87.6 CI_FULL=1 Date: Fri Jun 13 02:51:07 UTC 2025 System: ARCH=amd64 CPUS=128 MEM=493Gi HOSTNAME=v1_0_0-nightly_20250613_amd64_x-nightly Resources: CPU_LIST=0-127 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_6f10fb814a4bcca8_v1.0.0-nightly.20250613 02:51:14 [02:51:14.727] ERROR: validator Timeout 2025-06-13T02:51:13.816Z waiting for 3 attestations for slot 1796 02:51:16 [02:51:16.241] ERROR: validator Timeout 2025-06-13T02:51:15.339Z waiting for 2 attestations for slot 1796 02:51:16 [02:51:16.310] INFO: validator Retrieved 6/6 txs for block proposal {"blockNumber":1795,"slotNumber":1796,"totalTxsInProposal":6,"txsFromProposal":0,"txsFromMempool":6,"txsFromP2P":0,"missingTxs":0} 02:51:16 [02:51:16.311] INFO: validator Attesting to proposal for slot 1796 {"slotNumber":1796,"blockNumber":1795,"archive":"0x2c52cc1320bd8f93702e6a5818dfcbfa0df05692d8fabbe64cd6e0a5af4afab1","txCount":6,"txHashes":["0x05d022e6c870462da1d8be55fe636ad6cc46163e2a81a10cdbc17634e49907c9","0x24e9be425abf1852fccaa338fdc490b3ae7242da63123f860111bfe361b6dccd","0x222f889bc2746385eb6aab2ee1f4230393635d84edbd2a9e3f1b3006303a0550","0x2b2e0b448dd9cb171050147d87f892eebeeda9434004c8d58629c72643d2ff89","0x03e3aaf7b61bd481cd7d09f15757f567cd612e52fba23f3829b67f4c2d8ff61c","0x1719f41f1d39781b7671584d86e8c5015762d305499096cd4c3709079fad27d8"]} 02:51:16 [02:51:16.324] INFO: validator Retrieved 6/6 txs for block proposal {"blockNumber":1795,"slotNumber":1796,"totalTxsInProposal":6,"txsFromProposal":0,"txsFromMempool":6,"txsFromP2P":0,"missingTxs":0} 02:51:16 [02:51:16.326] INFO: validator Attesting to proposal for slot 1796 {"slotNumber":1796,"blockNumber":1795,"archive":"0x2d42b51c39c064298f984a242863d4f1729ed3317888f48c77af10589f7b550d","txCount":6,"txHashes":["0x0b215e53fc2a3cf02b4e4d512b0ffda6108ae10a0f6f482f4ecd29e0c4f94c01","0x06f23d9dde6fea98cb2c16aba79b31607accd951e893528d3389b047346ac8d5","0x0eb5f5f1cce071f412c21f9412928ad7346343b1f839c634ff8e99383b376536","0x2ffe8dce093f0fbbfd163f81a8dce3460df545d032a5ca94f67f43c3cb9152be","0x174b5113efbf0d2c442376df7b41a1bbd7cbaa4cd21cf201e6015fcd2633cd75","0x028fa778de6f1f01bdb545a2f1450af95bbc42fb9df1b6efdea6f007bf76ad8b"]} 02:51:16 [02:51:16.345] INFO: validator Retrieved 6/6 txs for block proposal {"blockNumber":1795,"slotNumber":1796,"totalTxsInProposal":6,"txsFromProposal":0,"txsFromMempool":6,"txsFromP2P":0,"missingTxs":0} 02:51:16 [02:51:16.346] WARN: validator Re-execution state mismatch, slashing invalid block {"slotNumber":1796,"blockNumber":1795,"archive":"0x0ff65c354893d0003e1c45f70108aadab78f1dd07445cb5d9adcae623ffb7852","txCount":6,"txHashes":["0x0e38fc9867f8979870de0ec5a2c7855f80048c5885f9fa6fe710bb624b4e8602","0x19663725331755615e39a3c3597c7a200918b94ba680bbc312eb53a7f6c8da9a","0x0a4d5e61838fbb8451dac78a70f461ea57875bf9b647570e7e098801ec4c62e5","0x0c7dfa47909165653dc3c8a148fdc8e500e452354624c56e98017ff3d4698fd1","0x158d4d5adf118459683b2ec170248445d652722f39438437a8a76b803276fd32","0x1827c619b4f659f88b89abe41543e56bab53da109b29e649ffea1ea7534ab879"]} 02:51:16 [02:51:16.348] ERROR: validator Failed to attest to proposal: ReExStateMismatchError: Validator Error: Re-execution state mismatch 02:51:16 at ValidatorClient.reExecuteTransactions (/home/aztec-dev/aztec-packages/yarn-project/validator-client/src/validator.ts:362:13) 02:51:16 at runNextTicks (node:internal/process/task_queues:65:5) 02:51:16 at listOnTimeout (node:internal/timers:549:9) 02:51:16 at processTimers (node:internal/timers:523:7) 02:51:16 at ValidatorClient.attestToProposal (/home/aztec-dev/aztec-packages/yarn-project/validator-client/src/validator.ts:285:9) 02:51:16 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/validator-client/src/validator.test.ts:236:28) {"slotNumber":1796,"blockNumber":1795,"archive":"0x0ff65c354893d0003e1c45f70108aadab78f1dd07445cb5d9adcae623ffb7852","txCount":6,"txHashes":["0x0e38fc9867f8979870de0ec5a2c7855f80048c5885f9fa6fe710bb624b4e8602","0x19663725331755615e39a3c3597c7a200918b94ba680bbc312eb53a7f6c8da9a","0x0a4d5e61838fbb8451dac78a70f461ea57875bf9b647570e7e098801ec4c62e5","0x0c7dfa47909165653dc3c8a148fdc8e500e452354624c56e98017ff3d4698fd1","0x158d4d5adf118459683b2ec170248445d652722f39438437a8a76b803276fd32","0x1827c619b4f659f88b89abe41543e56bab53da109b29e649ffea1ea7534ab879"]} 02:51:16 [02:51:16.367] INFO: validator Retrieved 6/6 txs for block proposal {"blockNumber":1795,"slotNumber":1796,"totalTxsInProposal":6,"txsFromProposal":0,"txsFromMempool":6,"txsFromP2P":0,"missingTxs":0} 02:51:16 [02:51:16.369] WARN: validator Re-execution state mismatch, slashing invalid block {"slotNumber":1796,"blockNumber":1795,"archive":"0x07cef4c5d9173ce66e12b06287fa0889703d5d7ae017dcae4f618252f7cba80d","txCount":6,"txHashes":["0x2d23fbbd8544bd96daf90038dcd67a90789010d6001b3c4b9bd9ef9b216d690d","0x0e9672aec1dfb9d62cb9761730d29b9d56dfb204a44b99a1d1282435b78e6575","0x1eb33562f452bf2ff517fcf18644bfacec94e7412a8152c8d9bc1ba934f64fa2","0x2d67175725eca1312affed3f7d739c3f7b37d48ca24e9a05ef512a899232428c","0x1ed4d98708e186ecf8c9a874a464712aa24e2c55cd111b11c97781c943b5a787","0x12d0d2bbf1514ed61e12b3f1ba92da61c91d94a365621beb996404579786c683"]} 02:51:16 [02:51:16.370] ERROR: validator Failed to attest to proposal: ReExStateMismatchError: Validator Error: Re-execution state mismatch 02:51:16 at ValidatorClient.reExecuteTransactions (/home/aztec-dev/aztec-packages/yarn-project/validator-client/src/validator.ts:362:13) 02:51:16 at runNextTicks (node:internal/process/task_queues:65:5) 02:51:16 at listOnTimeout (node:internal/timers:549:9) 02:51:16 at processTimers (node:internal/timers:523:7) 02:51:16 at ValidatorClient.attestToProposal (/home/aztec-dev/aztec-packages/yarn-project/validator-client/src/validator.ts:285:9) 02:51:16 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/validator-client/src/validator.test.ts:288:28) {"slotNumber":1796,"blockNumber":1795,"archive":"0x07cef4c5d9173ce66e12b06287fa0889703d5d7ae017dcae4f618252f7cba80d","txCount":6,"txHashes":["0x2d23fbbd8544bd96daf90038dcd67a90789010d6001b3c4b9bd9ef9b216d690d","0x0e9672aec1dfb9d62cb9761730d29b9d56dfb204a44b99a1d1282435b78e6575","0x1eb33562f452bf2ff517fcf18644bfacec94e7412a8152c8d9bc1ba934f64fa2","0x2d67175725eca1312affed3f7d739c3f7b37d48ca24e9a05ef512a899232428c","0x1ed4d98708e186ecf8c9a874a464712aa24e2c55cd111b11c97781c943b5a787","0x12d0d2bbf1514ed61e12b3f1ba92da61c91d94a365621beb996404579786c683"]} 02:51:16 [02:51:16.381] INFO: validator Retrieved 6/6 txs for block proposal {"blockNumber":1795,"slotNumber":1796,"totalTxsInProposal":6,"txsFromProposal":0,"txsFromMempool":1,"txsFromP2P":5,"missingTxs":0} 02:51:16 [02:51:16.381] INFO: validator Attesting to proposal for slot 1796 {"slotNumber":1796,"blockNumber":1795,"archive":"0x16c1577816a9ac4f4765cf3373eaf8abb56c655f61068ead41b92e3823c68c54","txCount":6,"txHashes":["0x0d0750016d1e50a251bee5ed0ee82b9edc5fc310d890fd8e2c437dcebe0a5bf1","0x055e9565bcf088021800a0e45dce0388481c63eb236ffeaf7ad3681196d935ce","0x13a02bd2322ad2eafafcdb23e01b1fc8cdbe23d05cc03bc067cb7d03e21608f0","0x05e22358ce345834b33d2158d2f8f9d81ea2d3ac55465e81f7d1914bcad7548c","0x0796759a4db831b6d84cb3f12dd3cdb3182d2c14c98012d28c2063fb34ee2ec3","0x2c2b7aa8a35987bf6a1ff0b841d5e0240f3516760a6046fa490587b3ae88cf25"]} 02:51:16 [02:51:16.396] INFO: validator Retrieved 6/6 txs for block proposal {"blockNumber":1795,"slotNumber":1796,"totalTxsInProposal":6,"txsFromProposal":0,"txsFromMempool":0,"txsFromP2P":6,"missingTxs":0} 02:51:16 [02:51:16.404] INFO: validator Retrieved 0/6 txs for block proposal {"blockNumber":1795,"slotNumber":1796,"totalTxsInProposal":6,"txsFromProposal":0,"txsFromMempool":0,"txsFromP2P":0,"missingTxs":6} 02:51:16 [02:51:16.405] ERROR: validator Missing 6/6 txs to attest to proposal {"proposalInfo":{"slotNumber":1796,"blockNumber":1795,"archive":"0x11142395119cb86d9556b7a62282c6347a7811b69d21e7f8fe58efe513f7aeee","txCount":6,"txHashes":["0x0d07060bc9eba3ceff28a3982c794cb7bab791ba957db3dbbab2708ca4978d91","0x1b63e2ffd1aa39ca6142e9dcc6b962eea224795bf6aa1f01a048e769de387ea6","0x0e1cc7daebbdb13dca492036fe881409fa3f31faa3110f5936397f7c830278ef","0x01e1e3f3fe0e00ef195b5668bc7c0db3c544bc441bdb6ea6a2e43df7f01cef32","0x11ef46731bda528398f7b589b4892291e7be1d654e6a5571d069434ebaba7a0b","0x0f137ee2d214cd21e8c4df0e001150b89db8196ad551065eac1d9dc7254a51fa"]},"missing":["0x0d07060bc9eba3ceff28a3982c794cb7bab791ba957db3dbbab2708ca4978d91","0x1b63e2ffd1aa39ca6142e9dcc6b962eea224795bf6aa1f01a048e769de387ea6","0x0e1cc7daebbdb13dca492036fe881409fa3f31faa3110f5936397f7c830278ef","0x01e1e3f3fe0e00ef195b5668bc7c0db3c544bc441bdb6ea6a2e43df7f01cef32","0x11ef46731bda528398f7b589b4892291e7be1d654e6a5571d069434ebaba7a0b","0x0f137ee2d214cd21e8c4df0e001150b89db8196ad551065eac1d9dc7254a51fa"]} 02:51:16 [02:51:16.414] INFO: validator Retrieved 6/6 txs for block proposal {"blockNumber":1795,"slotNumber":1796,"totalTxsInProposal":6,"txsFromProposal":0,"txsFromMempool":6,"txsFromP2P":0,"missingTxs":0} 02:51:16 [02:51:16.415] ERROR: validator Failed to attest to proposal: Error: Failed to build block 02:51:16 at Proxy.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/validator-client/src/validator.test.ts:325:15) 02:51:16 at /home/aztec-dev/aztec-packages/yarn-project/node_modules/jest-mock/build/index.js:397:39 02:51:16 at Proxy.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/node_modules/jest-mock/build/index.js:404:13) 02:51:16 at Proxy.mockConstructor (/home/aztec-dev/aztec-packages/yarn-project/node_modules/jest-mock/build/index.js:148:19) 02:51:16 at ValidatorClient.buildBlock [as reExecuteTransactions] (/home/aztec-dev/aztec-packages/yarn-project/validator-client/src/validator.ts:341:58) 02:51:16 at ValidatorClient.reExecuteTransactions [as attestToProposal] (/home/aztec-dev/aztec-packages/yarn-project/validator-client/src/validator.ts:285:20) 02:51:16 at runNextTicks (node:internal/process/task_queues:65:5) 02:51:16 at listOnTimeout (node:internal/timers:549:9) 02:51:16 at processTimers (node:internal/timers:523:7) 02:51:16 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/validator-client/src/validator.test.ts:328:27) {"slotNumber":1796,"blockNumber":1795,"archive":"0x06940a348cc9898b48942ee70bfd61941e47cc6b91d3f8f5debe6e214d693194","txCount":6,"txHashes":["0x08156da1f676fa423ae1e2a14da609f350b51df78650c2bafcce8d17663e5342","0x2552e80eebfb7d991e4822dd3d5301055b825e08803baae95272b28ea7911e1d","0x2e03422ab9694005a7ef05d3add7afdd3d3112185c2a5e5e5aac4b3818fab347","0x302f5345ed98322c116d8fd016e2b398352c9022deb46bf73c27c32c68709710","0x185e0a07f2b32a1e367b838fd015ad0f8dd87cb15a44f01be449a8935fe2746f","0x0057f9e6d3b7e4a49a73de6e32473cfacb3573ca7234e9700e04350001240f96"]} 02:51:16 [02:51:16.430] INFO: validator Retrieved 6/6 txs for block proposal {"blockNumber":1795,"slotNumber":1796,"totalTxsInProposal":6,"txsFromProposal":0,"txsFromMempool":6,"txsFromP2P":0,"missingTxs":0} 02:51:16 [02:51:16.463] INFO: validator Retrieved 6/6 txs for block proposal {"blockNumber":1795,"slotNumber":1796,"totalTxsInProposal":6,"txsFromProposal":0,"txsFromMempool":6,"txsFromP2P":0,"missingTxs":0} 02:51:16 [02:51:16.464] INFO: validator Attesting to proposal for slot 1796 {"slotNumber":1796,"blockNumber":1795,"archive":"0x17f703fed1360ec128b677f60ebe0a508ef342df2537d2918d15518cf3077ac9","txCount":6,"txHashes":["0x06caf30bbd8e4c5f99642ecf40809ac534a93df439b2f948b7eece0a7f3c2b3b","0x0f9a24f6921c4bd652ce7f11e4f6a4cffeb02cc5e9ba9811250ba53a07b3ae78","0x00120bdd352335d42d133aa20c3eaf3d8e56382a14bcdceab344fb93900dd9e6","0x305f9a7e7cb0304a3cadb777a288f9842cbe5709bb1b4e2911e049ba987d35f7","0x0751d8676bb0e0184a3192df1db7fe0fb353970b2f512d47abd040b4e5988eda","0x03314991ebabac0076567ca66e69228acd8f602cb4a986d5689a027e7c752671"]} 02:51:16 PASS src/validator.test.ts (7.511 s) 02:51:16 ValidatorClient 02:51:16 ✓ Should collect attestations from its own validators (1135 ms) 02:51:16 constructor 02:51:16 ✓ should throw error if an invalid private key is provided (8 ms) 02:51:16 createBlockProposal 02:51:16 ✓ should create a valid block proposal without txs (468 ms) 02:51:16 collectAttestations 02:51:16 ✓ should timeout if we do not collect enough attestations in time (1013 ms) 02:51:16 ✓ should collect attestations for a proposal (54 ms) 02:51:16 attestToProposal 02:51:16 ✓ should attest to proposal (13 ms) 02:51:16 ✓ should re-execute and attest to proposal (15 ms) 02:51:16 ✓ should not attest to proposal if roots do not match, and should emit WANT_TO_SLASH_EVENT (25 ms) 02:51:16 ✓ should not emit WANT_TO_SLASH_EVENT if slashing is disabled (17 ms) 02:51:16 ✓ should request txs if missing for attesting (12 ms) 02:51:16 ✓ should request txs even if not attestor in this slot (12 ms) 02:51:16 ✓ should throw an error if the transactions are not available (9 ms) 02:51:16 ✓ should not return an attestation if re-execution fails (10 ms) 02:51:16 ✓ should not return an attestation if no validators are in the committee (15 ms) 02:51:16 ✓ should not return an attestation if the proposer is not the current proposer (15 ms) 02:51:16 ✓ should attest with all validator keys that are in the committee (21 ms) 02:51:16 ✓ should not return an attestation if the proposal is not for the current or next slot (15 ms) 02:51:16 02:51:16 Test Suites: 1 passed, 1 total 02:51:16 Tests: 17 passed, 17 total 02:51:16 Snapshots: 0 total 02:51:16 Time: 7.613 s 02:51:16 Ran all test suites matching /validator-client\/src\/validator.test.ts/i. 02:51:16 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?