Parent Log: http://ci.aztec-labs.com/f7f41d385a4341ce Command: 411627cf9c043d00 yarn-project/scripts/run_test.sh validator-client/src/validator.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/721a41c449eb0c4538a26180f6061f326128cf78 Env: REF_NAME=gh-readonly-queue/next/pr-14963-60e60f99f2634ad75a76b6e103858ff9ccd041d5 CURRENT_VERSION=0.87.6 CI_FULL=1 Date: Mon Jun 16 18:42:17 UTC 2025 System: ARCH=amd64 CPUS=128 MEM=493Gi HOSTNAME=pr-14963_amd64_x4-full Resources: CPU_LIST=0-127 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_6f10fb814a4bcca8_next 18:42:25 [18:42:25.588] ERROR: validator Timeout 2025-06-16T18:42:24.677Z waiting for 3 attestations for slot 1796 18:42:27 [18:42:27.076] ERROR: validator Timeout 2025-06-16T18:42:26.173Z waiting for 2 attestations for slot 1796 18:42:27 [18:42:27.155] INFO: validator Retrieved 6/6 txs for block proposal {"blockNumber":1795,"slotNumber":1796,"totalTxsInProposal":6,"txsFromProposal":0,"txsFromMempool":6,"txsFromP2P":0,"missingTxs":0} 18:42:27 [18:42:27.156] INFO: validator Attesting to proposal for slot 1796 {"slotNumber":1796,"blockNumber":1795,"archive":"0x2befd51362f38613dc653dc1e58d524802b6c750e85b86672f581f81b800556c","txCount":6,"txHashes":["0x237aba4a4a65acc3a71f47a52e04cfd5f53a9665cdc64d022d5630f4a4f77545","0x1fd0d898119beb3c3a2769387eab7c620a761cc1115c84703b57542b6e120287","0x09b5a2a69cb98eed14b66c0e88764d84dd1f416ac66d095238dea3bc84737b47","0x040dc301b1e27b54b03ca01b9f1543c7a2cd8dcfb8a57c55f5b683918b96fede","0x22dbad3ee7361c7741f04263265a3f983e5a1153199b9729d3ef5e433e2881b3","0x1486c993b276f9dbdcf32915633d75ead75fd23417c7edd335f54c46ee261995"]} 18:42:27 [18:42:27.172] INFO: validator Retrieved 6/6 txs for block proposal {"blockNumber":1795,"slotNumber":1796,"totalTxsInProposal":6,"txsFromProposal":0,"txsFromMempool":6,"txsFromP2P":0,"missingTxs":0} 18:42:27 [18:42:27.173] INFO: validator Attesting to proposal for slot 1796 {"slotNumber":1796,"blockNumber":1795,"archive":"0x26ada2aedb25b5731ef087c92890a17b4d8406dc106e5bca07f8ae7eb48665cb","txCount":6,"txHashes":["0x2ab8c386fbc00f47054cf1dd7b3cdd37aa4917aad1b59ee396dc688483341e0e","0x1e5ce3a4ec5c1e2c657a4bb73d39bab80580ae533de0a579ba37578586723187","0x008f38df96b4c535da5798f68d98affc4a5c39ec646c38da44347d7ef25fef59","0x13338d0c99534ab3feb75962f744ce58c1fbac301e6e43b822681dd34d40cae0","0x2873704d564bf51be023b98a8da49c65903ccc5040a6f79af97c57969fbea7b1","0x00d44b612a9a75b38dbe6377564629f49f9db0ee6a90ce92fd512f5800bb0838"]} 18:42:27 [18:42:27.190] INFO: validator Retrieved 6/6 txs for block proposal {"blockNumber":1795,"slotNumber":1796,"totalTxsInProposal":6,"txsFromProposal":0,"txsFromMempool":6,"txsFromP2P":0,"missingTxs":0} 18:42:27 [18:42:27.191] WARN: validator Re-execution state mismatch, slashing invalid block {"slotNumber":1796,"blockNumber":1795,"archive":"0x19111a84d1b496a986075fee52285b498e2e037059c0a3fca181892c475e80f9","txCount":6,"txHashes":["0x0f839651a50185f5fb2aab710a734541f8e1dfb3f57a501da803c8a8ac5edbb1","0x2b6e30c4b1953a8d73d970e29459102d1a6bcba8779a058ec585cbbdde34304e","0x258ee39a0a1c770d443fe1b96d4f6bc61a9c7479015b2ecd5bec455ff3d9e481","0x3002738ada3f2257c369ae943d3969157e04d6fb8f669928f41ae762ee85e094","0x116a576693fd5cdf0dd1f50127a5553a2aa3bc8d5842c8087383f81baadda350","0x0df29a038d608f1138b04fbebbed4dd20593ff219fa6694a86d4e92a8c7d787a"]} 18:42:27 [18:42:27.193] ERROR: validator Failed to attest to proposal: ReExStateMismatchError: Validator Error: Re-execution state mismatch 18:42:27 at ValidatorClient.reExecuteTransactions (/home/aztec-dev/aztec-packages/yarn-project/validator-client/src/validator.ts:366:13) 18:42:27 at ValidatorClient.attestToProposal (/home/aztec-dev/aztec-packages/yarn-project/validator-client/src/validator.ts:289:9) 18:42:27 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/validator-client/src/validator.test.ts:236:28) {"slotNumber":1796,"blockNumber":1795,"archive":"0x19111a84d1b496a986075fee52285b498e2e037059c0a3fca181892c475e80f9","txCount":6,"txHashes":["0x0f839651a50185f5fb2aab710a734541f8e1dfb3f57a501da803c8a8ac5edbb1","0x2b6e30c4b1953a8d73d970e29459102d1a6bcba8779a058ec585cbbdde34304e","0x258ee39a0a1c770d443fe1b96d4f6bc61a9c7479015b2ecd5bec455ff3d9e481","0x3002738ada3f2257c369ae943d3969157e04d6fb8f669928f41ae762ee85e094","0x116a576693fd5cdf0dd1f50127a5553a2aa3bc8d5842c8087383f81baadda350","0x0df29a038d608f1138b04fbebbed4dd20593ff219fa6694a86d4e92a8c7d787a"]} 18:42:27 [18:42:27.217] INFO: validator Retrieved 6/6 txs for block proposal {"blockNumber":1795,"slotNumber":1796,"totalTxsInProposal":6,"txsFromProposal":0,"txsFromMempool":6,"txsFromP2P":0,"missingTxs":0} 18:42:27 [18:42:27.219] WARN: validator Re-execution state mismatch, slashing invalid block {"slotNumber":1796,"blockNumber":1795,"archive":"0x0204081b2eb950e805363e505ec84cd34bf96d27cb7a7a875922a5c3f886412d","txCount":6,"txHashes":["0x2d84b21c189193999d9c0ceda41b50baca5dbf8c3683ebe60558f93e71f21046","0x2a7d1c6df11ec9c1cf9e3949246bffc59b39cd0906a2f0052e9554919d817a64","0x2461b5719b9ab03e6069e487359198c5263bb68a54cb4b453583555eb819549e","0x2ff173eeb5f382ddd9d84a3a55848257de82dbc6cd6b60d9bc838dc5c316dca3","0x1ccc492f02d37e349690870f9621671239f6fde2a58e40243bdb4e3f463d12fe","0x015e90e0fb2405d247e49580a0344f246b856b1a27f1536fc74a11cb416f8207"]} 18:42:27 [18:42:27.220] ERROR: validator Failed to attest to proposal: ReExStateMismatchError: Validator Error: Re-execution state mismatch 18:42:27 at ValidatorClient.reExecuteTransactions (/home/aztec-dev/aztec-packages/yarn-project/validator-client/src/validator.ts:366:13) 18:42:27 at ValidatorClient.attestToProposal (/home/aztec-dev/aztec-packages/yarn-project/validator-client/src/validator.ts:289:9) 18:42:27 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/validator-client/src/validator.test.ts:288:28) {"slotNumber":1796,"blockNumber":1795,"archive":"0x0204081b2eb950e805363e505ec84cd34bf96d27cb7a7a875922a5c3f886412d","txCount":6,"txHashes":["0x2d84b21c189193999d9c0ceda41b50baca5dbf8c3683ebe60558f93e71f21046","0x2a7d1c6df11ec9c1cf9e3949246bffc59b39cd0906a2f0052e9554919d817a64","0x2461b5719b9ab03e6069e487359198c5263bb68a54cb4b453583555eb819549e","0x2ff173eeb5f382ddd9d84a3a55848257de82dbc6cd6b60d9bc838dc5c316dca3","0x1ccc492f02d37e349690870f9621671239f6fde2a58e40243bdb4e3f463d12fe","0x015e90e0fb2405d247e49580a0344f246b856b1a27f1536fc74a11cb416f8207"]} 18:42:27 [18:42:27.237] INFO: validator Retrieved 6/6 txs for block proposal {"blockNumber":1795,"slotNumber":1796,"totalTxsInProposal":6,"txsFromProposal":0,"txsFromMempool":1,"txsFromP2P":5,"missingTxs":0} 18:42:27 [18:42:27.237] INFO: validator Attesting to proposal for slot 1796 {"slotNumber":1796,"blockNumber":1795,"archive":"0x15eb3b98ef4061c18b60fed58c6e6819c28d527438a4042c554a9203ab0c68f1","txCount":6,"txHashes":["0x21b8161fd4359f4a87f4610fda80c2a30bf7c06382fc5be36d343f3675d3eedb","0x164df91a3c9c380f95fa19d21dad1a2fdae44444bb61e1f17f1c046089fdce46","0x11bba8f4170308e5a6118f6347b3d79476f4a3a3f092184d82c3cdbe9c4922aa","0x22a4905cb85c08637280c9f617300631c9758d90fe850c4bc248e5ce28f98868","0x1807195bea5fa8db3e54d9e2e1e7cd7587f50c20e993390d4fc7a5b914f0f26d","0x19ad6afb3e15f9dd0ee0bc0caa1be1bc12736e8ce7f7c90f8509c93b823093ed"]} 18:42:27 [18:42:27.249] INFO: validator Retrieved 6/6 txs for block proposal {"blockNumber":1795,"slotNumber":1796,"totalTxsInProposal":6,"txsFromProposal":0,"txsFromMempool":0,"txsFromP2P":6,"missingTxs":0} 18:42:27 [18:42:27.258] INFO: validator Retrieved 0/6 txs for block proposal {"blockNumber":1795,"slotNumber":1796,"totalTxsInProposal":6,"txsFromProposal":0,"txsFromMempool":0,"txsFromP2P":0,"missingTxs":6} 18:42:27 [18:42:27.259] ERROR: validator Missing 6/6 txs to attest to proposal {"proposalInfo":{"slotNumber":1796,"blockNumber":1795,"archive":"0x23fb835d2c9e7d5986d5f68cbc7c7cc1ca6a77979ea677632f9d914343e9833e","txCount":6,"txHashes":["0x1318429d7da254e31c2c193824d2dcfa8636258e4ac519df71f9dc7ef4a594a3","0x22bf111aaad1bf71cdd3a10f89f6973371564fda628bdecdb81912ffa6977720","0x2af0516ac4fb0e569bbdca1578f550aad98053700e42d9208fe262235daa8509","0x2b058d0713450c4537d87abaf02fbc87a65fc210c684886cc692f89a77dbea34","0x2f07697dea54db8d8f474afc3879213fc3ca288243a36cdf53549a52ff362652","0x2833d08e129e8a607724990a1e6c191cc4cdd7a3d7e95be04926f9b3f889bbe1"]},"missing":["0x1318429d7da254e31c2c193824d2dcfa8636258e4ac519df71f9dc7ef4a594a3","0x22bf111aaad1bf71cdd3a10f89f6973371564fda628bdecdb81912ffa6977720","0x2af0516ac4fb0e569bbdca1578f550aad98053700e42d9208fe262235daa8509","0x2b058d0713450c4537d87abaf02fbc87a65fc210c684886cc692f89a77dbea34","0x2f07697dea54db8d8f474afc3879213fc3ca288243a36cdf53549a52ff362652","0x2833d08e129e8a607724990a1e6c191cc4cdd7a3d7e95be04926f9b3f889bbe1"]} 18:42:27 [18:42:27.274] INFO: validator Retrieved 6/6 txs for block proposal {"blockNumber":1795,"slotNumber":1796,"totalTxsInProposal":6,"txsFromProposal":0,"txsFromMempool":6,"txsFromP2P":0,"missingTxs":0} 18:42:27 [18:42:27.276] ERROR: validator Failed to attest to proposal: Error: Failed to build block 18:42:27 at Proxy.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/validator-client/src/validator.test.ts:325:15) 18:42:27 at /home/aztec-dev/aztec-packages/yarn-project/node_modules/jest-mock/build/index.js:305:39 18:42:27 at Proxy.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/node_modules/jest-mock/build/index.js:312:13) 18:42:27 at Proxy.mockConstructor (/home/aztec-dev/aztec-packages/yarn-project/node_modules/jest-mock/build/index.js:102:19) 18:42:27 at ValidatorClient.buildBlock [as reExecuteTransactions] (/home/aztec-dev/aztec-packages/yarn-project/validator-client/src/validator.ts:345:58) 18:42:27 at ValidatorClient.reExecuteTransactions [as attestToProposal] (/home/aztec-dev/aztec-packages/yarn-project/validator-client/src/validator.ts:289:20) 18:42:27 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/validator-client/src/validator.test.ts:328:27) {"slotNumber":1796,"blockNumber":1795,"archive":"0x0c9b62b16705e91ecc8f3e499b9b99e41ff36d27b2537a94b7855a22576672d5","txCount":6,"txHashes":["0x01d7c6fc07b73bb1e2b48b0b60b817c8ebb76dec2d54fda4c2d47e2c98fbacd2","0x0cb504056eb98dc9a681d52fbdcd62c948fc160439f611366717ce8c72a1a6b9","0x1eb274d745b7d4222bd510fcb4da2cff73175411503d912324fa640a90993a20","0x12de60be1ea1e06fdeb792e7d1d94841fd3a170ec6b0d956d759d59ffec7612f","0x100d642fad10bd7e9e788bdfed064c1de86d3c59ff6e2235e549344240432af9","0x202e37e6e233e1a1aa248dfc1d33f0400e6198c0d5c04380f47639da3713b029"]} 18:42:27 [18:42:27.289] INFO: validator Retrieved 6/6 txs for block proposal {"blockNumber":1795,"slotNumber":1796,"totalTxsInProposal":6,"txsFromProposal":0,"txsFromMempool":6,"txsFromP2P":0,"missingTxs":0} 18:42:27 [18:42:27.330] INFO: validator Retrieved 6/6 txs for block proposal {"blockNumber":1795,"slotNumber":1796,"totalTxsInProposal":6,"txsFromProposal":0,"txsFromMempool":6,"txsFromP2P":0,"missingTxs":0} 18:42:27 [18:42:27.331] INFO: validator Attesting to proposal for slot 1796 {"slotNumber":1796,"blockNumber":1795,"archive":"0x177835f61c1d6b1af1d4bc4b90c5bb5db0a6819b857b87df6677fc46ad61f2e8","txCount":6,"txHashes":["0x169375b4776ad83c83b6f2c0cc294135d51a96d598296ebed4e108f7435c3be2","0x0fa542fa4cf5961af2ce7f10e3933513d4efb025d452b8a7daf9c3a223eecb11","0x111a813e0628c39ce228adf0c5d71e2f8c0101d877ee66d6c6700f7b271b3f67","0x157b374fd11823c8d2fd5f657741d6f9f70532033cf84848dd77a265418c537c","0x190aa7efc541bbe89ded1af54f591d2c1ff7a5a6c648312f48f1dac71fa6d438","0x1102ad2be0e6a6b98d6f2926dc9f5234166c16b809069203e3829e1572d54e9b"]} 18:42:27 PASS src/validator.test.ts (8.39 s) 18:42:27 ValidatorClient 18:42:27 Should collect attestations from its own validators (1187 ms) 18:42:27 constructor 18:42:27 should throw error if an invalid private key is provided (13 ms) 18:42:27 createBlockProposal 18:42:27 should create a valid block proposal without txs (424 ms) 18:42:27 collectAttestations 18:42:27 should timeout if we do not collect enough attestations in time (1015 ms) 18:42:27 should collect attestations for a proposal (60 ms) 18:42:27 attestToProposal 18:42:27 should attest to proposal (18 ms) 18:42:27 should re-execute and attest to proposal (17 ms) 18:42:27 should not attest to proposal if roots do not match, and should emit WANT_TO_SLASH_EVENT (18 ms) 18:42:27 should not emit WANT_TO_SLASH_EVENT if slashing is disabled (25 ms) 18:42:27 should request txs if missing for attesting (17 ms) 18:42:27 should request txs even if not attestor in this slot (11 ms) 18:42:27 should throw an error if the transactions are not available (9 ms) 18:42:27 should not return an attestation if re-execution fails (18 ms) 18:42:27 should not return an attestation if no validators are in the committee (13 ms) 18:42:27 should not return an attestation if the proposer is not the current proposer (17 ms) 18:42:27 should attest with all validator keys that are in the committee (24 ms) 18:42:27 should not return an attestation if the proposal is not for the current or next slot (7 ms) 18:42:27 18:42:27 Test Suites: 1 passed, 1 total 18:42:27 Tests: 17 passed, 17 total 18:42:27 Snapshots: 0 total 18:42:27 Time: 8.526 s 18:42:27 Ran all test suites matching validator-client/src/validator.test.ts. 18:42:27 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?