Parent Log: http://ci.aztec-labs.com/c4378d58bdcb481c Command: 9d60524367dfa79a yarn-project/scripts/run_test.sh validator-client/src/validator.test.ts Commit: https://github.com/AztecProtocol/aztec-packages/commit/056e5230c330d6ad19900135ecf2a4787181496a Env: REF_NAME=gh-readonly-queue/next/pr-12986-a9f91dd1e5946aecfeb192ce869eb3e8eca2742e CURRENT_VERSION=0.87.6 CI_FULL=1 Date: Tue Jun 17 13:14:27 UTC 2025 System: ARCH=amd64 CPUS=128 MEM=493Gi HOSTNAME=pr-12986_amd64_x1-full Resources: CPU_LIST=0-127 CPUS=2 MEM=8g TIMEOUT=600s History: http://ci.aztec-labs.com/list/history_6f10fb814a4bcca8_next 13:14:35 [13:14:35.903] ERROR: validator Timeout 2025-06-17T13:14:34.994Z waiting for 3 attestations for slot 1796 13:14:37 [13:14:37.416] ERROR: validator Timeout 2025-06-17T13:14:36.513Z waiting for 2 attestations for slot 1796 13:14:37 [13:14:37.465] INFO: validator Retrieved 6/6 txs for block proposal {"blockNumber":1795,"slotNumber":1796,"totalTxsInProposal":6,"txsFromProposal":0,"txsFromMempool":6,"txsFromP2P":0,"missingTxs":0} 13:14:37 [13:14:37.467] INFO: validator Attesting to proposal for slot 1796 {"slotNumber":1796,"blockNumber":1795,"archive":"0x2962613e17e54a20e7c1d0d9a34b7d6071722f103bf5c6960d387e4d74712fe2","txCount":6,"txHashes":["0x0a9274b4c1e3c7b812263d00e141b6a39a93cd4e52efd17849f570f2a89062d5","0x2e974ac55618ac7aa7d2446bf01e6e953aef4d11523a3541c2beec3dc56c14fc","0x25737e2d2bba55a36d4e0a283a672aadb14b929a2a7d8755aef69a74f53facc4","0x06f3b321efd71c2cd7db2596cbf2cbd1e7decb76777207655b44c74064bb84c8","0x21ffd12113de26b7e72095919163e1472abaa55590f210f58c912ce7ab3c8d9f","0x20a5405db4539abb0f0d22d305f4144c23bca0e04aff11aa59bdfbff349ed8ca"]} 13:14:37 [13:14:37.481] INFO: validator Retrieved 6/6 txs for block proposal {"blockNumber":1795,"slotNumber":1796,"totalTxsInProposal":6,"txsFromProposal":0,"txsFromMempool":6,"txsFromP2P":0,"missingTxs":0} 13:14:37 [13:14:37.483] INFO: validator Attesting to proposal for slot 1796 {"slotNumber":1796,"blockNumber":1795,"archive":"0x16d1021b0835bf311fcada6dcd1450648094f172a8061f66773b967f35a5e26f","txCount":6,"txHashes":["0x0b95e3bb8080a1486f4b35563fc23e6800aad25655d079df90f8a7e687aff750","0x145bcc87904259a6e356775dd9ab9cedd25ce22b511863b4380a48d7848340ac","0x08bc8d5e1268194c54fe59c413fbc05aefa71e8694bbbfd7320473aeb60e4af2","0x2d7765a987639efff331950203cb7011a24fae8d8c933dc451a7be43fc3dd3ca","0x2f00f7d7177c12ba67f22e6364c508f386e0de9b19076786c83cd3347d0a410e","0x1db7e7a543f475b6851836aa04eab5ec15190ec96a6c81802f0af02b1cd483e5"]} 13:14:37 [13:14:37.504] INFO: validator Retrieved 6/6 txs for block proposal {"blockNumber":1795,"slotNumber":1796,"totalTxsInProposal":6,"txsFromProposal":0,"txsFromMempool":6,"txsFromP2P":0,"missingTxs":0} 13:14:37 [13:14:37.505] WARN: validator Re-execution state mismatch, slashing invalid block {"slotNumber":1796,"blockNumber":1795,"archive":"0x010fd9c5dd1ed6591f3cc87b3fdb150f3c14b881d4ca0af16c56ef5cf5edfd8c","txCount":6,"txHashes":["0x1b964946c0aaeb83a281bbcc413c4c9fca342f4a4e5474410abc8a980a7c9352","0x1585498085d8540438df21554db306d3f1fe24f4b85fc46789ecbe73c830ce97","0x069054ef0931f3faaaf2f544f9de332f09ddb133c48fa4898dfe6b51907d71e8","0x00f4675c751a0a0f12f4aaf05c5f399b9057cc4c1b8ba9875b0748cf5b800eb4","0x018981ce1c531b0bf78adde185a926e1961ee15df80f5a813b0a71f09f5ac958","0x2eb4fb6b3eb01f4871ee9fcece4cf10e1d71451ee2757a0631f34c7adbbbaf75"]} 13:14:37 [13:14:37.507] ERROR: validator Failed to attest to proposal: ReExStateMismatchError: Validator Error: Re-execution state mismatch 13:14:37 at ValidatorClient.reExecuteTransactions (/home/aztec-dev/aztec-packages/yarn-project/validator-client/src/validator.ts:366:13) 13:14:37 at ValidatorClient.attestToProposal (/home/aztec-dev/aztec-packages/yarn-project/validator-client/src/validator.ts:289:9) 13:14:37 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/validator-client/src/validator.test.ts:237:28) {"slotNumber":1796,"blockNumber":1795,"archive":"0x010fd9c5dd1ed6591f3cc87b3fdb150f3c14b881d4ca0af16c56ef5cf5edfd8c","txCount":6,"txHashes":["0x1b964946c0aaeb83a281bbcc413c4c9fca342f4a4e5474410abc8a980a7c9352","0x1585498085d8540438df21554db306d3f1fe24f4b85fc46789ecbe73c830ce97","0x069054ef0931f3faaaf2f544f9de332f09ddb133c48fa4898dfe6b51907d71e8","0x00f4675c751a0a0f12f4aaf05c5f399b9057cc4c1b8ba9875b0748cf5b800eb4","0x018981ce1c531b0bf78adde185a926e1961ee15df80f5a813b0a71f09f5ac958","0x2eb4fb6b3eb01f4871ee9fcece4cf10e1d71451ee2757a0631f34c7adbbbaf75"]} 13:14:37 [13:14:37.524] INFO: validator Retrieved 6/6 txs for block proposal {"blockNumber":1795,"slotNumber":1796,"totalTxsInProposal":6,"txsFromProposal":0,"txsFromMempool":6,"txsFromP2P":0,"missingTxs":0} 13:14:37 [13:14:37.525] WARN: validator Re-execution state mismatch, slashing invalid block {"slotNumber":1796,"blockNumber":1795,"archive":"0x0fb2392c2dd3a47d58fa9662491cddaf636c08cc87b9b7df04eb7066cd76f1c6","txCount":6,"txHashes":["0x04297712f54b068fd4413daa4fea7dbb317c84b2941350a89097a001e5740b41","0x0ad95f4d99544e39b4b290d3273b0e6d610ebe8ac5498d4eeeb9f5e9910fc445","0x20adec96c6c66aa3dc5cd23791131c9c37d75195e7d36b1f79a5b16c9378ef99","0x2c2ea31da5243daff46ce709f12fae4542b052a179bade3963f5217524590e37","0x11629d5168de2a7d51c2e1d6ba0888b583138d65c75e253123ca5b63c97c3f7f","0x18201ca1d018fde9a194ad94d284cd73cfe4b4e45ab6e3f14077d51459477bf3"]} 13:14:37 [13:14:37.526] ERROR: validator Failed to attest to proposal: ReExStateMismatchError: Validator Error: Re-execution state mismatch 13:14:37 at ValidatorClient.reExecuteTransactions (/home/aztec-dev/aztec-packages/yarn-project/validator-client/src/validator.ts:366:13) 13:14:37 at ValidatorClient.attestToProposal (/home/aztec-dev/aztec-packages/yarn-project/validator-client/src/validator.ts:289:9) 13:14:37 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/validator-client/src/validator.test.ts:289:28) {"slotNumber":1796,"blockNumber":1795,"archive":"0x0fb2392c2dd3a47d58fa9662491cddaf636c08cc87b9b7df04eb7066cd76f1c6","txCount":6,"txHashes":["0x04297712f54b068fd4413daa4fea7dbb317c84b2941350a89097a001e5740b41","0x0ad95f4d99544e39b4b290d3273b0e6d610ebe8ac5498d4eeeb9f5e9910fc445","0x20adec96c6c66aa3dc5cd23791131c9c37d75195e7d36b1f79a5b16c9378ef99","0x2c2ea31da5243daff46ce709f12fae4542b052a179bade3963f5217524590e37","0x11629d5168de2a7d51c2e1d6ba0888b583138d65c75e253123ca5b63c97c3f7f","0x18201ca1d018fde9a194ad94d284cd73cfe4b4e45ab6e3f14077d51459477bf3"]} 13:14:37 [13:14:37.542] INFO: validator Retrieved 6/6 txs for block proposal {"blockNumber":1795,"slotNumber":1796,"totalTxsInProposal":6,"txsFromProposal":0,"txsFromMempool":1,"txsFromP2P":5,"missingTxs":0} 13:14:37 [13:14:37.543] INFO: validator Attesting to proposal for slot 1796 {"slotNumber":1796,"blockNumber":1795,"archive":"0x181f6f38a4daf1bf02671f4adbad78c5b29ee5acca3afca64c1a94d0b75f878b","txCount":6,"txHashes":["0x2c92ebc6859b1ca198658e969dd4ab10e7d2a81d89dfc3388af43d5b413b39df","0x2dd72b31c7d9eea3590aa3050a9359f886e3867e7cdd6738b8bc507d37e83af8","0x0c473a9baeb895ffd2b01507994c4e2b614949ba20a6c2ac4cc980a8d847d234","0x1b9a19ea45d49567bb64198998dbbc487384e54c3333378d5dc6dc063b564658","0x155c6000b5224487905471d290b3537321e124e0dfda1d57e2a1de3296cddeae","0x00f1c7dba657cf37f64908aa3889ec851a734306b409637ed5eab1dfad110fa2"]} 13:14:37 [13:14:37.562] INFO: validator Retrieved 6/6 txs for block proposal {"blockNumber":1795,"slotNumber":1796,"totalTxsInProposal":6,"txsFromProposal":0,"txsFromMempool":0,"txsFromP2P":6,"missingTxs":0} 13:14:37 [13:14:37.573] INFO: validator Retrieved 0/6 txs for block proposal {"blockNumber":1795,"slotNumber":1796,"totalTxsInProposal":6,"txsFromProposal":0,"txsFromMempool":0,"txsFromP2P":0,"missingTxs":6} 13:14:37 [13:14:37.573] ERROR: validator Missing 6/6 txs to attest to proposal {"proposalInfo":{"slotNumber":1796,"blockNumber":1795,"archive":"0x231a88d3fb92efb106d202f9002a9c1a622453b9731440e6fc735b9effa3a653","txCount":6,"txHashes":["0x0cde5c74dc38dd401e4e59ef8eb51337cdd9f4b9c356923a411c1dd0ff9feac6","0x0409fb601d1f258eb13ddc490b08e7a9b1ce0dc308ae9f224f37071a45fbddbf","0x2da5133fafea11cee2dfd2749e1aaa4a6eae49bd7265457f21f968c274aee433","0x0b453db48a5a02aab90f7cf241ca6ad9fefab58170fc7d498fc10ce9ba7c6ded","0x10ecc64e343b6539bf50fc64d1e611292d7818154e558147b188c602fe11fdc0","0x21cef99cb4c59ca57d3d291aebedfc3d283e109ef67f6c8fd7d27ccd861bb887"]},"missing":["0x0cde5c74dc38dd401e4e59ef8eb51337cdd9f4b9c356923a411c1dd0ff9feac6","0x0409fb601d1f258eb13ddc490b08e7a9b1ce0dc308ae9f224f37071a45fbddbf","0x2da5133fafea11cee2dfd2749e1aaa4a6eae49bd7265457f21f968c274aee433","0x0b453db48a5a02aab90f7cf241ca6ad9fefab58170fc7d498fc10ce9ba7c6ded","0x10ecc64e343b6539bf50fc64d1e611292d7818154e558147b188c602fe11fdc0","0x21cef99cb4c59ca57d3d291aebedfc3d283e109ef67f6c8fd7d27ccd861bb887"]} 13:14:37 [13:14:37.583] INFO: validator Retrieved 6/6 txs for block proposal {"blockNumber":1795,"slotNumber":1796,"totalTxsInProposal":6,"txsFromProposal":0,"txsFromMempool":6,"txsFromP2P":0,"missingTxs":0} 13:14:37 [13:14:37.584] ERROR: validator Failed to attest to proposal: Error: Failed to build block 13:14:37 at Proxy.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/validator-client/src/validator.test.ts:326:15) 13:14:37 at /home/aztec-dev/aztec-packages/yarn-project/node_modules/jest-mock/build/index.js:305:39 13:14:37 at Proxy.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/node_modules/jest-mock/build/index.js:312:13) 13:14:37 at Proxy.mockConstructor (/home/aztec-dev/aztec-packages/yarn-project/node_modules/jest-mock/build/index.js:102:19) 13:14:37 at ValidatorClient.buildBlock [as reExecuteTransactions] (/home/aztec-dev/aztec-packages/yarn-project/validator-client/src/validator.ts:345:58) 13:14:37 at ValidatorClient.reExecuteTransactions [as attestToProposal] (/home/aztec-dev/aztec-packages/yarn-project/validator-client/src/validator.ts:289:20) 13:14:37 at Object.<anonymous> (/home/aztec-dev/aztec-packages/yarn-project/validator-client/src/validator.test.ts:329:27) {"slotNumber":1796,"blockNumber":1795,"archive":"0x0ea62ff23571f1256d4f353e2b78eb76cb378c8cf4ec765b2d3a288ff005379e","txCount":6,"txHashes":["0x1da9d3c6b4915ac387d180f0afca4df948fcb2077f26296ace3dbfa7df5fcab9","0x00cc110de3781e97e36d80dd0af80a1c9d4854994045372006f8063e9726d8d5","0x1ff32b474c39e80bdf260a476c3a3e3634e1e47e231752cde68199aa43bb7662","0x1fc684c21a858cf7f2ada4392e94fa65494f54c243dc1ef87f7a7e0f264b5f2d","0x07bc91bf21319b2a4534857eaec37de2bae3ba91ff9c9ec54836a702c7176e35","0x0bc39a77bf6e330fb08335a177a213ec3de652844d09482ada4b7297b64edc69"]} 13:14:37 [13:14:37.601] INFO: validator Retrieved 6/6 txs for block proposal {"blockNumber":1795,"slotNumber":1796,"totalTxsInProposal":6,"txsFromProposal":0,"txsFromMempool":6,"txsFromP2P":0,"missingTxs":0} 13:14:37 [13:14:37.628] INFO: validator Retrieved 6/6 txs for block proposal {"blockNumber":1795,"slotNumber":1796,"totalTxsInProposal":6,"txsFromProposal":0,"txsFromMempool":6,"txsFromP2P":0,"missingTxs":0} 13:14:37 [13:14:37.628] INFO: validator Attesting to proposal for slot 1796 {"slotNumber":1796,"blockNumber":1795,"archive":"0x2c9295904d9807fe63feaca767141e7a1740f60eee1a8b66106a8f3261347b56","txCount":6,"txHashes":["0x26020f3187487ff7be42f439bada8e2bbcb556e281f2cd040154eada6043978d","0x0b0137a76fac3204d45dfafb3ac7620dafca7c16eab2d068dc9869cab86464b5","0x151df60de62c4b9de469b61481bab6b69bfa0403404467027e759f364b495836","0x2f1e06828a96b6e25856be55d43b46bfea1074c295d06b519e2751cecaaa60d6","0x062a762b9f89f373f18f15d3d312dcb394a9855d6a43f41824ad21fe11e9a28a","0x09980ca85d187c860846633e72aaad634e5e42bb2e791916b58681e71ffd4339"]} 13:14:37 PASS src/validator.test.ts (8.661 s) 13:14:37 ValidatorClient 13:14:37 ✓ Should collect attestations from its own validators (1144 ms) 13:14:37 constructor 13:14:37 ✓ should throw error if an invalid private key is provided (7 ms) 13:14:37 createBlockProposal 13:14:37 ✓ should create a valid block proposal without txs (468 ms) 13:14:37 collectAttestations 13:14:37 ✓ should timeout if we do not collect enough attestations in time (1011 ms) 13:14:37 ✓ should collect attestations for a proposal (33 ms) 13:14:37 attestToProposal 13:14:37 ✓ should attest to proposal (18 ms) 13:14:37 ✓ should re-execute and attest to proposal (19 ms) 13:14:37 ✓ should not attest to proposal if roots do not match, and should emit WANT_TO_SLASH_EVENT (20 ms) 13:14:37 ✓ should not emit WANT_TO_SLASH_EVENT if slashing is disabled (17 ms) 13:14:37 ✓ should request txs if missing for attesting (20 ms) 13:14:37 ✓ should request txs even if not attestor in this slot (14 ms) 13:14:37 ✓ should throw an error if the transactions are not available (10 ms) 13:14:37 ✓ should not return an attestation if re-execution fails (11 ms) 13:14:37 ✓ should not return an attestation if no validators are in the committee (17 ms) 13:14:37 ✓ should not return an attestation if the proposer is not the current proposer (12 ms) 13:14:37 ✓ should attest with all validator keys that are in the committee (17 ms) 13:14:37 ✓ should not return an attestation if the proposal is not for the current or next slot (12 ms) 13:14:37 13:14:37 Test Suites: 1 passed, 1 total 13:14:37 Tests: 17 passed, 17 total 13:14:37 Snapshots: 0 total 13:14:37 Time: 8.784 s 13:14:37 Ran all test suites matching validator-client/src/validator.test.ts. 13:14:37 Force exiting Jest: Have you considered using `--detectOpenHandles` to detect async operations that kept running after all tests finished?