SpyCheese
5080cdffdd
Merge branch 'session-stats-patch' into accelerator
2024-08-20 12:41:55 +03:00
SpyCheese
faedb4635c
Remove unused get validator session stats query
2024-08-20 11:33:16 +03:00
SpyCheese
1b4fb42859
End validator session stats
2024-08-19 19:55:11 +03:00
SpyCheese
0ca022cc72
Improve validator session stats
...
* Collator stats: block limits, number of processed external messages
* Collator and validator work time
* Last key block seqno
* Approvers and signers
2024-08-19 18:35:50 +03:00
SpyCheese
a14490637a
More overlay stats
2024-08-01 18:39:22 +03:00
SpyCheese
70322f58c1
Use candidates from DB in wait block data
2024-08-01 13:57:32 +03:00
SpyCheese
0e7374610d
Improve block broadcasts
2024-07-25 16:33:19 +03:00
SpyCheese
3ab7cc3c73
Merge branch 'testnet' into accelerator
2024-07-17 15:33:47 +03:00
SpyCheese
b9e89d4c66
"getcollatoroptionsjson" command in validator console ( #1059 )
...
* "getcollatoroptionsjson" command in validator console
* Improve state serializer
Use previous persistent state to speed up reading
2024-07-17 15:10:55 +03:00
SpyCheese
3a8ef60bbb
Fast-sync overlays
...
* Semiprivate overlays
* Fast sync overlays in full-node
* Adjust shard overlays
2024-07-13 15:40:26 +03:00
SpyCheese
d74d3f1fc2
Merge branch 'testnet' into accelerator
2024-07-10 15:35:54 +03:00
EmelyanenkoK
57f95cc282
Add collator options ( #1052 )
...
* Set collator options from validator console
* Fix compilation error in manager-disk
* Defer all messages if out msg queue is too big
* Fix checking queue size in collator
---------
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-07-10 14:58:13 +03:00
SpyCheese
172e404426
Merge branch 'testnet' into accelerator
2024-06-28 11:55:12 +03:00
Marat
06f503dd02
Tonlib: add methods smc.getRawFullAccountState and blocks.getOutMsgQueueSizes ( #1027 )
...
* add method smc.getRawFullAccountState
* Add method blocks.getOutMsgQueueSizes
2024-06-27 16:45:22 +03:00
EmelyanenkoK
0daee1d887
Merge message dispatch queue ( #1030 )
...
* Deferred messages and msg metadata
* Store out msg queue size in state
* Add checks for queue processing
1. Collator must process at least one message from AccountDispatchQueue (unless block is full)
2. The first message from a transaction is not counted, it cannot be deferred (unless AccountDispatchQueue is not empty)
* Return msg metadata from LS in listBlockTransactions[Ext]
* Enable new features by capabilities
* Changes in deferred messages
* Process deferred messages via new_msgs in collator
* Rework setting deferred_lt, bring back check_message_processing_order, check order of deferred_lt in validator
* Use have_unprocessed_account_dispatch_queue_ in collator
* Fix setting transaction lt for deferred messages
* Fix lite-client compilation error
* Changes in process_dispatch_queue, rename deferred_lt -> emitted_lt
* Fix compilation error
* Use uint64 for msg queue size
* Add liteServer.getBlockOutMsgQueueSize
* Fix compilation error
* Fix typos in comments
---------
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-06-27 16:12:23 +03:00
SpyCheese
90d2edf535
Improve CollatorNode
...
* Keep track of validator groups
* Pre-generate shard blocks
2024-06-25 14:06:15 +03:00
SpyCheese
007f1fb1d7
New liteserver config format
...
* Specify shards and seqno/utime/lt limits for liteservers in global config
* Support in lite-client, tonlib, blockchain-explorer
* Rework proxy-liteserver
2024-06-12 18:12:45 +03:00
SpyCheese
38ab70c037
Changes in validation
...
* Configure collator list in validator-console
* Remove "lite-validator" flags
* Better compatibility in validate-query.cpp
2024-06-11 13:39:14 +03:00
SpyCheese
b8999be2c0
New archive format and importing archive slices
2024-06-06 18:31:28 +03:00
SpyCheese
eb4c876f22
Merge branch 'testnet' into block-generation
2024-06-04 16:49:47 +03:00
EmelyanenkoK
74801d00b8
Command to disable state serializer ( #1011 )
...
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-05-31 20:50:31 +03:00
SpyCheese
1ee9e47007
Merge branch testnet into block-generation
2024-05-30 11:21:39 +03:00
EmelyanenkoK
229d6a8ee9
Fix TL scheme for liteServer.nonfinal.getValidatorGroups ( #1008 )
...
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-05-29 15:11:09 +03:00
EmelyanenkoK
8a4d44de1e
Compress block candidate broadcasts ( #1007 )
...
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-05-29 15:10:42 +03:00
EmelyanenkoK
539d5dd2de
Add candidates cache ( #1000 )
...
* Broadcast shardchain block candidates in private overlays, generate proof links from candidates
* Disable shardchain block broadcasts in private overlays
* Send block candidate broadcasts to custom overlays, allow non-validators to receive candidates
---------
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-05-24 09:58:07 +03:00
SpyCheese
172c16ca2e
Merge branch 'testnet' into block-generation
2024-05-13 16:38:48 +03:00
EmelyanenkoK
d5c09936cf
Block broadcasts in custom overlays ( #986 )
...
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-05-10 17:04:49 +03:00
EmelyanenkoK
6fb2019a4f
Improve validator session stats ( #982 )
...
* Add list of validators
* Fix producer stats
* Make round and stats timestamps more meaningful
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-05-08 17:41:15 +03:00
SpyCheese
a745f6f679
Merge branch 'testnet' into block-generation
2024-04-26 12:08:28 +03:00
EmelyanenkoK
9a543c6b28
Add more info to session stats ( #973 )
...
* Improve validator session stats
* Improve validator session stats
Add got_submit_at, collation_cached, validation_cached.
Fix stats cleanup.
* Fix setting timestamp for cached blocks
* Add serialize/deserialize time, serialized size to validator session stats, fix setting is_accepted
---------
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-04-25 18:47:15 +03:00
SpyCheese
1fda6902a9
Merge branch 'testnet' into block-generation
2024-04-01 18:32:44 +03:00
EmelyanenkoK
f7907bdd58
Rename private ext msg overlays to custom overlays, change interface a bit ( #952 )
...
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-04-01 18:24:08 +03:00
SpyCheese
4916e4847a
Merge branch 'testnet' into block-generation
2024-04-01 17:28:23 +03:00
EmelyanenkoK
0434eadc1f
Add custom overlays for external messages ( #949 )
...
* Private overlay for external messages
* Improve ext msg overlays
* Manage from validator console
* Bypass out queue size limit for high-priority messages
* Shuffle messages in get_external_messages
* Cleanup mempool when creating validator group
* Improve private overlays for externals
1. Allow using validator adnl ids in addition to fullnode ids
2. Set priority per sender, not per overlay
3. Require the same overlay name for all nodes
4. Enable lz4 in private block overlay
* Fix typo, add debug logs
* Enable lz4 in private block overlay by config
Change proto_version for lz4 in catchain overlays to 4
* Add logs for broadcasts in fullnode
---------
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-04-01 16:44:08 +03:00
SpyCheese
f5cedc3b6e
Enable compression in private overlays v2 and in collator node
2024-03-29 15:04:07 +03:00
SpyCheese
7999a7e2c1
Merge branch 'testnet' into block-generation
2024-03-26 16:19:34 +03:00
EmelyanenkoK
b07614335c
liteServer.getOutMsgQueueSizes method ( #943 )
...
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-03-26 15:55:58 +03:00
EmelyanenkoK
0bcebe8a0e
Exp/compress candidates ( #942 )
...
* Compress block candidates in validator-session
* Compress blocks in full-node (disabled for now)
---------
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-03-26 14:52:46 +03:00
EmelyanenkoK
9452c367e4
LS queries to nonfinal blocks ( #941 )
...
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-03-26 14:51:06 +03:00
SpyCheese
3190c67f18
Simplify getCapabilities in fullnode
2024-03-26 11:42:30 +03:00
SpyCheese
2ee7cbc106
Merge branch 'testnet' into block-generation
...
# Conflicts:
# tonlib/tonlib/TonlibClient.cpp
# validator-engine/validator-engine.hpp
# validator/validator-options.hpp
# validator/validator.h
2024-03-25 18:40:47 +03:00
EmelyanenkoK
f1592641de
Tonlib improvement fixes ( #934 )
...
* 3.6. Fix directory traversal in KeyValueDir
* 3.9. Fix buffer_to_hex reversing nibbles
* 3.5. Fix error handling at blocks.getBlockHeader
* 3.11. Fix query.forget
* 3.12. Fix error handling in RemoteRunSmcMethod
* 4.1. Delete unused files
* 3.10. Use named constants instead hardcoded constants
* 3.4. Fix response block header verification
* 3.1. Check proof of blocks.getShards response
* fix td::buffer_to_hex + test
* 3.2. Add proof check for listBlockTransactions response in RunEmulator actor
* 3.8. Add proof checking for getLibraries method
* fix regression tests
* 3.3 Add proof checking for lookupBlock method
* Add publishers to proof of getLibrariesWithProof response (#25 )
* fix missing return, fix requesting mc block
* Fix requesting lookupBlock with client mc blk == mc ref block
* Fix duplicating lib data in proof and data, add mode 2 for not including the data
* Migration of LastBlockStorage with fixed td::buffer_to_hex
---------
Co-authored-by: ms <dungeon666master@protonmail.com>
Co-authored-by: Marat <98183742+dungeon-master-666@users.noreply.github.com>
2024-03-19 15:31:29 +03:00
SpyCheese
fc6e2ead29
Revert "Process adnl query errors"
...
This reverts commit 1869a25062
2024-03-15 14:13:07 +03:00
SpyCheese
28699654fb
New private block overlays
2024-02-21 18:38:43 +03:00
SpyCheese
a2eb3f3631
Merge branch 'testnet' into block-generation
2024-02-16 16:38:47 +03:00
EmelyanenkoK
59927ba534
Improve block broadcasts processing; add special overlay for blocks for validators ( #885 )
...
* Improve block broadcast processing
* ValidatorManagerImpl::written_handle
* Retry sending broadcasts in ValidatorGroup
* Fix setting channel_ready in AdnlPeerPair
* Add special overlay for validators for block broadcasting (#842 )
* Private overlay for broadcasting blocks
---------
Co-authored-by: SpyCheese <mikle98@yandex.ru>
(cherry picked from commit a52045bd91
2024-02-01 20:20:45 +03:00
SpyCheese
f4fd3ff3be
Merge branch 'testnet' into block-generation
2024-02-01 19:29:25 +03:00
SpyCheese
a68b5cbe62
Improve validator session stats ( #861 )
2024-01-16 14:24:46 +03:00
EmelyanenkoK
4303e49c93
Postpone addition of overlay for block broadcasting ( #842 )
...
This reverts commit a52045bd91
2024-01-16 11:29:03 +03:00
EmelyanenkoK
a52045bd91
Add special overlay for validators for block broadcasting ( #842 )
...
* Private overlay for broadcasting blocks
---------
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2023-12-28 21:54:55 +03:00
