SpyCheese
7999a7e2c1
Merge branch 'testnet' into block-generation
2024-03-26 16:19:34 +03:00
EmelyanenkoK
9452c367e4
LS queries to nonfinal blocks ( #941 )
...
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-03-26 14:51:06 +03:00
SpyCheese
747b24aa18
Fix QueueSizeCounter and ValidatorGroup after merge
2024-02-19 13:10:47 +03:00
SpyCheese
a2eb3f3631
Merge branch 'testnet' into block-generation
2024-02-16 16:38:47 +03:00
EmelyanenkoK
12c1b1a2e6
Limit file descriptors num by adding archive slice lru ( #892 )
...
* --max-archive-fd option limits open files in archive manager
* Don't close the latest archives + bugfix
* Delete temp packages early
---------
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-02-07 14:56:37 +03:00
EmelyanenkoK
e723213d5c
Log number of LS queries by type ( #891 )
...
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-02-06 16:52:12 +03:00
EmelyanenkoK
59927ba534
Improve block broadcasts processing; add special overlay for blocks for validators ( #885 )
...
* Improve block broadcast processing
* ValidatorManagerImpl::written_handle
* Retry sending broadcasts in ValidatorGroup
* Fix setting channel_ready in AdnlPeerPair
* Add special overlay for validators for block broadcasting (#842 )
* Private overlay for broadcasting blocks
---------
Co-authored-by: SpyCheese <mikle98@yandex.ru>
(cherry picked from commit a52045bd91
)
---------
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-02-01 20:20:45 +03:00
SpyCheese
f4fd3ff3be
Merge branch 'testnet' into block-generation
2024-02-01 19:29:25 +03:00
EmelyanenkoK
d91643face
Fix getting shard client block id ( #870 )
...
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-01-22 18:33:26 +03:00
SpyCheese
a68b5cbe62
Improve validator session stats ( #861 )
2024-01-16 14:24:46 +03:00
EmelyanenkoK
b3be4283ff
Better error messages from LS for missing blocks ( #837 )
...
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2023-12-25 09:30:51 +03:00
EmelyanenkoK
ace934ff35
Adjust allowed time lag for last_liteserver_state + more verbose logs ( #836 )
...
* Add logs to collator and validator
* More logs to get_ext_messages, decrease verbosity level
* Adjust allowed time lag for last_liteserver_state
* Change verbosity of STATUS message
---------
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2023-12-19 10:39:25 +03:00
EmelyanenkoK
5e6b67ae96
Improve handling outbound message queues ( #825 )
...
* Improve handling outbound message queues
* Cleanup queue faster
* Calculate queue sizes in background
* Force or limit split/merge depending on queue size
* Increase validate_ref limit for transaction
* Add all changes of public libraries to block size estimation
* Don't crash on timeout in GC
* Don't import external messages when queue is too big
---------
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2023-12-13 12:57:34 +03:00
EmelyanenkoK
9b6d699c21
Cache recent block states and adjust timeouts ( #823 )
...
* Add parameter --celldb-compress-depth to speed up celldb
* Fix collator timeout
* Add block_state_cache
* Adjust state cache ttl
* Don't merge shards when queue is too big
* Decrease lt limit if previous block is too old
---------
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2023-12-08 14:20:17 +03:00
SpyCheese
1e3a12259b
Optimize masterchain collation
...
Use only shard blocks with ready msg queues
2023-08-30 20:14:19 +03:00
SpyCheese
9e02853cbb
Improve importing msg queues
2023-08-03 12:06:41 +03:00
SpyCheese
5c02459fd8
Optimize importing out queues
2023-07-31 18:12:09 +03:00
SpyCheese
8c4bc5b3f1
Fix sending msg queue queries
2023-07-26 12:21:19 +03:00
SpyCheese
f1e62d0075
Move msg queue limits to config
2023-07-24 15:29:55 +03:00
SpyCheese
d082ac36b0
Merge branch 'testnet' into block-generation
2023-03-28 16:52:33 +03:00
neodiX42
f06d5cb053
Make path separator cross-platform in few places ( #628 )
...
* make path separator cross-platform in few places
* reuse path separator definer
2023-03-05 14:15:53 +03:00
SpyCheese
225f71238b
Option for collating masterchain on validators
2023-01-16 19:30:15 +03:00
SpyCheese
29851c38ef
Various changes after merge
2023-01-12 17:32:59 +03:00
SpyCheese
d652f7d706
Merge branch 'testnet' into block-generation
...
# Conflicts:
# adnl/adnl-query.cpp
# crypto/block/block.tlb
# crypto/block/mc-config.h
# lite-client/lite-client.cpp
# overlay/overlay-manager.h
# overlay/overlay-peers.cpp
# overlay/overlay.cpp
# overlay/overlay.h
# overlay/overlay.hpp
# overlay/overlays.h
# rldp-http-proxy/DNSResolver.cpp
# rldp-http-proxy/rldp-http-proxy.cpp
# tl/generate/scheme/ton_api.tl
# tl/generate/scheme/ton_api.tlo
# tl/generate/scheme/tonlib_api.tlo
# ton/ton-types.h
# tonlib/tonlib/ExtClient.cpp
# tonlib/tonlib/ExtClient.h
# tonlib/tonlib/ExtClientLazy.cpp
# tonlib/tonlib/ExtClientOutbound.h
# tonlib/tonlib/ExtClientRaw.h
# tonlib/tonlib/TonlibClient.cpp
# tonlib/tonlib/TonlibClient.h
# tonlib/tonlib/tonlib-cli.cpp
# validator/impl/collator.cpp
# validator/impl/validate-query.cpp
# validator/impl/validate-query.hpp
# validator/manager.cpp
# validator/state-serializer.cpp
# validator/state-serializer.hpp
# validator/validator-group.cpp
# validator/validator-group.hpp
# validator/validator.h
2022-12-22 23:37:35 +03:00
EmelyanenkoK
1b106ef270
Use state with applied shards in liteserver ( #553 )
...
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2022-12-13 17:46:54 +03:00
SpyCheese
d4339b839c
Add "delshard", "delcollator" to validator-engine-console
2022-10-17 13:24:59 +03:00
SpyCheese
1d42c38122
Move some constants to global config ( #484 )
2022-10-10 17:13:21 +03:00
SpyCheese
636348ffc2
Merge branch 'testnet' into block-generation
...
# Conflicts:
# overlay/overlay-fec-broadcast.cpp
# overlay/overlay.hpp
# tl/generate/scheme/ton_api.tl
# tl/generate/scheme/ton_api.tlo
# validator-engine-console/validator-engine-console-query.cpp
# validator-engine-console/validator-engine-console-query.h
# validator-engine-console/validator-engine-console.cpp
# validator-engine/validator-engine.cpp
# validator-engine/validator-engine.hpp
# validator/downloaders/wait-block-state.hpp
# validator/impl/validate-query.cpp
# validator/validator.h
2022-10-06 13:46:25 +03:00
SpyCheese
81c0e920c5
Simplify selecting shards for monitor
2022-10-06 13:41:13 +03:00
SpyCheese
9fb986f6f5
Disable downloading archives during sync
2022-10-06 13:41:02 +03:00
EmelyanenkoK
8329a58994
Add GetPerfTimerStats ( #451 )
...
* Add getperfwarningtimeraverage query for validator-engine-console
* Fix for getperfwarningtimeraverage query
* getperftimerstats
* Add history max size: 1 hour
* PerfWarningTimer: move callback instead of copy
* PerfWarningTimer: fix move constructor bug
* PerfWarningTimer: fix bug: lifetime of the callback was greater than lifetime of the local variable 'manager' captured by reference
* Fix validate-query.cpp: 'manager' used after it was moved
* PerfWarningTimer: remove logs
* getperftimerstats: write to json file
* getperftimerstatsjson
Co-authored-by: legaii <jgates.ardux@gmail.com>
Co-authored-by: Ivan Siomash <106972486+legaii@users.noreply.github.com>
2022-09-10 12:57:13 +03:00
SpyCheese
c2e7d0b0de
Bugfixes in manager.cpp
2022-08-23 17:31:37 +03:00
SpyCheese
ea7a5776fe
Download persistent states when syncing new shards
2022-08-19 18:24:18 +03:00
SpyCheese
be2169e523
Reload validator options when needed
2022-08-19 18:24:17 +03:00
SpyCheese
011e97f53c
Flag "full collated data" in mc config; fix accept-block
2022-08-19 18:24:17 +03:00
SpyCheese
597fd8443d
Collator nodes preload msg queues
2022-08-19 18:24:17 +03:00
SpyCheese
910398da92
Improved neighbor choosing in full-node-shard
2022-08-19 18:24:17 +03:00
SpyCheese
662435462e
Validators temporary join shard overlays
2022-08-19 18:24:17 +03:00
SpyCheese
5ba2a55716
Add --lite-validator flag, rework is_validator checks
2022-08-19 18:24:17 +03:00
SpyCheese
7241522de2
Remove obsolete interface for importing blocks
2022-08-19 18:24:16 +03:00
SpyCheese
212c07f2f0
Change update_shard_configuration
2022-08-19 18:24:15 +03:00
SpyCheese
e43e235143
Get neighbors' msg queues from other nodes
2022-08-19 18:24:15 +03:00
SpyCheese
7ac60bea7d
New shard overlays
2022-08-19 18:24:15 +03:00
SpyCheese
53270a00e6
Add CollatorNode and make validators request blocks from it
2022-08-19 18:24:15 +03:00
SpyCheese
996c23e506
Shardchain validation without monitoring shardchains
2022-08-19 18:24:14 +03:00
SpyCheese
bdfca7afef
Remove unused code
2022-08-19 18:24:14 +03:00
SpyCheese
415ace3da9
Exporting and importing candidates using validator-engine-console; lite mode for validator group
2022-08-19 18:24:14 +03:00
SpyCheese
849d995346
Add getvalidatorsessions query to validator-engine-console
2022-08-19 18:24:14 +03:00
SpyCheese
417c3bb640
More detailed validator session stats
2022-08-18 21:52:08 +03:00
SpyCheese
b3e6819f3f
Log validator session stats to file
2022-08-18 21:51:57 +03:00