SpyCheese
a745f6f679
Merge branch 'testnet' into block-generation
2024-04-26 12:08:28 +03:00
EmelyanenkoK
9a543c6b28
Add more info to session stats ( #973 )
...
* Improve validator session stats
* Improve validator session stats
Add got_submit_at, collation_cached, validation_cached.
Fix stats cleanup.
* Fix setting timestamp for cached blocks
* Add serialize/deserialize time, serialized size to validator session stats, fix setting is_accepted
---------
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-04-25 18:47:15 +03:00
EmelyanenkoK
d2b012c883
Add write time stats to celldb/db_stats.txt ( #972 )
...
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-04-25 18:45:39 +03:00
SpyCheese
1b7f7aed9f
Merge branch 'refs/heads/testnet' into block-generation
2024-04-15 14:09:19 +03:00
EmelyanenkoK
190aa6bd4a
Use shard client timestamp to determine expiration of temp archives ( #965 )
...
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-04-15 13:44:12 +03:00
SpyCheese
8143eb074e
Merge branch 'testnet' into block-generation
2024-04-08 14:44:28 +03:00
EmelyanenkoK
a2bd695b89
Fix prepare_vm_c7 ( #958 )
...
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-04-08 14:29:54 +03:00
EmelyanenkoK
b8111d8b5b
Fix setting due_payment in storage phase ( #957 )
...
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-04-08 11:15:52 +03:00
EmelyanenkoK
cc4244f5a4
Fix setting inited_ in FullNodeCustomOverlay ( #954 )
...
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-04-03 12:11:07 +03:00
EmelyanenkoK
8390d887d3
Set temp packages ttl to 1h ( #953 )
...
This leaves only 3 last temp packages
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-04-02 11:46:40 +03:00
SpyCheese
1fda6902a9
Merge branch 'testnet' into block-generation
2024-04-01 18:32:44 +03:00
EmelyanenkoK
f7907bdd58
Rename private ext msg overlays to custom overlays, change interface a bit ( #952 )
...
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-04-01 18:24:08 +03:00
SpyCheese
4916e4847a
Merge branch 'testnet' into block-generation
2024-04-01 17:28:23 +03:00
EmelyanenkoK
0434eadc1f
Add custom overlays for external messages ( #949 )
...
* Private overlay for external messages
* Improve ext msg overlays
* Manage from validator console
* Bypass out queue size limit for high-priority messages
* Shuffle messages in get_external_messages
* Cleanup mempool when creating validator group
* Improve private overlays for externals
1. Allow using validator adnl ids in addition to fullnode ids
2. Set priority per sender, not per overlay
3. Require the same overlay name for all nodes
4. Enable lz4 in private block overlay
* Fix typo, add debug logs
* Enable lz4 in private block overlay by config
Change proto_version for lz4 in catchain overlays to 4
* Add logs for broadcasts in fullnode
---------
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-04-01 16:44:08 +03:00
Marat
46ca0e6014
Check pack_statistics for nullptr ( #950 )
2024-03-29 22:01:53 +03:00
SpyCheese
f5cedc3b6e
Enable compression in private overlays v2 and in collator node
2024-03-29 15:04:07 +03:00
SpyCheese
8385336eab
Merge branch 'testnet' into block-generation
2024-03-28 18:12:21 +03:00
Marat
10487b1c71
Collect statistics for .pack files ( #944 )
...
* Statistics for .pack files
* optimizations
* fix typo
* fix erasing packages
2024-03-27 14:23:11 +03:00
SpyCheese
036ce69786
Use compression in new private overlays
2024-03-26 16:22:52 +03:00
SpyCheese
7999a7e2c1
Merge branch 'testnet' into block-generation
2024-03-26 16:19:34 +03:00
EmelyanenkoK
b07614335c
liteServer.getOutMsgQueueSizes method ( #943 )
...
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-03-26 15:55:58 +03:00
EmelyanenkoK
0bcebe8a0e
Exp/compress candidates ( #942 )
...
* Compress block candidates in validator-session
* Compress blocks in full-node (disabled for now)
---------
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-03-26 14:52:46 +03:00
EmelyanenkoK
9452c367e4
LS queries to nonfinal blocks ( #941 )
...
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-03-26 14:51:06 +03:00
SpyCheese
3190c67f18
Simplify getCapabilities in fullnode
2024-03-26 11:42:30 +03:00
SpyCheese
2ee7cbc106
Merge branch 'testnet' into block-generation
...
# Conflicts:
# tonlib/tonlib/TonlibClient.cpp
# validator-engine/validator-engine.hpp
# validator/validator-options.hpp
# validator/validator.h
2024-03-25 18:40:47 +03:00
Marat
0feaaf591c
Mode 644 for db_stats.txt ( #938 )
2024-03-20 15:57:20 +03:00
Marat
7a6bfa7e7a
Save rocksdb statistics to file every minute ( #932 )
...
* Save rocksdb statistics to file every minute
* Add flag to disable collecting rocksdb statistics
2024-03-20 14:21:40 +03:00
EmelyanenkoK
0a82a19313
Don't serialize expired persistent states ( #935 )
...
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-03-19 15:43:03 +03:00
EmelyanenkoK
f1592641de
Tonlib improvement fixes ( #934 )
...
* 3.6. Fix directory traversal in KeyValueDir
* 3.9. Fix buffer_to_hex reversing nibbles
* 3.5. Fix error handling at blocks.getBlockHeader
* 3.11. Fix query.forget
* 3.12. Fix error handling in RemoteRunSmcMethod
* 4.1. Delete unused files
* 3.10. Use named constants instead hardcoded constants
* 3.4. Fix response block header verification
* 3.1. Check proof of blocks.getShards response
* fix td::buffer_to_hex + test
* 3.2. Add proof check for listBlockTransactions response in RunEmulator actor
* 3.8. Add proof checking for getLibraries method
* fix regression tests
* 3.3 Add proof checking for lookupBlock method
* Add publishers to proof of getLibrariesWithProof response (#25 )
* fix missing return, fix requesting mc block
* Fix requesting lookupBlock with client mc blk == mc ref block
* Fix duplicating lib data in proof and data, add mode 2 for not including the data
* Migration of LastBlockStorage with fixed td::buffer_to_hex
---------
Co-authored-by: ms <dungeon666master@protonmail.com>
Co-authored-by: Marat <98183742+dungeon-master-666@users.noreply.github.com>
2024-03-19 15:31:29 +03:00
Marat
69de1cb621
Fix linker error: undefined reference to LiteServerCacheImpl::MAX_CACHE_SIZE ( #930 )
...
Co-authored-by: EmelyanenkoK <emelyanenko.kirill@gmail.com>
2024-03-19 15:24:15 +03:00
EmelyanenkoK
fc69377f9c
Fix running VM in liteserver and tonlib ( #933 )
...
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-03-19 15:23:34 +03:00
SpyCheese
e216651112
Merge branch 'testnet' into block-generation
...
# Conflicts:
# crypto/block/mc-config.cpp
# crypto/block/mc-config.h
2024-03-11 18:08:08 +03:00
EmelyanenkoK
9d05696452
Add infrastructure for precompiled smartcontracts ( #927 )
...
* Utils for writing precompiled contracts
* Precompiled contracts in config, override gas_usage for them
* Add base class for precompiled contracts
* Improve utils for precompiled smc
* Implement GETPRECOMPILEDGAS
* Enable precompiles by flag
* Process null data in PrecompiledSmartContract
* Fix ton_block wasm build
* Fix vm::util::store_(u)long
---------
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-03-05 16:54:49 +03:00
SpyCheese
6c680dbc4e
Cleanup code in validator-group.cpp (after merge)
2024-02-22 15:00:41 +03:00
SpyCheese
0fb781b4c3
Improve queue cleanup (after merge)
2024-02-22 14:55:11 +03:00
SpyCheese
28699654fb
New private block overlays
2024-02-21 18:38:43 +03:00
EmelyanenkoK
310dd6dec1
Fix fetching mc config for runSmcMethod, fix caching in LS ( #915 )
...
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-02-21 16:13:55 +03:00
EmelyanenkoK
c7302bc4a3
Fix checking ext message broadcasts ( #912 )
...
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-02-19 19:01:50 +03:00
SpyCheese
e575d27302
Remove unused priority_broadcast_receivers
2024-02-19 14:21:15 +03:00
SpyCheese
747b24aa18
Fix QueueSizeCounter and ValidatorGroup after merge
2024-02-19 13:10:47 +03:00
SpyCheese
a2eb3f3631
Merge branch 'testnet' into block-generation
2024-02-16 16:38:47 +03:00
EmelyanenkoK
af71dae31b
Ls run method ( #906 )
...
* Improve LS runSmcMethod
* Full c7 and libraries
* Don't request c7 (mode 8) in lite-client
* Prioritize remote result in lite-client runmethod (but not runmethodfull)
* Return simplified c7 from runSmgMethod, add flag to return full
---------
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-02-16 16:30:43 +03:00
EmelyanenkoK
eb4831d7d6
Add --archive-preload-period ( #904 )
...
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-02-15 12:03:57 +03:00
EmelyanenkoK
4d39772e40
Drop only accepted duplicate ext messages, don't cache errors ( #902 )
...
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-02-12 10:42:02 +03:00
EmelyanenkoK
f344aa46c3
Drop duplicate ext msg broadcasts ( #894 )
...
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-02-09 15:28:23 +03:00
EmelyanenkoK
79c48ebbba
Add cache for some LS requests ( #893 )
...
* Cache runSmcMethod queries to LS
* Drop duplicate sendMessage
* Drop sendMessage cache once a minute
---------
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-02-07 15:45:51 +03:00
EmelyanenkoK
12c1b1a2e6
Limit file descriptors num by adding archive slice lru ( #892 )
...
* --max-archive-fd option limits open files in archive manager
* Don't close the latest archives + bugfix
* Delete temp packages early
---------
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-02-07 14:56:37 +03:00
EmelyanenkoK
e723213d5c
Log number of LS queries by type ( #891 )
...
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-02-06 16:52:12 +03:00
SpyCheese
c38b2928ec
Fix typo in archive-slice.cpp ( #850 ) ( #879 )
2024-02-02 17:02:38 +03:00
EmelyanenkoK
59927ba534
Improve block broadcasts processing; add special overlay for blocks for validators ( #885 )
...
* Improve block broadcast processing
* ValidatorManagerImpl::written_handle
* Retry sending broadcasts in ValidatorGroup
* Fix setting channel_ready in AdnlPeerPair
* Add special overlay for validators for block broadcasting (#842 )
* Private overlay for broadcasting blocks
---------
Co-authored-by: SpyCheese <mikle98@yandex.ru>
(cherry picked from commit a52045bd91
)
---------
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-02-01 20:20:45 +03:00