SpyCheese
1ee9e47007
Merge branch testnet into block-generation
2024-05-30 11:21:39 +03:00
EmelyanenkoK
539d5dd2de
Add candidates cache ( #1000 )
...
* Broadcast shardchain block candidates in private overlays, generate proof links from candidates
* Disable shardchain block broadcasts in private overlays
* Send block candidate broadcasts to custom overlays, allow non-validators to receive candidates
---------
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-05-24 09:58:07 +03:00
SpyCheese
eb41e1a10e
Merge branch 'testnet' into block-generation
2024-05-22 11:00:24 +03:00
EmelyanenkoK
561f342639
Add --celldb-direct-io and --celldb-preload-all ( #993 )
...
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-05-14 16:05:29 +03:00
SpyCheese
172c16ca2e
Merge branch 'testnet' into block-generation
2024-05-13 16:38:48 +03:00
EmelyanenkoK
c7fd75ce56
Fix creating rocksdb cache ( #989 )
...
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-05-13 14:54:57 +03:00
EmelyanenkoK
1433f23eff
Add option --celldb-cache-size ( #988 )
...
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-05-13 12:48:18 +03:00
SpyCheese
a745f6f679
Merge branch 'testnet' into block-generation
2024-04-26 12:08:28 +03:00
EmelyanenkoK
d2b012c883
Add write time stats to celldb/db_stats.txt ( #972 )
...
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-04-25 18:45:39 +03:00
SpyCheese
8143eb074e
Merge branch 'testnet' into block-generation
2024-04-08 14:44:28 +03:00
EmelyanenkoK
8390d887d3
Set temp packages ttl to 1h ( #953 )
...
This leaves only 3 last temp packages
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-04-02 11:46:40 +03:00
SpyCheese
4916e4847a
Merge branch 'testnet' into block-generation
2024-04-01 17:28:23 +03:00
Marat
46ca0e6014
Check pack_statistics for nullptr ( #950 )
2024-03-29 22:01:53 +03:00
SpyCheese
8385336eab
Merge branch 'testnet' into block-generation
2024-03-28 18:12:21 +03:00
Marat
10487b1c71
Collect statistics for .pack files ( #944 )
...
* Statistics for .pack files
* optimizations
* fix typo
* fix erasing packages
2024-03-27 14:23:11 +03:00
SpyCheese
2ee7cbc106
Merge branch 'testnet' into block-generation
...
# Conflicts:
# tonlib/tonlib/TonlibClient.cpp
# validator-engine/validator-engine.hpp
# validator/validator-options.hpp
# validator/validator.h
2024-03-25 18:40:47 +03:00
Marat
0feaaf591c
Mode 644 for db_stats.txt ( #938 )
2024-03-20 15:57:20 +03:00
Marat
7a6bfa7e7a
Save rocksdb statistics to file every minute ( #932 )
...
* Save rocksdb statistics to file every minute
* Add flag to disable collecting rocksdb statistics
2024-03-20 14:21:40 +03:00
SpyCheese
a2eb3f3631
Merge branch 'testnet' into block-generation
2024-02-16 16:38:47 +03:00
EmelyanenkoK
eb4831d7d6
Add --archive-preload-period ( #904 )
...
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-02-15 12:03:57 +03:00
EmelyanenkoK
12c1b1a2e6
Limit file descriptors num by adding archive slice lru ( #892 )
...
* --max-archive-fd option limits open files in archive manager
* Don't close the latest archives + bugfix
* Delete temp packages early
---------
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-02-07 14:56:37 +03:00
SpyCheese
c38b2928ec
Fix typo in archive-slice.cpp ( #850 ) ( #879 )
2024-02-02 17:02:38 +03:00
SpyCheese
f4fd3ff3be
Merge branch 'testnet' into block-generation
2024-02-01 19:29:25 +03:00
EmelyanenkoK
83efcebad0
Improve CellDb migration ( #835 )
...
* Fix deserializing cells
* Use proxy actor
* Add delays
* Print stats every minute
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2023-12-19 10:39:35 +03:00
EmelyanenkoK
9b6d699c21
Cache recent block states and adjust timeouts ( #823 )
...
* Add parameter --celldb-compress-depth to speed up celldb
* Fix collator timeout
* Add block_state_cache
* Adjust state cache ttl
* Don't merge shards when queue is too big
* Decrease lt limit if previous block is too old
---------
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2023-12-08 14:20:17 +03:00
SpyCheese
66b98b6d6a
Merge branch 'testnet' into block-generation
2023-07-21 19:29:57 +03:00
neodiX42
50d2361394
On MacOS, writing more than 0x7fffffff bytes will fail with errno 22 ( #737 )
2023-07-14 16:27:59 +03:00
SpyCheese
e4e77c16c5
Merge branch 'testnet' into block-generation
2023-06-02 13:34:00 +03:00
SpyCheese
87d4f4bc7f
Fix saving list of packages in archive manager
2023-05-02 18:32:20 +03:00
EmelyanenkoK
8bc20ede2e
Add archive manager index ( #685 )
...
* Optimize get_file_desc_by_ seqno/lt/ut
* Optimize get_next_file_desc
---------
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2023-04-28 12:58:02 +03:00
SpyCheese
876c68c5c7
Merge branch 'testnet' into block-generation
2023-03-31 13:11:36 +03:00
SpyCheese
5e0dadfff6
Rollback celldb optimization ( #658 )
2023-03-30 10:03:05 +03:00
SpyCheese
d082ac36b0
Merge branch 'testnet' into block-generation
2023-03-28 16:52:33 +03:00
EmelyanenkoK
47311d6e0e
Improve tweaking for high throughput ( #610 )
...
* Option "--disable-ext-msg-broadcast"
* "Get shard out queue size" query
* Move disabling ext msg broadcasts from command-line arguments to config
* Fix compilation error
* Asynchronous store_cell and gc in celldb
* Make GC in celldb work evenly over time
* Increase timeouts for downloading blocks
* Reuse blocks from previous rounds in validator session
* Use Rldp2 in FullNode for downloading persistent states and archives
* Improve logs in download-archive-slice and download-state
* Decrease delay between serializing shards
* Make CellDbIn::load_cell synchronous to avoid interfering with store_cell
---------
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2023-03-15 10:47:35 +03:00
neodiX42
f06d5cb053
Make path separator cross-platform in few places ( #628 )
...
* make path separator cross-platform in few places
* reuse path separator definer
2023-03-05 14:15:53 +03:00
SpyCheese
0578cb4a42
Fix typos, UBs and warnings ( #625 )
2023-02-28 12:06:09 +03:00
SpyCheese
45c0270716
Improve handling of absent blocks in archive manager ( #600 )
2023-01-23 14:40:28 +03:00
SpyCheese
d652f7d706
Merge branch 'testnet' into block-generation
...
# Conflicts:
# adnl/adnl-query.cpp
# crypto/block/block.tlb
# crypto/block/mc-config.h
# lite-client/lite-client.cpp
# overlay/overlay-manager.h
# overlay/overlay-peers.cpp
# overlay/overlay.cpp
# overlay/overlay.h
# overlay/overlay.hpp
# overlay/overlays.h
# rldp-http-proxy/DNSResolver.cpp
# rldp-http-proxy/rldp-http-proxy.cpp
# tl/generate/scheme/ton_api.tl
# tl/generate/scheme/ton_api.tlo
# tl/generate/scheme/tonlib_api.tlo
# ton/ton-types.h
# tonlib/tonlib/ExtClient.cpp
# tonlib/tonlib/ExtClient.h
# tonlib/tonlib/ExtClientLazy.cpp
# tonlib/tonlib/ExtClientOutbound.h
# tonlib/tonlib/ExtClientRaw.h
# tonlib/tonlib/TonlibClient.cpp
# tonlib/tonlib/TonlibClient.h
# tonlib/tonlib/tonlib-cli.cpp
# validator/impl/collator.cpp
# validator/impl/validate-query.cpp
# validator/impl/validate-query.hpp
# validator/manager.cpp
# validator/state-serializer.cpp
# validator/state-serializer.hpp
# validator/validator-group.cpp
# validator/validator-group.hpp
# validator/validator.h
2022-12-22 23:37:35 +03:00
SpyCheese
c7f06abfbc
Fix finding blocks by lt and ut in archive manager ( #536 )
2022-11-30 08:38:46 +03:00
SpyCheese
ea7a5776fe
Download persistent states when syncing new shards
2022-08-19 18:24:18 +03:00
EmelyanenkoK
845cbca1e5
Make asynchronous celldb interface ( #388 )
...
* Asynchronous load_cell in celldb
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2022-06-01 10:03:50 +03:00
EmelyanenkoK
89b8717cf8
Persistent optimization ( #382 )
...
* State serialization consuming less RAM
* Move large-boc-serializer to crypto/vm, refactor code
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2022-05-24 21:17:11 +03:00
EmelyanenkoK
c07394aab5
Optimization of persistent state serialization ( #364 )
...
* Fix double serialization of masterchain; increase sync_blocks_before
* Improve logging in DownloadState
* Write persistent state directly to file instead of a buffer
* Don't keep ref to masterchain state in AsyncStateSerializer
* Sparse state serialization over longer period
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2022-05-15 17:51:24 +03:00
ton
eecf05ca59
bugfixes + tonlib update
2020-04-30 15:04:47 +04:00
ton
9f008b129f
updated submodules, bugfixes
...
- added new fift/func code for validator complaint creation
- bugfixes in validator
- updates in tonlib
- new versions of rocksdb/abseil
- hardfork support
2020-04-27 16:01:46 +04:00
ton
be9c34c62d
bugfixes
2020-04-10 23:06:01 +04:00
ton
8be3fc99ed
bugfixes + decreased archive slice size
2020-04-08 23:49:28 +04:00
ton
148a5e0179
small db changes
2020-04-07 19:35:04 +04:00
ton
cf97f48cd7
error handling in lite client, speed up message dequeue in blocks
2020-04-07 00:08:53 +04:00
ton
dd4ac0f440
vm bugfixes
2020-02-28 18:59:47 +04:00