1
0
Fork 0
mirror of https://github.com/ton-blockchain/ton synced 2025-02-15 04:32:21 +00:00
Commit graph

194 commits

Author SHA1 Message Date
SpyCheese
378b5e94c8 Automatically issue and import fast sync overlay certificates 2024-12-04 18:06:19 +03:00
SpyCheese
4826f7665f Merge branch 'testnet' into accelerator 2024-12-03 20:46:55 +03:00
SpyCheese
9ae88d87e3
Export all keys command in validator-engine-console (#1412)
* Export all keys command in validator-engine-console

* Use OPENSSL_cleanse in Bits256::fill_zero_s
2024-12-03 17:19:12 +03:00
SpyCheese
923f1cd69b Improve collator node pings and collation manager stats 2024-11-28 14:13:49 +03:00
birydrad
bf572f9599 optimistic out-msg-queue broadcast 2024-11-26 21:41:12 +04:00
SpyCheese
640c0bb313 Merge branch 'testnet' into accelerator 2024-11-26 16:50:57 +03:00
SpyCheese
954a96a077
Accelerator: partial fullnodes (#1393)
* Accelerator: partial fullnodes

1) Node can monitor a subset of shards
2) New archive slice format (sharded)
3) Validators are still required to have all shards
4) Support partial liteservers in lite-client, blockchain explorer, tonlib
5) Proxy liteserver

* Fix compilation error
2024-11-26 14:46:58 +03:00
neodix42
62444100f5
Add message hash to tonlib response (#1379)
* add msg hash

* regenerate tonlib_api.tlo
2024-11-26 11:23:05 +03:00
SpyCheese
e6aac0b143 Merge branch 'testnet' into accelerator 2024-11-26 09:28:07 +03:00
SpyCheese
b60f6ee72f Write collation stats to session stats, add collator options for collated data 2024-11-26 08:54:19 +03:00
SpyCheese
061c82f89c
Send validator telemetry to the private overlay (#1325)
* Send validator telemetry to the private overlay

* Improve rotating neighbours in overlays
2024-11-25 22:37:18 +03:00
SpyCheese
b3bea413e3 Rework validator-collator interaction
1) Remove config 41, move "full collated data" to capabilities
2) Whitelist on collator nodes
3) "Ping" request for collator nodes
4) More customizable collators list for validators
5) CollationManager
2024-11-21 11:47:39 +03:00
SpyCheese
df21424047 Merge branch 'testnet' into accelerator 2024-10-09 21:10:36 +03:00
SpyCheese
b69214b6af
Validator patch: state download, adnl stats (#1257)
* Persistent state download improvements

1) Don't start over on restart
2) Download shards one at a time to reduce RAM usage
3) More logs

* Remove old peers from adnl stats
2024-10-09 13:55:59 +03:00
SpyCheese
8c1692fd30 Merge branch 'testnet' into accelerator 2024-10-04 14:55:54 +03:00
SpyCheese
8364a2425f
Improve overlay stats (#1242) 2024-10-04 12:19:42 +03:00
SpyCheese
1c2c777644 Merge branch 'testnet' into accelerator 2024-10-02 17:49:12 +03:00
SpyCheese
f94d1bee0c
Extra currencies (#1122)
* Support extra currencies in tonlib, blockchain-explorer, getAccountPrunned

* Fix dict_combine_with with non-zero mode
2024-10-01 10:22:49 +03:00
SpyCheese
9dfa3fa11a Configure shards for custom overlays 2024-09-26 19:24:03 +03:00
SpyCheese
ed6788e579 Merge branch 'testnet' into accelerator 2024-09-23 18:07:41 +03:00
birydrad
72020c04c4
celldb in-memory mode, stats for actors, perf counters, minor fix in rldp2 (#1164)
* getactorstats query for validator-engine-console

* celldb in-memory mode (--celldb-in-memory option)

* rldp2: bugfix - do not estimate speed while nothing is sent

* add simple ed25519 benchmark

* fix compilation errors of different platforms and move to c++20

* fix some warnings

* turn on TON_USE_ABSEIL for glibc 2.27 nix build

---------

Co-authored-by: birydrad <>
2024-09-23 17:34:37 +03:00
SpyCheese
09da42e38f Merge branch 'testnet' into accelerator 2024-09-19 12:12:46 +03:00
SpyCheese
b304b1c7be
LS getDispatchQueueInfo and getDispatchQueueMessages methods (#1161)
* liteServer.getDispatchQueueInfo query

* Fix getting min/max lt

* LS getDispatchQueueMessages method
2024-09-13 20:47:30 +03:00
SpyCheese
9d927e8cfb Merge branch 'testnet' into accelerator 2024-09-10 10:06:10 +03:00
SpyCheese
feff73c4be Merge branch 'safe_features' into testnet-update 2024-09-06 11:48:46 +03:00
SpyCheese
e32a74e9c5
Collator: change deferring behavior when out queue size is big (#1135) 2024-09-05 15:56:07 +03:00
EmelyanenkoK
b2b79fead1
Ratelimit nochannel ADNL packets (#1147)
* Get ADNL stats in validator console

* Add timestamp to stats

* Limit nochannel adnl packets

---------

Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-09-03 13:34:31 +03:00
SpyCheese
dc26c3be67 Improve validator session stats (#1117)
* Improve validator session stats

* Collator stats: block limits, number of processed external messages
* Collator and validator work time
* Last key block seqno
* Approvers and signers

* End validator session stats
2024-08-28 11:15:23 +03:00
SpyCheese
908415d00b
Accelerator, part 1 (#1119)
This commit contains some parts of https://github.com/ton-blockchain/ton/tree/accelerator
This is auxiliary code that mostly does not change node behavior.

1) Semiprivate overlays and other improvements in overlays code
2) Rename actual_min_split -> monitor_min_split, fix building shard overlays
3) Loading block candidates by block id from DB, fix accept_block after validator restart
4) Cells: ProofStorageStat and changes in CellUsageTree
5) Remove some unused code, other minor changes
2024-08-23 11:46:40 +03:00
SpyCheese
9c3dc22b78
Improve validator session stats (#1117)
* Improve validator session stats

* Collator stats: block limits, number of processed external messages
* Collator and validator work time
* Last key block seqno
* Approvers and signers

* End validator session stats
2024-08-20 19:54:16 +03:00
SpyCheese
5080cdffdd Merge branch 'session-stats-patch' into accelerator 2024-08-20 12:41:55 +03:00
SpyCheese
faedb4635c Remove unused get validator session stats query 2024-08-20 11:33:16 +03:00
SpyCheese
1b4fb42859 End validator session stats 2024-08-19 19:55:11 +03:00
SpyCheese
0ca022cc72 Improve validator session stats
* Collator stats: block limits, number of processed external messages
* Collator and validator work time
* Last key block seqno
* Approvers and signers
2024-08-19 18:35:50 +03:00
SpyCheese
a14490637a More overlay stats 2024-08-01 18:39:22 +03:00
SpyCheese
70322f58c1 Use candidates from DB in wait block data 2024-08-01 13:57:32 +03:00
SpyCheese
0e7374610d Improve block broadcasts 2024-07-25 16:33:19 +03:00
SpyCheese
3ab7cc3c73 Merge branch 'testnet' into accelerator 2024-07-17 15:33:47 +03:00
SpyCheese
b9e89d4c66
"getcollatoroptionsjson" command in validator console (#1059)
* "getcollatoroptionsjson" command in validator console

* Improve state serializer

Use previous persistent state to speed up reading
2024-07-17 15:10:55 +03:00
SpyCheese
3a8ef60bbb Fast-sync overlays
* Semiprivate overlays
* Fast sync overlays in full-node
* Adjust shard overlays
2024-07-13 15:40:26 +03:00
SpyCheese
d74d3f1fc2 Merge branch 'testnet' into accelerator 2024-07-10 15:35:54 +03:00
EmelyanenkoK
57f95cc282
Add collator options (#1052)
* Set collator options from validator console

* Fix compilation error in manager-disk

* Defer all messages if out msg queue is too big

* Fix checking queue size in collator

---------

Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-07-10 14:58:13 +03:00
SpyCheese
172e404426 Merge branch 'testnet' into accelerator 2024-06-28 11:55:12 +03:00
Marat
06f503dd02
Tonlib: add methods smc.getRawFullAccountState and blocks.getOutMsgQueueSizes (#1027)
* add method smc.getRawFullAccountState

* Add method blocks.getOutMsgQueueSizes
2024-06-27 16:45:22 +03:00
EmelyanenkoK
0daee1d887
Merge message dispatch queue (#1030)
* Deferred messages and msg metadata

* Store out msg queue size in state

* Add checks for queue processing

1. Collator must process at least one message from AccountDispatchQueue (unless block is full)
2. The first message from a transaction is not counted, it cannot be deferred (unless AccountDispatchQueue is not empty)

* Return msg metadata from LS in listBlockTransactions[Ext]

* Enable new features by capabilities

* Changes in deferred messages

* Process deferred messages via new_msgs in collator
* Rework setting deferred_lt, bring back check_message_processing_order, check order of deferred_lt in validator

* Use have_unprocessed_account_dispatch_queue_ in collator

* Fix setting transaction lt for deferred messages

* Fix lite-client compilation error

* Changes in process_dispatch_queue, rename deferred_lt -> emitted_lt

* Fix compilation error

* Use uint64 for msg queue size

* Add liteServer.getBlockOutMsgQueueSize

* Fix compilation error

* Fix typos in comments

---------

Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-06-27 16:12:23 +03:00
SpyCheese
90d2edf535 Improve CollatorNode
* Keep track of validator groups
* Pre-generate shard blocks
2024-06-25 14:06:15 +03:00
SpyCheese
007f1fb1d7 New liteserver config format
* Specify shards and seqno/utime/lt limits for liteservers in global config
* Support in lite-client, tonlib, blockchain-explorer
* Rework proxy-liteserver
2024-06-12 18:12:45 +03:00
SpyCheese
38ab70c037 Changes in validation
* Configure collator list in validator-console
* Remove "lite-validator" flags
* Better compatibility in validate-query.cpp
2024-06-11 13:39:14 +03:00
SpyCheese
b8999be2c0 New archive format and importing archive slices 2024-06-06 18:31:28 +03:00
SpyCheese
eb4c876f22 Merge branch 'testnet' into block-generation 2024-06-04 16:49:47 +03:00