external/ton
1
0
Fork 0
mirror of https://github.com/ton-blockchain/ton synced 2025-03-09 15:40:10 +00:00
Code Issues Releases Wiki Activity

TON Storage utilities (#564)

Browse source 
* Rename chunk to piece in MerkleTree for consistency

* Refactor PeerManager

* Make PeerState thread-safe

* Download torrent by hash

* First version of storage daemon

* Download torrents partially

* Improve storing and loading torrent state in DB

* Rewrite MerkleTree

* "Remove torrent" in storage daemon

* Process errors, fix bugs in storage

* Move TonlibClientWrapper from rldp-http-proxy to tonlib

* Initial version of storage provider

* Move interaction with contracts to smc-util

* Improve TonlibClientWrapper interface

* Various improvements in storage provider

* Fix TorrentCreator.cpp

* Improve interface for partial download

* Client mode in storage-daemon

* Improve interface of storage-daemon-cli

* Fix calculating speed, show peers in storage-daemon

* Use permanent adnl id in storage daemon

* Fix sending large "storage.addUpdate" messages

* Improve printing torrents in cli

* Update tlo

* Fix RldpSender::on_ack

* Update storage provider

* Add "address" parameter to get-provider-params

* Allow client to close storage contract

* Limit torrent description

* Add more logs to storage provider

* smc.forget tonlib method

* Use smc.forget in storage daemon

* Optimize sending messages in smc-util.cpp

* Fix verbosity, remove excessive logs

* Json output in storage-daemon-cli

* Update storage provider contracts

* Fix rldp2 acks

* Change verbosity of logs in rldp2

* Update help and output of commands and in storage-daemon-cli

Co-authored-by: SpyCheese <mikle98@yandex.ru>
This commit is contained in:
EmelyanenkoK 2022-12-22 12:24:13 +03:00 • committed by GitHub
parent 434dc487a4
commit 360ef54e6b
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
75 changed files with 8872 additions and 1148 deletions
Download patch file Download diff file Expand all files Collapse all files

22
storage/PartsHelper.h
View file

@ -26,12 +26,16 @@
namespace ton {
struct PartsHelper {
public:
PartsHelper(size_t parts_count) : parts_(parts_count), peers_(64) {
explicit PartsHelper(size_t parts_count = 0) : parts_(parts_count), peers_(64) {
peers_[0].is_valid = true;
}
using PartId = size_t;
using PeerToken = size_t;
void init_parts_count(size_t parts_count) {
CHECK(parts_.empty());
parts_.resize(parts_count);
}
PeerToken register_self() {
return self_token_;
}
@ -123,6 +127,22 @@ struct PartsHelper {
change_key(part_id, part->rnd, part->peers_count, 0, part->priority, part->priority);
}
void on_self_part_not_ready(PartId part_id) {
auto peer = get_peer(self_token_);
if (!peer->ready_parts.set_zero(part_id)) {
return;
}
auto part = get_part(part_id);
CHECK(part->is_ready);
part->is_ready = false;
for (auto &peer : peers_) {
if (peer.ready_parts.get(part_id)) {
peer.want_download_count++;
}
}
change_key(part_id, part->rnd, 0, part->peers_count, part->priority, part->priority);
}
struct RarePart {
PartId part_id;
PeerId peer_id;