1
0
Fork 0
mirror of https://github.com/ton-blockchain/ton synced 2025-02-13 11:42:18 +00:00
Commit graph

862 commits

Author SHA1 Message Date
SpyCheese
5080cdffdd Merge branch 'session-stats-patch' into accelerator 2024-08-20 12:41:55 +03:00
SpyCheese
faedb4635c Remove unused get validator session stats query 2024-08-20 11:33:16 +03:00
SpyCheese
dbe51d6d13 Status page in blockchain-explorer 2024-08-19 20:31:24 +03:00
SpyCheese
1b4fb42859 End validator session stats 2024-08-19 19:55:11 +03:00
SpyCheese
0ca022cc72 Improve validator session stats
* Collator stats: block limits, number of processed external messages
* Collator and validator work time
* Last key block seqno
* Approvers and signers
2024-08-19 18:35:50 +03:00
SpyCheese
06515c3735
Limit the number of threads to 127 (#1111) 2024-08-16 10:23:41 +03:00
SpyCheese
3950b7eb9a Merge branch 'testnet' into accelerator 2024-08-15 15:42:33 +03:00
SpyCheese
9661676646
Improve dht lookup in overlays (#1104)
Continue dht lookup even if value was found
2024-08-15 15:26:35 +03:00
SpyCheese
77a816e461
Improve creating channels in adnl (#1108)
* Improve creating channels in adnl

* Improve handling of cryptographic keys
2024-08-15 15:25:16 +03:00
SpyCheese
0cff1c88f7
Fix UB in blst aggregate verify (#1107) 2024-08-15 12:53:05 +03:00
SpyCheese
2052b1574f --add-shard parameter 2024-08-12 13:56:29 +03:00
SpyCheese
e7da7a5580 OverlayImpl::get_neighbours bugfix 2024-08-12 10:07:15 +03:00
SpyCheese
c740b098e2 Merge branch 'testnet' into accelerator 2024-08-09 15:50:00 +03:00
SpyCheese
7ecc31bc96 Use block data from block candidate in AcceptBlockQuery 2024-08-09 15:49:47 +03:00
EmelyanenkoK
7cbe20c440 Update changelog 2024-08-09 10:59:11 +03:00
neodix42
489721eab5
Add github action for Ubuntu 24.04 (#1085)
* add github action for macOS 14 (arm64, M1)

* add github action (portable) for macOS 14 (arm64, M1)

* rename macOS arm64 output artifact

* Update libsodium on windows

* Compile libsodium

* Update build-windows.bat

* use upgraded libsodium 1.0.20; use compiled static libsodium for Windows instead of precompiled;

* revert libsodium 1.0.20; use compiled static libsodium for Windows instead of precompiled;

* use upgraded libsodium 1.0.20; use compiled static libsodium for Windows instead of precompiled;

* fix libsodium version 1.0.19; use compiled static libsodium for Windows instead of precompiled;

* try 1.0.20 libsodium precompiled on github

* try 1.0.18 libsodium precompiled on github

* try windows build on win server 2019

* and use PlatformToolset=v142

* use cmake -G "Visual Studio 16 2019"

* fix path to msvc 2019 on github

* separate github windows build on win server 2019 and build on win server 2022

* Update assembly/native/build-windows-2019.bat

add retry mechanism

Co-authored-by: Dr. Awesome Doge <doge@ton.org>

* add test-emulator; disable test groovy pipeline

* trigger all gh actions

* fix win build

* call test-emulator

* fix test-emulator

* test ubuntu 24.04 native build

* ubuntu 24.04 has clang-16 by default

---------

Co-authored-by: neodiX <neodix42@ton.org>
Co-authored-by: Dr. Awesome Doge <doge@ton.org>
Co-authored-by: ms <dungeon666master@protonmail.com>
2024-08-09 10:57:52 +03:00
SpyCheese
dcb409462a Cleanup mempool on collators 2024-08-09 09:20:42 +03:00
SpyCheese
4a6479af57 Merge branch 'testnet' into accelerator 2024-08-07 15:28:31 +03:00
EmelyanenkoK
e985ac0358
Add --fast-state-serializer flag and responding to AdnlMessageCreateChannel with Nop (#1096)
* Add --fast-state-serializer and tools for jemalloc

* Disable fast state serializer by default unless RAM is >= 90GB
* Print jemalloc stats once a minute
* Dump jemalloc profile on request

* Respond to AdnlMessageCreateChannel with Nop

---------

Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-08-07 14:25:45 +03:00
SpyCheese
15099f2664 Fix setting bad_peers_ in overlay 2024-08-06 22:11:11 +03:00
SpyCheese
a14490637a More overlay stats 2024-08-01 18:39:22 +03:00
SpyCheese
70322f58c1 Use candidates from DB in wait block data 2024-08-01 13:57:32 +03:00
EmelyanenkoK
8714477ccb Add forgotten mutex lock on RocksDb::end_snapshot 2024-07-30 09:32:35 +03:00
SpyCheese
d4da0ace74 Merge branch 'testnet' into accelerator 2024-07-29 15:28:00 +03:00
SpyCheese
db1ba2ea82
Fix setting unixtime in test-emulator (#1084) 2024-07-29 15:26:41 +03:00
SpyCheese
e7a26f58ab
Fix compilation error in test-tddb (#1083) 2024-07-29 15:23:30 +03:00
Marat
25386f5b00
Add method for fetching emulator version info (#1079) 2024-07-27 19:27:38 +03:00
EmelyanenkoK
b3828f8eb2
Print oldest celldb snapshot to stats (#1078)
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-07-26 22:11:58 +03:00
neodix42
679e6be294
Remove rocksdb usage from fift (#1064)
* add github action for macOS 14 (arm64, M1)

* add github action (portable) for macOS 14 (arm64, M1)

* rename macOS arm64 output artifact

* Update libsodium on windows

* Compile libsodium

* Update build-windows.bat

* use upgraded libsodium 1.0.20; use compiled static libsodium for Windows instead of precompiled;

* revert libsodium 1.0.20; use compiled static libsodium for Windows instead of precompiled;

* use upgraded libsodium 1.0.20; use compiled static libsodium for Windows instead of precompiled;

* fix libsodium version 1.0.19; use compiled static libsodium for Windows instead of precompiled;

* try 1.0.20 libsodium precompiled on github

* try 1.0.18 libsodium precompiled on github

* try windows build on win server 2019

* and use PlatformToolset=v142

* use cmake -G "Visual Studio 16 2019"

* fix path to msvc 2019 on github

* separate github windows build on win server 2019 and build on win server 2022

* Update assembly/native/build-windows-2019.bat

add retry mechanism

Co-authored-by: Dr. Awesome Doge <doge@ton.org>

* add test-emulator; disable test groovy pipeline

* trigger all gh actions

* fix win build

* call test-emulator

* remove usage of rocksdb in fift-lib

* put back some code for test-db

* fix test-emulator

* remove usage of db-path parameter in fift

* some func adjustments

* fix checkout of openssl in fift-func-wasm-build-ubuntu.sh

* typo

* improve wasm build script for quicker turn around

* remove sENVIRONMENT=web,worker for funcfiftlib. will be added later.

* remove sENVIRONMENT=web,worker for funcfiftlib. will be added later.

* remove sENVIRONMENT=web,worker for funcfiftlib. will be added later.

* minor adjustments

* remove -d option in fift; optimize fift-lib usage

* reduce tondb usage

---------

Co-authored-by: neodiX <neodix42@ton.org>
Co-authored-by: Dr. Awesome Doge <doge@ton.org>
Co-authored-by: ms <dungeon666master@protonmail.com>
2024-07-26 22:10:55 +03:00
SpyCheese
28f9a9b159
More verbose vm logs, fix parsing slice literals (#1076)
* More verbose VM logs

* Fix parsing slice literals in fift
2024-07-26 16:09:43 +03:00
Marat
a5521a60aa
Fix incorrect gas consumption with verbosity > 3 (#1077) 2024-07-26 15:08:52 +03:00
SpyCheese
0e7374610d Improve block broadcasts 2024-07-25 16:33:19 +03:00
SpyCheese
4c8d25ac1b Save and send block candidates in collator nodes 2024-07-24 20:04:24 +03:00
SpyCheese
4b68c7b165 Merge branch 'testnet' into accelerator 2024-07-23 18:07:58 +03:00
SpyCheese
1b9372804f
Make block overloaded if dispatch queue processing limit is reached (#1070) 2024-07-23 16:47:28 +03:00
SpyCheese
58ca7b44ff
Add null check in manager.cpp (#1069) 2024-07-23 15:17:36 +03:00
SpyCheese
5743dbf335 Changes in fast sync overlays
Join all overlays (not only monitoring shards) in order to be able to send broadcasts to other overlays
2024-07-18 12:43:55 +03:00
hey-researcher
015e2e55d3
Fix tonlib client crashing when block lookup error (#979)
Co-authored-by: hey-researcher <ton-researcher@pm.me>
2024-07-17 17:30:28 +03:00
SpyCheese
36b98e8aa0 Fix compilation error in shard-client.cpp 2024-07-17 16:52:56 +03:00
SpyCheese
d81b69e38b Use previous and next validators in fast sync overlays 2024-07-17 15:34:45 +03:00
SpyCheese
3ab7cc3c73 Merge branch 'testnet' into accelerator 2024-07-17 15:33:47 +03:00
SpyCheese
b9e89d4c66
"getcollatoroptionsjson" command in validator console (#1059)
* "getcollatoroptionsjson" command in validator console

* Improve state serializer

Use previous persistent state to speed up reading
2024-07-17 15:10:55 +03:00
SpyCheese
f518c10444 Improve selection neighbours in overlay 2024-07-15 16:21:01 +03:00
SpyCheese
5f9efc7add Fix compilation error 2024-07-15 12:07:46 +03:00
SpyCheese
3a8ef60bbb Fast-sync overlays
* Semiprivate overlays
* Fast sync overlays in full-node
* Adjust shard overlays
2024-07-13 15:40:26 +03:00
SpyCheese
ac3b8d6088 Merge branch 'testnet' into accelerator 2024-07-13 15:38:56 +03:00
EmelyanenkoK
00cd053dbc
Fix processing dispatch queue (#1057)
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-07-13 14:43:04 +03:00
SpyCheese
d74d3f1fc2 Merge branch 'testnet' into accelerator 2024-07-10 15:35:54 +03:00
neodix42
5380e6fb8d
add test-emulator (#1048)
* add github action for macOS 14 (arm64, M1)

* add github action (portable) for macOS 14 (arm64, M1)

* rename macOS arm64 output artifact

* Update libsodium on windows

* Compile libsodium

* Update build-windows.bat

* use upgraded libsodium 1.0.20; use compiled static libsodium for Windows instead of precompiled;

* revert libsodium 1.0.20; use compiled static libsodium for Windows instead of precompiled;

* use upgraded libsodium 1.0.20; use compiled static libsodium for Windows instead of precompiled;

* fix libsodium version 1.0.19; use compiled static libsodium for Windows instead of precompiled;

* try 1.0.20 libsodium precompiled on github

* try 1.0.18 libsodium precompiled on github

* try windows build on win server 2019

* and use PlatformToolset=v142

* use cmake -G "Visual Studio 16 2019"

* fix path to msvc 2019 on github

* separate github windows build on win server 2019 and build on win server 2022

* Update assembly/native/build-windows-2019.bat

add retry mechanism

Co-authored-by: Dr. Awesome Doge <doge@ton.org>

* add test-emulator; disable test groovy pipeline

* trigger all gh actions

* fix win build

* call test-emulator

* fix test-emulator

---------

Co-authored-by: neodiX <neodix42@ton.org>
Co-authored-by: Dr. Awesome Doge <doge@ton.org>
Co-authored-by: ms <dungeon666master@protonmail.com>
2024-07-10 15:00:18 +03:00
neodix42
2792fc22f1
Improved Docker image (#1051)
* add github action for macOS 14 (arm64, M1)

* add github action (portable) for macOS 14 (arm64, M1)

* rename macOS arm64 output artifact

* Update libsodium on windows

* Compile libsodium

* Update build-windows.bat

* use upgraded libsodium 1.0.20; use compiled static libsodium for Windows instead of precompiled;

* revert libsodium 1.0.20; use compiled static libsodium for Windows instead of precompiled;

* use upgraded libsodium 1.0.20; use compiled static libsodium for Windows instead of precompiled;

* fix libsodium version 1.0.19; use compiled static libsodium for Windows instead of precompiled;

* try 1.0.20 libsodium precompiled on github

* try 1.0.18 libsodium precompiled on github

* try windows build on win server 2019

* and use PlatformToolset=v142

* use cmake -G "Visual Studio 16 2019"

* fix path to msvc 2019 on github

* separate github windows build on win server 2019 and build on win server 2022

* Update assembly/native/build-windows-2019.bat

add retry mechanism

Co-authored-by: Dr. Awesome Doge <doge@ton.org>

* rework docker image; provide installation, configuration and troubleshooting guidelines; add nc, ifconfig, netstat and iptraf-ng utilities for troubleshooting;

* put back control.template

* add tcpdump and curl to the docker image;
update default validator ports;
add kubernetes deployment guidelines with network=host;
test metalLB load balancer

* tested metalLB load balancer

* tested aws deployment

* tested gcp deployment

* todo ali cloud and storage mount points, currently only the networking was tested

* add storage/pv/pvc; repair broken links, adjust docu

* change to dynamic storage provisioning without node affinity (statefulSet+headless service)
WIP

* modify gcp deployment WIP

* modify aws deployment WIP

* add resource requests/limits

* some docu changes

* some docu changes; aws tested

* support $DUMP_URL parameter as well as $ZFS_POOL_NAME;
add pv and plzip to docker image for dump extraction;
use mainnet dump by default in k8s deployments;

* support $DUMP_URL parameter as well as $ZFS_POOL_NAME;
add pv and plzip to docker image for dump extraction;
use mainnet dump by default in k8s deployments;
add AliCloud support

* minor remarks, final tests

* remove ZFS_POOL_NAME parameter

* improve docker github action - run test and add release tag, compile against arm64

* set docker test timeout

* test if validator-engine inside the docker image is valid

* test if validator-engine inside the docker image is valid

* test if validator-engine inside the docker image is valid

* adjust recommended node values for ali cloud deployment

---------

Co-authored-by: neodiX <neodix42@ton.org>
Co-authored-by: Dr. Awesome Doge <doge@ton.org>
2024-07-10 14:59:08 +03:00