1
0
Fork 0
mirror of https://github.com/ton-blockchain/ton synced 2025-03-09 15:40:10 +00:00
Commit graph

976 commits

Author SHA1 Message Date
SpyCheese
5743dbf335 Changes in fast sync overlays
Join all overlays (not only monitoring shards) in order to be able to send broadcasts to other overlays
2024-07-18 12:43:55 +03:00
hey-researcher
015e2e55d3
Fix tonlib client crashing when block lookup error (#979)
Co-authored-by: hey-researcher <ton-researcher@pm.me>
2024-07-17 17:30:28 +03:00
SpyCheese
36b98e8aa0 Fix compilation error in shard-client.cpp 2024-07-17 16:52:56 +03:00
SpyCheese
d81b69e38b Use previous and next validators in fast sync overlays 2024-07-17 15:34:45 +03:00
SpyCheese
3ab7cc3c73 Merge branch 'testnet' into accelerator 2024-07-17 15:33:47 +03:00
SpyCheese
b9e89d4c66
"getcollatoroptionsjson" command in validator console (#1059)
* "getcollatoroptionsjson" command in validator console

* Improve state serializer

Use previous persistent state to speed up reading
2024-07-17 15:10:55 +03:00
SpyCheese
f518c10444 Improve selection neighbours in overlay 2024-07-15 16:21:01 +03:00
SpyCheese
5f9efc7add Fix compilation error 2024-07-15 12:07:46 +03:00
SpyCheese
3a8ef60bbb Fast-sync overlays
* Semiprivate overlays
* Fast sync overlays in full-node
* Adjust shard overlays
2024-07-13 15:40:26 +03:00
SpyCheese
ac3b8d6088 Merge branch 'testnet' into accelerator 2024-07-13 15:38:56 +03:00
EmelyanenkoK
00cd053dbc
Fix processing dispatch queue (#1057)
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-07-13 14:43:04 +03:00
SpyCheese
d74d3f1fc2 Merge branch 'testnet' into accelerator 2024-07-10 15:35:54 +03:00
neodix42
5380e6fb8d
add test-emulator (#1048)
* add github action for macOS 14 (arm64, M1)

* add github action (portable) for macOS 14 (arm64, M1)

* rename macOS arm64 output artifact

* Update libsodium on windows

* Compile libsodium

* Update build-windows.bat

* use upgraded libsodium 1.0.20; use compiled static libsodium for Windows instead of precompiled;

* revert libsodium 1.0.20; use compiled static libsodium for Windows instead of precompiled;

* use upgraded libsodium 1.0.20; use compiled static libsodium for Windows instead of precompiled;

* fix libsodium version 1.0.19; use compiled static libsodium for Windows instead of precompiled;

* try 1.0.20 libsodium precompiled on github

* try 1.0.18 libsodium precompiled on github

* try windows build on win server 2019

* and use PlatformToolset=v142

* use cmake -G "Visual Studio 16 2019"

* fix path to msvc 2019 on github

* separate github windows build on win server 2019 and build on win server 2022

* Update assembly/native/build-windows-2019.bat

add retry mechanism

Co-authored-by: Dr. Awesome Doge <doge@ton.org>

* add test-emulator; disable test groovy pipeline

* trigger all gh actions

* fix win build

* call test-emulator

* fix test-emulator

---------

Co-authored-by: neodiX <neodix42@ton.org>
Co-authored-by: Dr. Awesome Doge <doge@ton.org>
Co-authored-by: ms <dungeon666master@protonmail.com>
2024-07-10 15:00:18 +03:00
neodix42
2792fc22f1
Improved Docker image (#1051)
* add github action for macOS 14 (arm64, M1)

* add github action (portable) for macOS 14 (arm64, M1)

* rename macOS arm64 output artifact

* Update libsodium on windows

* Compile libsodium

* Update build-windows.bat

* use upgraded libsodium 1.0.20; use compiled static libsodium for Windows instead of precompiled;

* revert libsodium 1.0.20; use compiled static libsodium for Windows instead of precompiled;

* use upgraded libsodium 1.0.20; use compiled static libsodium for Windows instead of precompiled;

* fix libsodium version 1.0.19; use compiled static libsodium for Windows instead of precompiled;

* try 1.0.20 libsodium precompiled on github

* try 1.0.18 libsodium precompiled on github

* try windows build on win server 2019

* and use PlatformToolset=v142

* use cmake -G "Visual Studio 16 2019"

* fix path to msvc 2019 on github

* separate github windows build on win server 2019 and build on win server 2022

* Update assembly/native/build-windows-2019.bat

add retry mechanism

Co-authored-by: Dr. Awesome Doge <doge@ton.org>

* rework docker image; provide installation, configuration and troubleshooting guidelines; add nc, ifconfig, netstat and iptraf-ng utilities for troubleshooting;

* put back control.template

* add tcpdump and curl to the docker image;
update default validator ports;
add kubernetes deployment guidelines with network=host;
test metalLB load balancer

* tested metalLB load balancer

* tested aws deployment

* tested gcp deployment

* todo ali cloud and storage mount points, currently only the networking was tested

* add storage/pv/pvc; repair broken links, adjust docu

* change to dynamic storage provisioning without node affinity (statefulSet+headless service)
WIP

* modify gcp deployment WIP

* modify aws deployment WIP

* add resource requests/limits

* some docu changes

* some docu changes; aws tested

* support $DUMP_URL parameter as well as $ZFS_POOL_NAME;
add pv and plzip to docker image for dump extraction;
use mainnet dump by default in k8s deployments;

* support $DUMP_URL parameter as well as $ZFS_POOL_NAME;
add pv and plzip to docker image for dump extraction;
use mainnet dump by default in k8s deployments;
add AliCloud support

* minor remarks, final tests

* remove ZFS_POOL_NAME parameter

* improve docker github action - run test and add release tag, compile against arm64

* set docker test timeout

* test if validator-engine inside the docker image is valid

* test if validator-engine inside the docker image is valid

* test if validator-engine inside the docker image is valid

* adjust recommended node values for ali cloud deployment

---------

Co-authored-by: neodiX <neodix42@ton.org>
Co-authored-by: Dr. Awesome Doge <doge@ton.org>
2024-07-10 14:59:08 +03:00
EmelyanenkoK
57f95cc282
Add collator options (#1052)
* Set collator options from validator console

* Fix compilation error in manager-disk

* Defer all messages if out msg queue is too big

* Fix checking queue size in collator

---------

Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-07-10 14:58:13 +03:00
SpyCheese
c54f095c1b
Don't use user-provided fees for internal messages (#1050) 2024-07-10 09:17:37 +03:00
SpyCheese
d46261c110
Fix reading state_serializer_enabled from config (#1045) 2024-07-02 17:12:43 +03:00
SpyCheese
d6f30a0d6c Merge branch 'testnet' into accelerator 2024-07-02 13:19:15 +03:00
Marat
c15d878fee
emulator fixes, add basic tests (#1042) 2024-07-02 12:40:57 +03:00
Marat
0bf7febf9f
set correct config addr for emulator (#1028) 2024-07-02 12:35:17 +03:00
SpyCheese
f4b23a257b Fix parsing config in tonlib 2024-06-28 15:05:54 +03:00
SpyCheese
7f263b8b11 Don't request queue size if not needed in validate-query 2024-06-28 12:46:08 +03:00
SpyCheese
81b7993d66 Update query-utils.cpp 2024-06-28 11:57:14 +03:00
SpyCheese
172e404426 Merge branch 'testnet' into accelerator 2024-06-28 11:55:12 +03:00
krigga
7f837014f1
fix: emulator bounce conditions (#974) 2024-06-27 16:48:15 +03:00
tom
fae7763ec7
Fix typos (#998) 2024-06-27 16:46:37 +03:00
Marat
06f503dd02
Tonlib: add methods smc.getRawFullAccountState and blocks.getOutMsgQueueSizes (#1027)
* add method smc.getRawFullAccountState

* Add method blocks.getOutMsgQueueSizes
2024-06-27 16:45:22 +03:00
EmelyanenkoK
0daee1d887
Merge message dispatch queue (#1030)
* Deferred messages and msg metadata

* Store out msg queue size in state

* Add checks for queue processing

1. Collator must process at least one message from AccountDispatchQueue (unless block is full)
2. The first message from a transaction is not counted, it cannot be deferred (unless AccountDispatchQueue is not empty)

* Return msg metadata from LS in listBlockTransactions[Ext]

* Enable new features by capabilities

* Changes in deferred messages

* Process deferred messages via new_msgs in collator
* Rework setting deferred_lt, bring back check_message_processing_order, check order of deferred_lt in validator

* Use have_unprocessed_account_dispatch_queue_ in collator

* Fix setting transaction lt for deferred messages

* Fix lite-client compilation error

* Changes in process_dispatch_queue, rename deferred_lt -> emitted_lt

* Fix compilation error

* Use uint64 for msg queue size

* Add liteServer.getBlockOutMsgQueueSize

* Fix compilation error

* Fix typos in comments

---------

Co-authored-by: SpyCheese <mikle98@yandex.ru>
2024-06-27 16:12:23 +03:00
dbaranovstonfi
38fc1d5456
Added nullptr check for emulation_result (#1037)
* Added nullptr check for emulation_result

* Typo

* added cast to EmulationExternalNotAccepted and diagnostic message

* formatting

* formatting

* removed unnecessary nesting

---------

Co-authored-by: dbaranov34 <baranov34@gmail.com>
2024-06-27 15:45:59 +03:00
EmelyanenkoK
11f39acef5
Fix bug of broadcast stop on receiving the last FEC piece (#1040) 2024-06-27 15:44:51 +03:00
Snoppy
2634e63e4f
chore: fix typos (#980)
Signed-off-by: snoppy <michaleli@foxmail.com>
2024-06-27 11:16:12 +03:00
Max Mercuriev
c56e65739b
Doclinks that refer to docs.ton.org domain (#1029)
* Correct documentation link

Update moved URL in comments

* Update all doc links
2024-06-27 11:03:16 +03:00
SpyCheese
5e0b190fc2 Merge branch 'testnet' into accelerator 2024-06-25 14:07:22 +03:00
SpyCheese
90d2edf535 Improve CollatorNode
* Keep track of validator groups
* Pre-generate shard blocks
2024-06-25 14:06:15 +03:00
EmelyanenkoK
c2e7278fcd
Fix skipped action list order (#1036)
* nullify incorrect actions directly in skipped_action_list
2024-06-25 11:18:36 +03:00
neodix42
94c9fece0d
Fix TON compilation on Windows (github only) (#1020)
* add github action for macOS 14 (arm64, M1)

* add github action (portable) for macOS 14 (arm64, M1)

* rename macOS arm64 output artifact

* Update libsodium on windows

* Compile libsodium

* Update build-windows.bat

* use upgraded libsodium 1.0.20; use compiled static libsodium for Windows instead of precompiled;

* revert libsodium 1.0.20; use compiled static libsodium for Windows instead of precompiled;

* use upgraded libsodium 1.0.20; use compiled static libsodium for Windows instead of precompiled;

* fix libsodium version 1.0.19; use compiled static libsodium for Windows instead of precompiled;

* try 1.0.20 libsodium precompiled on github

* try 1.0.18 libsodium precompiled on github

* try windows build on win server 2019

* and use PlatformToolset=v142

* use cmake -G "Visual Studio 16 2019"

* fix path to msvc 2019 on github

* separate github windows build on win server 2019 and build on win server 2022

* Update assembly/native/build-windows-2019.bat

add retry mechanism

Co-authored-by: Dr. Awesome Doge <doge@ton.org>

---------

Co-authored-by: neodiX <neodix42@ton.org>
Co-authored-by: Dr. Awesome Doge <doge@ton.org>
2024-06-24 17:09:25 +03:00
EmelyanenkoK
773ebe0765
Decrease catchain_max_block_delay to 0.4 2024-06-20 16:44:46 +03:00
SpyCheese
3695bf0797 Merge branch 'testnet' into accelerator 2024-06-12 18:53:54 +03:00
SpyCheese
007f1fb1d7 New liteserver config format
* Specify shards and seqno/utime/lt limits for liteservers in global config
* Support in lite-client, tonlib, blockchain-explorer
* Rework proxy-liteserver
2024-06-12 18:12:45 +03:00
EmelyanenkoK
bd23029d0a
Soft send message validation (#1021)
* check mode on invalid action_send_msg

* Fix random seed generation

* Explicitly skip invalid actions

* Count skipped valid messages, rename cfg option to message_skip_enabled

* Allow unfreeze via external messages

* Detect and handle bounce_on_fail mode for invalid messages

* Fix codestyle

* Adjust doc
2024-06-11 15:08:08 +03:00
SpyCheese
38ab70c037 Changes in validation
* Configure collator list in validator-console
* Remove "lite-validator" flags
* Better compatibility in validate-query.cpp
2024-06-11 13:39:14 +03:00
SpyCheese
f91ed6cc31 Merge branch 'refs/heads/testnet' into accelerator 2024-06-10 13:23:47 +03:00
EmelyanenkoK
6250662d56
Merge pull request #1017 from ton-blockchain/master
Sync branches
2024-06-10 12:05:02 +03:00
EmelyanenkoK
5c392e0f2d
Merge pull request #1016 from ton-blockchain/testnet
Merge developer branch
2024-06-09 20:42:35 +03:00
EmelyanenkoK
7841d751c0 Add changelog 2024-06-08 17:57:38 +03:00
neodix42
ec00ccc482
Add github actions for macOS 14 (arm64, shared and portable) (#1001)
* add github action for macOS 14 (arm64, M1)

* add github action (portable) for macOS 14 (arm64, M1)

* rename macOS arm64 output artifact
2024-06-07 18:52:43 +03:00
neodix42
0a0a92c6b0
Use jemalloc in portable artifacts (#1003)
* use jemalloc in portable builds;
also avoid mixing musl with glibc artifacts in nix builds;

* minor fix for ubuntu arm nix build
2024-06-07 18:52:11 +03:00
neodix42
5186c4755c
Change fift path separator for FIFTPATH and -I argument (#1014)
* add github action for macOS 14 (arm64, M1)

* add github action (portable) for macOS 14 (arm64, M1)

* rename macOS arm64 output artifact

* Colon cannot be used as a path separator for FIFTPATH or -I argument in fift on Windows when absolute paths are used (e.g. C:\path\lib:C:\path\smartcont).
Suggestion to use @ as a new path separator on Windows.

---------

Co-authored-by: neodiX <neodix42@ton.org>
2024-06-07 18:50:11 +03:00
SpyCheese
b8999be2c0 New archive format and importing archive slices 2024-06-06 18:31:28 +03:00
SpyCheese
eb4c876f22 Merge branch 'testnet' into block-generation 2024-06-04 16:49:47 +03:00