SpyCheese
d082ac36b0
Merge branch 'testnet' into block-generation
2023-03-28 16:52:33 +03:00
EmelyanenkoK
47311d6e0e
Improve tweaking for high throughput ( #610 )
...
* Option "--disable-ext-msg-broadcast"
* "Get shard out queue size" query
* Move disabling ext msg broadcasts from command-line arguments to config
* Fix compilation error
* Asynchronous store_cell and gc in celldb
* Make GC in celldb work evenly over time
* Increase timeouts for downloading blocks
* Reuse blocks from previous rounds in validator session
* Use Rldp2 in FullNode for downloading persistent states and archives
* Improve logs in download-archive-slice and download-state
* Decrease delay between serializing shards
* Make CellDbIn::load_cell synchronous to avoid interfering with store_cell
---------
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2023-03-15 10:47:35 +03:00
Marat
078aabe50e
Add method listBlockTransactionsExt to liteserver ( #399 )
...
* Verify proof for method blocks.getTransactions
* check completeness of response
* fix start_lt
* fix mode & 128, check bTxes->ids_ out of bounds
* Improve gitactions; separate cpp-check (#346 )
* Use ninja build tool and compile blockchain-explorer
Ninja builds TON much faster;
* Use clang instead of gcc
* remove blockchain-explorer
since target not found on github action
* move ccpcheck to other gitaction
* run nativelib-java only against wallets branch for now
* rename gitaction
* Update windows2019x64-tonlib-java.yml
* Update windows2019x64-tonlib-java.yml
* Update macos-10.15-tonlib-java.yml
* Update windows2019x64-tonlib-java.yml
* Update windows2019x64-tonlib-java.yml
* rebase
* update tlo's
* Revert "Improve gitactions; separate cpp-check (#346 )"
This reverts commit bd1d96e6d391e48840d81cfcf10d2692848e504e.
* add checks, simplify ls response
* Revert workflows
* Add verifying proofs
* fix win build
---------
Co-authored-by: neodiX42 <namlem@gmail.com>
2023-03-07 19:49:25 +03:00
neodiX42
f06d5cb053
Make path separator cross-platform in few places ( #628 )
...
* make path separator cross-platform in few places
* reuse path separator definer
2023-03-05 14:15:53 +03:00
SpyCheese
706be23c83
Limit maximal Merkle depth ( #626 )
2023-02-28 12:06:57 +03:00
SpyCheese
0578cb4a42
Fix typos, UBs and warnings ( #625 )
2023-02-28 12:06:09 +03:00
neodiX42
5a47495d87
Add cross-platform Linux and macOS binaries (statically compiled with NixPkgs) + wasm artifacts ( #621 )
...
* fix build
* nix flake
* nix package
* static musl build env
* make all builds in static env
* GH Actions nightly and static workflows
* deb package
* cmake install {adnl-proxy,blockchain-explorer,create-state,http-proxy,rldp-http-proxy,storage-cli}
* nix flake: add static glibc build variant
* GH Actions: deb-nightly-{musl,glibc_static}, tests-rolling jobs
* rpm package
* build blockchain-explorer
* GH Actions: deb_rpm-nightly: ubuntu-{latest=>22.04}
* crypto/pow-miner: skip install
* ghactions: tests-rolling: show tests run, progress
* ghactions: deb_rpm-nightly: add manual trigger [skip ci]
* nix flake refactor
* find_package=>pkg-config(zlib)
FindZLIB.cmake can't find static zlib prior to CMake 3.24, so use
pkg-config.
* nix old glibc build
* nix aarch64 support
* packages: Populate APT and RPM repos at ton-repo
- {deb,rpm}.sh: Separate build and install dirs
- rpm.sh: Conditionally include lib/
- Accomodate local CI runs w/act
* [skip ci] README packages
* fix aarch64 build -Wnoerror=address
* [skip ci] rpm set releasever
* [skip ci] document local packages upload
* m1 build: gate cpu=apple-m1 by clang version
* packages: Ship musl binaries + old glibc dylibs
* packages: macos build
* nix: bump nixpkgs
* fix windows CI build
* [skip ci] nix: static aarch64 builds
* packages: deb,rpm multiarch
* ghactions: aarch64 musl deb,rpm build
* [skip ci] deb build: deref source links, -x
* [skip ci] nix darwin static build
* [skip ci] nix common hostPkgs
* [skip ci] brew: move formula over to homebrew-ton-repo
* [skip ci] nix fix aarch64-linux build
* [skip ci] ghactions: nix use GITHUB_TOKEN
* [skip ci] Move from ton-repo to gh releases
* [skip ci] ghactions aarch64-darwin self-hosted runner
* [skip ci] ghactions deb,rpm nightly 10h timeout
* [skip ci] fix brew install
fixes
Errno::EACCES: Permission denied @ dir_s_mkdir - /private/tmp/ton-XXX/bin/.brew_home
* [skip ci] ghactions deb,rpm nightly: don't upload ton-packages as we gh release them later
* [skip ci] README: brew instructions
* [skip ci] nightly linux binaries release
* [skip ci] packages: ship macos dylib
* [skip ci] ghactions: Run Windows build nightly, upload to gh releases
* nix: remove defaultPackage, switch to different oldglibc build method
We used to rebuild nixpkgs-stable with old glibc, which broke on aarch64
due to its particular bootstrap toolchain. This just takes nixos 19.09's
version of GCC but new dependencies, sidestepping the issue.
* fix rpm release, add aur release
* fix local (act) ci run
* ghactions: linux-nightly: Print out SSH public keys
* ghactions: bump cachix actions
* nix: default devShell
* [skip ci] rpm,aur: Ship lib
* [skip ci] packages: windows: Remove CMake files from out
* [skip ci] packages: Import chocolatey package
* fixup! fix rpm release, add aur release
* [skip ci] packages: aarch64-linux: build dylib as well
* [skip ci] ghactions: run on self-hosted
* [skip ci] ghactions: windows-nightly: Bump nodejs actions
* [skip ci] nix: Only add Linux packaging tools on Linux
* [skip ci] doc: document direct download binaries in README
* fix tonlib android jni ci
* fixup! fix tonlib android jni ci
* [skip ci] ghactions: Update GH release dates
Errata: doesn't update tags.
* [skip ci] ghactions: Fix racy brew gh release by splitting arch
* initiali commit - binaries only
* fixes
* fixes
* fixes
* fixes
* remove packages dir for now
* add storage-daemon storage-daemon-cli
* fix emulator
* try macos aarch64
* try macos aarch64
* try macos aarch64
* try macos aarch64
* try macos aarch64
* try macos aarch64
* try macos aarch64
* try macos aarch64
* try macos aarch64
* try macos aarch64
* try macos aarch64 sh
* try macos aarch64 sh
* try macos aarch64 bash
* try macos aarch64 bash
* try macos aarch64 bash
* try macos aarch64 bash
* try macos aarch64 bash
* try macos aarch64 bash
* try macos aarch64 bash
* fix funcfiftlib compilation with emscripten
* fix funcfiftlib compilation with emscripten
* add github action to compile TON with emscripten
* add github action to compile TON with emscripten
* add github action to compile TON with emscripten
* add github action to compile TON with emscripten
* add github action to compile TON with emscripten
* add github action to compile TON with emscripten
* try macos aarch64
* fix funcfiftlib compilation with emscripten
* fix funcfiftlib compilation with emscripten
* add github action to compile TON with emscripten
* disable aarch64 github actions for now
* disable aarch64 github actions for now
* trigger all GH actions
* trigger all GH actions 2
* trigger all GH actions 3
* trigger all GH actions 4
* trigger all GH actions 5
* put back rldp-http-proxy to win build
* put back rldp-http-proxy to win build
* dont use pkgConfig for zlib
* fix zlib_library
* use BUILD_SHARED_LIBS flag for static compilation
* test 1
* test 2
* add wasm binaries to release.
test 3
* add simple binaries' execution test
* build emulator-emscripten
* build and add into artifacts wasm tlbc and emulator-emscripten
* build and add into artifacts wasm tlbc and emulator-emscripten, 2
* build and add into artifacts wasm tlbc and emulator-emscripten, 3
* build and add into artifacts wasm tlbc and emulator-emscripten, 4
* build emulator-emscripten with static libs
* minor nix mac aarch64 fix
* add single artifacts to release
* bypass $repo to Dockerfile
* add wasm artifacts to release
* add wasm artifacts to release
* add wasm artifacts to release
* add wasm artifacts to release
* add more artifacts to release; remove compilation against Ubuntu 18.04.
* retrieve GITHUB_TOKEN for ton-blockchain/ton
* remove binary check for arm64
---------
Co-authored-by: tonthemoon <tonthemoon@mailbox.org>
2023-02-27 12:32:41 +03:00
Andrey Pfau
426879cd82
ErrorCode::notready for "block is not applied": (#594 )
2023-02-02 10:04:54 +03:00
SpyCheese
1e4eecfdb0
Logs and size limits for incoming queries in FullNodeShard ( #601 )
...
* Log incoming queries in FullNodeShard
* Limit size for some queries in FullNodeShard
2023-02-02 10:04:19 +03:00
EmelyanenkoK
3b3c25b654
Add account state by transaction and emulator (extended) ( #592 )
...
* account_state_by_transaction
* Correct time calculation
* Bug fixes
* Refactor
* namespace block::transaction
* smc.forget
* RunEmulator: remove wallet_id
* Refactor & fixes
* AccountStateByTransaction: use shardchain block instead of masterchain block
* transaction emulator core
* refactor
* tx emulator major functionality
* small format changes
* readme
* clean
* return json, add support for init messages
* tx emulator readme
* refactor getConfigParam and getConfigAll
* add shardchain_libs_boc parameter
* option to change verbosity level of transaction emulator
* fix deserializing ShardAccount with account_none
* add mode needSpecialSmc when unpack config
* emulator: block::Transaction -> block::transaction::Transaction
* Refactor
* emulator: Fix bug
* emulator: Support for emulator-extern
* emulator: Refactor
* Return vm log and vm exit code.
* fix build on macos, emulator_static added
* adjust documentation
* ignore_chksig for external messages
* tvm emulator, run get method
* Added more params for transaction emulator
* Added setters for optional transaction emulator params, moved libs to a new setter
* Added actions cell output to transaction emulator
* fix tonlib build
* refactoring, rand seed as hex size 64, tvm emulator send message
* tvm send message, small refactoring
* fix config decoding, rename
* improve documentation
* macos export symbols
* Added run_get_method to transaction emulator emscipten wrapper
* Fixed empty action list serialization
* Changed actions list cell to serialize as json null instead of empty string in transaction emulator
* stack as boc
* log gas remaining
* Fix prev_block_id
* fix build errors
* Refactor fetch_config_params
* fix failing unwrap of optional rand_seed
* lookup correct shard, choose prev_block based on account shard
* fix tonlib android jni build
---------
Co-authored-by: legaii <jgates.ardux@gmail.com>
Co-authored-by: ms <dungeon666master@protonmail.com>
Co-authored-by: krigga <krigga7@gmail.com>
2023-02-02 10:03:45 +03:00
SpyCheese
45c0270716
Improve handling of absent blocks in archive manager ( #600 )
2023-01-23 14:40:28 +03:00
SpyCheese
5ad7f8c246
Allow queries to collator from validators only
2023-01-17 21:02:47 +03:00
SpyCheese
225f71238b
Option for collating masterchain on validators
2023-01-16 19:30:15 +03:00
SpyCheese
d324fa5820
Bugfix
2023-01-13 19:04:11 +03:00
SpyCheese
29851c38ef
Various changes after merge
2023-01-12 17:32:59 +03:00
SpyCheese
1ccf25d6b7
Merge branch 'testnet' into block-generation
2023-01-11 16:10:57 +03:00
SpyCheese
13b9f460af
SuspendedAddressList config param ( #585 )
...
* SuspendedAddressList config param
* Change tag for cskip_suspended
2023-01-09 20:37:58 +03:00
SpyCheese
eff610f807
Disable liteServer.getState method ( #573 )
2022-12-27 20:11:22 +03:00
SpyCheese
d652f7d706
Merge branch 'testnet' into block-generation
...
# Conflicts:
# adnl/adnl-query.cpp
# crypto/block/block.tlb
# crypto/block/mc-config.h
# lite-client/lite-client.cpp
# overlay/overlay-manager.h
# overlay/overlay-peers.cpp
# overlay/overlay.cpp
# overlay/overlay.h
# overlay/overlay.hpp
# overlay/overlays.h
# rldp-http-proxy/DNSResolver.cpp
# rldp-http-proxy/rldp-http-proxy.cpp
# tl/generate/scheme/ton_api.tl
# tl/generate/scheme/ton_api.tlo
# tl/generate/scheme/tonlib_api.tlo
# ton/ton-types.h
# tonlib/tonlib/ExtClient.cpp
# tonlib/tonlib/ExtClient.h
# tonlib/tonlib/ExtClientLazy.cpp
# tonlib/tonlib/ExtClientOutbound.h
# tonlib/tonlib/ExtClientRaw.h
# tonlib/tonlib/TonlibClient.cpp
# tonlib/tonlib/TonlibClient.h
# tonlib/tonlib/tonlib-cli.cpp
# validator/impl/collator.cpp
# validator/impl/validate-query.cpp
# validator/impl/validate-query.hpp
# validator/manager.cpp
# validator/state-serializer.cpp
# validator/state-serializer.hpp
# validator/validator-group.cpp
# validator/validator-group.hpp
# validator/validator.h
2022-12-22 23:37:35 +03:00
SpyCheese
15cdfb0462
Fix compilation error in manager-disk.cpp ( #556 )
2022-12-15 17:12:43 +03:00
EmelyanenkoK
1b106ef270
Use state with applied shards in liteserver ( #553 )
...
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2022-12-13 17:46:54 +03:00
SpyCheese
ac50074ff6
Fix getting cell-db-reader in AsyncStateSerializer ( #546 )
2022-12-07 21:49:17 +03:00
SpyCheese
33a0d1e8bc
Allow starting node with a newer hardfork in config ( #538 )
2022-11-30 12:12:19 +03:00
EmelyanenkoK
d8dd75ec83
Limit account storage size ( #530 )
...
* Limit size of an account
* Bugfix
* Don't check size for special accounts
* Improve timeouts in collator and validator
Co-authored-by: SpyCheese <mikle98@yandex.ru>
2022-11-30 08:40:19 +03:00
SpyCheese
a4a3ea2b77
liteServer.getAccountStatePrunned method ( #534 )
2022-11-30 08:39:32 +03:00
SpyCheese
c7f06abfbc
Fix finding blocks by lt and ut in archive manager ( #536 )
2022-11-30 08:38:46 +03:00
SpyCheese
4714726f4a
Cache result of run_collate_query in ValidatorGroup
2022-11-25 09:49:04 +03:00
SpyCheese
d4339b839c
Add "delshard", "delcollator" to validator-engine-console
2022-10-17 13:24:59 +03:00
SpyCheese
1d42c38122
Move some constants to global config ( #484 )
2022-10-10 17:13:21 +03:00
SpyCheese
580884033b
Check limits in validate-query, check timeout in collator ( #469 )
2022-10-06 21:31:41 +03:00
SpyCheese
636348ffc2
Merge branch 'testnet' into block-generation
...
# Conflicts:
# overlay/overlay-fec-broadcast.cpp
# overlay/overlay.hpp
# tl/generate/scheme/ton_api.tl
# tl/generate/scheme/ton_api.tlo
# validator-engine-console/validator-engine-console-query.cpp
# validator-engine-console/validator-engine-console-query.h
# validator-engine-console/validator-engine-console.cpp
# validator-engine/validator-engine.cpp
# validator-engine/validator-engine.hpp
# validator/downloaders/wait-block-state.hpp
# validator/impl/validate-query.cpp
# validator/validator.h
2022-10-06 13:46:25 +03:00
SpyCheese
81c0e920c5
Simplify selecting shards for monitor
2022-10-06 13:41:13 +03:00
SpyCheese
9fb986f6f5
Disable downloading archives during sync
2022-10-06 13:41:02 +03:00
SpyCheese
699a56b951
Send block broadcasts directly to collators
2022-10-06 13:40:53 +03:00
SpyCheese
b0c2c6c525
Don't send proof of masterchain message queue
2022-09-23 17:23:00 +03:00
SpyCheese
bb5bc6178c
Change recursion to loop in CellSlice
2022-09-21 11:04:40 +03:00
SpyCheese
2512f0287b
Tonlib method getShardBlockProof ( #465 )
...
* Tonlib method getShardBlockProof
* Clarify limit of result.size() in getShardBlockProof
2022-09-20 10:49:28 +03:00
SpyCheese
62a412ac13
Add some required collated data
2022-09-15 20:14:34 +03:00
SpyCheese
86250706b8
Change format of specifying shards to monitor
2022-09-13 16:02:55 +03:00
EmelyanenkoK
8329a58994
Add GetPerfTimerStats ( #451 )
...
* Add getperfwarningtimeraverage query for validator-engine-console
* Fix for getperfwarningtimeraverage query
* getperftimerstats
* Add history max size: 1 hour
* PerfWarningTimer: move callback instead of copy
* PerfWarningTimer: fix move constructor bug
* PerfWarningTimer: fix bug: lifetime of the callback was greater than lifetime of the local variable 'manager' captured by reference
* Fix validate-query.cpp: 'manager' used after it was moved
* PerfWarningTimer: remove logs
* getperftimerstats: write to json file
* getperftimerstatsjson
Co-authored-by: legaii <jgates.ardux@gmail.com>
Co-authored-by: Ivan Siomash <106972486+legaii@users.noreply.github.com>
2022-09-10 12:57:13 +03:00
SpyCheese
c2e7d0b0de
Bugfixes in manager.cpp
2022-08-23 17:31:37 +03:00
SpyCheese
be824e9649
Check is_applied in liteserver
2022-08-22 10:25:28 +03:00
SpyCheese
1efd425403
Fix compatibility
2022-08-19 18:24:18 +03:00
SpyCheese
ea7a5776fe
Download persistent states when syncing new shards
2022-08-19 18:24:18 +03:00
SpyCheese
be2169e523
Reload validator options when needed
2022-08-19 18:24:17 +03:00
SpyCheese
011e97f53c
Flag "full collated data" in mc config; fix accept-block
2022-08-19 18:24:17 +03:00
SpyCheese
81d32ba5d6
Out msg queue proof: send only the required part
2022-08-19 18:24:17 +03:00
SpyCheese
597fd8443d
Collator nodes preload msg queues
2022-08-19 18:24:17 +03:00
SpyCheese
910398da92
Improved neighbor choosing in full-node-shard
2022-08-19 18:24:17 +03:00
SpyCheese
662435462e
Validators temporary join shard overlays
2022-08-19 18:24:17 +03:00
