TVM Upgrade (#686)

* New TVM instructions

* Remove PREVBLOCKS

* Separate target ton_crypto into TVM-related and -unrelared code

* Add fine for failed "send message"; rework SENDMSG

* Fix include

* Fix bugs, improve action fines

* Disable fines for special accounts

* Handle msg_balance_remaining.grams == null in transaction.cpp

* Bugfixes in SENDMSG

* Fix fee calculation in SENDMSG

* Fix CellStorageStat and transaction.cpp after merge

* SETBOUNCEONACTIONPHASEFAIL instruction

* ADDDIVMOD instructions

* RUNVM, RUNVMX instructions

* Changes in RUNVM

* Tests for adddiv and runvm

* HASHEXT instruction

* Improve opcode-timing

More iterations
Don't measure preliminary run
Remove logs and other excessive operations
Add "error" to output

* Increase RUNVM gas price

* Optimize HASHEXT, adjust gas price

* Add "bounce of action fail" flag to actions

* Stack operations with unlimited arguments

* Ristretto255 instructions

* Adjust gas consumption

* Optional fixed number of return values in RUNVM, fix exception handling

* Adjust gas consumption

* Simplify gas consumption logic

* Support of secp256k1 and sodium libraries in builds (#11)

* add support of secp256k1 library to the builds (linux, win)

* add support of secp256k1 library to the builds (linux, win)

* install secp256k1 via brew

* install libsodium via brew;
change sodium to upper case in FindSodium.cmake

* install libsodium via brew;
change sodium to upper case in FindSodium.cmake

* simplify FindSodium.cmake

* bug fixing

* bug fixing

* bug fixing

* add macro SODIUM_STATIC

* adjust build command for windows

* put back original FindSodium.cmake

* put back original FindSodium.cmake

* fix sodium unzipped path for windows;
add ninja

* fix sodium unzipped path for windows;
add ninja

* fix sodium unzipped path for windows;
add ninja

* Win32 github build for secp256k1

* x64 architecture github build for secp256k1

* fix sodium linking on linux

* enable docker buildx arm64 builds from forked repos

* enable docker buildx arm64 builds from forked repos

* enable docker buildx arm64 builds from forked repos

* adjust mac builds for secp2561k and sodium

* fix tonlib jni generation

* minor fix

* sync fixes across platforms

* add libsodium build script for android and precompiled static libraries

* build tonlib for android (fails)

* FindSodium uppercase

* remove system libsodium for android, use precompiled instead;
specify SECP256K1_INCLUDE_DIR fir mac 12.6

* uppercase sodium

* simplify FindSodium

* fix windows build sodium path;
use ninja for windows

* simplify sodium 2

* adjust windows sodium paths;
add paths to android jni

* add ninja build windows

* add ninja build windows

* add ninja build windows 2

* remove win ninja

* fix 1

* fix 2

* fix win 3

* fix linux compile 3

* fix jni 1

* fix jni 2 and mac

* fix jni 3

* fix jni 4

* fix jni 5

* fix mac 6

* fix mac 7 and jni paths

* fix jni 8

* rework sodium for android

* rework sodium for android

* rework sodium for android 2

* fixed sodium for android 2

* fixed sodium for android 3

* static secp256k1 for android

* add precompiled arm secp256k1

* add precompiled arm secp256k1

* build native-lib with secp256k1 x86-64 (non arm)

* update precompiled with NDK libsecp256k1.a

* update precompiled with NDK libsecp256k1.a

* update precompiled with NDK libsecp256k1.a

* refactor llvm-strip location

* refactor llvm-strip location

* add native-lib.so for armv7a, armv8a

* add native-lib.so for armv7a, armv8a

* test  armv7a, armv8a

* armv7a - fails linking on sodium, test -> armv8a

* works x86-64, armv7a - fails linking on sodium, armv8a - fails linking secp256k1 (incompatible with aarch64linux)

* update libpsec256k1, sodium static libs

* test x86 android native-lib

* test armv7 android native-lib

* test armv8 android native-lib

* x86_64 and arm64 android native-lib works

* x86_64 and arm64 android native-lib works

* x86_64 and arm64 android native-lib works

* test armv7 android native-lib

* test all android native-libs

* test all android native-libs

* test all android native-libs

* test all android native-libs - without SodiumAndroid

* test all android native-libs - with FindSodiumAndroid.cmake

* win, with Sodium via SODIUM_DIR

* win, with Sodium via SODIUM_DIR env

* win, with Sodium via SODIUM_DIR env

* win, with Sodium via SODIUM_DIR env and SODIUM_USE_STATIC_LIBS

* win, with Sodium via SODIUM_DIR, SODIUM_USE_STATIC_LIBS and SODIUM_INCLUDE_DIR

* android, with FindSodium

* android, with FindSodium with SODIUM_USE_STATIC_LIBS

* remove if not apple

* target_link_libraries(ton_crypto_core PUBLIC secp256k1)

* android SECP256K1_INCLUDE_DIRS

* android SECP256K1_INCLUDE_DIR

* add libsecp256k1.a/so pre-compiled with ubuntu 22 x86-64

* add libsecp256k1.a/so pre-compiled with ubuntu 22 x86-64

* sodium dirs

* sodium dirs

* sodium dirs

* remove NOT APPLE and SodiumAndroid

* add NOT APPLE and remove SodiumAndroid

* add NOT APPLE and remove SodiumAndroid

* remove build scripts for 18.04, reduce CMakeLists.txt

* remove build scripts for 18.04, reduce CMakeLists.txt

* Fix cas consumption during library load

* Fix fetch_config_params after merge

* Add all ADDDIVMOD ops to Asm.fif

* Save unpaid storage fee to due_payment

* Add "set prev blocks info" to emulator

* Adjusted builds  (#13)

* Update flake.nix

Add libsodium

* add libsecp256k1-dev and libsodium-dev into wasm build

* make back emulator a shared library;
put emulator to artifacts;
compile wasm artifacts with sodium and secp256k1.

* add secp256k1 to nix

* compile emulator statically with nix

* compile emulator statically with nix

* compile emulator lib statically with nix

* compile emulator lib statically with nix

* add libemulator to artifacts

* add shared libemulator library to artifacts

* minor release fix

* update set-output commands;
add recent_changelog.md

* releases fixes

* releases fixes, multiline

* releases fixes, multiline

* releases fixes, multiline

* put back multiline changelog

* put back multiline changelog

* ConfigParam 19 (global-id) and GLOBALID instruction

* Fix gas consumption in HASHEXT

* Add blst library

* Add bls instructions

* Allow passing long code to opcode-timing

* Add bls testcase

* More BLS instructions

* Fix tests, add bls tests

* Add more bls tests

* Improve some bls operations

* Adjust some BLS gas prices

* Adjust BLS gas prices

* Enable __BLST_PORTABLE__ flag only if PORTABLE flag is set

* Add tests for BLS_PAIRING

* GASCONSUMED instruction

* Fix compilation against docker with blst library; (#14)

* fix compilation against docker with blst library;
add precompiled libblst.a to android builds

* minor fix

* Adjust BLKSWX gas

* Fix comparison with NAN

* Allow arbitrary integers for scalars in ristretto multiplication, fix test

* Adjust nix builds according to PR 694 (#15)

* integrate and test PR-694

* integrate and test PR-694, test 2

* Add P256_CHKSIGN (secp256r1)

---------

Co-authored-by: SpyCheese <mikle98@yandex.ru>
Co-authored-by: neodiX42 <namlem@gmail.com>

crypto/CMakeLists.txt

@@ -4,7 +4,7 @@ if (NOT OPENSSL_FOUND)
   find_package(OpenSSL REQUIRED)
 endif()
 
-set(TON_CRYPTO_SOURCE
+set(TON_CRYPTO_CORE_SOURCE
   Ed25519.cpp
   common/bigint.cpp
   common/refcnt.cpp
@@ -19,26 +19,8 @@ set(TON_CRYPTO_SOURCE
   openssl/bignum.cpp
   openssl/residue.cpp
   openssl/rand.cpp
-  vm/stack.cpp
-  vm/atom.cpp
-  vm/continuation.cpp
-  vm/dict.cpp
-  vm/memo.cpp
-  vm/dispatch.cpp
-  vm/opctable.cpp
-  vm/cp0.cpp
-  vm/stackops.cpp
-  vm/tupleops.cpp
-  vm/arithops.cpp
-  vm/cellops.cpp
-  vm/contops.cpp
-  vm/dictops.cpp
-  vm/debugops.cpp
-  vm/tonops.cpp
   vm/boc.cpp
   vm/large-boc-serializer.cpp
-  vm/utils.cpp
-  vm/vm.cpp
   tl/tlblib.cpp
 
   Ed25519.h
@@ -66,34 +48,10 @@ set(TON_CRYPTO_SOURCE
   tl/tlbc-data.h
   tl/tlblib.hpp
 
-  vm/arithops.h
-  vm/atom.h
-  vm/boc.h
-  vm/boc-writers.h
-  vm/box.hpp
-  vm/cellops.h
-  vm/continuation.h
-  vm/contops.h
-  vm/cp0.h
-  vm/debugops.h
-  vm/dict.h
-  vm/dictops.h
-  vm/excno.hpp
-  vm/fmt.hpp
-  vm/log.h
-  vm/memo.h
-  vm/opctable.h
-  vm/stack.hpp
-  vm/stackops.h
-  vm/tupleops.h
-  vm/tonops.h
-  vm/vmstate.h
-  vm/utils.h
-  vm/vm.h
-
-  vm/cells.h
-  vm/cellslice.h
+  keccak/keccak.h
+  keccak/keccak.cpp
 
+  vm/dict.cpp
   vm/cells/Cell.cpp
   vm/cells/CellBuilder.cpp
   vm/cells/CellHash.cpp
@@ -106,6 +64,7 @@ set(TON_CRYPTO_SOURCE
   vm/cells/MerkleProof.cpp
   vm/cells/MerkleUpdate.cpp
 
+  vm/dict.h
   vm/cells/Cell.h
   vm/cells/CellBuilder.h
   vm/cells/CellHash.h
@@ -124,9 +83,64 @@ set(TON_CRYPTO_SOURCE
   vm/cells/VirtualCell.h
   vm/cells/VirtualizationParameters.h
 
+  vm/cells.h
+  vm/cellslice.h
+
   vm/db/StaticBagOfCellsDb.h
   vm/db/StaticBagOfCellsDb.cpp
-)
+
+  vm/Hasher.h
+  vm/Hasher.cpp
+
+  ellcurve/secp256k1.h
+  ellcurve/secp256k1.cpp
+  ellcurve/p256.h
+  ellcurve/p256.cpp)
+
+set(TON_CRYPTO_SOURCE
+  vm/stack.cpp
+  vm/atom.cpp
+  vm/continuation.cpp
+  vm/memo.cpp
+  vm/dispatch.cpp
+  vm/opctable.cpp
+  vm/cp0.cpp
+  vm/stackops.cpp
+  vm/tupleops.cpp
+  vm/arithops.cpp
+  vm/cellops.cpp
+  vm/contops.cpp
+  vm/dictops.cpp
+  vm/debugops.cpp
+  vm/tonops.cpp
+  vm/utils.cpp
+  vm/vm.cpp
+  vm/bls.cpp
+
+  vm/arithops.h
+  vm/atom.h
+  vm/boc.h
+  vm/boc-writers.h
+  vm/box.hpp
+  vm/cellops.h
+  vm/continuation.h
+  vm/contops.h
+  vm/cp0.h
+  vm/debugops.h
+  vm/dictops.h
+  vm/excno.hpp
+  vm/fmt.hpp
+  vm/log.h
+  vm/memo.h
+  vm/opctable.h
+  vm/stack.hpp
+  vm/stackops.h
+  vm/tupleops.h
+  vm/tonops.h
+  vm/vmstate.h
+  vm/utils.h
+  vm/vm.h
+  vm/bls.h)
 
 set(TON_DB_SOURCE
   vm/db/DynamicBagOfCellsDb.cpp
@@ -271,17 +285,25 @@ set(BIGINT_TEST_SOURCE
 
 set(USE_EMSCRIPTEN ${USE_EMSCRIPTEN} PARENT_SCOPE)
 
+add_library(ton_crypto_core STATIC ${TON_CRYPTO_CORE_SOURCE})
+target_include_directories(ton_crypto_core PUBLIC $<BUILD_INTERFACE:${CMAKE_CURRENT_SOURCE_DIR}>
+        $<BUILD_INTERFACE:${CMAKE_CURRENT_SOURCE_DIR}/..>)
+target_link_libraries(ton_crypto_core PUBLIC ${OPENSSL_CRYPTO_LIBRARY} tdutils tddb_utils)
+if (NOT WIN32)
+  target_link_libraries(ton_crypto_core PUBLIC dl z)
+endif()
+target_include_directories(ton_crypto_core SYSTEM PUBLIC $<BUILD_INTERFACE:${OPENSSL_INCLUDE_DIR}>)
 
 add_library(ton_crypto STATIC ${TON_CRYPTO_SOURCE})
 target_include_directories(ton_crypto PUBLIC $<BUILD_INTERFACE:${CMAKE_CURRENT_SOURCE_DIR}>
 	$<BUILD_INTERFACE:${CMAKE_CURRENT_SOURCE_DIR}/..>)
-target_link_libraries(ton_crypto PUBLIC ${OPENSSL_CRYPTO_LIBRARY} tdutils tddb_utils)
+target_link_libraries(ton_crypto PUBLIC ${OPENSSL_CRYPTO_LIBRARY} tdutils tddb_utils ton_crypto_core ton_block)
 if (USE_EMSCRIPTEN)
   target_link_options(ton_crypto PRIVATE -fexceptions)
   target_compile_options(ton_crypto PRIVATE -fexceptions)
 endif()
 if (NOT WIN32)
-  find_library(DL dl) 
+  find_library(DL dl)
   if (DL)
     target_link_libraries(ton_crypto PUBLIC dl z)
   else()
@@ -290,6 +312,39 @@ if (NOT WIN32)
 endif()
 target_include_directories(ton_crypto SYSTEM PUBLIC $<BUILD_INTERFACE:${OPENSSL_INCLUDE_DIR}>)
 
+add_dependencies(ton_crypto blst)
+target_include_directories(ton_crypto PRIVATE ${BLST_INCLUDE_DIR})
+target_link_libraries(ton_crypto PRIVATE ${BLST_LIB})
+
+if (NOT USE_EMSCRIPTEN)
+  find_package(Secp256k1 REQUIRED)
+endif()
+
+if (MSVC)
+  find_package(Sodium REQUIRED)
+  target_compile_definitions(ton_crypto PUBLIC SODIUM_STATIC)
+  target_include_directories(ton_crypto_core PUBLIC $<BUILD_INTERFACE:${SECP256K1_INCLUDE_DIRS}>)
+  target_link_libraries(ton_crypto PUBLIC ${SECP256K1_LIBRARIES})
+elseif (ANDROID)
+  target_include_directories(ton_crypto_core PUBLIC $<BUILD_INTERFACE:${SECP256K1_INCLUDE_DIR}>)
+  target_link_libraries(ton_crypto PUBLIC $<BUILD_INTERFACE:${SECP256K1_LIBRARY}>)
+else()
+  if (NOT USE_EMSCRIPTEN)
+    find_package(Sodium REQUIRED)
+    target_include_directories(ton_crypto_core PUBLIC $<BUILD_INTERFACE:${SECP256K1_INCLUDE_DIRS}>)
+    target_link_libraries(ton_crypto PUBLIC ${SECP256K1_LIBRARIES})
+  else()
+    target_include_directories(ton_crypto_core PUBLIC $<BUILD_INTERFACE:${SECP256K1_INCLUDE_DIR}>)
+    target_link_libraries(ton_crypto PUBLIC ${SECP256K1_LIBRARY})
+  endif()
+  if (NOT APPLE AND NOT USE_EMSCRIPTEN)
+    target_link_libraries(ton_crypto_core PUBLIC secp256k1)
+  endif()
+endif()
+
+target_include_directories(ton_crypto_core PUBLIC $<BUILD_INTERFACE:${SODIUM_INCLUDE_DIR}>)
+target_link_libraries(ton_crypto PUBLIC ${SODIUM_LIBRARY_RELEASE})
+
 add_library(ton_db STATIC ${TON_DB_SOURCE})
 target_include_directories(ton_db PUBLIC $<BUILD_INTERFACE:${CMAKE_CURRENT_SOURCE_DIR}>
 	$<BUILD_INTERFACE:${CMAKE_CURRENT_SOURCE_DIR}/..>)
@@ -316,12 +371,12 @@ endif()
 
 add_library(src_parser ${PARSER_SOURCE})
 target_include_directories(src_parser PUBLIC $<BUILD_INTERFACE:${CMAKE_CURRENT_SOURCE_DIR}>)
-target_link_libraries(src_parser PUBLIC ton_crypto)
+target_link_libraries(src_parser PUBLIC ton_crypto_core)
 
 add_library(ton_block ${BLOCK_SOURCE})
 target_include_directories(ton_block PUBLIC $<BUILD_INTERFACE:${CMAKE_CURRENT_SOURCE_DIR}>
         $<BUILD_INTERFACE:${CMAKE_CURRENT_SOURCE_DIR}/block> $<BUILD_INTERFACE:${CMAKE_CURRENT_SOURCE_DIR}/..>)
-target_link_libraries(ton_block PUBLIC ton_crypto tdutils tdactor tl_api)
+target_link_libraries(ton_block PUBLIC ton_crypto_core tdutils tdactor tl_api)
 
 add_executable(func func/func-main.cpp ${FUNC_LIB_SOURCE})
 target_include_directories(func PUBLIC $<BUILD_INTERFACE:${CMAKE_CURRENT_SOURCE_DIR}>)
@@ -347,12 +402,12 @@ if (USE_EMSCRIPTEN)
   target_link_options(funcfiftlib PRIVATE -sALLOW_TABLE_GROWTH=1)
   target_link_options(funcfiftlib PRIVATE --embed-file ${CMAKE_CURRENT_SOURCE_DIR}/fift/lib@/fiftlib)
   target_link_options(funcfiftlib PRIVATE -fexceptions)
-  target_compile_options(funcfiftlib PRIVATE -fexceptions)
+  target_compile_options(funcfiftlib PRIVATE -fexceptions -fno-stack-protector)
 endif()
 
 add_executable(tlbc tl/tlbc.cpp)
 target_include_directories(tlbc PUBLIC $<BUILD_INTERFACE:${CMAKE_CURRENT_SOURCE_DIR}>)
-target_link_libraries(tlbc PUBLIC ton_crypto src_parser)
+target_link_libraries(tlbc PUBLIC ton_crypto_core src_parser)
 if (WINGETOPT_FOUND)
   target_link_libraries_system(tlbc wingetopt)
 endif()