Skip to content

Releases: ethereum/retesteth

Retesteth v0.3.1 - Cancun

02 Nov 10:08
6205647
Compare
Choose a tag to compare

Docker file big update, support pyt8n, besu, evmone, geth, pyspecs, ethereumjs, nimbus
Compatible test release: https://github.com/ethereum/tests/releases/tag/v13

New options:

--singlenet >=forkname                   select multiple forks when running/generating the tests
--singlenet "fork1,fork2"
--verbosity PYSPEC                       print pyspec script log
--statediff Frontier--Berlin             print state diff between poststates on forkA and forkB of the test

Removed option:

Announcment

Retesteth is ethereum test runner / generator tool for the tests (https://github.com/ethereum/tests)
Uses existing clients to run/generate the tests. See documentation. (https://ethereum-tests.readthedocs.io/en/latest/)
The test process diagram: https://tinyurl.com/y525ezs7

Testing stats

Testing results are available at http://retesteth.ethdevops.io/
There is a web tool for vmtracing the tests using supported clients and retesteth: http://retesteth.ethdevops.io/web/
All blockchain tests are being run by hive tool: https://hivetests.ethdevops.io/

Changelog

Interesting

  • docker script with all supported clients in it
  • do not require excpetion code to be defined in configs (check the text directly from test if not defined)
  • use t8n eof tool to run/generate EOFTests
  • exectimlog measures totaltime, cputime and client t8n subcall time
  • support EIP4844 blockheaders, transactions
  • support pyt8n transition tool
  • cancun fields support in tests and apis
  • rejected transactions in state tests filled as invalid blocks in bc version of the state test
  • statediff forkA--forkB option
  • limit max test suite execution time to 5000 sec
  • support :yul evmversion optimisationflag {} in test fillers
  • yul and solc version can be set by adding a special comment in the test src
  • print all warnings summary

Client Configs

  • better error and log reporting from client .sh scripts
  • pyspec managment script
  • support besu, ethereumjs, evmone, pyt8n, nimbus t8ns
  • more options for the docker.sh script

Technical

  • continue Pyspecs .py generation support
  • refactor Statetest runner
  • disallow multiple keys in .json and .yml (excpet json comment fields)
  • do not ask basefee calculation on genesis block
  • use c++20 features
  • support client configs
  • basic libssz tests (develop mode)
  • detect .py tests that are marked as skipped
  • singlenet option work with .py tests
  • rlp_decoded printed in bc tests for invalid blocks too
  • support nimbus --vmtrace
  • better detect folders and files as tests when passed to retesteth directly without any options
  • fix json parse bugs
  • allow helper files which are not tests in test folders (required by pyspecs)

ubuntu 20.04.6:
http://retesteth.ethdevops.io/release/0.3.1-cancun/ubuntu-20.04.6/retesteth-0.3.1-cancun-ubuntu-20.04.6

Might need the dependecies install (but better to be run on Ubuntu20):

- sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y
- sudo apt-get update
- sudo apt-get install gcc-9
- sudo apt-get install --only-upgrade libstdc++6

macOS-XCode14:
http://retesteth.ethdevops.io/release/0.3.1-cancun/macOS-XCode14/retesteth-0.3.1-cancun-macOS-XCode14

Docker:
Clients updated as of 01.11.2023 (6 GB image)
https://ethereum-tests.readthedocs.io/en/latest/retesteth-tutorial.html#retesteth-in-a-docker-container
geth evm version: evm version 1.13.5-unstable-a3be3812-20231102
lllc version: 0.5.14-develop.2023.7.11+commit.c58ab2c6.mod.Linux.g++
solidity version: 0.8.21+commit.d9974bed.Linux.g++
http://retesteth.ethdevops.io/release/0.3.1-cancun/dretesteth-0.3.1-cancun.tar

Documentation:
https://ethereum-tests.readthedocs.io/en/latest/

Retesteth v0.3.0 - Shanghai

20 Mar 12:35
e98b5e6
Compare
Choose a tag to compare

Many changes: proto support for pyspec, new clients, Shanghai logic
Introducing more debug options (--statediff, --poststate, --vmtrace) for intermediate states/transactions in blockchain tests
Net tests suites: -t EIPTEsts, -t EOFTests
Compatible test release: https://github.com/ethereum/tests/releases/tag/v12

New options:

    retesteth file.json                  Run/Fill the test directly (--singletest detected if in tests path, --testfile if outside)
    retesteth <Folder>                   Run/Fill the test directory (if inside testpath detect -t suite, not all suites supported)
    --exportcall <Folder>                Option to export t8ntool interactions
    --vmtrace <Folder>                   Option to export transaction traces into files
    --vmtrace x:y                        Trace block x, transaction y

    --vmtraceraw <Folder>                Option to export transaction traces into files
    --vmtraceraw x:y                     Trace block x, transaction y

      (intermidiate state for individual transaction in bc tests requires --filltests command)
    --poststate  <Folder>                Option to export transaction states into files (when running state tests)
    --poststate x:y                      Show poststate block x, transaction y
    --statediff                          Print statediff post vs pre in StateTests
    --statediff x:ytox2:y2               Show statediff from block x, transaction y  to block x2, transaction y2
    --statediff xtoy                     Show statediff from block x  to block y

    --chainid  id                        To override transaction chain id when generating or running the test

    --verbosity <channel>                Set logs channels. 'STATS|RPC|TESTLOG|LOWLOG|SOCKET|STATE'
    --getvectors                         Output all subunits of the given test (disables execution)
    --filloutdated                       Run only unfilled test fillers

Removed option:

    --testfolder                   No longer required as new test folders automatically registrate within boost

Announcment

Retesteth is ethereum test runner / generator tool for the tests (https://github.com/ethereum/tests)
Uses existing clients to run/generate the tests. See documentation. (https://ethereum-tests.readthedocs.io/en/latest/)
The test process diagram: http://tinyurl.com/2ctak8yn

Testing stats

Testing results are available at http://retesteth.ethdevops.io/
There is a web tool for vmtracing the tests using supported clients and retesteth: http://retesteth.ethdevops.io/web/
All blockchain tests are being run by hive tool: https://hivetests.ethdevops.io/

Changelog

Interesting

  • any new folder in supported test src suites will be automatically registered into boost
  • new unregistered folders and subfolders (1 lvl depth) automatically register within boost
  • custom compiler shell script in client configs to define parser for src code in test fillers (example, docs)
  • cmake configure option -DLOCALDEPS to be able to use locally installed dependencies and don't use hunter (BOOST)
  • intermidiate poststate and statediff debug in blockchain tests
  • vmtraceraw "outfolder" option to export transaction traces into files
  • poststate "outfolder" option to export transaction states into files (when running state tests)
  • verbosity better selection of logging output
  • getvectors option to print all test vectors commands in particular test suite
  • filloutdated option to refill only those tests that hash is different to the filler file
  • t8ntool calculate baseFee support
  • forceupdate option allow to fill LegacyTests
  • singlenet option in test run mode does not throw an Error
  • chainID defined for individual fork in forks config files
  • web utility scripts added to the repo
  • statediff option print state change in state tests
  • fork+xxxx automatically asks t8n clients to run on fork+xxxx (where xxxx is eip number) rules
  • support Shanghai logic (adds withdrawalsRoot and withdrawals fields to the bc tests)

Client Configs

  • integrate ethereumjs config
  • integrate etc (ethereum classic) config
  • integrate nimbus config
  • integrate evmone config (develop)
  • switch besu from rpc config to t8n
  • new option checkDifficulty to verify ETH difficulty calculation of the t8ntool client
  • new option checkBasefee to verify ETH baseFee calculation of the t8ntool client
  • new option checkBasefee to verify ETH baseFee calculation of the t8ntool client
  • new array fillerSkipForks to skip filling tests on forks (forks + eips) that are not supported
  • new option calculateBasefee to calculate basefee for the t8ntool client that does not support it
  • new option calculateDifficulty to force retesteth calculated difficulty (in case client does not support it)
  • new option support1559 to disable blockheader auto convertion to Merge/1559 rules (for etc clients)
  • new option transactionAsJson to send t8ntool tx files in json form not RLP (for evmone type clients)
  • integrate pyspec .py fillers support (experimental)
  • update default yul.sh script
  • update default start.sh for t8ntool clients (include --erorlog option parsing and better exception check)
  • update dretesteth.sh

Technical

  • print retesteth config path
  • update circle config builds, support mac builds
  • refactor compiler.cpp, main.cpp, options.cpp, statetests, testsuite runner and more
  • update to CXX17
  • remove libff MPIR scrypt AES dependencies
  • remove unused boost_program_options
  • update hunter gate to https://github.com/cpp-pm/hunter/archive/v0.24.7.tar.gz
  • refactor includes in .h and .cpp files. remove redundancies
  • fix fs=boost::filesystem in headers compiler error
  • make dataobject a separate lib
  • nodes option autoresolve hostname (before only accepting IP)
  • hardcode new test folders, fix --testfolder option
  • testfile have now the same logic as normal test execution/generation
  • refactor test versioning (test hash verification, test filler verification, test without fillers)
  • refactor Blockchain test run/generation functions
  • better check of error log from t8ntool
  • disable RPC support for GeneralStateTests generation (do not ask to calculate genesis)
  • don't stop on test's _info section validaton errors

ubuntu 18.04.3:
http://retesteth.ethdevops.io/release/0.3.0-shanghai/ubuntu-18.04.3/retesteth-0.3.0-shanghai-ubuntu-18.04.3

Might need the dependecies install (but better to be run on Ubuntu20):

- sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y
- sudo apt-get update
- sudo apt-get install gcc-9
- sudo apt-get install --only-upgrade libstdc++6

macOS-XCode12:
http://retesteth.ethdevops.io/release/0.3.0-shanghai/macOS-XCode12/retesteth-0.3.0-shanghai-macOS-XCode12

macOS-XCode14:
http://retesteth.ethdevops.io/release/0.3.0-shanghai/macOS-XCode14/retesteth-0.3.0-shanghai-macOS-XCode14

Docker:
(!Better version of docker is comming with other clients support!)
geth version: geth version 1.11.5-unstable-5d23d21f-20230320 Git Commit (around): 5d23d21f
geth evm version: geth version 1.11.5-unstable-5d23d21f
lllc version: Version: 0.5.14-develop.2022.7.30+commit.a096d7a9.Linux.g++
solidity version: Version: 0.8.17+commit.8df45f5f.Linux.g++
http://retesteth.ethdevops.io/release/0.3.0-shanghai/dretesteth-0.3.0-shanghai.tar

Documentation:
https://ethereum-tests.readthedocs.io/en/latest/

Retesteth v0.2.2 - merge

30 Jul 08:53
2286dc1
Compare
Choose a tag to compare

Merge PoS structures support in tests, little refactoring, new option --testfolder, --nologcolor, custom chainID in transactions
Geth + custom eip example configuration, MacOS support, update ReadME
Compatible test release: https://github.com/ethereum/tests/releases/tag/v11

New options:

    --testfolder <SubFolder>                Run tests from a custom test folder located in a given suite. Requires -t <TestSuite>
    --nologcolor                                    Disable color codes in log output

Announcment

Retesteth is ethereum test runner / generator tool for the tests (https://github.com/ethereum/tests)
Uses existing clients to run/generate the tests. See documentation. (https://ethereum-tests.readthedocs.io/en/latest/)
The test process diagram: http://tinyurl.com/2ctak8yn

Testing stats

Testing results are available at http://retesteth.ethdevops.io/
There is a web tool for vmtracing the tests using supported clients and retesteth: http://retesteth.ethdevops.io/web/
All blockchain tests are being run by hive tool: https://hivetests.ethdevops.io/

Changelog

Interesting

Technical

  • update cmake build script to use latest boost 1.79 version for MacOS support
  • export solidity version to generated tests (solc)
  • :label prefix for label names is not exported to generated state tests to save space
  • if test_setChainParams fail, the tests continue exectution
  • experiment with std::move to reduce dynamic memory allocation
  • protection from repeating forks in transaction tests
  • refactor t8ntool backend code (blockchain builder)
  • refactor testSuite.cpp, split heavy functions
  • go version updated in docker file to support geth, support changes in geth t8n
  • correct translating the fork name to geth t8n tool internal forkname
  • fix memory leaks / race conditions what found
  • new test exception names
  • t8ntool backend blockchain logic for Merge support
  • check data pointer to be empty when printin DataObject, a rare bug happened when exception is thrown and DataObject is printed after
  • refactor t8ntool backend block verification a litle

ubuntu 18.04.3:
http://retesteth.ethdevops.io/release/0.2.2-merge/ubuntu-18.04.3/retesteth-0.2.2-merge-ubuntu-18.04.3

Might need the dependecies install:

- sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y
- sudo apt-get update
- sudo apt-get install gcc-4.9
- sudo apt-get install --only-upgrade libstdc++6

macOS-XCode12:
http://retesteth.ethdevops.io/release/0.2.2-merge/macOS-XCode12/retesteth-0.2.2-merge-macOS-XCode12

Docker:
geth version: Version: 1.10.22-unstable Git Commit: fea569f90aa608abeb13cea6c9fd55f1d0a77f40
geth evm version: evm version 1.10.22-unstable-fea569f9-20220729
lllc version: Version: 0.5.14-develop.2022.7.30+commit.a096d7a9.Linux.g++
solidity version: Version: 0.8.6+commit.11564f7e.Linux.g++
http://retesteth.ethdevops.io/release/0.2.2-merge/dretesteth-0.2.2-merge.tar

Documentation:
https://ethereum-tests.readthedocs.io/en/latest/

Retesteth v0.2.1 - difficulty

27 Nov 18:36
1ee8186
Compare
Choose a tag to compare

Coming up with DifficultyTests for ArrowGlacier, new DifficultyTests test suite to point check the difficulty formula depening on fork
New test exceptions for transaction tests invalid RLP handling. T8N, T9N support.

New test suite: -t DifficultyTests
New test method: VALUE test_calculateDifficulty(FORK, VALUE _blockNumber, _parentTimestamp, VALUE _parentDifficulty, VALUE _currentTimestamp, VALUE _uncleNumber)

New options:

    --vmtrace.nomemory           "Disable memory in vmtrace/vmtraceraw"
    --vmtrace.nostack            "Disable stack in vmtrace/vmtraceraw"
    --vmtrace.noreturndata       "Disable returndata in vmtrace/vmtraceraw"

Announcment

Retesteth is ethereum test runner / generator tool for the tests (https://github.com/ethereum/tests)
Uses existing clients to run/generate the tests. See documentation. (https://ethereum-tests.readthedocs.io/en/latest/)
The test process diagram: http://tinyurl.com/2ctak8yn

Testing stats

Testing results are available at http://retesteth.ethdevops.io/
There is a web tool for vmtracing the tests using supported clients and retesteth: http://retesteth.ethdevops.io/web/
All blockchain tests are being run by hive tool: https://hivetests.ethdevops.io/

Changelog

  • suppot TransactionTests suite. handle invalid transaction RLPs
  • continue development of 0x:bigint feature, fix bugs
  • condition variable on the main thread instead of checking finalization of jobs in cycle (actually slows down, because of the safety mutex)
  • make bash scripts more safe with other versions of shell
  • Added stEIP3607 to BCGeneralStateTests
  • t8ntool ArrowGlacier support
  • t8ntool more exceptions to check invalid transactions
  • t9ntool support (transaction tests)
  • more unit tests, fix potential thread lock places and memory leaks
  • fix bug with generated test hash calculation for blockchain tests (1 test to many blockchain tests)

ubuntu 18.04.3:
http://retesteth.ethdevops.io/release/0.2.1-difficulty/ubuntu-18.04.3/retesteth-0.2.1-difficulty-ubuntu-18.04.3

Might need the dependecies install:

- sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y
- sudo apt-get update
- sudo apt-get install gcc-4.9
- sudo apt-get install --only-upgrade libstdc++6

macOS-XCode11:
http://retesteth.ethdevops.io/release/0.2.1-difficulty/macOS-XCode11/retesteth-0.2.1-difficulty-macOS-XCode11

Docker:
geth version: Version: 1.10.14-unstable Git Commit: 4ebeca19d739a243dc0549bcaf014946cde95c4f
geth evm version: evm version 1.10.14-unstable-4ebeca19-20211125
lllc version: 0.5.14-develop.2021.11.27+commit.401d5358.mod.Linux.g++
solidity version: Version: 0.8.5+commit.a4f2e591.Linux.g++
http://retesteth.ethdevops.io/release/0.2.1-difficulty/dretesteth-0.2.1-difficulty.tar

Documentation:
https://ethereum-tests.readthedocs.io/en/latest/

Retesteth v0.2.0 - memory

15 Sep 18:48
078dc86
Compare
Choose a tag to compare

Breaking change:
Test-parse logic optimization. Do not sort source test json structure before calculating the hash, to save time. This changes the way filler hash is calculated leading to older versions of retesteth tests would not pass the hash verification check. (except legacy tests)

Continue refactoring and optimizations. Near 50% execution time saved on remote VPS so far.

New test suite: -t TransactionTests
New test method: test_rawTransaction(BYTES, FORK)
ethereum/go-ethereum#23494

Check on the generated tests when filling the tests. If no changes after test regeneration, do not update _info section by default.
New option --forceupdate to update the regenerated test even if no changes (_info section header always change)

Announcment

Retesteth is ethereum test runner / generator tool for the tests (https://github.com/ethereum/tests)
Uses existing clients to run/generate the tests. See documentation. (https://ethereum-tests.readthedocs.io/en/latest/)
The test process diagram: http://tinyurl.com/2ctak8yn

Testing stats

Testing results are available at http://retesteth.ethdevops.io/
There is a web tool for vmtracing the tests using supported clients and retesteth: http://retesteth.ethdevops.io/web/
All blockchain tests are being run by hive tool: https://hivetests.ethdevops.io/

Changelog

  • --showhash show full hash
  • support difficulty formula calculation from t8ntool (ethereum/go-ethereum#23353)
  • json are sorted on export, sort function refactored, no sort on json load
  • cache values/hash string representation for future calls when requested to be converted, recache if data is mutated (!)
  • notification when trying to run older generated test
  • test suites output (x of y) verbosity
  • more smart pointer use. less data copy when filling the tests (!)
  • New test suite: -t TransactionTests Net test method: test_rawTransaction(BYTES, FORK)
  • refactoring, logic optimizations to save execution time
  • --forceupdate option when filling the tests
  • do not update the _info section by default if no changes been done after --filltests

! - potential bug behavior, stay aware

ubuntu 18.04.3:
http://retesteth.ethdevops.io/release/0.2.0-memory/ubuntu-18.04.3/retesteth-0.2.0-memory-ubuntu-18.04.3

Might need the dependecies install:

- sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y
- sudo apt-get update
- sudo apt-get install gcc-4.9
- sudo apt-get install --only-upgrade libstdc++6

macOS-XCode11:
http://retesteth.ethdevops.io/release/0.2.0-memory/macOS-XCode11/retesteth-0.2.0-memory-macOS-XCode11

Docker:
geth version: Version: 1.10.9-unstable Git Commit: 84ff152de56b9d65f6888daef9dc00c97a6aafd3
geth evm version: evm version 1.10.9-unstable-84ff152d-20210915
lllc version: Version: 0.5.14-develop.2021.6.12+commit.401d5358.Linux.g++
solidity version: Version: 0.8.5+commit.a4f2e591.Linux.g++
http://retesteth.ethdevops.io/release/0.2.0-memory/dretesteth-0.2.0-memory.tar

Documentation:
https://ethereum-tests.readthedocs.io/en/latest/

Retesteth v0.1.2 - london-spdataobj

06 Aug 13:28
9940c76
Compare
Choose a tag to compare

A big update on memory managment with more optimizations to come.

Announcment

Ethereum test runner / generator tool for the tests (https://github.com/ethereum/tests)
Uses existing clients to run/generate the tests. See documentation. (https://ethereum-tests.readthedocs.io/en/latest/)

Changelog

  • timeout shutdown in 10 hours execution time (for stat page)
  • use bigint for values, allow overflow values in Ethereum structures for comuptation
  • fix issue when error didn't finish the thread in retesteth
  • test_modifyTimestump is absolute in blockchain tests
  • memory and json parsing optimizations
  • store DataObject using smart pointers.
  • support 100_000_000 notation for decimal values in test fillers
  • store temp files on memory drive if possible (make sure there is enough space in /dev/shm)
  • download boost dependecy from http://retesteth.ethdevops.io/ when cmake

ubuntu 18.04.3:
http://retesteth.ethdevops.io/release/0.1.2-london/ubuntu-18.04.3/retesteth-0.1.2-london-ubuntu-18.04.3

Might need the dependecies install:

- sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y
- sudo apt-get update
- sudo apt-get install gcc-4.9
- sudo apt-get install --only-upgrade libstdc++6

macOS-XCode11:
http://retesteth.ethdevops.io/release/0.1.2-london/macOS-XCode11/retesteth-0.1.2-london-macOS-XCode11

Docker:
geth version: Version: 1.10.7-unstable Git Commit: d3e3a460ec947c9e1e963d1a35f887d95f23f99d
geth evm version: evm version 1.10.7-unstable-d3e3a460-20210804
lllc version: Version: 0.5.14-develop.2021.6.12+commit.401d5358.Linux.g++
solidity version: Version: 0.8.5+commit.a4f2e591.Linux.g++
http://retesteth.ethdevops.io/release/0.1.2-london/dretesteth-0.1.2-london.tar

Documentation:
https://ethereum-tests.readthedocs.io/en/latest/

Retesteth v0.1.1 - eip1559

12 Jun 22:38
ab6c70d
Compare
Choose a tag to compare

Ethereum test runner / generator tool for the tests (https://github.com/ethereum/tests)
Uses existing clients to run/generate the tests. See documentation.

Changelog

  • fix --checkhash warnings on LegacyTests
  • remove blockchain version of old VMTests
  • typed transactions exported without rlp prefix (as plain 01 + tx.bytes)
  • select transaction by label in a filled state test
  • check for excessive expect sections in gstate tests
  • yul compilation support
  • t8ntool secret key export
  • transaction type2 support in gstate tests (0x02)
  • DataObject notinitialized type for std logic. fix issues with autosort.
  • openethereum-evm gstate tests support via wrapper
  • replace BlockHeader with spBlockHeader
  • introduce new struct BlockHeader1559
  • support besu and oewrap
  • EIP1559 test parsing
  • setup.sh script in client configs. (executed once in the begining of retesteth run)
  • fieldReplace map in clients config (on rpc protocol)
  • checkLogHash option in clients config
  • check t8ntool response files for emptiness bugfix
  • eip1559 blockchain test support (t8ntool)
  • eip1559 BerlinToLondonAt5 support (t8ntool)
  • invalid transactions check
  • test_mineBlocks method expect result of rejected transactions

ubuntu 18.04.3:
http://retesteth.ethdevops.io/release/0.1.1-eip1559/ubuntu-18.04.3/retesteth-0.1.1-eip1559-ubuntu-18.04.3

Might need the dependecies install:

- sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y
- sudo apt-get update
- sudo apt-get install gcc-4.9
- sudo apt-get install --only-upgrade libstdc++6

macOS-XCode11:
http://retesteth.ethdevops.io/release/0.1.1-eip1559/macOS-XCode11/retesteth-0.1.1-eip1559-macOS-XCode11

Docker:
geth version: Version: 1.10.4-unstable Git Commit: eff998effbf466d4acbe599583dd8ec75f2af6a1
geth evm version: evm version 1.10.4-unstable-eff998ef-20210611
lllc version: Version: 0.5.14-develop.2021.6.12+commit.401d5358.Linux.g++
solidity version: Version: 0.8.5+commit.a4f2e591.Linux.g++
http://retesteth.ethdevops.io/release/0.1.1-eip1559/dretesteth-0.1.1-eip1559.tar

Documentation:
https://ethereum-tests.readthedocs.io/en/latest/

Retesteth v0.1.0-accesslist Release Fix

15 Mar 19:51
156b5ba
Compare
Choose a tag to compare

Ethereum test runner / generator tool for the tests (https://github.com/ethereum/tests)
Uses existing clients to run/generate the tests. See documentation.

!!!FIX the testfile option!!!

Changelog

  • move expectException in blockchain filler outside of blockheader.
  • allow ">=Frtontier" : {} inside blockheader in blockchain filler (individual overwrite)
  • show trRaw data debug when failing a state test
  • select tr by data label (in gtests) from cmd and expect section
  • support data/value/gas index ranges in gtests expect section
  • tx.nonce "auto" in bcTest fillers
  • bugfix: color symbols corrected when output to console
  • bugfix: remove comments when filling a single test file
  • VMTests subfolder in GeneralStateTests
  • labels in filled tests. "_info" section of filled test change for new tests
  • warning debug when lllc compilation fails
  • tx.access lists support in gtests and blockchain tests
  • fix nonce from being size_t in state. acc.nonce > 2**64-1 is not allowed
  • better debug around transactions failing in blockchain test generation
  • vmTrace in blockchain tests (wip)

ubuntu 18.04.3:
http://retesteth.ethdevops.io/release/0.1.0-accesslist/ubuntu-18.04.3/retesteth-0.1.0-accesslist-ubuntu-18.04.3

Might need the dependecies install:

- sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y
- sudo apt-get update
- sudo apt-get install gcc-4.9
- sudo apt-get install --only-upgrade libstdc++6

macOS-XCode10:
http://retesteth.ethdevops.io/release/0.1.0-accesslist/macOS-XCode10/retesteth-0.1.0-accesslist-macOS-XCode10

Docker:
geth version: Version: 1.10.2-unstable Git Commit: faacc8e0faa89f5b3a7055e86924a95b6a9be944
geth evm version: evm version 1.10.2-unstable-faacc8e0-20210315
lllc version: Version: 0.5.14-develop.2021.3.9+commit.14c9d5de.Linux.g++
solidity version: Version: 0.7.0+commit.9e61f92b.Linux.g++
http://retesteth.ethdevops.io/release/0.1.0-accesslist/dretesteth-0.1.0-accesslist.tar

Documentation:
https://ethereum-tests.readthedocs.io/en/latest/

Retesteth v0.1.0-accesslist Release

09 Mar 18:58
aa5ff53
Compare
Choose a tag to compare

Ethereum test runner / generator tool for the tests (https://github.com/ethereum/tests)
Uses existing clients to run/generate the tests. See documentation.

Changelog

  • move expectException in blockchain filler outside of blockheader.
  • allow ">=Frtontier" : {} inside blockheader in blockchain filler (individual overwrite)
  • show trRaw data debug when failing a state test
  • select tr by data label (in gtests) from cmd and expect section
  • support data/value/gas index ranges in gtests expect section
  • tx.nonce "auto" in bcTest fillers
  • bugfix: color symbols corrected when output to console
  • bugfix: remove comments when filling a single test file
  • VMTests subfolder in GeneralStateTests
  • labels in filled tests. "_info" section of filled test change for new tests
  • warning debug when lllc compilation fails
  • tx.access lists support in gtests and blockchain tests
  • fix nonce from being size_t in state. acc.nonce > 2**64-1 is not allowed
  • better debug around transactions failing in blockchain test generation
  • vmTrace in blockchain tests (wip)

ubuntu 18.04.3:
http://retesteth.ethdevops.io/release/0.1.0-accesslist/ubuntu-18.04.3/retesteth-0.1.0-accesslist-ubuntu-18.04.3

Might need the dependecies install:

- sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y
- sudo apt-get update
- sudo apt-get install gcc-4.9
- sudo apt-get install --only-upgrade libstdc++6

macOS-XCode10:
http://retesteth.ethdevops.io/release/0.1.0-accesslist/macOS-XCode10/retesteth-0.1.0-accesslist-macOS-XCode10

Docker:
geth version: Version: 1.10.2-unstable Git Commit: 22082f9e565665f7da045b9ff708e4698f383c77
geth evm version: evm version 1.10.2-unstable-22082f9e-20210309
lllc version: Version: 0.5.14-develop.2021.3.9+commit.14c9d5de.Linux.g++
solidity version: Version: 0.7.0+commit.9e61f92b.Linux.g++
http://retesteth.ethdevops.io/release/0.1.0-accesslist/dretesteth-0.1.0-accesslist.tar

Documentation:
https://ethereum-tests.readthedocs.io/en/latest/

Retesteth v0.0.9-berlin Release

31 Oct 15:57
ab0e685
Compare
Choose a tag to compare

Ethereum test runner / generator tool for the tests (https://github.com/ethereum/tests)
Uses existing clients to run/generate the tests. See documentation.

ubuntu 18.04.3:
http://retesteth.ethdevops.io/release/0.0.9-berlin/ubuntu-18.04.3/retesteth-0.0.9-berlin-ubuntu-18.04.3

Might need the dependecies install:

- sudo add-apt-repository ppa:ubuntu-toolchain-r/test -y
- sudo apt-get update
- sudo apt-get install gcc-4.9
- sudo apt-get install --only-upgrade libstdc++6

macOS-XCode10:
http://retesteth.ethdevops.io/release/0.0.9-berlin/macOS-XCode10/retesteth-0.0.9-berlin-macOS-XCode10

Docker:
geth evm version 1.9.24-unstable-b63bffe8-20201030
lllc version: 0.5.14-develop.2020.10.30+commit.9189ad7a.Linux.g++
http://retesteth.ethdevops.io/release/0.0.9-berlin/dretesteth-0.0.9-berlin.tar

Documentation:
https://ethereum-tests.readthedocs.io/en/latest/