-
Notifications
You must be signed in to change notification settings - Fork 4
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Testing setup #36
Testing setup #36
Conversation
| "eip1559.json" | ||
| "mergeTest.json" | ||
|
||
// These tests are passing, but they take a lot of time to execute so we are going to skip them. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
How long for curiosity?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
as long as it's running now (10 mins)
we don't exclude any tests now (not the false &&
)
general_state_test!(st_stack, stStackTests); | ||
general_state_test!(st_static_call, stStaticCall); // passing, but conflicts with rewards contract | ||
general_state_test!(st_transaction, stTransactionTest); | ||
general_state_test!(vm_tests, VMTests); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
All of these should fail? Why?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
apart from eip 1559, withdrawals, tests rn fail for 2 main reasons:
- wrong impl on our end
- the test "should fail" and it is faililng, but the exact error string in reth (ExecutionStageError.MaxGasReached) is different than in exec specs (MAX_GAS_REACHED, for eg)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Awesome!! Love this addition, good progress
I'll merge as is, we can work on passing more tests in another branch |
.github/workflows/test.yml
Outdated
- name: Downloading ethereum/tests | ||
run: git clone https://github.com/ethereum/tests ethereum-tests | ||
- name: Downloading EELS fixtures released at Cancun | ||
run: curl -LO https://github.com/ethereum/execution-spec-tests/releases/download/v2.1.1/fixtures.tar.gz && tar -xzf fixtures.tar.gz |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Was going to suggest caching, but this is very fast already
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
the curl -LO
is done within a sec, but git clone does take some time tbh
Adds necessary handlers and drivers for testing with ethereum/tests and the new eels tests.
failing-tests
feature (25%).This PR is targeted mostly at setting up the code needed to run the EELS or ethereum tests. The tests themselves will be kept updated as and when Gnosis tests are available. The tests currently passing is just to prove that we aren't doing anything wildly wrong.