You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
We need to be able to rerun a module on all existing submission in case we ever make changes that affect the benchmarking results.
Describe the solution you'd like
A script that can be run by a maintainer to recreate results.json for submission to the Proteobench/module repository.
This can either be a standalone srcipt (preferable) or a wrapper around streamlit page tests.
If possible the script should be generic and take the module name, results.json and file location as input.
Additional context
Here are some prerequisites:
all data required for rerunning a module are stored
method names are standardized enough to write one generic runner
Please add any additional prerequisites, hurdles or goals you see for this.
The text was updated successfully, but these errors were encountered:
Would you rather see this as a jupyter notebook (react with eyes), or as a command line script (react with rocket)?
A notebook makes it easier to see what's happening, while a command line script could more easily be run via gh actions.
Is your feature request related to a problem? Please describe.
We need to be able to rerun a module on all existing submission in case we ever make changes that affect the benchmarking results.
Describe the solution you'd like
A script that can be run by a maintainer to recreate results.json for submission to the Proteobench/module repository.
This can either be a standalone srcipt (preferable) or a wrapper around streamlit page tests.
If possible the script should be generic and take the module name, results.json and file location as input.
Additional context
Here are some prerequisites:
Please add any additional prerequisites, hurdles or goals you see for this.
The text was updated successfully, but these errors were encountered: