You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When I want to run the evaluation script on predictions already generated by a model, and I run the evaluation script swebench.harness.run_evaluation in a Windows system, it causes several issues. This is because SWE-bench is not completely OS independent.
Traceback (most recent call last):
File "<frozen runpy>", line 189, in _run_module_as_main
File "<frozen runpy>", line 112, in _get_module_details
File "C:\Users\enan\projects\SWE-bench\swebench\__init__.py", line 46, in <module>
from swebench.harness.run_evaluation import (
File "C:\Users\enan\projects\SWE-bench\swebench\harness\run_evaluation.py", line 5, in <module>
import resource
ModuleNotFoundError: No module named 'resource'
This import error can be easily fixed just by commenting it out. But there are other OS-dependent issues that pops up.
System Information
WIndows 11, Python 3.12, swebench git+7501f0993193
The text was updated successfully, but these errors were encountered:
Describe the bug
When I want to run the evaluation script on predictions already generated by a model, and I run the evaluation script
swebench.harness.run_evaluation
in a Windows system, it causes several issues. This is because SWE-bench is not completely OS independent.Steps/Code to Reproduce
Expected Results
The evaluation runs without error.
Actual Results
Several errors occur.
This import error can be easily fixed just by commenting it out. But there are other OS-dependent issues that pops up.
System Information
WIndows 11, Python 3.12, swebench git+7501f0993193
The text was updated successfully, but these errors were encountered: