We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
SWE-bench/swebench/harness/docker_utils.py
Lines 283 to 284 in 5f5a7df
The above one says it will remove instance images but it is already removed in run_instance itself.
SWE-bench/swebench/harness/run_evaluation.py
Lines 227 to 228 in 5f5a7df
Should the count be removed or should include that previous removal count using env var?
python -m swebench.harness.run_evaluation \ --predictions_path gold \ --max_workers 1 \ --run_id gold \ --split test \ --dataset_name princeton-nlp/SWE-bench \ --instance_ids sympy__sympy-21612
Removed 1 image(s).
Removed 0 images.
No response
The text was updated successfully, but these errors were encountered:
No branches or pull requests
Describe the bug
SWE-bench/swebench/harness/docker_utils.py
Lines 283 to 284 in 5f5a7df
The above one says it will remove instance images but it is already removed in run_instance itself.
SWE-bench/swebench/harness/run_evaluation.py
Lines 227 to 228 in 5f5a7df
Should the count be removed or should include that previous removal count using env var?
Steps/Code to Reproduce
python -m swebench.harness.run_evaluation \ --predictions_path gold \ --max_workers 1 \ --run_id gold \ --split test \ --dataset_name princeton-nlp/SWE-bench \ --instance_ids sympy__sympy-21612
Expected Results
Removed 1 image(s).
Actual Results
Removed 0 images.
System Information
No response
The text was updated successfully, but these errors were encountered: