Add SWE-bench Verified evaluation result (74.0%)
#35
by SaylorTwift HF Staff - opened
YAML Metadata Error:Invalid content in Eval Result file .eval_results/swe_bench_verified_with_tools.yaml
Check out the documentation for more information.
Show details
Task ID "swe_bench_verified" does not match any task in dataset "SWE-bench/SWE-bench_Verified". Available: swe_bench_%_resolved, swe_bench_average_cost
.eval_results/swe_bench_verified_with_tools.yaml
ADDED
|
@@ -0,0 +1,10 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: SWE-bench/SWE-bench_Verified
|
| 3 |
+
task_id: swe_bench_verified
|
| 4 |
+
value: 74.0
|
| 5 |
+
date: '2026-03-17'
|
| 6 |
+
source:
|
| 7 |
+
url: https://huggingface.co/MiniMaxAI/MiniMax-M2.1
|
| 8 |
+
name: Model Card
|
| 9 |
+
user: burtenshaw
|
| 10 |
+
notes: "With tools"
|