bingran-you commited on
Commit
5f946db
·
verified ·
1 Parent(s): fa68495

Draft: Add SkillsBench v1.1 evaluation result

Browse files

Draft for @bingran-you review; maintainers please do not merge yet.

## Summary

Adds MiniMax M3's SkillsBench v1.1 with-skills evaluation result to Hugging Face eval results.

This is a metadata-only PR adding `.eval_results/skillsbench.yaml`. It does not change model files, code, dependencies, or runtime behavior.

## Result

- Benchmark: SkillsBench v1.1
- Benchmark dataset: https://huggingface.co/datasets/benchflow/skillsbench
- Task id: `skillsbench_v1_1`
- Value: `53.0`
- Mode: with-skills
- Harness: BenchFlow
- Agent: OpenHands
- Coverage: 87 tasks x 3 trials, full 261/261 selected trials
- Recomputed date: 2026-06-11

## Source

Official export:
https://huggingface.co/datasets/benchflow/skillsbench-leaderboard/raw/main/leaderboard/skillsbench/v1.1/official.json

Trajectory/result archive:
https://huggingface.co/datasets/benchflow/skillsbench-leaderboard

## Notes

SkillsBench has paired with-skills and without-skills scores. This PR submits only the with-skills score because the current Hugging Face benchmark dataset defines `skillsbench_v1_1` as the default leaderboard task. A no-skills leaderboard can be added separately if/when the benchmark dataset adds a second task id.

Files changed (1) hide show
  1. .eval_results/skillsbench.yaml +11 -0
.eval_results/skillsbench.yaml ADDED
@@ -0,0 +1,11 @@
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: benchflow/skillsbench
3
+ task_id: skillsbench_v1_1
4
+ revision: be2a6ce2cb1f4ff67ce937307cade0c5a0477a13
5
+ value: 53.0
6
+ date: "2026-06-11"
7
+ source:
8
+ url: https://huggingface.co/datasets/benchflow/skillsbench-leaderboard/raw/main/leaderboard/skillsbench/v1.1/official.json
9
+ name: SkillsBench v1.1 official leaderboard
10
+ user: benchflow
11
+ notes: "with-skills; BenchFlow harness; OpenHands agent; 87 tasks x 3 trials; full 261/261 coverage"