🏆 Evaluation Results

#1
by nathanael-fijalkow - opened
MVA+IASD LLM for code and proof org

Evaluation Results

Model: LLM-course/chess-duc-backup
Parameters: 998,518 [PASS]
Chess library check: [PASS]

Performance

Metric Value
Total moves played 500
Games played 21
Legal moves (first try) 366 (73.2%)
Legal moves (with retries) 440 (88.0%)

Interpretation

  • >90% legal rate: Excellent! Model has learned chess rules well.
  • 70-90% legal rate: Good, but room for improvement.
  • <70% legal rate: Model struggles with legal move generation.

Sign up or log in to comment