Update README.md
Browse files
README.md
CHANGED
|
@@ -105,8 +105,14 @@ These are the results of the benchmarks for *Atomight-V2.5-1.7B*, evaluated with
|
|
| 105 |
| Domain | Score | Details |
|
| 106 |
|---|---:|---|
|
| 107 |
| gsm8krefn | **86.96%** | 260/299 correct · greedy decoding · max_new_tokens=900 |
|
|
|
|
|
|
|
| 108 |
|
| 109 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 110 |
|
| 111 |
---
|
| 112 |
|
|
|
|
| 105 |
| Domain | Score | Details |
|
| 106 |
|---|---:|---|
|
| 107 |
| gsm8krefn | **86.96%** | 260/299 correct · greedy decoding · max_new_tokens=900 |
|
| 108 |
+
| arcchalrefn | **94.00%** | 235/250 correct · greedy decoding · max_new_tokens=1100 |
|
| 109 |
+
| humanevalrefn | In Progress | -- |
|
| 110 |
|
| 111 |
+
Methodology and full results are documented in the accompanying paper:
|
| 112 |
+
|
| 113 |
+
> NovatasticRoScript (2026). *IIfSLM: An Intelligence Index for Small Language Models.* Zenodo. [https://doi.org/10.5281/zenodo.21753925](https://doi.org/10.5281/zenodo.21753925)
|
| 114 |
+
|
| 115 |
+
See the [full IIfSLM dataset and methodology notes](https://huggingface.co/datasets/NovatasticRoScript/IIfSLM-v1) -- and feel free to run your own model against it too.
|
| 116 |
|
| 117 |
---
|
| 118 |
|