NovatasticRoScript commited on
Commit
03efae3
Β·
verified Β·
1 Parent(s): 14981d6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -4
README.md CHANGED
@@ -95,7 +95,7 @@ model-index:
95
 
96
  Despite its tiny physical footprint, Atomight-V2.1-0.5B targets highly efficient edge-device reasoning, structured text outputs, lightweight coding assistance, and rapid deployment workflows under severe compute constraints.
97
 
98
- ### πŸš€ Key Highlights
99
  - **Parameter Footprint:** ~494M parameters (Loads into ~1GB VRAM at FP16).
100
  - **Training Paradigm:** GRPO reinforcement learning focusing on high-signal reasoning vectors instead of brute-force dataset scale.
101
  - **Edge-Optimized:** Designed specifically for low-overhead mobile, local, and browser-based inference loops (Google Colab / Kaggle native workflow).
@@ -108,7 +108,7 @@ https://huggingface.co/mradermacher/Atomight-V2.1-0.5B-Inference-GGUF
108
 
109
  ---
110
 
111
- ## πŸ“Š Evaluation & Benchmark Results
112
 
113
  Official evaluations were conducted using the **EleutherAI LM Evaluation Harness** at FP16 precision.
114
 
@@ -125,7 +125,7 @@ Official evaluations were conducted using the **EleutherAI LM Evaluation Harness
125
  <img src="OfficialBenchmarkAtomight2.1.png" alt="Atomight V2.1 Benchmark" width="500" style="max-width: 100%;">
126
  </p>
127
 
128
- ### πŸ” Comparative Engineering Insights
129
 
130
  * **Punching Above Weight Classes:** Atomight-V2.1-0.5B outpaces Meta's larger **Llama-3.2-1B-Instruct** on localized logic-retrieval metrics, clearing **59.3%** on ARC-Easy and **33.8%** on ARC-Challenge compared to Llama's *56.7%* and *31.8%* respectively.
131
  * **The Reasoning Gap:** On mathematical reasoning (GSM8K), when evaluated with **Flexible Extraction parsing (32.45%)**, Atomight demonstrates higher raw mathematical accuracy than both Qwen2.5-0.5B-Instruct (*26.8%*) and Llama-3.2-1B-Instruct (*24.4%*).
@@ -133,7 +133,7 @@ Official evaluations were conducted using the **EleutherAI LM Evaluation Harness
133
 
134
  ---
135
 
136
- ## πŸ’» Quickstart: Inference Execution
137
 
138
  Atomight utilizes system and sequence prompts to partition thinking spaces. For optimal reasoning convergence, use explicit `<thinking>` and `<answer>` encapsulation layers.
139
 
@@ -179,6 +179,7 @@ with torch.no_grad():
179
 
180
  print(tokenizer.decode(outputs[0], skip_special_tokens=True))
181
 
 
182
  ---
183
 
184
  ## πŸ“„ Citations
 
95
 
96
  Despite its tiny physical footprint, Atomight-V2.1-0.5B targets highly efficient edge-device reasoning, structured text outputs, lightweight coding assistance, and rapid deployment workflows under severe compute constraints.
97
 
98
+ ### Key Highlights
99
  - **Parameter Footprint:** ~494M parameters (Loads into ~1GB VRAM at FP16).
100
  - **Training Paradigm:** GRPO reinforcement learning focusing on high-signal reasoning vectors instead of brute-force dataset scale.
101
  - **Edge-Optimized:** Designed specifically for low-overhead mobile, local, and browser-based inference loops (Google Colab / Kaggle native workflow).
 
108
 
109
  ---
110
 
111
+ ## Evaluation & Benchmark Results
112
 
113
  Official evaluations were conducted using the **EleutherAI LM Evaluation Harness** at FP16 precision.
114
 
 
125
  <img src="OfficialBenchmarkAtomight2.1.png" alt="Atomight V2.1 Benchmark" width="500" style="max-width: 100%;">
126
  </p>
127
 
128
+ ### Comparative Engineering Insights
129
 
130
  * **Punching Above Weight Classes:** Atomight-V2.1-0.5B outpaces Meta's larger **Llama-3.2-1B-Instruct** on localized logic-retrieval metrics, clearing **59.3%** on ARC-Easy and **33.8%** on ARC-Challenge compared to Llama's *56.7%* and *31.8%* respectively.
131
  * **The Reasoning Gap:** On mathematical reasoning (GSM8K), when evaluated with **Flexible Extraction parsing (32.45%)**, Atomight demonstrates higher raw mathematical accuracy than both Qwen2.5-0.5B-Instruct (*26.8%*) and Llama-3.2-1B-Instruct (*24.4%*).
 
133
 
134
  ---
135
 
136
+ ## Quickstart: Inference Execution
137
 
138
  Atomight utilizes system and sequence prompts to partition thinking spaces. For optimal reasoning convergence, use explicit `<thinking>` and `<answer>` encapsulation layers.
139
 
 
179
 
180
  print(tokenizer.decode(outputs[0], skip_special_tokens=True))
181
 
182
+
183
  ---
184
 
185
  ## πŸ“„ Citations