NovatasticRoScript commited on
Commit
b7573e1
·
verified ·
1 Parent(s): 948da97

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +69 -0
README.md CHANGED
@@ -1,3 +1,72 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: mit
3
  base_model: Qwen/Qwen2.5-0.5B
 
1
+ ---
2
+ language:
3
+ - en
4
+ tags:
5
+ - lm-evaluation-harness
6
+ model-index:
7
+ - name: Atomight-V2.1-0.5B-Inference
8
+ results:
9
+ - task:
10
+ type: text-generation
11
+ name: ARC-Challenge
12
+ dataset:
13
+ name: AI2 ARC-Challenge
14
+ type: allenai/ai2_arc
15
+ config: ARC-Challenge
16
+ split: test
17
+ metrics:
18
+ - name: Accuracy
19
+ type: acc
20
+ value: 0.30802
21
+ - name: Accuracy (Norm)
22
+ type: acc_norm
23
+ value: 0.33788
24
+ - task:
25
+ type: text-generation
26
+ name: GSM8K
27
+ dataset:
28
+ name: GSM8K
29
+ type: openai/gsm8k
30
+ config: main
31
+ split: test
32
+ metrics:
33
+ - name: Exact Match (Strict)
34
+ type: exact_match
35
+ value: 0.19788
36
+ - name: Exact Match (Flexible)
37
+ type: exact_match
38
+ value: 0.32449
39
+ - task:
40
+ type: text-generation
41
+ name: ARC-Easy
42
+ dataset:
43
+ name: AI2 ARC-Easy
44
+ type: allenai/ai2_arc
45
+ config: ARC-Easy
46
+ split: test
47
+ metrics:
48
+ - name: Accuracy
49
+ type: acc
50
+ value: 0.65446
51
+ - name: Accuracy (Norm)
52
+ type: acc_norm
53
+ value: 0.59343
54
+ - task:
55
+ type: text-generation
56
+ name: HellaSwag
57
+ dataset:
58
+ name: HellaSwag
59
+ type: Rowan/hellaswag
60
+ split: validation
61
+ metrics:
62
+ - name: Accuracy
63
+ type: acc
64
+ value: 0.40709
65
+ - name: Accuracy (Norm)
66
+ type: acc_norm
67
+ value: 0.52350
68
+ ---
69
+
70
  ---
71
  license: mit
72
  base_model: Qwen/Qwen2.5-0.5B