RowRed commited on
Commit
af349f2
·
verified ·
1 Parent(s): e38602d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +25 -8
README.md CHANGED
@@ -95,14 +95,31 @@ Level 0: 762 (27.2%) • Level 1: 674 (24.1%) • Level 2: 795 (28.4%) • Level
95
  - Class balancing: sqrt‑scaled class weights + weighted random sampler
96
 
97
  ## Evaluation Results
98
- Test Set (400 held‑out samples)
99
-
100
- | Metric | Value |
101
- |--------------------------|-------|
102
- | Exact Match Accuracy | 65.0% |
103
- | Adjacent (±1) Accuracy | 92.5% |
104
- | Macro F1 | 0.663 |
105
- | Weighted F1 | 0.653 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
106
 
107
  ## How to Get Started with the Model
108
 
 
95
  - Class balancing: sqrt‑scaled class weights + weighted random sampler
96
 
97
  ## Evaluation Results
98
+
99
+ Reported on 600 held‑out samples from TRAINING.jsonl (internal test).
100
+ |Metric|Value|
101
+ |----|----|
102
+ |Exact Match Accuracy|64.5%|
103
+ |Adjacent (±1) Accuracy|93.0%|
104
+ |Macro F1|0.663|
105
+ |Weighted F1|0.653|
106
+
107
+ Per‑Class Performance (internal test, 600 samples)
108
+ |Level|Precision|Recall|F1|Support|
109
+ |----|----|----|----|----|
110
+ |L0 (Trivial)|0.658|0.626|0.642|163|
111
+ |L1 (Simple)|0.457|0.628|0.529|145|
112
+ |L2 (Moderate)|0.683|0.571|0.622|170|
113
+ |L3 (Complex)|0.933|0.795|0.858|122|
114
+
115
+ Confusion Matrix (internal test, 600 samples)
116
+
117
+ | |Pred L0|Pred L1|Pred L2|Pred L3|
118
+ |----|----|----|----|----|
119
+ |True L0|102|46|13|2|
120
+ |True L1|35|91|18|1|
121
+ |True L2|15|54|97|4|
122
+ |True L3|3|8|14|97|
123
 
124
  ## How to Get Started with the Model
125