Upload README.md with huggingface_hub

README.md

@@ -5,41 +5,22 @@ pipeline_tag: text-generation
 tags:
 - code
 - code-generation
-model-index:
-- name: selection-coder-100m
-  results:
-  - task:
-      type: text-generation
-    dataset:
-      name: HumanEval
-      type: openai_humaneval
-    metrics:
-      - type: pass@1
-        value: 0.0
-  - task:
-      type: text-generation
-    dataset:
-      name: MBPP
-      type: mbpp
-    metrics:
-      - type: pass@1
-        value: 0.5
 ---
 
 # selection-coder-100m
 
-A 211.3M-parameter Python code generation model. Context length 1024.
+A 212.4M-parameter Python code model. Context length 2048.
 
 ## Benchmarks (pass@1, greedy)
 
-| Benchmark | pass@1 | n |
+| Benchmark | standard | reasoning |
 |---|---|---|
-| HumanEval | 0.0% | 164 |
-| MBPP | 0.5% | 200 |
+| HumanEval | 0.61% | 0.0% |
+| MBPP | 3.5% | 0.5% |
 
-## Usage
+_reasoning = chain-of-thought prompt + 2 self-refine iterations._
 
-Prompt format:
+## Usage
 ```
 ### Instruction:
 <your task>