Upload README.md with huggingface_hub
Browse files
README.md
ADDED
|
@@ -0,0 +1,44 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
base_model: Qwen/Qwen2.5-Coder-1.5B
|
| 4 |
+
tags:
|
| 5 |
+
- code2lora
|
| 6 |
+
- hypernetwork
|
| 7 |
+
- lora
|
| 8 |
+
- code
|
| 9 |
+
library_name: code2lora
|
| 10 |
+
---
|
| 11 |
+
|
| 12 |
+
# code2lora_cli_multitask
|
| 13 |
+
|
| 14 |
+
Multi-task **Code2LoRA-GRU** hypernetwork checkpoint used by the `c2l-terminal`
|
| 15 |
+
(`code2lora` pip package). Given a repository's commit history it generates a
|
| 16 |
+
LoRA adapter for a frozen **Qwen2.5-Coder-1.5B** base, for two auto-routed tasks:
|
| 17 |
+
|
| 18 |
+
- `assert_rhs` (task 0) — test-assertion completion
|
| 19 |
+
- `qa` (task 1) — free-form repository question answering (diff + repository-state)
|
| 20 |
+
|
| 21 |
+
## Training
|
| 22 |
+
|
| 23 |
+
- Warm-started from the single-task assertion GRU hypernetwork (grown 0→2 tasks
|
| 24 |
+
via a zero-padded, output-identical initialization).
|
| 25 |
+
- Finetuned on **164,173** commit-grounded Q&A pairs (73,829 diff-grounded +
|
| 26 |
+
90,344 repository-state) **+ a 10% assertion-completion rehearsal sample**,
|
| 27 |
+
which prevents catastrophic forgetting of the original task.
|
| 28 |
+
|
| 29 |
+
## Evaluation (held-out test splits, CR / IR)
|
| 30 |
+
|
| 31 |
+
| task | metric | CR | IR |
|
| 32 |
+
|---|---|---|---|
|
| 33 |
+
| assertion completion | exact match | 60.5 | 66.1 |
|
| 34 |
+
| repository QA | QA quality (½·(ROUGE-L+token-F1)) | 0.229 | 0.230 |
|
| 35 |
+
|
| 36 |
+
Assertion accuracy matches the original single-task checkpoint (60.3 / 64.5)
|
| 37 |
+
while adding the QA capability at no measurable cost.
|
| 38 |
+
|
| 39 |
+
## Usage
|
| 40 |
+
|
| 41 |
+
```bash
|
| 42 |
+
pip install code2lora
|
| 43 |
+
C2L_CKPT_REPO=code2lora/code2lora_cli_multitask c2lt
|
| 44 |
+
```
|