excesc commited on
Commit
e92792f
·
verified ·
1 Parent(s): 43345f5

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +186 -0
README.md ADDED
@@ -0,0 +1,186 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: Qwen/Qwen3-14B
4
+ language:
5
+ - en
6
+ - multilingual
7
+ tags:
8
+ - code
9
+ - coding
10
+ - agentic
11
+ - code-generation
12
+ - code-review
13
+ - debugging
14
+ - instruction-tuned
15
+ - lora
16
+ - sft
17
+ - perciqa
18
+ - aurora
19
+ - canadian-ai
20
+ - mini
21
+ pipeline_tag: text-generation
22
+ library_name: transformers
23
+ ---
24
+
25
+ # Aurora-Code-Mini-V1
26
+
27
+ > *Compact. Capable. Canadian.*
28
+
29
+ Aurora-Code-Mini-V1 is a 14.8B dense coding model built by Perciqa, a Canadian AI company. Fine-tuned from Qwen3-14B on a highly curated, proprietary dataset of agentic coding instruction pairs, Aurora-Code-Mini-V1 is designed for developers who need fast, high-quality coding assistance — without cloud dependencies, usage limits, or black boxes.
30
+
31
+ **License:** Apache 2.0
32
+ **Hardware:** Requires ~28 GB VRAM at BF16, or ~8 GB with 4-bit quantization.
33
+ **Made in Canada** 🇨🇦
34
+
35
+ ---
36
+
37
+ ## What Aurora-Code-Mini-V1 Does
38
+
39
+ Aurora-Code-Mini-V1 is tuned specifically for developers who need a model they can deploy, audit, and fully control on their own infrastructure.
40
+
41
+ - **Code Generation:** Write functions, classes, and complete programs across 40+ languages.
42
+ - **Debugging:** Identify root causes and produce clear, actionable fixes.
43
+ - **Code Review:** Flag security issues, suggest refactors, and explain tradeoffs.
44
+ - **Agentic Tasks:** Multi-step tool use, planning, and repository-level reasoning.
45
+ - **Refactoring:** Modernize legacy code, apply design patterns, and improve maintainability.
46
+ - **Test Writing:** Generate unit tests, integration tests, and comprehensive test suites.
47
+
48
+ *No black boxes. No data leaving your infrastructure. Your model, your terms.*
49
+
50
+ ---
51
+
52
+ ## Quickstart
53
+
54
+ ### Install
55
+
56
+ ```bash
57
+ pip install "transformers>=4.51.0" accelerate peft
58
+ ```
59
+
60
+ ### Transformers (Adapter)
61
+
62
+ ```python
63
+ from transformers import AutoModelForCausalLM, AutoTokenizer
64
+ from peft import PeftModel
65
+
66
+ model_name = "Qwen/Qwen3-14B"
67
+ adapter_name = "Perciqa/Aurora-Code-Mini-V1"
68
+
69
+ tokenizer = AutoTokenizer.from_pretrained(model_name)
70
+ base = AutoModelForCausalLM.from_pretrained(
71
+ model_name,
72
+ torch_dtype="auto",
73
+ device_map="auto",
74
+ )
75
+ model = PeftModel.from_pretrained(base, adapter_name)
76
+
77
+ system_prompt = (
78
+ "You are Aurora, an AI code assistant built by Perciqa. "
79
+ "You help developers write, review, and understand code. "
80
+ "You provide clear, correct, and complete solutions. "
81
+ "When you're unsure, you say so."
82
+ )
83
+
84
+ messages = [
85
+ {"role": "system", "content": system_prompt},
86
+ {"role": "user", "content": "Write a Python function to merge two sorted lists."},
87
+ ]
88
+
89
+ text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
90
+ inputs = tokenizer([text], return_tensors="pt").to(model.device)
91
+
92
+ outputs = model.generate(
93
+ **inputs,
94
+ max_new_tokens=1024,
95
+ temperature=0.7,
96
+ do_sample=True,
97
+ )
98
+ response = tokenizer.decode(outputs[0][len(inputs.input_ids[0]):], skip_special_tokens=True)
99
+ print(response)
100
+ ```
101
+
102
+ ### vLLM (Recommended for Production)
103
+
104
+ ```bash
105
+ pip install vllm
106
+ vllm serve Perciqa/Aurora-Code-Mini-V1 --max-model-len 32768
107
+ ```
108
+
109
+ Query via the OpenAI-compatible API:
110
+
111
+ ```python
112
+ from openai import OpenAI
113
+
114
+ client = OpenAI(base_url="http://localhost:8000/v1", api_key="token-abc123")
115
+
116
+ response = client.chat.completions.create(
117
+ model="Perciqa/Aurora-Code-Mini-V1",
118
+ messages=[
119
+ {"role": "system", "content": "You are Aurora, an AI code assistant built by Perciqa."},
120
+ {"role": "user", "content": "Refactor this function to be more Pythonic."},
121
+ ],
122
+ max_tokens=1024,
123
+ )
124
+ print(response.choices[0].message.content)
125
+ ```
126
+
127
+ ### Ollama
128
+
129
+ ```bash
130
+ ollama run hf.co/Perciqa/Aurora-Code-Mini-V1
131
+ ```
132
+
133
+ ---
134
+
135
+ ## Training Approach
136
+
137
+ *(Note: Specific dataset metrics, teacher model names, and internal training configurations are kept proprietary to protect Perciqa's intellectual property.)*
138
+
139
+ Aurora-Code-Mini-V1 is fine-tuned from the Qwen3-14B base model using a rigorous, multi-stage approach:
140
+
141
+ - **Proprietary Curation:** Trained on a carefully curated, high-quality dataset of agentic coding instruction pairs spanning critical developer workflows, including generation, debugging, refactoring, and testing.
142
+ - **Parameter-Efficient Fine-Tuning:** Optimized using Low-Rank Adaptation (LoRA) to preserve the base model's robust general reasoning capabilities while specializing in high-fidelity, developer-centric tasks.
143
+ - **Quality Assurance:** Checkpoints were extensively evaluated on held-out validation sets to optimize for low loss, high token accuracy, and strong generalization without overfitting.
144
+
145
+ ---
146
+
147
+ ## Model Details
148
+
149
+ | Field | Value |
150
+ | :--- | :--- |
151
+ | **Architecture** | Dense Transformer (GQA) |
152
+ | **Total Parameters** | 14.8B |
153
+ | **Transformer Layers** | 40 |
154
+ | **Attention Heads** | 40 (Q) / 8 (KV) |
155
+ | **Context Length** | 131,072 tokens (native) |
156
+ | **Base Model** | Qwen3-14B |
157
+ | **License** | Apache 2.0 |
158
+ | **Hardware (BF16)** | ~28 GB VRAM |
159
+ | **Hardware (4-bit)** | ~8 GB VRAM |
160
+
161
+ ---
162
+
163
+ ## System Prompt
164
+
165
+ For optimal performance, we recommend using the following system prompt:
166
+
167
+ > You are Aurora, an AI code assistant built by Perciqa.
168
+ > You help developers write, review, and understand code.
169
+ > You provide clear, correct, and complete solutions.
170
+ > When you're unsure, you say so.
171
+
172
+ ---
173
+
174
+ ## About Perciqa
175
+
176
+ Perciqa is a Canadian AI company building enterprise models and tools that organisations can deploy, audit, and fully control — on their own infrastructure, on their own terms. Founded in 2023 and based in Canada 🇨🇦.
177
+
178
+ [perciqa.com](https://perciqa.com) · [GitHub](https://github.com/perciqa)
179
+
180
+ ---
181
+
182
+ ## License
183
+
184
+ Aurora-Code-Mini-V1 is released under the **Apache 2.0 License**.
185
+
186
+ *Made with ♥ by Perciqa 🇨🇦*