Maxilicious20 commited on
Commit
e80b5e4
·
verified ·
1 Parent(s): 5033e44

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +89 -0
README.md CHANGED
@@ -1,3 +1,92 @@
1
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2
  license: apache-2.0
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ base_model: Qwen/Qwen2.5-Coder-3B-Instruct
3
+ library_name: peft
4
+ pipeline_tag: text-generation
5
+ tags:
6
+ - base_model:adapter:Qwen/Qwen2.5-Coder-3B-Instruct
7
+ - lora
8
+ - sft
9
+ - transformers
10
+ - trl
11
+ - german
12
+ - english
13
+ - coding
14
+ - code-generation
15
+ - aether
16
+ - gguf
17
  license: apache-2.0
18
+ language:
19
+ - de
20
+ - en
21
  ---
22
+
23
+ # Aether 2.5 Coder
24
+
25
+ Aether 2.5 Coder is a specialized coding and technical reasoning model built on top of the **Qwen2.5-Coder-3B-Instruct** base architecture. Fine-tuned using SFT (Supervised Fine-Tuning) with Hugging Face TRL and PEFT (LoRA) on custom datasets, Aether 2.5 Coder combines high-precision code generation, script optimization, and debugging with multilingual instruction following in German and English.
26
+
27
+ > 🚀 **Looking for GGUF versions?**
28
+ > If you want to run Aether 2.5 Coder locally via **LM Studio**, **Ollama**, or **llama.cpp**, check out the pre-quantized GGUF repository:
29
+ > 👉 **[Maxilicious20/Aether-2.5-Coder-3B-GGUF](https://huggingface.co/Maxilicious20/Aether-2.5-Coder-3B-GGUF)**
30
+
31
+ ## Model Details
32
+
33
+ ### Model Description
34
+
35
+ - **Developed by:** Maxilicious20
36
+ - **Model type:** Causal Language Model (LoRA Adapter)
37
+ - **Language(s) (NLP):** German, English, Programming Languages (Python, JavaScript, C++, Luau, etc.)
38
+ - **License:** Apache-2.0
39
+ - **Finetuned from model:** Qwen/Qwen2.5-Coder-3B-Instruct
40
+
41
+ ## Uses
42
+
43
+ ### Direct Use
44
+
45
+ Aether 2.5 Coder is tailored for automated code completion, script writing, structural refactoring, debugging, and software architecture planning. It delivers top-tier 3B coding performance while maintaining low VRAM consumption for efficient execution on consumer hardware.
46
+
47
+ ### Quantized & GGUF Models
48
+
49
+ For standalone CPU/GPU local execution without Python/Transformers dependencies, use the quantized GGUF binaries:
50
+
51
+ * 📦 **GGUF Repository:** [Maxilicious20/Aether-2.5-Coder-3B-GGUF](https://huggingface.co/Maxilicious20/Aether-2.5-Coder-3B-GGUF)
52
+ * **Available Quantizations:**
53
+ * `aether_coder_f16.gguf` (Uncompressed / Full Precision)
54
+ * `aether_coder_q8_0.gguf` (High Quality / 8-bit)
55
+ * `aether_coder_q4_k_m.gguf` (Recommended / Balanced Speed & VRAM)
56
+
57
+ ### How to Get Started with the Model
58
+
59
+ #### Python (Transformers & PEFT)
60
+
61
+ Use the following Python code to load Aether 2.5 Coder with `transformers` and `peft`:
62
+
63
+ ```python
64
+ import torch
65
+ from transformers import AutoModelForCausalLM, AutoTokenizer
66
+ from peft import PeftModel
67
+
68
+ base_model_id = "Qwen/Qwen2.5-Coder-3B-Instruct"
69
+ adapter_id = "Maxilicious20/Aether-2.5-Coder-3B"
70
+
71
+ # Load Tokenizer and Base Model
72
+ tokenizer = AutoTokenizer.from_pretrained(base_model_id)
73
+ base_model = AutoModelForCausalLM.from_pretrained(
74
+ base_model_id,
75
+ torch_dtype=torch.bfloat16,
76
+ device_map="auto"
77
+ )
78
+
79
+ # Load Aether 2.5 Coder LoRA Adapter
80
+ model = PeftModel.from_pretrained(base_model, adapter_id)
81
+
82
+ # Example Prompt
83
+ messages = [
84
+ {"role": "system", "content": "You are Aether 2.5 Coder, an expert AI programming assistant."},
85
+ {"role": "user", "content": "Write a Python script to filter and parse a JSON dataset efficiently."}
86
+ ]
87
+
88
+ prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
89
+ inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
90
+
91
+ outputs = model.generate(**inputs, max_new_tokens=512)
92
+ print(tokenizer.decode(outputs[0][inputs.input_ids.shape[1]:], skip_special_tokens=True))