Text Generation
PEFT
Safetensors
Transformers
GGUF
German
English
lora
sft
trl
german
english
coding
code-generation
aether
conversational
Instructions to use Maxilicious20/Aether-2.5-Coder with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use Maxilicious20/Aether-2.5-Coder with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-Coder-3B-Instruct") model = PeftModel.from_pretrained(base_model, "Maxilicious20/Aether-2.5-Coder") - Transformers
How to use Maxilicious20/Aether-2.5-Coder with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Maxilicious20/Aether-2.5-Coder") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Maxilicious20/Aether-2.5-Coder", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Maxilicious20/Aether-2.5-Coder with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Maxilicious20/Aether-2.5-Coder" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Maxilicious20/Aether-2.5-Coder", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Maxilicious20/Aether-2.5-Coder
- SGLang
How to use Maxilicious20/Aether-2.5-Coder with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Maxilicious20/Aether-2.5-Coder" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Maxilicious20/Aether-2.5-Coder", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Maxilicious20/Aether-2.5-Coder" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Maxilicious20/Aether-2.5-Coder", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use Maxilicious20/Aether-2.5-Coder with Docker Model Runner:
docker model run hf.co/Maxilicious20/Aether-2.5-Coder
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,92 @@
|
|
| 1 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 2 |
license: apache-2.0
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
+
base_model: Qwen/Qwen2.5-Coder-3B-Instruct
|
| 3 |
+
library_name: peft
|
| 4 |
+
pipeline_tag: text-generation
|
| 5 |
+
tags:
|
| 6 |
+
- base_model:adapter:Qwen/Qwen2.5-Coder-3B-Instruct
|
| 7 |
+
- lora
|
| 8 |
+
- sft
|
| 9 |
+
- transformers
|
| 10 |
+
- trl
|
| 11 |
+
- german
|
| 12 |
+
- english
|
| 13 |
+
- coding
|
| 14 |
+
- code-generation
|
| 15 |
+
- aether
|
| 16 |
+
- gguf
|
| 17 |
license: apache-2.0
|
| 18 |
+
language:
|
| 19 |
+
- de
|
| 20 |
+
- en
|
| 21 |
---
|
| 22 |
+
|
| 23 |
+
# Aether 2.5 Coder
|
| 24 |
+
|
| 25 |
+
Aether 2.5 Coder is a specialized coding and technical reasoning model built on top of the **Qwen2.5-Coder-3B-Instruct** base architecture. Fine-tuned using SFT (Supervised Fine-Tuning) with Hugging Face TRL and PEFT (LoRA) on custom datasets, Aether 2.5 Coder combines high-precision code generation, script optimization, and debugging with multilingual instruction following in German and English.
|
| 26 |
+
|
| 27 |
+
> 🚀 **Looking for GGUF versions?**
|
| 28 |
+
> If you want to run Aether 2.5 Coder locally via **LM Studio**, **Ollama**, or **llama.cpp**, check out the pre-quantized GGUF repository:
|
| 29 |
+
> 👉 **[Maxilicious20/Aether-2.5-Coder-3B-GGUF](https://huggingface.co/Maxilicious20/Aether-2.5-Coder-3B-GGUF)**
|
| 30 |
+
|
| 31 |
+
## Model Details
|
| 32 |
+
|
| 33 |
+
### Model Description
|
| 34 |
+
|
| 35 |
+
- **Developed by:** Maxilicious20
|
| 36 |
+
- **Model type:** Causal Language Model (LoRA Adapter)
|
| 37 |
+
- **Language(s) (NLP):** German, English, Programming Languages (Python, JavaScript, C++, Luau, etc.)
|
| 38 |
+
- **License:** Apache-2.0
|
| 39 |
+
- **Finetuned from model:** Qwen/Qwen2.5-Coder-3B-Instruct
|
| 40 |
+
|
| 41 |
+
## Uses
|
| 42 |
+
|
| 43 |
+
### Direct Use
|
| 44 |
+
|
| 45 |
+
Aether 2.5 Coder is tailored for automated code completion, script writing, structural refactoring, debugging, and software architecture planning. It delivers top-tier 3B coding performance while maintaining low VRAM consumption for efficient execution on consumer hardware.
|
| 46 |
+
|
| 47 |
+
### Quantized & GGUF Models
|
| 48 |
+
|
| 49 |
+
For standalone CPU/GPU local execution without Python/Transformers dependencies, use the quantized GGUF binaries:
|
| 50 |
+
|
| 51 |
+
* 📦 **GGUF Repository:** [Maxilicious20/Aether-2.5-Coder-3B-GGUF](https://huggingface.co/Maxilicious20/Aether-2.5-Coder-3B-GGUF)
|
| 52 |
+
* **Available Quantizations:**
|
| 53 |
+
* `aether_coder_f16.gguf` (Uncompressed / Full Precision)
|
| 54 |
+
* `aether_coder_q8_0.gguf` (High Quality / 8-bit)
|
| 55 |
+
* `aether_coder_q4_k_m.gguf` (Recommended / Balanced Speed & VRAM)
|
| 56 |
+
|
| 57 |
+
### How to Get Started with the Model
|
| 58 |
+
|
| 59 |
+
#### Python (Transformers & PEFT)
|
| 60 |
+
|
| 61 |
+
Use the following Python code to load Aether 2.5 Coder with `transformers` and `peft`:
|
| 62 |
+
|
| 63 |
+
```python
|
| 64 |
+
import torch
|
| 65 |
+
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 66 |
+
from peft import PeftModel
|
| 67 |
+
|
| 68 |
+
base_model_id = "Qwen/Qwen2.5-Coder-3B-Instruct"
|
| 69 |
+
adapter_id = "Maxilicious20/Aether-2.5-Coder-3B"
|
| 70 |
+
|
| 71 |
+
# Load Tokenizer and Base Model
|
| 72 |
+
tokenizer = AutoTokenizer.from_pretrained(base_model_id)
|
| 73 |
+
base_model = AutoModelForCausalLM.from_pretrained(
|
| 74 |
+
base_model_id,
|
| 75 |
+
torch_dtype=torch.bfloat16,
|
| 76 |
+
device_map="auto"
|
| 77 |
+
)
|
| 78 |
+
|
| 79 |
+
# Load Aether 2.5 Coder LoRA Adapter
|
| 80 |
+
model = PeftModel.from_pretrained(base_model, adapter_id)
|
| 81 |
+
|
| 82 |
+
# Example Prompt
|
| 83 |
+
messages = [
|
| 84 |
+
{"role": "system", "content": "You are Aether 2.5 Coder, an expert AI programming assistant."},
|
| 85 |
+
{"role": "user", "content": "Write a Python script to filter and parse a JSON dataset efficiently."}
|
| 86 |
+
]
|
| 87 |
+
|
| 88 |
+
prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
|
| 89 |
+
inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
|
| 90 |
+
|
| 91 |
+
outputs = model.generate(**inputs, max_new_tokens=512)
|
| 92 |
+
print(tokenizer.decode(outputs[0][inputs.input_ids.shape[1]:], skip_special_tokens=True))
|