Running
1
MINT
🌿
Quantize LLMs to fit a specific memory budget without data
AI & ML interests
Model Quantization
Recent Activity
View all activity
Running
Per-Expert Mixed-Precision Quantization for 512-Expert MoE Models
🔬
Quantize large MoE models to mixed precision without data
Running
README
🐑
Running
1
SWAN: Data-Free Mixed-Precision Quantization
🦢
Quantize LLMs without data using per‑tensor mixed precision
Running
2
SAKD: SWAN-Guided Knowledge Distillation
📖
Generate quantization‑ready student models via guided distillation
Running
1
Sensitivity-Aware Training (SAT)
📄
Train LLMs to be quantization‑ready with sensitivity‑aware methods