Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

model-compression

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

94

Base only

Active filters: model-compression

jmurray10/phase4-quantum-compression

Updated Aug 27, 2025

Jungwoo4021/SV-Mixer

Updated Sep 17, 2025

kkkamur07/hindi-xlm-roberta-33M

Fill-Mask • Updated Oct 31, 2025

rahilsinghi/firstsight-qwen2-vl-2b-distilled

2B • Updated Dec 9, 2025 • 4

SamMikaelson/OLD_INT_8

3B • Updated Jan 15 • 4

Alrightlone/OBS-Diff-SDXL

Text-to-Image • Updated Jan 2 • 1

junzzhu/atomllama-33K-5x5-DigitMesh-sparse

Text Generation • 33.8k • Updated Jan 16 • 3

SamMikaelson/deepseek-ocr-int8-quantized

junzzhu/atomllama-33K-5x5-DigitMesh-sparse-q8

Text Generation • 34.7k • Updated Jan 15 • 4

krisaujla/BitLinear

Other • Updated Jan 20 • 2

ra225/Qwen2.5-14B-pruned-50p-rmsnorm-finetuned

ra225/Qwen2.5-7B-pruned-50p-rmsnorm-finetuned

ra225/Qwen2.5-7B-pruned-70p-rmsnorm-finetuned

ra225/Qwen2.5-7B-pruned-80p-rmsnorm-finetuned

ra225/Qwen2.5-14B-pruned-70p-rmsnorm-finetuned

ra225/Qwen2.5-7B-pruned-90p-rmsnorm-finetuned

ra225/Qwen2.5-14B-pruned-80p-rmsnorm-finetuned

ra225/Qwen2.5-14B-pruned-90p-rmsnorm-finetuned

ra225/Llama-2-7b-best_ratio50_rmsnorm_finetuned

ra225/Llama-2-7b-best_ratio70_rmsnorm_finetuned

ra225/Llama-2-7b-best_ratio80_rmsnorm_finetuned

ra225/Llama-2-7b-best_ratio90_rmsnorm_finetuned

ra225/Llama-2-13b-best_ratio50_rmsnorm_finetuned

ra225/Llama-2-13b-best_ratio70_rmsnorm_finetuned

ra225/Llama-2-13b-best_ratio80_rmsnorm_finetuned

ra225/Llama-2-13b-best_ratio90_rmsnorm_finetuned

rtj1/Qwen2.5-0.5B-AWQ-FP8-Dynamic

Text Generation • 0.6B • Updated Feb 10 • 6

rtj1/Qwen2.5-0.5B-AWQ-FP8-Block

Text Generation • 0.6B • Updated Feb 10 • 6

MoNE-Pruning/DeepSeek-V2-Lite-MoNE-48-c4-1000

Text Generation • 12B • Updated Feb 28 • 2

MoNE-Pruning/DeepSeek-V2-Lite-MoNE-48-zyda2-1000

Text Generation • 12B • Updated Feb 28 • 4