Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,054

Base only

Active filters: quantization

vcruz305/DSV4.1-Flash-SAGE-EXL3-1.59bpw

Text Generation • 267B • Updated 3 days ago • 289 • 2

IsValorum/Iris-mini-APEX-I-MiniPlus-V1-GGUF

Text Generation • 36B • Updated about 6 hours ago • 1.69k • 2

spst01/SmolLM2-135M-Sukshma

Text Generation • Updated 5 days ago • 160 • 2

TokenAI-zer/Swift-Qwen3.8-27b-oQ4-mtp

Image-Text-to-Text • 28B • Updated about 10 hours ago • 226 • 2

r0b0tlab/Qwen3.8-27B-EXL3-4.00bpw

Image-Text-to-Text • 8B • Updated 3 days ago • 107 • 2

r0b0tlab/Qwen3.8-27B-DFlash2-EXL3-4.00bpw

Text Generation • 0.6B • Updated 3 days ago • 388 • 2

ukung/semantic-lite-2

Sentence Similarity • 0.5B • Updated 2 days ago • 94 • 2

ABDALLALSWAITI/hunyuan_video_720_cfgdistill_e5m2

Updated Feb 11, 2025 • 1

HyperX-Sentience/SDXL-GGUF

Text-to-Image • 3B • Updated Jun 24, 2025 • 1k • 18

ABDALLALSWAITI/FLUX.1-dev-ControlNet-Union-Pro-2.0-fp8

Text-to-Image • 2B • Updated Apr 19, 2025 • 4.01k • 59

169Pi/Alpie-Core

Text Generation • Updated Jun 19 • 44 • 9

drbaph/Z-Image-Turbo-FP8

Text-to-Image • Updated Nov 27, 2025 • 11k • 54

Shifusen/72B-Qwen2.5-Kunou-v1-NVFP4

Text Generation • 42B • Updated Dec 19, 2025 • 13 • 1

EricRollei/HunyuanImage-3.0-Instruct-NF4-v2

Text-to-Image • 83B • Updated Feb 22 • 221 • 7

KeinNiemand/Qwen3.5-122B-A10B-IK_GGUF

Text Generation • 122B • Updated Mar 13 • 53 • 2

KeinNiemand/Qwen3.5-122B-A10B-abliterix-IK_GGUF

Text Generation • 122B • Updated Apr 14 • 97 • 3

AsadIsmail/gemma-4-E4B-it-ternary

Image-Text-to-Text • Updated Apr 27 • 1

Abiray/Qwen3.6-35B-A3B-Q4_K_M-GGUF

Image-Text-to-Text • 35B • Updated Apr 16 • 4.88k • 24

AEON-7/Nemotron-3-Nano-Omni-AEON-Ultimate-Uncensored-NVFP4

Any-to-Any • 20B • Updated Jul 15 • 623 • 9

d-alistarh/Qwen3.5-9B-GSQ-Q3_K_M-GGUF

9B • Updated May 1 • 116 • 1

kcnpxcp/Mistral-Medium-3.5-128B-TQ3

Image-Text-to-Text • 51B • Updated May 4 • 28 • 2

Abiray/Anima-base-v1.0-GGUF

Text-to-Image • 2B • Updated May 14 • 2.01k • 13

kizuna-intelligence/Command-A-Plus-Lite

Updated May 22 • 2

InsecureErasure/Z-Image-Turbo-NVFP4

Text-to-Image • Updated Jun 4 • 767 • 3

sprapp/sprapp-smollm2-360m-ternary

Text Generation • Updated Jun 8 • 1

facebook/MobileMoE-L-QAT

Text Generation • 3B • Updated 21 days ago • 47 • 7

facebook/MobileMoE-S-QAT

Text Generation • 0.7B • Updated 21 days ago • 306 • 6

wenshutang/ternlight

Sentence Similarity • Updated Jul 9 • 9

Winnougan/Comfy-Qwen3-VL-INT8

Updated Jun 28 • 25

SC117/Agents-A1-MTP-APEX-GGUF

Text Generation • 36B • Updated Jul 4 • 1.49k • 24