Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

21,832

Full-text search

Active filters: llama-cpp

Tesslate/OmniCoder-9B-GGUF

9B • Updated 1 day ago • 2.7k • 55

LocoreMind/LocoOperator-4B

Text Generation • 4B • Updated 17 days ago • 17k • 287

ruv/ruvltra-claude-code

Text Generation • 0.5B • Updated Jan 20 • 10.9k • 139

jinaai/jina-embeddings-v5-text-small-text-matching

Sentence Similarity • 0.6B • Updated 11 days ago • 15.8k • 10

jwest33/qwen3.5-9b-null-space-abliterated-GGUF

9B • Updated 10 days ago • 20.6k • 17

AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF

Text Generation • 8B • Updated Jun 4, 2025 • 608 • 145

jinaai/jina-embeddings-v5-text-small-retrieval

Sentence Similarity • 0.6B • Updated 11 days ago • 161k • 16

ggml-org/Qwen2.5-Coder-1.5B-Q8_0-GGUF

Text Generation • 2B • Updated Oct 28, 2024 • 5.19k • 17

jwest33/qwen3.5-4b-gabliterated-GGUF

4B • Updated 4 days ago • 1.5k • 3

ghost-actual/Qwen3.5-4B-Claude-Opus-4.6-Distilled-heretic

Text Generation • 5B • Updated 6 days ago • 1.12k • 3

ghost-actual/Qwen3.5-27B-Claude-Opus-4.6-Distilled-heretic-GGUF

Text Generation • 27B • Updated 6 days ago • 810 • 3

Sumitc13/sarvam-30b-GGUF

32B • Updated 5 days ago • 2.18k • 3

itlwas/Qwen2.5-Coder-7B-Q4_K_M-GGUF

Text Generation • 8B • Updated Dec 20, 2024 • 5.87k • 2

jwest33/ministral-3-3b-instruct-2512-null-space-abliterated-GGUF

Image-Text-to-Text • 4B • Updated Jan 21 • 547 • 3

LocoreMind/LocoOperator-4B-GGUF

4B • Updated 17 days ago • 2.96k • 11

InquiringMinds-AI/LongCat-Flash-Lite-GGUF

Text Generation • 69B • Updated 10 days ago • 1.22k • 5

HeYujie/Qwen3.5-35B-A3B-abliterated-GGUF

Image-Text-to-Text • 35B • Updated 9 days ago • 5.79k • 9

Ex0bit/Qwen3.5-PRISM-Dynamic-Quant-GGUF

Text Generation • 0.8B • Updated 11 days ago • 3.19k • 6

EganAI/qwen3.5-9b-terminal-merge

Text Generation • 9B • Updated 7 days ago • 3.28k • 14

Abhiray/Qwen3.5-9B-Abliterated-Claude-4.6-Opus-Reasoning-Distilled-GGUF

9B • Updated 5 days ago • 734 • 2

Anoxiom/Sujet-Finance-8B-v0.1-Q6_K-GGUF

Text Generation • 8B • Updated Apr 23, 2024 • 10 • 2

joshnader/Phi-3-mini-4k-instruct-Q8_0-GGUF

Text Generation • 4B • Updated Jul 3, 2024 • 42 • 1

Ransss/Pantheon-RP-1.5-12b-Nemo-Q8_0-GGUF

12B • Updated Aug 4, 2024 • 4 • 1

ggml-org/Meta-Llama-3.1-8B-Instruct-Q4_0-GGUF

Text Generation • 8B • Updated Sep 2, 2024 • 1.47k • 14

hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Sep 25, 2024 • 27.6k • 27

WSDW/Qwen2.5-7B-Instruct-Uncensored-Q4_K_M-GGUF

Text Generation • 8B • Updated Oct 6, 2024 • 7.56k • 2

noxinc/bitnet_b1_58-large-Q5_K_M-GGUF

0.7B • Updated Oct 20, 2024 • 12 • 1

yemiao2745/Qwen2.5-14B-Instruct-Uncensored-Q4_K_M-GGUF

15B • Updated Nov 23, 2024 • 774 • 5

matrixportalx/Llama-3.2-3B-Instruct-uncensored-Q3_K_M-GGUF

4B • Updated Dec 3, 2024 • 98 • 1

Hack337/WavGPT-2-Q8_0-GGUF

Text Generation • 8B • Updated Feb 18, 2025 • 12 • 3