Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

23,913

Base only

Active filters: llama-cpp

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated 2 days ago • 6.32k • 21

RavichandranJ/Dolphin3-Cyber-8B-GGUF

Text Generation • 8B • Updated 7 days ago • 8.61k • 21

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 49.5k • 718

barozp/Qwen3.6-28B-REAP20-A3B-GGUF

Text Generation • 28B • Updated Apr 19 • 9.33k • 33

Tesslate/OmniCoder-9B-GGUF

9B • Updated Mar 12 • 11.6k • 307

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated 5 days ago • 8.77k • 97

spiritbuun/buun-Qwen3.6-chat_template

Updated 18 days ago • 45

prism-ml/Ternary-Bonsai-1.7B-gguf

Text Generation • 2B • Updated 5 days ago • 2.04k • 22

Tivaphraen/granite-4.1-8b-Claude-Opus-4.6-Thinking-MAX-gguf

Text Generation • 9B • Updated 7 days ago • 633 • 3

EganAI/qwen3.5-9b-terminal-merge

Text Generation • 9B • Updated Mar 17 • 257 • 17

prism-ml/Bonsai-4B-gguf

Text Generation • 4B • Updated Apr 18 • 6.18k • 48

sillykiwi/Qwen3-4B-Cybersecurity-Heretic-16bit-Q4_K_M-GGUF

Text Generation • 4B • Updated Apr 3 • 407 • 4

deadbydawn101/gemma-4-E4B-Agentic-Opus-Reasoning-GeminiCLI-GGUF

Text Generation • 8B • Updated Apr 16 • 4.24k • 17

NidAll/supergemma4-e4b-abliterated-Q4_K_M-GGUF

Text Generation • 8B • Updated Apr 17 • 2.19k • 22

Youssofal/Kimi-K2.6-Abliterated-Heretic-GGUF

Text Generation • Updated Apr 21 • 19

rico03/Qwen3.6-27B-Claude-Opus-Reasoning-Distilled-GGUF

Text Generation • 27B • Updated Apr 23 • 15.5k • 46

FinnTheAI/Kimi-K2.6-SmartQuant-GGUF

Text Generation • 1T • Updated 7 days ago • 1.27k • 2

gaston-parravicini/LFM2.5-8B-A1B-Uncensored-Gaston-GGUF

Text Generation • 8B • Updated 16 days ago • 3.02k • 13

prithivMLmods/Holo-3.1-9B-GGUF

Image-Text-to-Text • 9B • Updated 13 days ago • 31.2k • 6

pjsmith/Qwen3.6-35B-A3B-2.6763bpw.gguf

35B • Updated 8 days ago • 709 • 3

ijohn07/harness-1-Q4_K_M-GGUF

Text Generation • 21B • Updated 6 days ago • 565 • 2

ThePradip/minicpm5-1b-kids-storyteller-GGUF

Text Generation • 1B • Updated 1 day ago • 510 • 2

FlameF0X/Apodex-1.0-mini-Q4_K_M-GGUF

Text Generation • 36B • Updated 3 days ago • 158 • 2

LeroyDyer/Mixtral_AI_Cyber_Dolphin-Q4_K_M-GGUF

7B • Updated Aug 26, 2024 • 19 • 2

ggml-org/Meta-Llama-3.1-8B-Instruct-Q4_0-GGUF

Text Generation • 8B • Updated Sep 2, 2024 • 5.71k • 15

RagnarokChan/Qwen2.5-3B-Instruct-Q4_0-GGUF

Text Generation • 3B • Updated Sep 22, 2024 • 37 • 1

ShabaHu/Qwen2.5-0.5B-Instruct-Q4_0-GGUF

Text Generation • 0.5B • Updated Sep 24, 2024 • 32 • 1

argearriojas/Phi-3.5-mini-instruct-Q4_0-GGUF

Text Generation • Updated Sep 27, 2024 • 67 • 1

lahirum/Llama-3.2-3B-Instruct-Q4_0-GGUF

Text Generation • 3B • Updated Oct 23, 2024 • 729 • 1

HuggingFaceTB/SmolLM2-360M-Instruct-GGUF

0.4B • Updated Oct 31, 2024 • 7.33k • 46