Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,925

Base only

Active filters: llama-cpp

RavichandranJ/Dolphin3-Cyber-8B-GGUF

Text Generation • 8B • Updated Jun 8 • 58.2k • 164

AYI-NEDJIMI/ISO27001-Expert-1.5B-GGUF

Text Generation • 2B • Updated Feb 21 • 88 • 3

mradermacher/LocoOperator-4B-i1-GGUF

4B • Updated Feb 24 • 40 • 4

Tesslate/OmniCoder-9B-GGUF

9B • Updated Mar 12 • 7.55k • 332

sillykiwi/Qwen3-4B-Cybersecurity-Heretic-16bit-Q4_K_M-GGUF

Text Generation • 4B • Updated Apr 3 • 1.29k • 11

Verkiki/Darwin-Darwin-4B-Opus-x-gemma-4-E4B-it-The-D-08412

8B • Updated Apr 10 • 135 • 1

majentik/gemma-4-26B-A4B-RotorQuant-GGUF-Q4_K_M

Image-Text-to-Text • 25B • Updated Jul 20 • 5.58k • 5

barozp/Qwen3.6-28B-REAP20-A3B-GGUF

Text Generation • 28B • Updated Apr 19 • 13.6k • 73

ShadowOkami/gemma-4-E2B-it-Uncensored-MAX-Q4_K_M-GGUF

Any-to-Any • 5B • Updated Apr 24 • 501 • 4

brunopio/Qwen3.5-14B-A3B-Claude-4.6-Opus-Reasoning-Distilled-reap-Q4_K_M-GGUF

Text Generation • 14B • Updated May 26 • 7.54k • 18

Abiray/Qwen3.6-27B-AEON-Ultimate-Uncensored-GGUF

Text Generation • 27B • Updated Apr 27 • 3.69k • 19

GestaltLabs/Ornstein-Hermes-3.6-27B-SABER-GGUF

Text Generation • 27B • Updated Apr 28 • 14.1k • 20

QuantLLM/SmolLM2-135M-GGUF

0.1B • Updated Apr 29 • 161 • 1

akpsahan/AceReason-Nemotron-14B-Q4_K_M-GGUF

Text Generation • 15B • Updated May 12 • 8.24k • 1

GreyManul/MiniMax-M2.7-Abliterated-Heretic-GGUF-UD

Text Generation • 229B • Updated May 16 • 169 • 1

spiritbuun/Nemotron-Labs-Diffusion-14B-Q8_0-GGUF

Text Generation • 14B • Updated May 20 • 89 • 11

torchsnow/Ministral-3-8B-Uncensored-Q5_K_S-GGUF

Image-to-Text • 8B • Updated May 23 • 500 • 1

LocalAI-io/privacy-filter-GGUF

Token Classification • 1B • Updated Jun 18 • 291 • 4

nascenia/Gemma3-9B-Instruct-GGUF

12B • Updated Jun 15 • 1

Ruler97/Godoter-27B-GGUF

Text Generation • 27B • Updated Jun 17 • 1.31k • 7

build-small-hackathon/HF-Knight-Qwen2.5-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Jun 15 • 47 • 1

BoneMangler/Qwen3-Coder-42B-A3B-Instruct-TOTAL-RECALL-MASTER-CODER-M-512k-ctx-W4A16-Q8_0-GGUF

Text Generation • 42B • Updated Jun 17 • 60 • 1

prithivMLmods/lift-GGUF

Image-Text-to-Text • 9B • Updated Jun 19 • 2.3k • 7

Kraekin/Gemma-4-26B-A4B-StyleTune-V2-Q4_K_M-GGUF

Text Generation • 26B • Updated Jun 20 • 202 • 2

mitkox/rlm-qwen3-8b-v0.1-Q4_K_M-GGUF

8B • Updated Jun 22 • 1.51k • 3

wepiqx/ASHQ1

Text Generation • Updated Jul 1 • 4

BennyDaBall/Krea-2-Engineer-V1-GGUF

Text Generation • 4B • Updated 15 days ago • 3.93k • 34

fisher046/granite-embedding-311m-multilingual-r2-Q8_0-GGUF

Feature Extraction • 0.3B • Updated Jul 2 • 52 • 1

livadies/Bonsai-27B-Android-Local

Text Generation • 27B • Updated Jul 15 • 722 • 5

zenmagnets/Nemotron-3-Embed-1B-Q4_K_M-GGUF

Sentence Similarity • 1B • Updated Jul 17 • 75.4k • 5