Edit Models filters

Tasks

Text Generation

Image-Text-to-Text

Parameters

Libraries

Transformers.js

Apps

Inference Providers

Hardware

Add your hardware

Models

181,107

Base only

Active filters: llama.cpp

bartowski/microsoft_Phi-4-mini-instruct-GGUF

Text Generation • 4B • Updated Feb 28, 2025 • 96.3k • 42

MaziyarPanahi/Phi-4-mini-instruct-GGUF

Text Generation • 4B • Updated Mar 1, 2025 • 147k • 13

city96/umt5-xxl-encoder-gguf

6B • Updated Mar 4, 2025 • 81.2k • 176

mmnga/sarashina2.2-3b-instruct-v0.1-gguf

3B • Updated Mar 5, 2025 • 744 • 9

NoirZangetsu/Qwen2.5-3B-Flutter

Text Generation • 3B • Updated Apr 7, 2025 • 190 • 2

ggml-org/gemma-3-1b-it-GGUF

1.0B • Updated Mar 12, 2025 • 21.3k • 32

unsloth/gemma-3-1b-it-GGUF

Text Generation • 1.0B • Updated May 9, 2025 • 40.1k • 93

google/gemma-3-12b-it-qat-q4_0-gguf

Image-Text-to-Text • 12B • Updated Apr 11, 2025 • 2.68k • 285

bartowski/google_gemma-3-4b-it-GGUF

Image-Text-to-Text • 4B • Updated Mar 22, 2025 • 24.6k • 40

lmstudio-community/gemma-3-12b-it-GGUF

Image-Text-to-Text • 12B • Updated Mar 12, 2025 • 15k • 45

MaziyarPanahi/gemma-3-4b-it-GGUF

Text Generation • 4B • Updated Mar 12, 2025 • 163k • 19

google/gemma-3-4b-it-qat-q4_0-gguf

Image-Text-to-Text • 4B • Updated Apr 11, 2025 • 5.53k • 270

mradermacher/diffullama-GGUF

7B • Updated Jul 11, 2025 • 41 • 1

mradermacher/Violet-Lyra-Gutenberg-v4-GGUF

12B • Updated Jul 31, 2025 • 56 • 3

mradermacher/woollie-medicine-33b-i1-GGUF

33B • Updated Mar 22, 2025 • 34 • 1

mradermacher/politics_right_deepseek-GGUF

2B • Updated Mar 18, 2025 • 93 • 1

mradermacher/bge-large-en-v1.5-GGUF

Feature Extraction • 0.3B • Updated Jul 11, 2025 • 117 • 1

mradermacher/airoboros_none_resp_gpt-4o-mini_inst_gpt-4o_resp-GGUF

8B • Updated Jul 11, 2025 • 114 • 3

bartowski/luvGPT_phi3-uncensored-chat-GGUF

Text Generation • 4B • Updated Mar 21, 2025 • 987 • 7

tensorblock/Phi-4-mini-instruct-abliterated-GGUF

Text Generation • 4B • Updated Jan 27 • 435 • 8

unsloth/DeepSeek-V3-0324-GGUF

Text Generation • 671B • Updated May 22, 2025 • 3.99k • 200

yandex/YandexGPT-5-Lite-8B-instruct-GGUF

8B • Updated Mar 31, 2025 • 3.22k • 76

mradermacher/Llama-3.1-8B-ArliAI-Indo-Formax-v1.0-GGUF

8B • Updated 23 days ago • 519 • 1

ltgbao/Qwen-QwQ-32b-Pentest-CoT-Q8_0-GGUF

33B • Updated Mar 31, 2025 • 1 • 2

mradermacher/Llama-3.1-Omni-FinAI-8B-GGUF

8B • Updated Jul 11, 2025 • 31 • 1

unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF

Image-Text-to-Text • 108B • Updated Jun 17, 2025 • 40.5k • 157

mradermacher/Qwen2.5-VL-7B-Instruct-GGUF

8B • Updated Aug 12, 2025 • 5.7k • 5

CyrusCheungkf/git-commit-3B

Text Generation • 3B • Updated Apr 19, 2025 • 36 • 3

MaxedOut/ComfyUI-Starter-Packs

Text-to-Image • 5B • Updated Feb 27 • 3.34k • 272

mradermacher/shisa-v2-qwen2.5-32b-i1-GGUF

33B • Updated Apr 14, 2025 • 205 • 1