Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

90

Base only

Active filters: vulkan

agentionai/Qwen3.8-Flash-Next-ROCmFP4-FAST-GGUF

Text Generation • 177B • Updated about 18 hours ago • 3.27k • 14

julianmb/Qwen-3.8-27B-ROCmFP4-FAST-GGUF

Text Generation • 27B • Updated 7 days ago • 26.2k • 24

agentionai/Qwen3.8-Flash-Next-ROCmFP4-FAST-imatrix-GGUF

Text Generation • 177B • Updated about 4 hours ago • 421 • 7

agentionai/Qwen3.8-27B-DFlash2-ROCmFP4-FAST-GGUF

Text Generation • 2B • Updated 4 days ago • 1.1k • 6

erayyapagci/DeepSeek-V4-Flash-IQ2XXS-TM64-Q4KAttention-v1

Text Generation • 284B • Updated 1 day ago • 363 • 2

agentionai/Qwen3.8-Flash-Next-MTP-ROCmFP4-FAST-GGUF

Text Generation • 4B • Updated 2 days ago • 312 • 2

0xSero/Qwen3.6-35B-GGUF

Text Generation • 35B • Updated May 30 • 1.98k • 26

plunderstruck/Qwen3.6-35B-A3B-MTP-ROCmFP4-GGUF

0.4B • Updated Jun 21 • 1.24k • 15

plunderstruck/Qwen3-Coder-Next-ROCmFP4-GGUF

80B • Updated Jun 21 • 138 • 4

plunderstruck/Qwable-3.6-27B-MTP-ROCmFP4-GGUF

0.5B • Updated Jun 21 • 148 • 2

jamiefutch/Qwen3.5-122B-A10B-MXFP4_MOE-MTP-GGUF

Text Generation • 125B • Updated Jul 10 • 281 • 5

pugant/Qwen3.6-35B-A3B-MTP-Q6_0_ROCMFPX

Text Generation • 36B • Updated 6 days ago • 45 • 1

vmarcelo/Qwen3.8-27B-MIX_GGUF

Text Generation • 27B • Updated 10 days ago • 13.6k • 11

cygnal/Qwen3.8-27B-heretic-ara-Q4_K_M-MTP-GGUF

Image-Text-to-Text • 27B • Updated 9 days ago • 32.6k • 7

finex666/Qwen3.8-27B-Abliterated-IQ4-MIX-MTP-GGUF

Text Generation • 27B • Updated 14 days ago • 1.92k • 2

guideboardlabs/Qwen3.8-27B-Q3-DOWN-XS-GGUF

27B • Updated 7 days ago • 285 • 1

Kindadodgy/qwen38-256k-on-16gb

Text Generation • 27B • Updated 5 days ago • 242 • 1

HoppouAI/Breeze-TTS-2.cpp

Text-to-Speech • 3B • Updated 1 day ago • 99 • 1

srdharanidharan/CyberGPT-Q4_K_M

Text Generation • 4B • Updated 1 day ago • 21 • 1

raining-codes/Gemma3-1B-LOMO-q4f16_1-MLC

Text Generation • Updated Oct 19, 2025

raining-codes/Gemma3-270M-LOMO-q4f16_1-MLC

Text Generation • Updated Oct 19, 2025 • 2

raining-codes/Qwen3-0.6B-LOMO-q4f16_1-MLC

Text Generation • Updated Oct 19, 2025 • 2

raining-codes/Qwen3-1.7B-LOMO-q4f16_1-MLC

Text Generation • Updated Oct 20, 2025 • 3

raining-codes/Qwen3-1.7B-LOMO-q4f16_1-MLC2

Text Generation • Updated Oct 21, 2025 • 1

ABBNDZ/ATTS1HG1

Text-to-Speech • 0.4B • Updated 4 days ago • 167 • 1

MarkShark2/omnivoice-onnx-kv-b1-fp16

Text-to-Speech • Updated Apr 27 • 1

clxudfast/huihui4-8b-a4b-v2-Q4_K_M

8B • Updated Apr 27 • 37 • 1

MarkShark2/flux2-klein-4b-onnx-webgpu-q4

Text-to-Image • Updated May 1

eric717273/Qwen3.5-122B-A10B-MXFP4_MOE-MTP-GGUF

Text Generation • 125B • Updated May 13 • 125 • 1

mlc911/drunet-ncnn

Image-to-Image • Updated May 19