Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

dynamic-quantization

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

112

Base only

Active filters: dynamic-quantization

amd/Llama-3.1-8B-Instruct-da8w8-torchao-v0.16.0

Text Generation • Updated Apr 30 • 28 • 1

amd/Qwen2.5-VL-7B-Instruct-da8w8-torchao-v0.16.0

Image-Text-to-Text • Updated May 4 • 14

amd/Phi-4-da8w8-torchao-v0.16.0

Text Generation • Updated May 4 • 15

amd/Qwen3-14B-Instruct-da8w8-torchao-v0.16.0

Text Generation • Updated May 4 • 26

WaveCut/FLUX.2-klein-9B-SDNQ-float4_e4m0fnu-dynamic-th0p01-svd-r128-s32

Text-to-Image • 6B • Updated May 14 • 19

amd/gpt-oss-20b-BF16-da8w8-torchao-v0.17.0

Text Generation • 21B • Updated Jun 17 • 29

amd/granite-4.0-h-tiny-da8w8-torchao-v0.17.0

Text Generation • 7B • Updated Jun 17 • 17

amd/InternVL3-8B-da8w8-torchao-v0.17.0

Image-Text-to-Text • Updated May 27 • 14

amd/Mistral-7B-v0.1-da8w8-torchao-v0.17.0

Text Generation • 7B • Updated Jun 17 • 14

amd/Qwen3-30B-A3B-da8w8-torchao-v0.17.0

Text Generation • 31B • Updated May 27 • 16

amd/Qwen3-VL-8B-Instruct-da8w8-torchao-v0.17.0

Image-Text-to-Text • 9B • Updated May 27 • 15

amd/Qwen2.5-VL-7B-Instruct-da8w8-torchao-v0.17.0

Image-Text-to-Text • Updated May 27 • 12

amd/gpt-oss-20b-BF16-w8a8-llmcompressor

Text Generation • 21B • Updated 15 days ago • 931

amd/Llama-3.1-8B-Instruct-da8w8-torchao-v0.17.0

Text Generation • 8B • Updated Jun 17 • 88

amd/Qwen3.5-9B-da8w8-torchao-v0.17.0

Text Generation • 9B • Updated Jun 30 • 104

amd/Llama-3.3-70B-Instruct-da8w8-torchao-v0.17.0

Text Generation • 71B • Updated Jun 30 • 15

amd/Phi-4-reasoning-plus-da8w8-torchao-v0.17.0

Text Generation • 15B • Updated Jun 30 • 20

lvyufeng/DeepSeek-V4-Flash-IQ1_M

Text Generation • Updated Jun 4 • 1

ukint-vs/FastContext-1.0-4B-SFT-Dynamic-4bit-MLX

Text Generation • 4B • Updated Jun 15 • 43 • 2

ShadowMonarch07/madlad400-3b-mt-int8

Translation • Updated Jun 16

amd/Mixtral-8x7B-Instruct-v0.1-da8w8-torchao-v0.17.0

Text Generation • Updated Jun 22 • 11

jedisct1/Qwopus3.6-35B-A3B-Coder-oQ4-MLX

Image-Text-to-Text • 35B • Updated Jun 30 • 18

jedisct1/Qwopus3.6-35B-A3B-Coder-oQ6-MLX

Image-Text-to-Text • 35B • Updated Jun 30 • 22

jedisct1/Qwopus3.6-35B-A3B-Coder-oQ8-MLX

Image-Text-to-Text • 35B • Updated Jun 30 • 13

amd/Mixtral-8x7B-Instruct-v0.1-w8a8-llmcompressor-v0.10.0.2

Text Generation • 47B • Updated Jul 24 • 1.19k

MarkChen1214/cohere-transcribe-03-2026-MLX-Mixed-2bit3bit4bit

Automatic Speech Recognition • 2B • Updated Jul 18 • 19 • 1

MarkChen1214/cohere-transcribe-arabic-07-2026-MLX-Mixed-2bit3bit4bit

Automatic Speech Recognition • 2B • Updated Jul 18 • 60 • 1

amd/gemma-4-12B-it-w8a8-llmcompressor

Text Generation • 12B • Updated Aug 6 • 369

amd/Phi-4-reasoning-plus-w8a8-llmcompressor

Text Generation • 15B • Updated Aug 5 • 440

aoiandroid/distil-whisper-large-v3-litert-fp8

Automatic Speech Recognition • Updated Jul 26