Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

62

Base only

Active filters: mac

brabooObrabo/Qwen3-4B-Instruct-2507-MLX-4bit-GS32-embed-8bit-GS32

Text Generation • 4B • Updated Oct 7, 2025 • 35

caiovicentino1/Qwen3.5-9B-HLWQ-MLX-4bit

Text Generation • 9B • Updated Apr 13 • 44 • 5

Outlier-Ai/Outlier-10B

Text Generation • Updated May 5 • 19 • 2

Outlier-Ai/Outlier-10B-V2

Text Generation • 8B • Updated May 5 • 17 • 1

Outlier-Ai/Outlier-40B

Text Generation • 15B • Updated May 5 • 17 • 1

mradermacher/Outlier-10B-V2-GGUF

Text Generation • 8B • Updated Apr 30 • 34 • 1

ancs21/parakeet-ctc-0.6b-vi-coreml

Automatic Speech Recognition • Updated Apr 10

Outlier-Ai/Outlier-70B-V3.2

Text Generation • Updated May 5 • 14 • 3

Outlier-Ai/Outlier-40B-V3.2

Text Generation • Updated May 5 • 17 • 1

Outlier-Ai/Outlier-150B-V3.2

Text Generation • Updated May 5 • 164 • 1

Outlier-Ai/Outlier-10B-V3.2

Text Generation • 23B • Updated May 5 • 15 • 1

Outlier-Ai/Outlier-70B-V3.3

Text Generation • Updated May 5 • 7 • 1

worthdoing/Qwen2.5-7B-Instruct-GGUF

Text Generation • 8B • Updated Apr 17 • 37

worthdoing/SmolLM2-1.7B-Instruct-GGUF

Text Generation • 2B • Updated Apr 17 • 74

worthdoing/Qwen2.5-3B-Instruct-GGUF

Text Generation • 3B • Updated Apr 17 • 103

worthdoing/Phi-4-mini-GGUF

Text Generation • 4B • Updated Apr 17 • 116

worthdoing/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • 7B • Updated Apr 17 • 72

worthdoing/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • 8B • Updated Apr 17 • 114

worthdoing/DeepSeek-R1-Distill-Qwen-7B-GGUF

Text Generation • 8B • Updated Apr 17 • 311

worthdoing/Phi-3.5-mini-instruct-GGUF

Text Generation • 4B • Updated Apr 17 • 27

worthdoing/Stablelm-2-Zephyr-1.6B-GGUF

Text Generation • 2B • Updated Apr 17 • 64

worthdoing/TinyLlama-1.1B-Chat-v1.0-GGUF

Text Generation • 1B • Updated Apr 17 • 13

worthdoing/Qwen2.5-14B-Instruct-GGUF

Text Generation • 15B • Updated Apr 17 • 36

worthdoing/Qwen3.6-35B-A3B-GGUF

Text Generation • 35B • Updated Apr 17 • 511

worthdoing/Mixtral-8x7B-Instruct-v0.1-GGUF

Text Generation • 47B • Updated Apr 17 • 441

Outlier-Ai/Outlier-Compact-14B-MLX-4bit

Text Generation • 15B • Updated May 5 • 12

Outlier-Ai/Outlier-Nano-1.7B-MLX-4bit

Text Generation • 2B • Updated May 5 • 26

Outlier-Ai/Outlier-Lite-7B-MLX-4bit

Text Generation • 8B • Updated May 5 • 11

Outlier-Ai/Outlier-Lite-7B-GGUF

Text Generation • 8B • Updated May 5 • 23

Outlier-Ai/Outlier-Compact-14B-GGUF

Text Generation • 15B • Updated May 5 • 37 • 1