Edit Models filters

Model Tree

PowerInfer/SmallThinker-4BA0.6B-Instruct

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

5

Full-text search

Active filters: PowerInfer/SmallThinker-4BA0.6B-Instruct

bartowski/PowerInfer_SmallThinker-4BA0.6B-Instruct-GGUF

Text Generation • 4B • Updated Jul 28, 2025 • 198

gabriellarson/SmallThinker-4BA0.6B-Instruct-GGUF

Text Generation • 4B • Updated Jul 28, 2025 • 66 • 1

DevQuasar/PowerInfer.SmallThinker-4BA0.6B-Instruct-GGUF

Text Generation • 4B • Updated Jul 30, 2025 • 79

noctrex/SmallThinker-4B-A0.6B-Instruct-MXFP4_MOE-GGUF

Text Generation • 4B • Updated Oct 27, 2025 • 61

Edge-Quant/SmallThinker-4BA0.6B-Instruct-Q4_K_M-GGUF

Text Generation • 4B • Updated Dec 3, 2025 • 33