Edit Models filters

Model Tree

nvidia/Nemotron-Mini-4B-Instruct

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

26

Base only

Active filters: nvidia/Nemotron-Mini-4B-Instruct

nvidia/Nemotron-Mini-4B-Instruct-ONNX-INT4

Updated Nov 18, 2024 • 8

NikolayKozloff/Nemotron-Mini-4B-Instruct-Q8_0-GGUF

4B • Updated Sep 13, 2024 • 33 • 2

bartowski/Nemotron-Mini-4B-Instruct-GGUF

Text Generation • 4B • Updated Sep 13, 2024 • 2.11k • 19

abiks/Nemotron-Mini-4B-Instruct-GGUF-Q8

4B • Updated Sep 14, 2024 • 9 • 3

second-state/Nemotron-Mini-4B-Instruct-GGUF

4B • Updated Aug 29, 2025 • 317 • 1

gaianet/Nemotron-Mini-4B-Instruct-GGUF

4B • Updated Sep 15, 2024 • 90

Felladrin/gguf-Q5_K_L-Nemotron-Mini-4B-Instruct

4B • Updated Sep 16, 2024 • 3

Felladrin/gguf-Q5_K_M-Nemotron-Mini-4B-Instruct

4B • Updated Sep 16, 2024 • 38

Solshine/Nemotron-Mini-4B-Instruct-Q4_K_M-GGUF

4B • Updated Sep 18, 2024 • 15

DevQuasar-5/Nemotron-Mini-4B-Instruct-GGUF

Text Generation • 4B • Updated Dec 4, 2024 • 212

WSDW/Nemotron-Mini-4B-Instruct-Q4_K_M-GGUF

4B • Updated Sep 30, 2024 • 15

jairo/Nemotron-Mini-4B-Instruct-Q4_K_M-GGUF

4B • Updated Oct 5, 2024 • 10

MaziyarPanahi/Nemotron-Mini-4B-Instruct-GGUF

Text Generation • 4B • Updated Oct 20, 2024 • 236 • 1

mradermacher/Nemotron-Mini-4B-Instruct-GGUF

4B • Updated Feb 15, 2025 • 78

mradermacher/Nemotron-Mini-4B-Instruct-i1-GGUF

4B • Updated Feb 15, 2025 • 236

performanceoptician/Nemotron-Mini-4B-Instruct-IQ4_NL-GGUF

4B • Updated Nov 26, 2024 • 17

performanceoptician/Nemotron-Mini-4B-Instruct-IQ4_XS-GGUF

4B • Updated Nov 26, 2024 • 6

mitulagr2/gguf-Q5_K_M-Nemotron-Mini-4B-Instruct

4B • Updated Jan 21, 2025 • 17

DevQuasar-7/nvidia.Nemotron-Mini-4B-Instruct-GGUF

Text Generation • 4B • Updated Feb 17, 2025 • 324 • 1

BernTheCreator/Nemotron-Mini-4B-Instruct-Q4_0-GGUF

Text Generation • 4B • Updated Mar 6, 2025 • 11

itlwas/Nemotron-Mini-4B-Instruct-Q4_K_M-GGUF

Text Generation • 4B • Updated Apr 19, 2025 • 1

tensorblock/nvidia_Nemotron-Mini-4B-Instruct-GGUF

Text Generation • 4B • Updated Jan 27 • 11

jalasoft/nemotron-mini-4B-it-ft-typ

Text Generation • Updated Dec 17, 2025 • 2

DuoNeural/NVIDIA-Nemotron-3-Nano-4B-GGUF

4B • Updated about 1 month ago • 222

mlx-community/Nemotron-Mini-4B-Instruct-4bit-mlx

0.7B • Updated 26 days ago • 347

TerraNTR/Nemotron-Mini-4B-Instruct-Q4_K_M-GGUF

Text Generation • 4B • Updated 25 days ago • 187