Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

bigcode/starcoderdata

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,073

Base only

Active filters: bigcode/starcoderdata

bal723/TinyLlama-1.1B-Chat-v1.0-openvino-4bit

Updated Mar 5, 2025 • 7

Evokipoo/salamandra-7b-Q4_K_M-GGUF

Text Generation • 8B • Updated Mar 6, 2025 • 22

harshsher/TinyLlama-1.1B-Chat

1B • Updated Mar 8, 2025

mradermacher/TinyDolphin-2.8.1-1.1b-GGUF

1B • Updated Jul 31, 2025 • 184

mradermacher/TinyDolphin-2.8.1-1.1b-i1-GGUF

1B • Updated Jul 14, 2025 • 201

Barelysociable89/TinyLlama-1.1B-Chat-v1.0-mlx-4Bit

0.2B • Updated Mar 11, 2025 • 12

mradermacher/diffullama-GGUF

7B • Updated Jul 11, 2025 • 93 • 1

mradermacher/diffullama-i1-GGUF

7B • Updated Jul 11, 2025 • 251

mradermacher/TinyDolphin-2.8.2-1.1b-laser-GGUF

1B • Updated Jul 31, 2025 • 114

mradermacher/TinyDolphin-2.8.2-1.1b-laser-i1-GGUF

1B • Updated Jul 14, 2025 • 86

mradermacher/TinyDolphin-2.8.2-1.1b-GGUF

1B • Updated Jul 31, 2025 • 51 • 1

mradermacher/TinyDolphin-2.8.2-1.1b-i1-GGUF

1B • Updated Jul 14, 2025 • 90

RWKV/RWKV7-Goose-World-PTH

Text Generation • Updated Mar 16, 2025 • 372

lehungquangminh/TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF

1B • Updated Mar 27, 2025 • 6 • 1

lehungquangminh/TinyLlama-1.1B-Chat-v1.0-Q4_0-GGUF

1B • Updated Mar 27, 2025 • 6

hollywoodfrancis/LopezLLM

Text Generation • Updated Mar 28, 2025 • 35

fbaldassarri/openlm-research_open_llama_3b_v2-autoround-int4-gs128-asym

Text Generation • 0.6B • Updated Apr 1, 2025 • 9

fbaldassarri/openlm-research_open_llama_3b_v2-autoround-int4-gs128-sym

Text Generation • 0.6B • Updated Apr 1, 2025 • 8

fbaldassarri/openlm-research_open_llama_3b_v2-autogptq-int4-gs128-asym

Text Generation • 3B • Updated Apr 1, 2025 • 11

fbaldassarri/openlm-research_open_llama_3b_v2-autogptq-int4-gs128-sym

Text Generation • 3B • Updated Apr 1, 2025 • 9

fbaldassarri/openlm-research_open_llama_7b_v2-autoround-int4-gs128-asym

Text Generation • 1B • Updated Apr 1, 2025 • 8

fbaldassarri/openlm-research_open_llama_7b_v2-autoround-int4-gs128-sym

Text Generation • 1B • Updated Apr 1, 2025 • 7

fbaldassarri/openlm-research_open_llama_7b_v2-autogptq-int4-gs128-asym

Text Generation • 7B • Updated Apr 1, 2025 • 11

fbaldassarri/openlm-research_open_llama_7b_v2-autogptq-int4-gs128-sym

Text Generation • 7B • Updated Apr 1, 2025 • 13

fbaldassarri/openlm-research_open_llama_7b_v2-autoawq-int4-gs128-asym

Text Generation • 7B • Updated Apr 1, 2025 • 7

fbaldassarri/openlm-research_open_llama_7b_v2-autoawq-int4-gs128-sym

Text Generation • 7B • Updated Apr 1, 2025 • 7

mradermacher/TinyLlama-1.1B-Instruct-GGUF

1B • Updated Apr 1, 2025 • 17

fbaldassarri/openlm-research_open_llama_3b_v2-autoround-int4-gs64-asym

Text Generation • 0.7B • Updated Apr 1, 2025 • 8

fbaldassarri/openlm-research_open_llama_3b_v2-autoround-int4-gs64-sym

Text Generation • 0.7B • Updated Apr 1, 2025 • 9

fbaldassarri/openlm-research_open_llama_3b_v2-autogptq-int4-gs64-asym

Text Generation • 3B • Updated Apr 1, 2025 • 10