Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
neuralmagic
's Collections
DeepSeek-R1-Distill Quantized
Granite 3.1 Quantization
Sparse-Llama-3.1-2of4
Vision Language Models Quantization
FP8 LLMs for vLLM
Llama-3.2 Quantization
Llama-3.1 Quantization
INT8 LLMs for vLLM
INT4 LLMs for vLLM
Sparse Foundational Llama 2 Models
Compression Papers
DeepSparse Sparse LLMs
Sparse Finetuning MPT
Compressed LLMs from the Community
Granite 3.1 Quantization
updated
Jan 24, 2025
Upvote
1
RedHatAI/granite-3.1-2b-instruct-quantized.w4a16
Text Generation
•
3B
•
Updated
Feb 28, 2025
•
28k
RedHatAI/granite-3.1-2b-instruct-quantized.w8a8
Text Generation
•
3B
•
Updated
Feb 28, 2025
•
14
RedHatAI/granite-3.1-8b-instruct-quantized.w4a16
Text Generation
•
8B
•
Updated
4 days ago
•
796
•
1
RedHatAI/granite-3.1-8b-instruct-quantized.w8a8
Text Generation
•
8B
•
Updated
4 days ago
•
302
•
2
RedHatAI/granite-3.1-2b-instruct-FP8-dynamic
Text Generation
•
3B
•
Updated
Jan 28, 2025
•
4
RedHatAI/granite-3.1-8b-instruct-FP8-dynamic
Text Generation
•
8B
•
Updated
4 days ago
•
264
•
1
RedHatAI/granite-3.1-2b-base-quantized.w4a16
Text Generation
•
3B
•
Updated
Feb 28, 2025
•
9
RedHatAI/granite-3.1-2b-base-quantized.w8a8
Text Generation
•
3B
•
Updated
Feb 28, 2025
•
8
RedHatAI/granite-3.1-8b-base-FP8-dynamic
Text Generation
•
8B
•
Updated
Feb 20, 2025
•
9
RedHatAI/granite-3.1-2b-base-FP8-dynamic
Text Generation
•
3B
•
Updated
Jan 30, 2025
•
4
RedHatAI/granite-3.1-8b-base-quantized.w4a16
Text Generation
•
8B
•
Updated
4 days ago
•
86
•
1
RedHatAI/granite-3.1-8b-base-quantized.w8a8
Text Generation
•
8B
•
Updated
Feb 28, 2025
•
11
Upvote
1
Share collection
View history
Collection guide
Browse collections