Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
RedHatAI
/
DeepSeek-R1-Distill-Llama-8B-quantized.w8a8
like
2
Follow
Red Hat AI
1.96k
Text Generation
Transformers
Safetensors
llama
deepseek
int8
vllm
llmcompressor
conversational
text-generation-inference
8-bit precision
compressed-tensors
arxiv:
2210.17323
License:
mit
Model card
Files
Files and versions
xet
Community
1
Deploy
Use this model
How run this in Google Collab ?
#1
by
Blockace
- opened
Mar 24, 2025
Discussion
Blockace
Mar 24, 2025
I want to run this model in google Collab. So how I integrate this?
See translation
Blockace
changed discussion status to
closed
Mar 24, 2025
Blockace
changed discussion status to
open
Mar 24, 2025
Edit
Preview
Upload images, audio, and videos by dragging in the text input, pasting, or
clicking here
.
Tap or paste here to upload images
Comment
·
Sign up
or
log in
to comment
