Hugging Face's logo

QuantTrio
/
DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Lite

Text Generation
Transformers
Safetensors
deepseek_v3
DeepSeek-R1-0528
GPTQ
Int4-Int8Mix
量化修复
vLLM
conversational
custom_code
text-generation-inference
4-bit precision
gptq
Model card Files
xet
 Community
1

Can you provide benchmark result of this model

#1
by oliver0102 - opened
Discussion
oliver0102

To compare performance loss compared with original one.
JunHowie
 QuantTrio org

We are preparing another higher quality version and have not yet conducted complete testing
JunHowie
 QuantTrio org

https://huggingface.co/QuantTrio/DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Compact

Sign up or log in to comment