RedHatAI/DeepSeek-R1-Distill-Qwen-32B-FP8-dynamic Text Generation • 33B • Updated Feb 27, 2025 • 12k • 10
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w4a16 Text Generation • 11B • Updated Feb 27, 2025 • 9.48k • 5
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w8a8 Text Generation • 71B • Updated Feb 27, 2025 • 239 • 2
RedHatAI/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic Text Generation • 71B • Updated Feb 27, 2025 • 10.3k • 10
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w4a16 Text Generation • 2B • Updated Feb 27, 2025 • 514
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w8a8 Text Generation • 8B • Updated Feb 27, 2025 • 3.9k • 2
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w4a16 Text Generation • 71B • Updated Feb 12, 2025 • 3.3k • 32
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a8 Text Generation • 71B • Updated Feb 11, 2025 • 2.53k • 21
RedHatAI/whisper-large-v2-W4A16-G128 Automatic Speech Recognition • 0.3B • Updated Jan 31, 2025 • 18 • 1
RedHatAI/DeepSeek-Coder-V2-Instruct-0724-quantized.w4a16 Text Generation • 32B • Updated Jan 12, 2025 • 13 • 1
RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-quantized.w8a8 Text Generation • 71B • Updated Jan 3, 2025 • 4
RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-quantized.w4a16 Text Generation • 11B • Updated Jan 3, 2025 • 2