RedHatAI/whisper-large-v2-W4A16-G128 Automatic Speech Recognition • 2B • Updated Jan 31, 2025 • 18 • 1
RedHatAI/DeepSeek-Coder-V2-Instruct-0724-quantized.w4a16 Text Generation • 238B • Updated Jan 12, 2025 • 76 • 1
RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-quantized.w8a8 Text Generation • 71B • Updated Jan 3, 2025 • 30
RedHatAI/Sparse-Llama-3.1-8B-ultrachat_200k-2of4-FP8-dynamic Text Generation • 8B • Updated Dec 19, 2024 • 24 • 1
RedHatAI/Sparse-Llama-3.1-8B-evolcodealpaca-2of4-FP8-dynamic Text Generation • 8B • Updated Dec 19, 2024 • 38
RedHatAI/Sparse-Llama-3.1-8B-gsm8k-2of4-FP8-dynamic Text Generation • 8B • Updated Dec 19, 2024 • 95 • 3
RedHatAI/Sparse-Llama-3.1-8B-gsm8k-2of4-quantized.w4a16 Text Generation • 2B • Updated Dec 19, 2024 • 26
RedHatAI/Sparse-Llama-3.1-8B-ultrachat_200k-2of4-quantized.w4a16 Text Generation • 2B • Updated Dec 19, 2024 • 24 • 3
RedHatAI/Sparse-Llama-3.1-8B-evolcodealpaca-2of4-quantized.w4a16 Text Generation • 2B • Updated Dec 19, 2024 • 25