RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16 Text Generation • 8B • Updated 2 days ago • 56.7k • 30
RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic Text Generation • 8B • Updated 2 days ago • 40.2k • 9
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8 Text Generation • 8B • Updated 2 days ago • 18.7k • 20
RedHatAI/Mistral-Small-24B-Instruct-2501-quantized.w4a16 Text Generation • 24B • Updated 2 days ago • 422 • 1
RedHatAI/granite-3.1-8b-instruct-quantized.w4a16 Text Generation • 8B • Updated 2 days ago • 1.16k • 1