RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a16 Text Generation • 19B • Updated Oct 9, 2024 • 234 • 5
RedHatAI/Phi-3-medium-128k-instruct-quantized.w4a16 Text Generation • 2B • Updated Oct 9, 2024 • 1.05k • 3
RedHatAI/Phi-3-mini-128k-instruct-quantized.w4a16 Text Generation • 0.7B • Updated Oct 9, 2024 • 41 • 1
RedHatAI/Meta-Llama-3-8B-Instruct-quantized.w8a8 Text Generation • 8B • Updated Oct 9, 2024 • 1.09k • 2
RedHatAI/Phi-3-medium-128k-instruct-quantized.w8a8 Text Generation • 14B • Updated Oct 9, 2024 • 7 • 2
RedHatAI/Phi-3-medium-128k-instruct-quantized.w8a16 Text Generation • 4B • Updated Oct 9, 2024 • 16 • 2