RedHatAI/Pixtral-Large-Instruct-2411-hf-quantized.w8a8
Image-Text-to-Text
•
124B
•
Updated
•
1
RedHatAI/Pixtral-Large-Instruct-2411-hf-FP8-dynamic
Image-Text-to-Text
•
124B
•
Updated
•
61
•
1
RedHatAI/Qwen2-VL-72B-Instruct-quantized.w4a16
Image-Text-to-Text
•
13B
•
Updated
•
2
RedHatAI/Qwen2-VL-72B-Instruct-FP8-dynamic
Image-Text-to-Text
•
73B
•
Updated
•
17
RedHatAI/Meta-Llama-3.1-70B-Instruct-FP8
Text Generation
•
71B
•
Updated
•
9.32k
•
50
RedHatAI/Meta-Llama-3.1-8B-FP8
Text Generation
•
8B
•
Updated
•
156k
•
10
RedHatAI/DeepSeek-V3-BF16
Text Generation
•
684B
•
Updated
•
5
•
1
RedHatAI/Mistral-7B-Instruct-v0.3-quantized.w4a16
Text Generation
•
7B
•
Updated
•
79
•
2
RedHatAI/QwQ-32B-quantized.w8a8
33B
•
Updated
•
88
RedHatAI/QwQ-32B-FP8-dynamic
Text Generation
•
33B
•
Updated
•
253
•
11
RedHatAI/Mixtral-8x7B-Instruct-v0.1-FP8
47B
•
Updated
•
1.39k
RedHatAI/Phi-4-mini-instruct-quantized.w8a8
4B
•
Updated
•
2
RedHatAI/Phi-4-mini-instruct-FP8-dynamic
4B
•
Updated
•
23
RedHatAI/Mixtral-8x7B-v0.1-quantized.w4a16
6B
•
Updated
•
53
RedHatAI/granite-3.1-2b-base-quantized.w4a16
Text Generation
•
0.5B
•
Updated
•
24
RedHatAI/granite-3.1-2b-base-quantized.w8a8
Text Generation
•
3B
•
Updated
•
7
RedHatAI/granite-3.1-8b-base-quantized.w8a8
Text Generation
•
8B
•
Updated
•
3
RedHatAI/granite-3.1-2b-instruct-quantized.w8a8
Text Generation
•
3B
•
Updated
•
57
RedHatAI/granite-3.1-2b-instruct-quantized.w4a16
Text Generation
•
0.5B
•
Updated
•
55
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w4a16
Text Generation
•
0.6B
•
Updated
•
152
•
1
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w8a8
Text Generation
•
2B
•
Updated
•
5.85k
•
2
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-FP8-dynamic
Text Generation
•
2B
•
Updated
•
6
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16
Text Generation
•
2B
•
Updated
•
3.55k
•
2
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w8a8
Text Generation
•
8B
•
Updated
•
4.3k
•
5
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-FP8-dynamic
Text Generation
•
8B
•
Updated
•
175
•
1
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w4a16
Text Generation
•
3B
•
Updated
•
1.32k
•
1
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w8a8
Text Generation
•
15B
•
Updated
•
2.06k
•
2
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-FP8-dynamic
Text Generation
•
Updated
•
161
•
3
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w4a16
Text Generation
•
6B
•
Updated
•
947
•
5
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w8a8
Text Generation
•
Updated
•
160
•
13