RedHatAI/Qwen3-4B-quantized.w4a16
Text Generation • 4B • Updated • 12.6k • 4
AI & ML interests
OpenSource and AI
Recent Activity
View all activity
Papers
SNLP: Layer-Parallel Inference via Structured Newton Corrections
S2D2: Fast Decoding for Diffusion LLMs via Training-Free Self-Speculation
RedHatAI/Qwen3-1.7B-FP8-dynamic
Text Generation • 2B • Updated • 5.88k
RedHatAI/Qwen3-1.7B-quantized.w4a16
Text Generation • 2B • Updated • 6.06k • 3
RedHatAI/Qwen3-0.6B-quantized.w4a16
Text Generation • 0.8B • Updated • 3.68k
RedHatAI/Qwen3-0.6B-FP8-dynamic
Text Generation • 0.8B • Updated • 353 • 1
RedHatAI/Qwen3-235B-A22B-FP8-dynamic
Text Generation • 235B • Updated • 55 • 2
RedHatAI/Qwen2-VL-72B-Instruct-quantized.w8a8
Image-Text-to-Text • 73B • Updated • 28
RedHatAI/Qwen2.5-VL-72B-Instruct-quantized.w8a8
Image-Text-to-Text • 73B • Updated • 81 • 1
RedHatAI/Qwen2.5-VL-3B-Instruct-quantized.w8a8
Image-Text-to-Text • 4B • Updated • 113k • 2
RedHatAI/Qwen2.5-VL-72B-Instruct-FP8-dynamic
Image-Text-to-Text • 73B • Updated • 4.38k • 15
RedHatAI/Qwen2.5-VL-3B-Instruct-FP8-dynamic
Image-Text-to-Text • 4B • Updated • 60.6k • 3
RedHatAI/whisper-large-v3-turbo-FP8-dynamic
Automatic Speech Recognition • 0.9B • Updated • 1.41k • 6
RedHatAI/whisper-large-v3-turbo-quantized.w8a8
Automatic Speech Recognition • 0.9B • Updated • 1.3k • 4
RedHatAI/whisper-large-v3-quantized.w4a16
Automatic Speech Recognition • 2B • Updated • 2.85k • 4
RedHatAI/whisper-large-v3-FP8-dynamic
Automatic Speech Recognition • 2B • Updated • 2.58k • 5
RedHatAI/whisper-large-v3-quantized.w8a8
Automatic Speech Recognition • 2B • Updated • 2.03k • 1
RedHatAI/whisper-medium-quantized.w8a8
Automatic Speech Recognition • 0.8B • Updated • 28
RedHatAI/whisper-medium-FP8-dynamic
Automatic Speech Recognition • 0.8B • Updated • 23 • 1
RedHatAI/whisper-tiny-quantized.w8a8
Automatic Speech Recognition • 57.8M • Updated • 36 • 1
RedHatAI/whisper-small-FP8-Dynamic
Automatic Speech Recognition • 0.3B • Updated • 25
RedHatAI/whisper-small-quantized.w8a8
Automatic Speech Recognition • 0.3B • Updated • 1.25k
RedHatAI/whisper-large-v2-quantized.w8a8
Automatic Speech Recognition • 2B • Updated • 29
RedHatAI/whisper-medium-quantized.w4a16
Automatic Speech Recognition • 0.8B • Updated • 23
RedHatAI/whisper-tiny-FP8-Dynamic
Automatic Speech Recognition • 57.8M • Updated • 25
RedHatAI/whisper-small-quantized.w4a16
Automatic Speech Recognition • 0.3B • Updated • 25 • 1
RedHatAI/whisper-large-v2-FP8-Dynamic
Automatic Speech Recognition • 2B • Updated • 81
RedHatAI/whisper-large-v2-quantized.w4a16
Automatic Speech Recognition • 2B • Updated • 26 • 1
RedHatAI/Qwen2.5-7B-FP8-dynamic
Text Generation • 8B • Updated • 60
RedHatAI/Qwen2.5-VL-7B-Instruct-FP8-Dynamic
Image-Text-to-Text • 8B • Updated • 9.2k • 5
RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w4a16
Image-Text-to-Text • 8B • Updated • 3.78k • 8