RedHatAI/phi-4-quantized.w8a8
Text Generation • 15B • Updated • 12.5k • 3
AI & ML interests
OpenSource and AI
Recent Activity
View all activity
Papers
SNLP: Layer-Parallel Inference via Structured Newton Corrections
S2D2: Fast Decoding for Diffusion LLMs via Training-Free Self-Speculation
RedHatAI/phi-4-quantized.w4a16
Text Generation • 15B • Updated • 88.6k • 5
RedHatAI/phi-4
Text Generation • 15B • Updated • 212 • 1
RedHatAI/Mistral-Small-24B-Instruct-2501
Text Generation • 24B • Updated • 66
RedHatAI/Mistral-Small-24B-Instruct-2501-quantized.w8a8
Text Generation • 24B • Updated • 15k • 2
RedHatAI/Mistral-Small-24B-Instruct-2501-FP8-dynamic
Text Generation • 24B • Updated • 5.33k • 13
RedHatAI/Mistral-Small-3.1-24B-Instruct-2503
Image-Text-to-Text • 24B • Updated • 109 • • 1
RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16
Image-Text-to-Text • 24B • Updated • 1.66k • 10
RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w8a8
Image-Text-to-Text • 24B • Updated • 1.19k • 5
RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-FP8-dynamic
Image-Text-to-Text • 24B • Updated • 80.3k • 9
RedHatAI/Llama-4-Maverick-17B-128E-Instruct-FP8
Image-Text-to-Text • 402B • Updated • 5.46k • 2
RedHatAI/Llama-4-Maverick-17B-128E-Instruct
Image-Text-to-Text • 402B • Updated • 148 • 3
RedHatAI/Llama-4-Scout-17B-16E-Instruct
Image-Text-to-Text • 109B • Updated • 7.92k
RedHatAI/Llama-4-Scout-17B-16E-Instruct-quantized.w4a16
Image-Text-to-Text • 109B • Updated • 9.04k • 13
RedHatAI/Llama-4-Scout-17B-16E-Instruct-FP8-dynamic
Image-Text-to-Text • 109B • Updated • 10.8k • 29
RedHatAI/gemma-4-12B-it-NVFP4
8B • Updated • 879
RedHatAI/gemma-4-12B-it-FP8-Dynamic
13B • Updated • 106
RedHatAI/gemma-4-31B-it-FP8-block
Image-Text-to-Text • 31B • Updated • 269k • 30
RedHatAI/Qwen3.6-27B-FP8
Image-Text-to-Text • 28B • Updated • 13.1k • 3
RedHatAI/Mistral-Small-4-119B-2603
119B • Updated • 74 • 1
RedHatAI/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4
Text Generation • 67B • Updated • 3.18k • 2
RedHatAI/NVIDIA-Nemotron-3-Ultra-550B-A55B-FP8-dynamic
Text Generation • 561B • Updated • 458 • 1
RedHatAI/gpt-oss-20b
Text Generation • 22B • Updated • 17.2k • 6
RedHatAI/NVIDIA-Nemotron-3-Ultra-550B-A55B-FP8-block
Text Generation • 561B • Updated • 33
RedHatAI/NVIDIA-Nemotron-3-Ultra-550B-A55B-quantized.w4a16
Text Generation • 565B • Updated • 746 • 3
RedHatAI/gemma-4-12B-it
Any-to-Any • 12B • Updated • 4
RedHatAI/DeepSeek-V4-Pro-BF16
Updated
RedHatAI/Kimi-K2.6-NVFP4
Updated • 20.1k • 13
RedHatAI/TinyLlama-1.1B-Chat-v1.0
1B • Updated • 17
RedHatAI/Ministral-3-14B-Instruct-2512-NVFP4
Text Generation • Updated • 590 • 2