RedHatAI/Phi-3-vision-128k-instruct-W4A16-G128
Text Generation • 4B • Updated • 52 • 1
AI & ML interests
OpenSource and AI
Recent Activity
Papers
SNLP: Layer-Parallel Inference via Structured Newton Corrections
S2D2: Fast Decoding for Diffusion LLMs via Training-Free Self-Speculation
RedHatAI/DeepSeek-R1-Llama-70B-quantized.w8a8
71B • Updated • 23 • 1
RedHatAI/pixtral-12b-FP8-dynamic
Text Generation • 13B • Updated • 1.61k • 10
RedHatAI/whisper-large-v2-W4A16-G128
Automatic Speech Recognition • 2B • Updated • 18 • 1
RedHatAI/granite-3.1-2b-base-FP8-dynamic
Text Generation • 3B • Updated • 36
RedHatAI/granite-3.1-2b-instruct-FP8-dynamic
Text Generation • 3B • Updated • 78
RedHatAI/Llama-3.2-1B-quantized.w8a8
1B • Updated • 64.5k • 1
RedHatAI/DeepSeek-Coder-V2-Instruct-0724-quantized.w4a16
Text Generation • 238B • Updated • 76 • 1
RedHatAI/DeepSeek-V2.5-1210-quantized.w4a16
Text Generation • 238B • Updated • 28
RedHatAI/DeepSeek-V2.5-1210-FP8
Text Generation • 236B • Updated • 54.7k • 4
RedHatAI/DeepSeek-Coder-V2-Instruct-0724-FP8
Text Generation • 236B • Updated • 24 • 1
RedHatAI/QwQ-32B-Preview-quantized.w8a8
Text Generation • 33B • Updated • 27
RedHatAI/QwQ-32B-Preview-FP8-dynamic
Text Generation • 33B • Updated • 34
RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-quantized.w8a8
Text Generation • 71B • Updated • 30
RedHatAI/Sparse-Llama-3.1-8B-ultrachat_200k-2of4-FP8-dynamic
Text Generation • 8B • Updated • 24 • 1
RedHatAI/Sparse-Llama-3.1-8B-evolcodealpaca-2of4-FP8-dynamic
Text Generation • 8B • Updated • 38
RedHatAI/Sparse-Llama-3.1-8B-gsm8k-2of4-FP8-dynamic
Text Generation • 8B • Updated • 95 • 3
RedHatAI/Sparse-Llama-3.1-8B-gsm8k-2of4-quantized.w4a16
Text Generation • 2B • Updated • 26
RedHatAI/Sparse-Llama-3.1-8B-ultrachat_200k-2of4-quantized.w4a16
Text Generation • 2B • Updated • 24 • 3
RedHatAI/Sparse-Llama-3.1-8B-evolcodealpaca-2of4-quantized.w4a16
Text Generation • 2B • Updated • 25
RedHatAI/Qwen2.5-14B-Instruct-quantized.w8a8
Text Generation • 15B • Updated • 71
RedHatAI/granite-3.1-8b-instruct-GGUF
8B • Updated • 6
RedHatAI/Sparse-Llama-3.1-8B-2of4
Text Generation • 8B • Updated • 146 • • 62
RedHatAI/Qwen2.5-Math-7B-Instruct-FP8-dynamic
8B • Updated • 29
RedHatAI/Qwen2.5-0.5B-Instruct-quantized.w8a8
Text Generation • 0.6B • Updated • 473
RedHatAI/Qwen2.5-72B-FP8-dynamic
Text Generation • 73B • Updated • 28 • 1
RedHatAI/Qwen2.5-72B-quantized.w8a8
Text Generation • 73B • Updated • 34
RedHatAI/Qwen2.5-14B-quantized.w8a8
Text Generation • 15B • Updated • 27 • 2
RedHatAI/Qwen2.5-14B-FP8-dynamic
Text Generation • 15B • Updated • 72 • 2
RedHatAI/Qwen2.5-7B-quantized.w8a8
Text Generation • 8B • Updated • 84 • 1