RedHatAI/Inkling-Small
Image-Text-to-Text • 266B • Updated • 89
AI & ML interests
OpenSource and AI
Recent Activity
View all activity
Papers
SNLP: Layer-Parallel Inference via Structured Newton Corrections
S2D2: Fast Decoding for Diffusion LLMs via Training-Free Self-Speculation
RedHatAI/Kimi-K3
Image-Text-to-Text • 2.8T • Updated • 36
RedHatAI/Mistral-Small-4-119B-2603-speculator.dspark
2B • Updated • 22
RedHatAI/Qwen3.6-35B-A3B-speculator.dspark
1.0B • Updated • 303 • 8
RedHatAI/Qwen2.5-7B-Instruct-quantized.w4a16
Text Generation • 8B • Updated • 432 • 1
RedHatAI/QwQ-32B-quantized.w8a8
33B • Updated • 171
RedHatAI/pixtral-12b-quantized.w4a16
Image-Text-to-Text • 13B • Updated • 483 • 1
RedHatAI/Qwen2.5-VL-72B-Instruct-quantized.w4a16
Image-Text-to-Text • 73B • Updated • 235 • 8
RedHatAI/Qwen2.5-VL-3B-Instruct-quantized.w4a16
Image-Text-to-Text • 4B • Updated • 243 • 4
RedHatAI/Pixtral-Large-Instruct-2411-hf-quantized.w4a16
Image-Text-to-Text • 124B • Updated • 47
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w4a16
Text Generation • 2B • Updated • 287 • 1
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w4a16
Text Generation • 71B • Updated • 887 • 6
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w4a16
Text Generation • 33B • Updated • 1.31k • 5
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w4a16
Text Generation • 15B • Updated • 260 • 1
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w8a8
Text Generation • 15B • Updated • 292 • 2
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16
Text Generation • 8B • Updated • 291 • 2
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w4a16
Text Generation • 8B • Updated • 407
RedHatAI/Mistral-Small-24B-Instruct-2501-quantized.w4a16
Text Generation • 24B • Updated • 548 • 2
RedHatAI/Qwen2-VL-72B-Instruct-quantized.w4a16
Image-Text-to-Text • 73B • Updated • 32
RedHatAI/granite-3.1-8b-base-quantized.w4a16
Text Generation • 8B • Updated • 197 • 1
RedHatAI/granite-3.1-2b-base-quantized.w4a16
Text Generation • 3B • Updated • 193
RedHatAI/granite-3.1-2b-instruct-quantized.w4a16
Text Generation • 3B • Updated • 10.3k
RedHatAI/granite-3.1-8b-instruct-quantized.w4a16
Text Generation • 8B • Updated • 887 • 1
RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-quantized.w4a16
Text Generation • 71B • Updated • 187
RedHatAI/QwQ-32B-Preview-quantized.w4a16
33B • Updated • 28
RedHatAI/Mixtral-8x7B-v0.1-quantized.w4a16
47B • Updated • 203
RedHatAI/Mixtral-8x22B-v0.1-quantized.w4a16
141B • Updated • 27
RedHatAI/Llama-3.3-70B-Instruct-quantized.w4a16
Text Generation • 71B • Updated • 4.89k • 4
RedHatAI/Qwen2.5-3B-quantized.w4a16
Text Generation • 3B • Updated • 467 • 1
RedHatAI/Qwen2.5-1.5B-quantized.w4a16
Text Generation • 2B • Updated • 194