Intel Neural Compressor

INC4AI

·

AI & ML interests

AI & ML interests

Recent Activity

updated a model 6 days ago

INC4AI/MiMo-V2.5-Pro-int4-mixed

updated a model 8 days ago

LeaderboardModel1/Qwen3.8-27B-AutoRound-W4A16-v2

published a model 8 days ago

LeaderboardModel1/Qwen3.8-27B-AutoRound-W4A16-v2

View all activity

Organizations

INC4AI 's models 71

INC4AI/DeepSeek-R1_mxfp8

INC4AI/DeepSeek-V2-Lite-Chat-FP8-STATIC-ATTN-TEST-ONLY

16B • Updated Jan 7 • 17

INC4AI/DeepSeek-V2-Lite-Chat-BF16-FP8-STATIC-FP8-KV-TEST-ONLY

16B • Updated Dec 29, 2025 • 313

INC4AI/DeepSeek-V2-Lite-Chat-Block-wise-FP8-Test-Only

16B • Updated Dec 29, 2025 • 11

INC4AI/Qwen3-8B-w2g64-AutoRound-test

2B • Updated Dec 23, 2025 • 3 • 1

INC4AI/Qwen3-235B-A22B-W4A16-G128-AutoRound-ITERS200-LLMC-TEST-ONLY

32B • Updated Dec 19, 2025 • 6

INC4AI/Qwen3-235B-A22B-W4A16-G128-AutoRound-ITERS1-LLMC-TEST-ONLY

Updated Dec 19, 2025

INC4AI/Qwen2.5-0.5B-W4A16-G128-AutoRound-LLMC-TEST-ONLY

Updated Dec 5, 2025

INC4AI/Ling-flash-2.0-gguf-q2ks-mixed-AutoRound

103B • Updated Oct 30, 2025 • 31 • 9

INC4AI/GLM-4.6-gguf-q2ks-mixed-AutoRound

357B • Updated Oct 24, 2025 • 27 • 6

INC4AI/DeepSeek-V3.1-Terminus-gguf-q2ks-mixed-AutoRound

671B • Updated Sep 25, 2025 • 22 • 6

INC4AI/DeepSeek-V3.1-Terminus-int4-mixed-AutoRound

Text Generation • 2B • Updated Sep 23, 2025 • 33 • 4

INC4AI/gpt-oss-20b-int4-g64-AutoRound

2B • Updated Sep 9, 2025 • 5

INC4AI/Seed-OSS-36B-Instruct-int4-AutoRound

2B • Updated Sep 1, 2025 • 5.15k • 14

INC4AI/Qwen2.5-VL-7B-Instruct-int4-mixed-AutoRound

2B • Updated Aug 25, 2025 • 11 • 1

INC4AI/GLM-4.5V-int4-AutoRound

2B • Updated Aug 15, 2025 • 9 • 14

INC4AI/Qwen3-Coder-480B-A35B-Instruct-gguf-q2ks-mixed-AutoRound

480B • Updated Jul 28, 2025 • 26 • 14

INC4AI/Qwen3-235B-A22B-Instruct-2507-gguf-q4km-AutoRound

235B • Updated Jul 24, 2025 • 23 • 8

INC4AI/neural-chat-7b-v3

Text Generation • 7B • Updated Nov 14, 2024 • 114 • 67

INC4AI/Qwen2-7B-int4-inc

Text Generation • 2B • Updated Oct 24, 2024 • 17 • 6

INC4AI/phi-2-int4-inc

Text Generation • 0.6B • Updated Oct 22, 2024 • 20 • 4

INC4AI/falcon-7b-int4-inc

Text Generation • 7B • Updated Aug 26, 2024 • 12

INC4AI/gemma-2b-int4-inc

Text Generation • 3B • Updated Aug 26, 2024 • 16 • 1

INC4AI/neural-chat-7b-v3-1-int4-inc

Text Generation • 7B • Updated Aug 26, 2024 • 28 • 2

INC4AI/neural-chat-7b-v3-3-int4-inc

Text Generation • 7B • Updated Aug 26, 2024 • 15 • 2

INC4AI/Qwen2-0.5B-Instuct-int4-inc

Text Generation • 0.6B • Updated Jun 6, 2024 • 12 • 1

INC4AI/Qwen2-1.5B-Instuct-int4-inc

Text Generation • 2B • Updated Jun 6, 2024 • 12 • 3

INC4AI/Mistral-7B-v0.1-int4-inc-lmhead

Text Generation • 1B • Updated May 29, 2024 • 14 • 1

INC4AI/falcon-7b-sq-int8-inc

Text Generation • Updated Apr 17, 2024 • 26

INC4AI/albert-base-v2-sst2-int8-static-inc

Text Classification • Updated Mar 22, 2024 • 52