Inference Optimization

community

AI & ML interests

None defined yet.

Recent Activity

ChibuUkachi published a model about 3 hours ago

inference-optimization/MiniMax-M2.5.w8a8

kylesayrs updated a model about 4 hours ago

inference-optimization/DeepSeek-V4-Flash-FP8-NVFP4

kylesayrs published a model about 4 hours ago

inference-optimization/DeepSeek-V4-Flash-FP8-NVFP4

View all activity

inference-optimization 's models 327

inference-optimization/Qwen3-30B-A3B-6.5-bits-mode-hybrid-per-tensor

25B • Updated 7 days ago • 31

inference-optimization/Qwen3-30B-A3B-6.5-bits-mode-heuristic-per-tensor

25B • Updated 7 days ago • 34

inference-optimization/Qwen3-30B-A3B-6-bits-mode-noise-per-tensor

23B • Updated 7 days ago • 30

inference-optimization/Qwen3-30B-A3B-6-bits-mode-hybrid-per-tensor

23B • Updated 7 days ago • 27

inference-optimization/Qwen3-30B-A3B-6-bits-mode-heuristic-per-tensor

23B • Updated 7 days ago • 47

inference-optimization/Qwen3-30B-A3B-5.5-bits-mode-noise-per-tensor

21B • Updated 7 days ago • 32

inference-optimization/Qwen3-30B-A3B-5.5-bits-mode-hybrid-per-tensor

21B • Updated 7 days ago • 33

inference-optimization/Qwen3-30B-A3B-5.5-bits-mode-heuristic-per-tensor

21B • Updated 7 days ago • 28

inference-optimization/Qwen3-30B-A3B-5-bits-mode-noise-per-tensor

19B • Updated 7 days ago • 31

inference-optimization/Qwen3-30B-A3B-5-bits-mode-hybrid-per-tensor

19B • Updated 7 days ago • 31

inference-optimization/Qwen3-30B-A3B-5-bits-mode-heuristic-per-tensor

19B • Updated 7 days ago • 48

inference-optimization/Qwen3-8B-7-bits-mode-noise-per-tensor

6B • Updated 7 days ago • 22

inference-optimization/Qwen3-8B-7-bits-mode-hybrid-per-tensor

7B • Updated 7 days ago • 22

inference-optimization/Qwen3-8B-7-bits-mode-heuristic-per-tensor

7B • Updated 7 days ago • 21

inference-optimization/Qwen3-8B-6.5-bits-mode-noise-per-tensor

6B • Updated 7 days ago • 22

inference-optimization/Qwen3-8B-6.5-bits-mode-hybrid-per-tensor

7B • Updated 7 days ago • 19

inference-optimization/Qwen3-8B-6.5-bits-mode-heuristic-per-tensor

7B • Updated 7 days ago • 21

inference-optimization/Qwen3-8B-6-bits-mode-noise-per-tensor

6B • Updated 7 days ago • 22

inference-optimization/Qwen3-8B-6-bits-mode-hybrid-per-tensor

6B • Updated 7 days ago • 20

inference-optimization/Qwen3-8B-6-bits-mode-heuristic-per-tensor

6B • Updated 7 days ago • 24

inference-optimization/Qwen3-8B-5.5-bits-mode-noise-per-tensor

6B • Updated 7 days ago • 24

inference-optimization/Qwen3-8B-5.5-bits-mode-hybrid-per-tensor

6B • Updated 7 days ago • 21

inference-optimization/Qwen3-8B-5.5-bits-mode-heuristic-per-tensor

6B • Updated 7 days ago • 21

inference-optimization/Qwen3-8B-5-bits-mode-noise-per-tensor

6B • Updated 7 days ago • 21

inference-optimization/Qwen3-8B-5-bits-mode-hybrid-per-tensor

6B • Updated 7 days ago • 27

inference-optimization/Qwen3-8B-5-bits-mode-heuristic-per-tensor

6B • Updated 7 days ago • 22

inference-optimization/Llama-3.1-8B-Instruct-7-bits-mode-noise-per-tensor

7B • Updated 7 days ago • 23

inference-optimization/Llama-3.1-8B-Instruct-7-bits-mode-hybrid-per-tensor

7B • Updated 7 days ago • 21

inference-optimization/Llama-3.1-8B-Instruct-7-bits-mode-heuristic-per-tensor

7B • Updated 7 days ago • 28

inference-optimization/Llama-3.1-8B-Instruct-6.5-bits-mode-noise-per-tensor

7B • Updated 7 days ago • 20