inference-optimization/Llama-3.2-1B-Instruct-6-bits-mode-heuristic-per-tensor
1B • Updated • 23
Inference Optimization
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
inference-optimization/Llama-3.2-1B-Instruct-5.5-bits-mode-noise-per-tensor
1B • Updated • 23
inference-optimization/Llama-3.2-1B-Instruct-5.5-bits-mode-hybrid-per-tensor
1B • Updated • 23
inference-optimization/Llama-3.2-1B-Instruct-5.5-bits-mode-heuristic-per-tensor
1B • Updated • 25
inference-optimization/Llama-3.2-1B-Instruct-5-bits-mode-noise-per-tensor
1B • Updated • 24
inference-optimization/Llama-3.2-1B-Instruct-5-bits-mode-hybrid-per-tensor
1B • Updated • 26
inference-optimization/Llama-3.2-1B-Instruct-5-bits-mode-heuristic-per-tensor
1B • Updated • 21
inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-w4a16-gptq
2B • Updated • 72
inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-w4a16-qmod
2B • Updated • 18
inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-nvfp4-qmod
5B • Updated • 21
inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-nvfp4-gptq
5B • Updated • 22
inference-optimization/Llama-3.1-8B-Instruct-quip-w4a16-gptq
2B • Updated • 20
inference-optimization/Llama-3.1-8B-Instruct-quip-w4a16-qmod
2B • Updated • 21
inference-optimization/Llama-3.1-8B-Instruct-quip-nvfp4-qmod
5B • Updated • 17
inference-optimization/Llama-3.1-8B-Instruct-quip-nvfp4-gptq
5B • Updated • 16
inference-optimization/Meta-Llama-3-8B-Instruct-W4A16_actorder_group
2B • Updated • 20
inference-optimization/old-MiniMax-M2.5.w4a16
31B • Updated • 23
inference-optimization/llama3-8b-sharegpt-5k-gen
Updated
inference-optimization/Llama-3.2-3B-Instruct-NVFP4
2B • Updated • 34
inference-optimization/Llama-3.2-3B-Instruct-FP8-Dynamic
3B • Updated • 29
inference-optimization/Llama-3.2-3B-Instruct-FP8-Block
3B • Updated • 18
inference-optimization/Llama-3.2-1B-Instruct-NVFP4
0.8B • Updated • 50
inference-optimization/Llama-3.2-1B-Instruct-FP8-Dynamic
1B • Updated • 34
inference-optimization/Llama-3.2-1B-Instruct-FP8-Block
1B • Updated • 15
inference-optimization/Qwen3-30B-A3B_5.5_bits_mode_heuristic
22B • Updated • 38
inference-optimization/Qwen3-30B-A3B_7.0_bits_mode_heuristic
27B • Updated • 41
inference-optimization/Qwen3-30B-A3B_7.0_bits_mode_noise
27B • Updated • 41
inference-optimization/Qwen3-30B-A3B_7.0_bits_mode_hybrid
25B • Updated • 39
inference-optimization/Qwen3-30B-A3B_6.5_bits_mode_heuristic
25B • Updated • 38
inference-optimization/Qwen3-30B-A3B_6.5_bits_mode_noise
25B • Updated • 41