Hyper-AI/gemma-4-31B-it-fp8
Image-Text-to-Text • 31B • Updated • 14 • 2
gemma-4-fp8
fp8 quant for gemma-4 models, nearly half memory decrease, speedup 30%, vllm serve can run
fp8 quant for gemma-4 models, nearly half memory decrease, speedup 30%, vllm serve can run