Models used in CI tests across llm-compressor, compressed-tensors, and vllm repositories.
-
inference-optimization/DSV4-tiny-empty
3B • Updated • 4.64k • 1 -
inference-optimization/GLM-5.2-0.8B-A0.8B
Text Generation • 0.8B • Updated • 4.93k • 4 -
inference-optimization/Llama-3.2-0.5B-Instruct
Text Generation • 0.5B • Updated • 23.8k • 1 -
inference-optimization/Qwen3-1.6B-A0.9B
Text Generation • 2B • Updated • 13.1k • 3