Quantized Qwen2.5-0.5B running on llama.cpp (Q4_K_M)
QuantAxis is an AI research and engineering lab...