louisguthmann/qwen3.5-2b-shellcommand-linux-gguf

Qwen3.5-2B ShellCommand-Linux GGUF

This repository contains merged GGUF exports of the current best Qwen3.5-2B ShellCommand-Linux LoRA.

Source

• adapter source: https://huggingface.co/louisguthmann/qwen3.5-2b-shellcommand-linux-lora
• GitHub repo: https://github.com/GuthL/bitnet-nl2sh

Files

• Qwen3.5-2B-shellcommand-linux-F16.gguf
• Qwen3.5-2B-shellcommand-linux-Q4_K_M.gguf
• Qwen3.5-2B-shellcommand-linux-Q4_K_S.gguf

Inherited Eval Snapshot

These metrics come from the source LoRA adapter before GGUF quantization.

• score: 276.5033
• verifier ok rate: 0.7750
• verifier command rate: 0.7604
• verifier ask rate: 0.7500
• verifier cannot rate: 1.0000
• exact any-exact rate: 0.2500
• exact parse-ok rate: 0.9800

Recommended Deployment Variants

• Q4_K_M: safer default if you want more quality headroom
• Q4_K_S: leaner option if memory or latency is tighter

CX23 Benchmarking

See the GitHub docs for the exact benchmark commands used for llama.cpp on Hetzner CX23.