macto/Qwen-7B-awq-4layer
Updated
Sihwa Lee
macto
AI & ML interests
None yet
Recent Activity
upvoted a paper 3 months ago
ReSET: Accurate Latency-Critical NVFP4 Reasoning via Step-Aware Temperature Scaling upvoted a paper 3 months ago
Tangram: Unlocking Non-Uniform KV Cache Compression for Efficient Multi-turn LLM ServingOrganizations
None yet
macto/Qwen-7B-awq-w4-g32
Text Generation • 8B • Updated • 8
macto/Qwen-7B-awq-w4-g128
Updated
macto/exllamav2-test
Text Generation • Updated • 11
macto/marlin-test
Text Generation • Updated • 8
macto/Qwen-7B-w4-g128-gptq-marlin
Text Generation • Updated • 10
macto/trt-qwen-w4-awq
Updated
macto/Qwen-7B-w4-awq-gemv
Text Generation • 8B • Updated • 8
macto/Qwen-7B-w4-awq-QUICK
Text Generation • 8B • Updated • 7
macto/Qwen-7B-w4-gemv
Text Generation • 8B • Updated • 7
macto/Qwen-7B-GEMV
Text Generation • 8B • Updated • 9
macto/aicas-test
Text Generation • 8B • Updated • 8