Henkie Tenkie

HenkTenk's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in Qwen/Qwen3.6-27B-FP8 9 days ago

Garbage output

👍 2

6

#8 opened 9 days ago by

andylele

New activity in QuantTrio/Qwen3.6-35B-A3B-AWQ 13 days ago

PPLX or KLD, or other benchmark

1

#4 opened 13 days ago by

HenkTenk

New activity in cyankiwi/Qwen3.6-35B-A3B-AWQ-4bit 13 days ago

How does this compare to the original 8bit qwen quant and the 4 bit auto-round quant?

2

#5 opened 15 days ago by

sparx3

liked 3 models 2 months ago

cyankiwi/Qwen3.5-122B-A10B-AWQ-4bit

Image-Text-to-Text • 24B • Updated Mar 26 • 82.6k • 32

cyankiwi/Qwen3.5-27B-AWQ-BF16-INT4

Image-Text-to-Text • 28B • Updated 23 days ago • 24.2k • 49

cyankiwi/Qwen3.5-35B-A3B-AWQ-4bit

Image-Text-to-Text • 37B • Updated Mar 26 • 538k • 39

New activity in cyankiwi/GLM-4.6V-AWQ-4bit 2 months ago

Can't seem to correctly generate structured output

17

#3 opened 5 months ago by

kldzj

liked a model 3 months ago

cyankiwi/GLM-4.6V-AWQ-4bit

Image-Text-to-Text • 19B • Updated Jan 13 • 1.82k • 12

New activity in cyankiwi/GLM-4.5-Air-AWQ-4bit 3 months ago

Running on 6 GPUs

🤗 1

4

#10 opened 6 months ago by

0xSero

KV Cache per token and Doubling the context size

3

#12 opened 4 months ago by

HenkTenk

New activity in cyankiwi/Devstral-2-123B-Instruct-2512-AWQ-4bit 5 months ago

Unable to use on 4x3090

3

#4 opened 5 months ago by

marutichintan

New activity in cyankiwi/GLM-4.5-Air-AWQ-4bit 5 months ago

Running on 4 GPUs with TP=4

3

#11 opened 5 months ago by

nephepritou

New activity in cyankiwi/Devstral-2-123B-Instruct-2512-AWQ-4bit 5 months ago

Duplicate files

➕ 1

7

#3 opened 5 months ago by

darkstar3537

New activity in cyankiwi/GLM-4.5V-AWQ-4bit 8 months ago

vLLM v0.10.2 won't start

2

#1 opened 8 months ago by

HenkTenk

New activity in cyankiwi/GLM-4.5-Air-AWQ-4bit 8 months ago

Improved useability

2

#7 opened 8 months ago by

HenkTenk

New activity in gghfez/c4ai-command-a-03-2025-AWQ 8 months ago

Newest vLLM produces nonsense with longer context

4

#1 opened 8 months ago by

HenkTenk

liked a model 8 months ago

cyankiwi/GLM-4.5-Air-AWQ-4bit

Text Generation • 19B • Updated Jan 13 • 4.42k • 28

New activity in cyankiwi/GLM-4.5-Air-AWQ-4bit 8 months ago

Does this actually work with VLLM?

32

#1 opened 9 months ago by

sirus