Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
443
20
404
John Leimgruber III
PRO
ubergarm
Follow
infocyde's profile picture
marsman96's profile picture
MarxistLeninist's profile picture
423 followers
·
65 following
https://blog.aifoundry.org/p/adventures-in-model-quantization
ubergarm
john-leimgruber
AI & ML interests
Open LLMs and Astrophotography image processing.
Recent Activity
new
activity
3 days ago
RDson/Qwen3.6-27B-MTP-IQ4_KS-GGUF:
Yay more ik quants!
liked
a model
3 days ago
RDson/Qwen3.6-27B-MTP-IQ4_KS-GGUF
new
activity
3 days ago
RDson/Qwen3.6-27B-MTP-Q4_K_M-GGUF:
提速效果不理想
View all activity
Organizations
ubergarm
's activity
All
Models
Datasets
Spaces
Buckets
Papers
Collections
Community
Posts
Upvotes
Likes
Articles
New activity in
RDson/Qwen3.6-27B-MTP-IQ4_KS-GGUF
3 days ago
Yay more ik quants!
❤️
1
#1 opened 3 days ago by
ubergarm
liked
a model
3 days ago
RDson/Qwen3.6-27B-MTP-IQ4_KS-GGUF
Text Generation
•
27B
•
Updated
7 days ago
•
21.4k
•
6
New activity in
RDson/Qwen3.6-27B-MTP-Q4_K_M-GGUF
3 days ago
提速效果不理想
7
#1 opened 9 days ago by
androidli
liked
a model
3 days ago
Lorbus/Qwen3.6-27B-int4-AutoRound
Image-Text-to-Text
•
6B
•
Updated
17 days ago
•
440k
•
89
New activity in
Lorbus/Qwen3.6-27B-int4-AutoRound
3 days ago
How does this fair against other quants without MTP like unsloth?
👍
1
1
#4 opened 14 days ago by
Crigges
New activity in
ubergarm/Qwen3.6-27B-GGUF
4 days ago
How to use MTP in GGUF?
18
#2 opened 9 days ago by
Friedland
liked
2 models
4 days ago
google/gemma-4-31B-it-assistant
Any-to-Any
•
0.5B
•
Updated
4 days ago
•
47.8k
•
169
RDson/Qwen3.6-27B-MTP-Q4_K_M-GGUF
27B
•
Updated
10 days ago
•
4.35k
•
19
updated
a model
5 days ago
ubergarm/Qwen3.6-27B-GGUF
Text Generation
•
27B
•
Updated
5 days ago
•
10.8k
•
18
New activity in
ubergarm/Qwen3.6-27B-GGUF
8 days ago
Q6_0 use over Q6_K?
2
#3 opened 8 days ago by
resynth
New activity in
ubergarm/Qwen3.6-27B-GGUF
10 days ago
Great model for single GPU use cases.
🔥
4
16
#1 opened 14 days ago by
phakio
liked
a model
11 days ago
XiaomiMiMo/MiMo-V2.5-Pro
Text Generation
•
1T
•
Updated
1 day ago
•
31.4k
•
490
New activity in
ubergarm/Qwen3.5-122B-A10B-GGUF
12 days ago
How to split this model between 2 (3) GPUs and CPU/RAM ?
30
#12 opened about 2 months ago by
mancub
updated
a model
12 days ago
ubergarm/Kimi-K2.6-GGUF
Text Generation
•
1T
•
Updated
12 days ago
•
5.75k
•
35
liked
a model
14 days ago
bartowski/Qwen_Qwen3.6-27B-GGUF
Image-Text-to-Text
•
27B
•
Updated
16 days ago
•
92k
•
32
New activity in
ubergarm/Qwen3.5-35B-A3B-GGUF
14 days ago
Any plans to release Qwen3.6 ?
1
#3 opened 15 days ago by
ittokasso
updated
a model
15 days ago
ubergarm/Qwen3.5-27B-GGUF
Text Generation
•
27B
•
Updated
15 days ago
•
1.91k
•
16
New activity in
ubergarm/Qwen3.5-27B-GGUF
15 days ago
smol-IQ4_NL with turboquant is outstanding for 24GB VRAM
🔥
1
3
#7 opened 15 days ago by
IHaveNoClueAndIMustPost
published
a model
15 days ago
ubergarm/Qwen3.6-27B-GGUF
Text Generation
•
27B
•
Updated
5 days ago
•
10.8k
•
18
New activity in
ubergarm/Kimi-K2.6-GGUF
15 days ago
Much faster IQ2_KS quantization PPL results?
3
#10 opened 16 days ago by
gghfez
Load more