BenGitter
bigstorm
AI & ML interests
digital general contractor, building LLM subs
Organizations
FP8 + INT4 version
14
#2 opened 3 months ago
by
bigstorm
Could you cook a similar version for Step 3.5?
๐ 1
7
#8 opened 3 months ago
by
bigstorm
Current Nightly Build is Unavailable + Other VLLM issues. Working docker config as of 1/21/2026
#3 opened 3 months ago
by
bigstorm
Thanks for quantize this model! could you further quantize it into 3.0bpw?
7
#1 opened over 1 year ago
by
blackcat1402
This model's knowledge cutoff is 2021..
2
#2 opened over 1 year ago
by
myquest
3.5 - 4.0 bpw quant request
1
#1 opened over 1 year ago
by
SporkySporkness
6bpw quant request
1
#2 opened over 1 year ago
by
Lissanro
Token Configuration Correction
1
#2 opened almost 2 years ago
by
bigstorm
Q6 Version
2
#2 opened almost 2 years ago
by
bigstorm