darkbit1001/MuXodious-gpt-4o-distill-Llama-3.1-8B-Instruct-PaperWitch-heresy-exl3-6.00bpw-hb8
Text Generation • 3B • Updated
Mario Gray
darkbit1001
·
AI & ML interests
Models stored here are made to fit a 3090 24GB, and 3070 8GB, including MOE offloads.
RK3588 16-GB
Recent Activity
updated a model about 3 hours ago
darkbit1001/MuXodious-gpt-4o-distill-Llama-3.1-8B-Instruct-PaperWitch-heresy-exl3-6.00bpw-hb8 published a model about 3 hours ago
darkbit1001/MuXodious-gpt-4o-distill-Llama-3.1-8B-Instruct-PaperWitch-heresy-exl3-6.00bpw-hb8 updated a model about 4 hours ago
darkbit1001/MuXodious-gpt-4o-distill-Llama-3.1-8B-Instruct-PaperWitch-heresy-exl3-4.00bpw-hb6Organizations
None yet
updated a
model about 3 hours ago
published a
model about 3 hours ago
updated a
model about 4 hours ago
published a
model about 4 hours ago
Reverse this string: '.DefaultCellStyle'
🔥 3
18
#50 opened 5 days ago
by 
owao
updated a
model 1 day ago
published a
model 1 day ago
Thank you for your work
👍 6
4
#1 opened 4 days ago
by 
vonamakitsune
updated a
model 5 days ago
published a
model 5 days ago
My fingers have blisters!
#41 opened 5 days ago
by darkbit1001
What level of quantization can preserve accuracy while effectively reducing the model size?
👀 1
4
#33 opened 6 days ago
by 
SeanKd
updated a
model 6 days ago
published a
model 6 days ago
liked a
model 6 days ago
updated a
model 6 days ago
I can offer compute if that helps?
👍 2
7
#4 opened 14 days ago
by 
kylebamboo
Why different MTP heads?
2
#1 opened 10 days ago
by darkbit1001
Two critical checkpoint errors prevent quantization (MTP config mismatch + wrong tensor naming)
🔥 2
2
#15 opened about 2 months ago
by 
Maennekes
MTP layers
3
#26 opened about 1 month ago
by 
Treene