Bib Projects
bibproj
AI & ML interests
None yet
Recent Activity
updated a collection 5 days ago
High quality quants for Mac Studio (MLX) updated a collection 5 days ago
High quality quants for Mac Studio (MLX) updated a model 5 days ago
mlx-community/GLM-5.3-4bitOrganizations
Getting error 400 when downloading
2
#2 opened about 2 months ago
by
jimreynold2nd
config declares num_nextn_predict_layers=1 but MTP draft tensors were dropped (disables speculative decoding)
1
#4 opened about 2 months ago
by
WillMitchell
big thank you for providing this 4bit mlx.
🚀 1
1
#1 opened 2 months ago
by
crystech
Garbage very soon in the output
👍 1
25
#3 opened 3 months ago
by
labhraighlep
Also providing MLX quants?
#6 opened 7 months ago
by
bibproj
ValueError: Missing 285 parameters
7
#1 opened 3 months ago
by
finding1
How did you run this on 512GB mac studio?
2
#2 opened 3 months ago
by
jimreynold2nd
How does this style of quant stack up to the existing MXFP4 quant?
9
#1 opened 3 months ago
by
harfum8
Thanks
1
#1 opened 4 months ago
by
labhraighlep
Vision capabilities are stripped
1
#2 opened 4 months ago
by
harfum8
MLX models and disclosure
2
#3 opened 4 months ago
by
labhraighlep
Low quality quant
4
#1 opened 5 months ago
by
DaniDubi
Was this created with the fixes in mlx-lm version 0.30.8?
1
#1 opened 7 months ago
by
finding1
5bit and 6bit versions
5
#1 opened 7 months ago
by
darthsider
Quantization question
1
#1 opened 8 months ago
by
Galathana
Anyone running this with M4 Max 128gb? How does it compare to 4bit quantization?
5
#1 opened 8 months ago
by
tumma72
Feedback
17
#1 opened 8 months ago
by
bibproj
Running the model with a dense attention
4
#35 opened 8 months ago
by
sszymczyk
Template Think issue
3
#2 opened 8 months ago
by
marutichintan
[SOLVED] No instruction following, Model just outputs vaguely relevant text, or goes into loops
5
#1 opened 9 months ago
by
bibproj