Model does not load in mlx-lm
#4
by xuv - opened
Hi.
llmfit mentions this model as an mlx-8bit quantisation. And it should be great for my MacOS M1 laptop. But somehow, it won’s load in mlx-lm. It keeps showing the full detail of the models files after download and that’s it.
Has anyone tried this with mlx-lm. Any pointers to get this running?