Convert to gguf-q2ks-mixed-AutoRound?
Hi there,
Thanks for sharing the model.
It will great if you could publish a gguf-q2ks-mixed-AutoRound version too.
Thank you.
Appreciate if you could share me the steps to do the conversation if you don't have resources to do it.
Thanks.
May I know any update?
May I know any update?
We are currently on the Chinese New Year holiday.
Typically, in each AutoRound quantized model card, we have attached the generation code or command.
You can follow these to quantize the models you want.
If you encounter any issues during quantization, please submit an issue to our repo.
May I know any update?
We are currently on the Chinese New Year holiday.
Typically, in each AutoRound quantized model card, we have attached the generation code or command.
You can follow these to quantize the models you want.If you encounter any issues during quantization, please submit an issue to our repo.
Thanks for quick response.
Happy Chinese New Year! The year of Fire π΄γ