GGUF support

#2
by maroo87 - opened

Hey I can't run this model in my low vram machine, can you please add gguf versions and support through scripts? many thanks

Sign up or log in to comment