GGUF?

#1
by pomazanbohdan - opened

GGUF?

I added everything you need to create it so that you can train her on your own data or adaptors/fine-tunes

!pip install llama-cpp-python

from llama_cpp import Llama

llm = Llama.from_pretrained(
repo_id="Raiff1982/Codette-Ultimate",
filename="codette-ultimate.gguf",
)

Raiff1982 changed discussion status to closed
Raiff1982 changed discussion status to open

I added an updated GGUF

Raiff1982 pinned discussion

Sign up or log in to comment