Install from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama-server -hf CMM7590/Lilith_AI_8B:# Run inference directly in the terminal:
llama-cli -hf CMM7590/Lilith_AI_8B:Use pre-built binary
# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf CMM7590/Lilith_AI_8B:# Run inference directly in the terminal:
./llama-cli -hf CMM7590/Lilith_AI_8B:Build from source code
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf CMM7590/Lilith_AI_8B:# Run inference directly in the terminal:
./build/bin/llama-cli -hf CMM7590/Lilith_AI_8B:Use Docker
docker model run hf.co/CMM7590/Lilith_AI_8B:Lilith AI
An LLM trained to act like Lilith from The NOexistenceN of you AND me.
About
This model is a LoRA fine-tuned LLM based on the Sao10K/Llama-3.1-8B-Stheno-v3.4 base model. It has been trained on lines directly extracted from the original game to simulate the personality and speech patterns of Lilith.
The cloud-hosted model can be found here: lilith.nullexistence.net
Folder & File Overview
- System Prompt.txt: A system prompt tailored specifically for this model.
- Lilith_AI_8B_Q4_0.gguf: The Q4_0 model file.
- Lilith_AI_8B_Q4_K_M.gguf: The Q4_K_M model file.
- Lilith_AI_8B_Q6_K.gguf: The Q6_K model file.
- Lilith_AI_8B_Q8_0.gguf: The Q8_0 model file.
- Lilith_AI_8B_F16.gguf: The F16 model file.
License
You are free to use, share, and adapt the model, but you must give appropriate credit to C.M.M. for training the model and this project.
Disclaimer
This model uses the character Lilith from The NOexistenceN series. This project is fan-made and not affiliated with, endorsed by, or sponsored by the original creators or copyright holders. All intellectual property related to the character belongs to the original copyright holders. Use of this model is for personal, educational, or research purposes only.
- Downloads last month
- 240
4-bit
6-bit
8-bit
16-bit
Model tree for CMM7590/Lilith_AI_8B
Base model
Sao10K/Llama-3.1-8B-Stheno-v3.4
Install from brew
# Start a local OpenAI-compatible server with a web UI: llama-server -hf CMM7590/Lilith_AI_8B:# Run inference directly in the terminal: llama-cli -hf CMM7590/Lilith_AI_8B: