LTX-Video
Collection
LTX-Video 0.9.5+ model weights for candle-video โข 2 items โข Updated
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama-server -hf oxide-lab/LTX-Video-0.9.5-diffusers:Q5_K_M# Run inference directly in the terminal:
llama-cli -hf oxide-lab/LTX-Video-0.9.5-diffusers:Q5_K_M# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf oxide-lab/LTX-Video-0.9.5-diffusers:Q5_K_M# Run inference directly in the terminal:
./llama-cli -hf oxide-lab/LTX-Video-0.9.5-diffusers:Q5_K_Mgit clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf oxide-lab/LTX-Video-0.9.5-diffusers:Q5_K_M# Run inference directly in the terminal:
./build/bin/llama-cli -hf oxide-lab/LTX-Video-0.9.5-diffusers:Q5_K_Mdocker model run hf.co/oxide-lab/LTX-Video-0.9.5-diffusers:Q5_K_MThis repository provides a high-performance, native Rust implementation of LTX-Video using the Candle ML framework.
Ensure you have Rust and the CUDA Toolkit installed, then:
git clone https://github.com/FerrisMind/candle-video
cd candle-video
cargo build --release --features flash-attn,cudnn
cargo run --example ltx-video --release -- \
--local-weights ./models/ltx-video \
--prompt "A serene mountain lake at sunset, photorealistic, 4k" \
--width 768 --height 512 --num-frames 97 \
--steps 30
| Resolution | Frames | VRAM (BF16) | VRAM (VAE Tiling) |
|---|---|---|---|
| 512x768 | 97 | ~8-13 GB | ~8-9 GB |
Note: Using GGUF T5 encoder saves an additional ~8-12GB of VRAM.
For more details, visit the main GitHub Repository.
5-bit
Base model
Lightricks/LTX-Video-0.9.5
Install from brew
# Start a local OpenAI-compatible server with a web UI: llama-server -hf oxide-lab/LTX-Video-0.9.5-diffusers:Q5_K_M# Run inference directly in the terminal: llama-cli -hf oxide-lab/LTX-Video-0.9.5-diffusers:Q5_K_M