Instructions to use dumpy50222/ComfyUI_LTX_Wan_Models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use dumpy50222/ComfyUI_LTX_Wan_Models with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="dumpy50222/ComfyUI_LTX_Wan_Models", filename="text_encoders/Gemma-4-E2B-Uncensored-HauhauCS-Aggressive-Q8_K_P.gguf", )
llm.create_chat_completion( messages = "No input example has been defined for this model task." )
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use dumpy50222/ComfyUI_LTX_Wan_Models with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0 # Run inference directly in the terminal: llama cli -hf dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0 # Run inference directly in the terminal: llama cli -hf dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0 # Run inference directly in the terminal: ./llama-cli -hf dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0 # Run inference directly in the terminal: ./build/bin/llama-cli -hf dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0
Use Docker
docker model run hf.co/dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0
- LM Studio
- Jan
- Ollama
How to use dumpy50222/ComfyUI_LTX_Wan_Models with Ollama:
ollama run hf.co/dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0
- Unsloth Studio
How to use dumpy50222/ComfyUI_LTX_Wan_Models with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for dumpy50222/ComfyUI_LTX_Wan_Models to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for dumpy50222/ComfyUI_LTX_Wan_Models to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for dumpy50222/ComfyUI_LTX_Wan_Models to start chatting
- Pi
How to use dumpy50222/ComfyUI_LTX_Wan_Models with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use dumpy50222/ComfyUI_LTX_Wan_Models with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0
Run Hermes
hermes
- Atomic Chat new
- OpenClaw new
How to use dumpy50222/ComfyUI_LTX_Wan_Models with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
- Docker Model Runner
How to use dumpy50222/ComfyUI_LTX_Wan_Models with Docker Model Runner:
docker model run hf.co/dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0
- Lemonade
How to use dumpy50222/ComfyUI_LTX_Wan_Models with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull dumpy50222/ComfyUI_LTX_Wan_Models:Q8_0
Run and chat with the model
lemonade run user.ComfyUI_LTX_Wan_Models-Q8_0
List all available models
lemonade list
| { | |
| "file_name": "fluxFillFP8_v10", | |
| "model_name": "Flux-Fill FP8", | |
| "file_path": "G:/AI/ComfyUI/models/diffusion_models/fluxFillFP8_v10.safetensors", | |
| "size": 11902532704, | |
| "modified": 1772081890.335832, | |
| "sha256": "61abe2128889f7c5004c11cda1afed29e183bbb07bc2bff243d270a2a819113b", | |
| "base_model": "Flux.1 D", | |
| "preview_url": "G:/AI/ComfyUI/models/diffusion_models/fluxFillFP8_v10.jpeg", | |
| "preview_nsfw_level": 1, | |
| "notes": "", | |
| "from_civitai": true, | |
| "civitai": { | |
| "id": 1085456, | |
| "modelId": 969431, | |
| "name": "v1.0", | |
| "nsfwLevel": 1, | |
| "createdAt": "2024-11-21T17:03:53.428Z", | |
| "updatedAt": "2024-11-21T17:20:04.761Z", | |
| "status": "Published", | |
| "publishedAt": "2024-11-21T17:20:04.760Z", | |
| "trainedWords": [ | |
| "texts" | |
| ], | |
| "trainingStatus": null, | |
| "trainingDetails": null, | |
| "baseModel": "Flux.1 D", | |
| "baseModelType": "Inpainting", | |
| "earlyAccessEndsAt": null, | |
| "earlyAccessConfig": null, | |
| "description": null, | |
| "uploadType": "Created", | |
| "usageControl": "Download", | |
| "licensingFee": null, | |
| "air": "urn:air:flux1:checkpoint:civitai:969431@1085456", | |
| "stats": { | |
| "downloadCount": 31560, | |
| "thumbsUpCount": 394 | |
| }, | |
| "model": { | |
| "name": "Flux-Fill FP8", | |
| "type": "Checkpoint", | |
| "nsfw": false, | |
| "poi": false, | |
| "description": "<p>Converted Flux Fill to FP8 for all my low Vram Peeps.<br />Happy inpainting </p>", | |
| "tags": [ | |
| "base model" | |
| ], | |
| "allowNoCredit": true, | |
| "allowCommercialUse": [ | |
| "Image", | |
| "RentCivit", | |
| "Rent", | |
| "Sell" | |
| ], | |
| "allowDerivatives": true, | |
| "allowDifferentLicense": true | |
| }, | |
| "files": [ | |
| { | |
| "id": 990604, | |
| "sizeKB": 11623567.09375, | |
| "name": "fluxFillFP8_v10.safetensors", | |
| "type": "Model", | |
| "pickleScanResult": "Success", | |
| "pickleScanMessage": "No Pickle imports", | |
| "virusScanResult": "Success", | |
| "virusScanMessage": null, | |
| "scannedAt": "2024-11-21T17:27:23.165Z", | |
| "metadata": { | |
| "format": "SafeTensor", | |
| "size": "full", | |
| "fp": "fp8" | |
| }, | |
| "hashes": { | |
| "AutoV1": "4E3A43A0", | |
| "AutoV2": "61ABE21288", | |
| "SHA256": "61ABE2128889F7C5004C11CDA1AFED29E183BBB07BC2BFF243D270A2A819113B", | |
| "CRC32": "E182D7B0", | |
| "BLAKE3": "9E564DBCF693E48719954B68EF00E5B1CB59088C17E6404BCB9784BC498D80B3", | |
| "AutoV3": "D7CBDB0D06CE" | |
| }, | |
| "primary": true, | |
| "downloadUrl": "https://civitai.red/api/download/models/1085456" | |
| } | |
| ], | |
| "images": [ | |
| { | |
| "url": "https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/d73b9cb5-c233-484b-9c06-34303ac9273a/original=true/41373210.jpeg", | |
| "nsfwLevel": 1, | |
| "width": 960, | |
| "height": 1011, | |
| "hash": "UBLh3v?w4.bbJAM{.8tR00jZ-;t8xvj[f6az", | |
| "type": "image", | |
| "metadata": { | |
| "hash": "UBLh3v?w4.bbJAM{.8tR00jZ-;t8xvj[f6az", | |
| "size": 1256361, | |
| "width": 960, | |
| "height": 1011 | |
| }, | |
| "minor": false, | |
| "poi": false, | |
| "meta": null, | |
| "availability": "Public", | |
| "hasMeta": false, | |
| "hasPositivePrompt": false, | |
| "onSite": false, | |
| "remixOfId": null | |
| } | |
| ], | |
| "downloadUrl": "https://civitai.red/api/download/models/1085456", | |
| "creator": { | |
| "username": "yogotatara", | |
| "image": "https://lh3.googleusercontent.com/a/AAcHTtePpS_v0LJd3t5ihCLp4du4MEhzQ3jJPkLq0hbz=s96-c" | |
| } | |
| }, | |
| "tags": [ | |
| "base model" | |
| ], | |
| "modelDescription": "<p>Converted Flux Fill to FP8 for all my low Vram Peeps.<br />Happy inpainting </p>", | |
| "civitai_deleted": false, | |
| "favorite": false, | |
| "exclude": false, | |
| "db_checked": false, | |
| "skip_metadata_refresh": false, | |
| "metadata_source": "civitai_api", | |
| "last_checked_at": 1782017770.53997, | |
| "hash_status": "completed", | |
| "usage_tips": "{}", | |
| "sub_type": "checkpoint" | |
| } |