Instructions to use AEmotionStudio/ComfyUI-Model-Backups with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use AEmotionStudio/ComfyUI-Model-Backups with Diffusers:

pip install -U diffusers transformers accelerate

import torch
from diffusers import DiffusionPipeline

# switch to "mps" for apple devices
pipe = DiffusionPipeline.from_pretrained("AEmotionStudio/ComfyUI-Model-Backups", dtype=torch.bfloat16, device_map="cuda")

prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k"
image = pipe(prompt).images[0]

llama-cpp-python

How to use AEmotionStudio/ComfyUI-Model-Backups with llama-cpp-python:

# !pip install llama-cpp-python

from llama_cpp import Llama

llm = Llama.from_pretrained(
	repo_id="AEmotionStudio/ComfyUI-Model-Backups",
	filename="clip/Qwen2.5-VL-7B-Instruct-abliterated.Q8_0.gguf",
)

llm.create_chat_completion(
	messages = "No input example has been defined for this model task."
)

Notebooks
Google Colab
Kaggle
Local Apps Settings

llama.cpp

How to use AEmotionStudio/ComfyUI-Model-Backups with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf AEmotionStudio/ComfyUI-Model-Backups:Q4_K_S
# Run inference directly in the terminal:
llama cli -hf AEmotionStudio/ComfyUI-Model-Backups:Q4_K_S

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf AEmotionStudio/ComfyUI-Model-Backups:Q4_K_S
# Run inference directly in the terminal:
llama cli -hf AEmotionStudio/ComfyUI-Model-Backups:Q4_K_S

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf AEmotionStudio/ComfyUI-Model-Backups:Q4_K_S
# Run inference directly in the terminal:
./llama-cli -hf AEmotionStudio/ComfyUI-Model-Backups:Q4_K_S

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf AEmotionStudio/ComfyUI-Model-Backups:Q4_K_S
# Run inference directly in the terminal:
./build/bin/llama-cli -hf AEmotionStudio/ComfyUI-Model-Backups:Q4_K_S

Use Docker

docker model run hf.co/AEmotionStudio/ComfyUI-Model-Backups:Q4_K_S

LM Studio
Jan
Ollama
How to use AEmotionStudio/ComfyUI-Model-Backups with Ollama:
```
ollama run hf.co/AEmotionStudio/ComfyUI-Model-Backups:Q4_K_S
```

Unsloth Studio

How to use AEmotionStudio/ComfyUI-Model-Backups with Unsloth Studio:

Install Unsloth Studio (macOS, Linux, WSL)

curl -fsSL https://unsloth.ai/install.sh | sh
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for AEmotionStudio/ComfyUI-Model-Backups to start chatting

Install Unsloth Studio (Windows)

irm https://unsloth.ai/install.ps1 | iex
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for AEmotionStudio/ComfyUI-Model-Backups to start chatting

Using HuggingFace Spaces for Unsloth

# No setup required
# Open https://huggingface.co/spaces/unsloth/studio in your browser
# Search for AEmotionStudio/ComfyUI-Model-Backups to start chatting

How to use AEmotionStudio/ComfyUI-Model-Backups with Pi:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf AEmotionStudio/ComfyUI-Model-Backups:Q4_K_S

Configure the model in Pi

# Install Pi:
npm install -g @mariozechner/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "llama-cpp": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "AEmotionStudio/ComfyUI-Model-Backups:Q4_K_S"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Hermes Agent new

How to use AEmotionStudio/ComfyUI-Model-Backups with Hermes Agent:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf AEmotionStudio/ComfyUI-Model-Backups:Q4_K_S

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default AEmotionStudio/ComfyUI-Model-Backups:Q4_K_S

Run Hermes

hermes

Atomic Chat new
Docker Model Runner
How to use AEmotionStudio/ComfyUI-Model-Backups with Docker Model Runner:
```
docker model run hf.co/AEmotionStudio/ComfyUI-Model-Backups:Q4_K_S
```

Lemonade

How to use AEmotionStudio/ComfyUI-Model-Backups with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull AEmotionStudio/ComfyUI-Model-Backups:Q4_K_S

Run and chat with the model

lemonade run user.ComfyUI-Model-Backups-Q4_K_S

List all available models

lemonade list

AEmotionStudio commited on 20 days ago

Commit

9a4ab73

verified ·

1 Parent(s): 8b288b5

Add vae backup

Browse files

Files changed (23) hide show

.gitattributes +1 -0
vae/Wan2_1_FlashVSR_TCDecoder_fp32.safetensors +3 -0
vae/Wan2_1_VAE_bf16.safetensors +3 -0
vae/Wan2_1_VAE_fp32.safetensors +3 -0
vae/Wan2_2_VAE_bf16.safetensors +3 -0
vae/ae.sft +3 -0
vae/cosmos_cv8x8x8_1.0.safetensors +3 -0
vae/diffusion_pytorch_model.fp16.safetensors +3 -0
vae/flux_vae.safetensors +3 -0
vae/hunyuan3d-vae-v2-1.ckpt +3 -0
vae/hunyuan_video_vae_bf16.safetensors +3 -0
vae/hunyuanvideo15_vae_fp16.safetensors +3 -0
vae/ltxv-13b-0.9.7-vae-BF16.safetensors +3 -0
vae/mmaudio_vae_16k_bf16.safetensors +3 -0
vae/mmaudio_vae_44k_fp32.safetensors +3 -0
vae/mmaudio_vocoder_bigvgan_best_netG_bf16.safetensors +3 -0
vae/svd.ave.fp16.safetensors +3 -0
vae/taew2_1.safetensors +3 -0
vae/taew2_2.safetensors +3 -0
vae/vae-ft-mse-840000-ema-pruned.safetensors +3 -0
vae/vae.pt +3 -0
vae/wan_alpha_2.1_vae_alpha_channel.safetensors +3 -0
vae/wan_alpha_2.1_vae_rgb_channel.safetensors +3 -0

@@ -55,3 +55,4 @@ unet/wan22RemixI2VGGUFV20_lowQ4KM.gguf filter=lfs diff=lfs merge=lfs -text
 unet/wan22RemixT2VV10GGUF_highQ4KM.gguf filter=lfs diff=lfs merge=lfs -text
 unet/wan22RemixT2VV10GGUF_lowQ4KM.gguf filter=lfs diff=lfs merge=lfs -text
 LLM/Llama-3.2-3B-Instruct/tokenizer.json filter=lfs diff=lfs merge=lfs -text

 unet/wan22RemixT2VV10GGUF_highQ4KM.gguf filter=lfs diff=lfs merge=lfs -text
 unet/wan22RemixT2VV10GGUF_lowQ4KM.gguf filter=lfs diff=lfs merge=lfs -text
 LLM/Llama-3.2-3B-Instruct/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+vae/ae.sft filter=lfs diff=lfs merge=lfs -text

+version https://git-lfs.github.com/spec/v1
+oid sha256:dcb896a684ad7bdc4f1dcfbfcf5bed5775d439e76a0241c753ccb2f8fa2353b9
+size 181359756

+version https://git-lfs.github.com/spec/v1
+oid sha256:e027f6859a9c0f4dbfbaa9d1f27b1e5f371a5b8462e8d2d74c1ee8c44c20b1a8
+size 253807438

+version https://git-lfs.github.com/spec/v1
+oid sha256:fd1531e31cdd20af005a9fb66e69afe4ea481a6db9b07cd889ece2e1ca2e67b9
+size 507591244

+version https://git-lfs.github.com/spec/v1
+oid sha256:0e913a2ca571c75fcb63385a8edadcca73454af5842596cb1ad11e4142590996
+size 1409401152

+version https://git-lfs.github.com/spec/v1
+oid sha256:afc8e28272cd15db3919bacdb6918ce9c1ed22e96cb12c4d5ed0fba823529e38
+size 335304388

+version https://git-lfs.github.com/spec/v1
+oid sha256:e4478fa8629160d16262276e52bdea91ecef636b005a2a29e93a3d7764e0863b
+size 211344924

+version https://git-lfs.github.com/spec/v1
+oid sha256:af602cd0eb4ad6086ec94fbf1438dfb1be5ec9ac03fd0215640854e90d6463a3
+size 195531910

+version https://git-lfs.github.com/spec/v1
+oid sha256:5cbe97f25e6e7abd4bccc80ab07524ec0c86d24118486a9ba49bb5dfb070288a
+size 655648152

+version https://git-lfs.github.com/spec/v1
+oid sha256:4ffef191d47b661d48f356ed9ed7cf391509af5f4c000ba07a75dcdc4c03c501
+size 492986478

+version https://git-lfs.github.com/spec/v1
+oid sha256:e7c3091949c27e2d55ae6d5df917b99dadfebbf308e5a50d0ade0d16c90297ae
+size 2521292758

	@@ -0,0 +1,3 @@

	@@ -0,0 +1,3 @@

	@@ -0,0 +1,3 @@

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ee5ddcebc0b92d81b8aed9ee43445b7a4e66df1acf180678c5aa40e82f898dc5
+size 2493857180

+version https://git-lfs.github.com/spec/v1
+oid sha256:5b60e163d5c1317d90ef445dc7740b30897e6791a86ca11f44f95aadd9261c32
+size 343320940

+version https://git-lfs.github.com/spec/v1
+oid sha256:2ceae39bd927ea945c20f2aad82c2244a446997d7b287186849caca434abf78d
+size 1221925960

+version https://git-lfs.github.com/spec/v1
+oid sha256:22d61314ae46025ab4ccf05447a384d8b37dcc3853a05a762ebc61f6b57f09e5
+size 224551036

+version https://git-lfs.github.com/spec/v1
+oid sha256:a870ebc6a8bc36bb4124c304341e7b258ab4010e365743fbac2dc43af98cf9b2
+size 22642926

+version https://git-lfs.github.com/spec/v1
+oid sha256:885f67667e7d8838340d0c9ce03dd3f2da73bc2b44e3eda6e41ec1d0f725f97e
+size 22848080

+version https://git-lfs.github.com/spec/v1
+oid sha256:735e4c3a447a3255760d7f86845f09f937809baa529c17370d83e4c3758f3c75
+size 334641190

+version https://git-lfs.github.com/spec/v1
+oid sha256:bb2d3aa3b61dd902d73b938bb4ce90a842a78889e453b67b3b64dd641becad67
+size 680651554

+version https://git-lfs.github.com/spec/v1
+oid sha256:5695e8d8abbc5680fe3eefbf6c1885c989df40d1d3c83c29e87ae5b363f0c0a7
+size 253806246