Sync to ComfyUI-repackaged layout (bf16)
Browse files- README.md +31 -25
- diffusion_models/joy_image_edit_bf16.safetensors β split_files/diffusion_models/joyai_image_edit_bf16.safetensors +0 -0
- text_encoders/qwen3vl_joyimage_bf16.safetensors β split_files/text_encoders/qwen_3vl_8b_joyimage_bf16.safetensors +0 -0
- vae/joy_image_edit_vae.safetensors β split_files/vae/wan_2.1_vae.safetensors +2 -2
README.md
CHANGED
|
@@ -1,56 +1,62 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
-
library_name:
|
| 4 |
pipeline_tag: image-to-image
|
| 5 |
tags:
|
| 6 |
- comfyui
|
| 7 |
- image-editing
|
| 8 |
-
- diffusers
|
| 9 |
- joyai
|
|
|
|
| 10 |
---
|
| 11 |
|
| 12 |
-
# JoyAI-Image-Edit (ComfyUI
|
| 13 |
|
| 14 |
-
|
| 15 |
-
|
| 16 |
-
Use these with the `joyai_image_comfyui` custom node from the [JoyAI-Image GitHub repo](https://github.com/jd-opensource/JoyAI-Image/tree/main/joyai_image_comfyui).
|
| 17 |
|
| 18 |
## Files
|
| 19 |
|
| 20 |
| File | Size | Goes into | Component |
|
| 21 |
|------|------|-----------|-----------|
|
| 22 |
-
| `diffusion_models/
|
| 23 |
-
| `text_encoders/
|
| 24 |
-
| `vae/
|
| 25 |
|
| 26 |
-
The
|
| 27 |
|
| 28 |
## Quick start
|
| 29 |
|
| 30 |
```bash
|
| 31 |
-
#
|
| 32 |
-
cd ComfyUI/custom_nodes
|
| 33 |
-
git clone https://github.com/jd-opensource/JoyAI-Image.git
|
| 34 |
-
cp -r JoyAI-Image/joyai_image_comfyui ./
|
| 35 |
-
rm -rf JoyAI-Image
|
| 36 |
-
|
| 37 |
-
# 2) Download the weights straight into ComfyUI/models/
|
| 38 |
hf download jdopensource/JoyAI-Image-Edit-ComfyUI \
|
| 39 |
-
--
|
|
|
|
|
|
|
| 40 |
|
| 41 |
-
#
|
| 42 |
```
|
| 43 |
|
| 44 |
## Requirements
|
| 45 |
|
| 46 |
-
|
| 47 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 48 |
|
| 49 |
-
|
| 50 |
|
| 51 |
-
|
|
|
|
|
|
|
| 52 |
|
| 53 |
## Links
|
| 54 |
|
| 55 |
-
- Source code
|
| 56 |
-
-
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
+
library_name: ComfyUI
|
| 4 |
pipeline_tag: image-to-image
|
| 5 |
tags:
|
| 6 |
- comfyui
|
| 7 |
- image-editing
|
|
|
|
| 8 |
- joyai
|
| 9 |
+
base_model: jdopensource/JoyAI-Image-Edit-Diffusers
|
| 10 |
---
|
| 11 |
|
| 12 |
+
# JoyAI-Image-Edit (ComfyUI)
|
| 13 |
|
| 14 |
+
Repackaged single-file weights of [`jdopensource/JoyAI-Image-Edit-Diffusers`](https://huggingface.co/jdopensource/JoyAI-Image-Edit-Diffusers) for ComfyUI's standard model-folder layout. Keys, filenames and directory layout follow the [Comfy-Org](https://huggingface.co/Comfy-Org) packaging convention used by `Qwen-Image-Edit_ComfyUI` and `Wan_2.1_ComfyUI_repackaged` β drop the files into `ComfyUI/models/` and they load natively.
|
|
|
|
|
|
|
| 15 |
|
| 16 |
## Files
|
| 17 |
|
| 18 |
| File | Size | Goes into | Component |
|
| 19 |
|------|------|-----------|-----------|
|
| 20 |
+
| `split_files/diffusion_models/joyai_image_edit_bf16.safetensors` | ~32 GB | `ComfyUI/models/diffusion_models/` | `JoyImageEditTransformer3DModel` (bf16) |
|
| 21 |
+
| `split_files/text_encoders/qwen_3vl_8b_joyimage_bf16.safetensors` | ~17 GB | `ComfyUI/models/text_encoders/` | Qwen3-VL-8B text encoder, JoyImage-finetuned (bf16) |
|
| 22 |
+
| `split_files/vae/wan_2.1_vae.safetensors` | ~250 MB | `ComfyUI/models/vae/` | Wan 2.1 VAE (shared with Wan / Qwen-Image; bf16) |
|
| 23 |
|
| 24 |
+
The VAE is the standard Wan 2.1 VAE β bit-identical to [`Comfy-Org/Wan_2.1_ComfyUI_repackaged/split_files/vae/wan_2.1_vae.safetensors`](https://huggingface.co/Comfy-Org/Wan_2.1_ComfyUI_repackaged/blob/main/split_files/vae/wan_2.1_vae.safetensors). If you already have it from Wan or Qwen-Image, you can skip the VAE here.
|
| 25 |
|
| 26 |
## Quick start
|
| 27 |
|
| 28 |
```bash
|
| 29 |
+
# Download into ComfyUI/models/ (skips split_files/ wrapper):
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 30 |
hf download jdopensource/JoyAI-Image-Edit-ComfyUI \
|
| 31 |
+
--include "split_files/*" \
|
| 32 |
+
--local-dir /path/to/ComfyUI/models \
|
| 33 |
+
--local-dir-use-symlinks False
|
| 34 |
|
| 35 |
+
# Or fetch each file individually into the matching model folder.
|
| 36 |
```
|
| 37 |
|
| 38 |
## Requirements
|
| 39 |
|
| 40 |
+
Native JoyImageEdit support is in flight upstream against [Comfy-Org/ComfyUI](https://github.com/comfyanonymous/ComfyUI). Until the PR lands, install ComfyUI from the JoyAI fork's branch:
|
| 41 |
+
|
| 42 |
+
```bash
|
| 43 |
+
git clone https://github.com/jd-opensource/JoyAI-Image.git
|
| 44 |
+
# follow the ComfyUI branch instructions in JoyAI-Image/README.md
|
| 45 |
+
```
|
| 46 |
+
|
| 47 |
+
When the upstream PR merges, plain `comfyanonymous/ComfyUI` will detect and load these files with no extra setup.
|
| 48 |
+
|
| 49 |
+
## Key namespaces
|
| 50 |
|
| 51 |
+
For developers / quantizers β the top-level state-dict prefixes in each file:
|
| 52 |
|
| 53 |
+
- **diffusion_models**: raw transformer keys (`double_blocks.*`, `condition_embedder.*`, `img_in.*`, `proj_out.*`, `norm_out.*`). No `model.diffusion_model.` wrapper. Auto-detected by ComfyUI's `model_detection.py`.
|
| 54 |
+
- **text_encoders**: HF Qwen3-VL keys (`model.language_model.*`, `model.visual.*`, `lm_head.*`). ComfyUI strips the `model.` wrappers internally.
|
| 55 |
+
- **vae**: standard Comfy-Org Wan 2.1 VAE keys (`encoder.{conv1,downsamples,middle}.*`, `decoder.{conv1,upsamples,middle,head}.*`, plus top-level `conv1.*`/`conv2.*` for the post-quant projections).
|
| 56 |
|
| 57 |
## Links
|
| 58 |
|
| 59 |
+
- Source code & nodes: [github.com/jd-opensource/JoyAI-Image](https://github.com/jd-opensource/JoyAI-Image)
|
| 60 |
+
- Diffusers weights: [jdopensource/JoyAI-Image-Edit-Diffusers](https://huggingface.co/jdopensource/JoyAI-Image-Edit-Diffusers)
|
| 61 |
+
- GGUF quantizations (community): [huangfeice/JoyAI-Image-Edit-Diffusers-GGUF](https://huggingface.co/huangfeice/JoyAI-Image-Edit-Diffusers-GGUF)
|
| 62 |
+
- License: Apache 2.0
|
diffusion_models/joy_image_edit_bf16.safetensors β split_files/diffusion_models/joyai_image_edit_bf16.safetensors
RENAMED
|
File without changes
|
text_encoders/qwen3vl_joyimage_bf16.safetensors β split_files/text_encoders/qwen_3vl_8b_joyimage_bf16.safetensors
RENAMED
|
File without changes
|
vae/joy_image_edit_vae.safetensors β split_files/vae/wan_2.1_vae.safetensors
RENAMED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2fc39d31359a4b0a64f55876d8ff7fa8d780956ae2cb13463b0223e15148976b
|
| 3 |
+
size 253815318
|