huangfeice commited on
Commit
c749a2d
Β·
verified Β·
1 Parent(s): 4b12495

Sync to ComfyUI-repackaged layout (bf16)

Browse files
README.md CHANGED
@@ -1,56 +1,62 @@
1
  ---
2
  license: apache-2.0
3
- library_name: diffusers
4
  pipeline_tag: image-to-image
5
  tags:
6
  - comfyui
7
  - image-editing
8
- - diffusers
9
  - joyai
 
10
  ---
11
 
12
- # JoyAI-Image-Edit (ComfyUI weights)
13
 
14
- Single-file `.safetensors` checkpoints of [JoyAI-Image-Edit](https://github.com/jd-opensource/JoyAI-Image), repackaged for the standard ComfyUI model folder layout.
15
-
16
- Use these with the `joyai_image_comfyui` custom node from the [JoyAI-Image GitHub repo](https://github.com/jd-opensource/JoyAI-Image/tree/main/joyai_image_comfyui).
17
 
18
  ## Files
19
 
20
  | File | Size | Goes into | Component |
21
  |------|------|-----------|-----------|
22
- | `diffusion_models/joy_image_edit_bf16.safetensors` | ~32 GB | `ComfyUI/models/diffusion_models/` | `JoyImageEditTransformer3DModel` (bf16) |
23
- | `text_encoders/qwen3vl_joyimage_bf16.safetensors` | ~17 GB | `ComfyUI/models/text_encoders/` | Qwen3VL text encoder (bf16) |
24
- | `vae/joy_image_edit_vae.safetensors` | ~254 MB | `ComfyUI/models/vae/` | `AutoencoderKLWan` |
25
 
26
- The repo's directory layout already matches `ComfyUI/models/`, so a single `hf download` into your models root drops every file where it needs to go.
27
 
28
  ## Quick start
29
 
30
  ```bash
31
- # 1) Install the custom node
32
- cd ComfyUI/custom_nodes
33
- git clone https://github.com/jd-opensource/JoyAI-Image.git
34
- cp -r JoyAI-Image/joyai_image_comfyui ./
35
- rm -rf JoyAI-Image
36
-
37
- # 2) Download the weights straight into ComfyUI/models/
38
  hf download jdopensource/JoyAI-Image-Edit-ComfyUI \
39
- --local-dir /path/to/ComfyUI/models
 
 
40
 
41
- # 3) Restart ComfyUI β€” new nodes appear under `loaders/joyai` and `image/joyai`.
42
  ```
43
 
44
  ## Requirements
45
 
46
- - `diffusers >= 0.39.0.dev0` (install from source: `pip install git+https://github.com/huggingface/diffusers.git`)
47
- - `transformers >= 4.57.0`
 
 
 
 
 
 
 
 
48
 
49
- ## GGUF quantizations
50
 
51
- Lower-bit GGUF quants of the transformer and text encoder are available at [huangfeice/JoyAI-Image-Edit-Diffusers-GGUF](https://huggingface.co/huangfeice/JoyAI-Image-Edit-Diffusers-GGUF) (community contribution). The VAE here is the only VAE you need β€” GGUF doesn't quantize VAE.
 
 
52
 
53
  ## Links
54
 
55
- - Source code, node implementation, and full documentation: [github.com/jd-opensource/JoyAI-Image](https://github.com/jd-opensource/JoyAI-Image)
56
- - Original Diffusers-format weights: [jdopensource/JoyAI-Image-Edit-Diffusers](https://huggingface.co/jdopensource/JoyAI-Image-Edit-Diffusers)
 
 
 
1
  ---
2
  license: apache-2.0
3
+ library_name: ComfyUI
4
  pipeline_tag: image-to-image
5
  tags:
6
  - comfyui
7
  - image-editing
 
8
  - joyai
9
+ base_model: jdopensource/JoyAI-Image-Edit-Diffusers
10
  ---
11
 
12
+ # JoyAI-Image-Edit (ComfyUI)
13
 
14
+ Repackaged single-file weights of [`jdopensource/JoyAI-Image-Edit-Diffusers`](https://huggingface.co/jdopensource/JoyAI-Image-Edit-Diffusers) for ComfyUI's standard model-folder layout. Keys, filenames and directory layout follow the [Comfy-Org](https://huggingface.co/Comfy-Org) packaging convention used by `Qwen-Image-Edit_ComfyUI` and `Wan_2.1_ComfyUI_repackaged` β€” drop the files into `ComfyUI/models/` and they load natively.
 
 
15
 
16
  ## Files
17
 
18
  | File | Size | Goes into | Component |
19
  |------|------|-----------|-----------|
20
+ | `split_files/diffusion_models/joyai_image_edit_bf16.safetensors` | ~32 GB | `ComfyUI/models/diffusion_models/` | `JoyImageEditTransformer3DModel` (bf16) |
21
+ | `split_files/text_encoders/qwen_3vl_8b_joyimage_bf16.safetensors` | ~17 GB | `ComfyUI/models/text_encoders/` | Qwen3-VL-8B text encoder, JoyImage-finetuned (bf16) |
22
+ | `split_files/vae/wan_2.1_vae.safetensors` | ~250 MB | `ComfyUI/models/vae/` | Wan 2.1 VAE (shared with Wan / Qwen-Image; bf16) |
23
 
24
+ The VAE is the standard Wan 2.1 VAE β€” bit-identical to [`Comfy-Org/Wan_2.1_ComfyUI_repackaged/split_files/vae/wan_2.1_vae.safetensors`](https://huggingface.co/Comfy-Org/Wan_2.1_ComfyUI_repackaged/blob/main/split_files/vae/wan_2.1_vae.safetensors). If you already have it from Wan or Qwen-Image, you can skip the VAE here.
25
 
26
  ## Quick start
27
 
28
  ```bash
29
+ # Download into ComfyUI/models/ (skips split_files/ wrapper):
 
 
 
 
 
 
30
  hf download jdopensource/JoyAI-Image-Edit-ComfyUI \
31
+ --include "split_files/*" \
32
+ --local-dir /path/to/ComfyUI/models \
33
+ --local-dir-use-symlinks False
34
 
35
+ # Or fetch each file individually into the matching model folder.
36
  ```
37
 
38
  ## Requirements
39
 
40
+ Native JoyImageEdit support is in flight upstream against [Comfy-Org/ComfyUI](https://github.com/comfyanonymous/ComfyUI). Until the PR lands, install ComfyUI from the JoyAI fork's branch:
41
+
42
+ ```bash
43
+ git clone https://github.com/jd-opensource/JoyAI-Image.git
44
+ # follow the ComfyUI branch instructions in JoyAI-Image/README.md
45
+ ```
46
+
47
+ When the upstream PR merges, plain `comfyanonymous/ComfyUI` will detect and load these files with no extra setup.
48
+
49
+ ## Key namespaces
50
 
51
+ For developers / quantizers β€” the top-level state-dict prefixes in each file:
52
 
53
+ - **diffusion_models**: raw transformer keys (`double_blocks.*`, `condition_embedder.*`, `img_in.*`, `proj_out.*`, `norm_out.*`). No `model.diffusion_model.` wrapper. Auto-detected by ComfyUI's `model_detection.py`.
54
+ - **text_encoders**: HF Qwen3-VL keys (`model.language_model.*`, `model.visual.*`, `lm_head.*`). ComfyUI strips the `model.` wrappers internally.
55
+ - **vae**: standard Comfy-Org Wan 2.1 VAE keys (`encoder.{conv1,downsamples,middle}.*`, `decoder.{conv1,upsamples,middle,head}.*`, plus top-level `conv1.*`/`conv2.*` for the post-quant projections).
56
 
57
  ## Links
58
 
59
+ - Source code & nodes: [github.com/jd-opensource/JoyAI-Image](https://github.com/jd-opensource/JoyAI-Image)
60
+ - Diffusers weights: [jdopensource/JoyAI-Image-Edit-Diffusers](https://huggingface.co/jdopensource/JoyAI-Image-Edit-Diffusers)
61
+ - GGUF quantizations (community): [huangfeice/JoyAI-Image-Edit-Diffusers-GGUF](https://huggingface.co/huangfeice/JoyAI-Image-Edit-Diffusers-GGUF)
62
+ - License: Apache 2.0
diffusion_models/joy_image_edit_bf16.safetensors β†’ split_files/diffusion_models/joyai_image_edit_bf16.safetensors RENAMED
File without changes
text_encoders/qwen3vl_joyimage_bf16.safetensors β†’ split_files/text_encoders/qwen_3vl_8b_joyimage_bf16.safetensors RENAMED
File without changes
vae/joy_image_edit_vae.safetensors β†’ split_files/vae/wan_2.1_vae.safetensors RENAMED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:39ffe6326a57bbc7c8a704d862e482588e3affc858bdbfc123a91b5ac3a3a42a
3
- size 253806966
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2fc39d31359a4b0a64f55876d8ff7fa8d780956ae2cb13463b0223e15148976b
3
+ size 253815318