Instructions to use Wan-AI/Wan2.2-Animate-2-14B-Diffusers with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use Wan-AI/Wan2.2-Animate-2-14B-Diffusers with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("Wan-AI/Wan2.2-Animate-2-14B-Diffusers", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
Add diffusers-format transformer weights
Browse filesAdds the diffusers-format Wan-Animate-2 weights for huggingface/diffusers#14413:
- `transformer/`: converted from the research state dict (conversion verified bitwise)
- `scheduler/scheduler_config.json`: the scheduler the release samples with (the current file says `UniPCMultistepScheduler`, which does not match `model_index.json`)
- `modular_model_index.json`: enables `ModularPipeline.from_pretrained` on this repo; the `transformer`/`scheduler` specs pin this PR's revision so it is runnable before merging — they can be set to `null` once merged
- transformer/config.json +1 -8
- transformer/diffusion_pytorch_model-00001-of-00004.safetensors +2 -2
- transformer/diffusion_pytorch_model-00002-of-00004.safetensors +2 -2
- transformer/diffusion_pytorch_model-00003-of-00004.safetensors +2 -2
- transformer/diffusion_pytorch_model-00004-of-00004.safetensors +2 -2
- transformer/diffusion_pytorch_model.safetensors.index.json +0 -0
transformer/config.json
CHANGED
|
@@ -7,7 +7,6 @@
|
|
| 7 |
"ffn_dim": 13824,
|
| 8 |
"freq_dim": 256,
|
| 9 |
"in_dim": 36,
|
| 10 |
-
"log_scale": 0.0,
|
| 11 |
"num_heads": 40,
|
| 12 |
"num_layers": 40,
|
| 13 |
"out_dim": 16,
|
|
@@ -16,17 +15,11 @@
|
|
| 16 |
2,
|
| 17 |
2
|
| 18 |
],
|
| 19 |
-
"qk_norm": true,
|
| 20 |
"refer_offset_h": 0,
|
| 21 |
"refer_offset_t": 1,
|
| 22 |
"refer_offset_w": -1,
|
| 23 |
"refer_stride": 1,
|
| 24 |
-
"sparse_type": 0,
|
| 25 |
"text_dim": 4096,
|
| 26 |
"text_len": 512,
|
| 27 |
-
"use_img_emb": true
|
| 28 |
-
"window_size": [
|
| 29 |
-
-1,
|
| 30 |
-
-1
|
| 31 |
-
]
|
| 32 |
}
|
|
|
|
| 7 |
"ffn_dim": 13824,
|
| 8 |
"freq_dim": 256,
|
| 9 |
"in_dim": 36,
|
|
|
|
| 10 |
"num_heads": 40,
|
| 11 |
"num_layers": 40,
|
| 12 |
"out_dim": 16,
|
|
|
|
| 15 |
2,
|
| 16 |
2
|
| 17 |
],
|
|
|
|
| 18 |
"refer_offset_h": 0,
|
| 19 |
"refer_offset_t": 1,
|
| 20 |
"refer_offset_w": -1,
|
| 21 |
"refer_stride": 1,
|
|
|
|
| 22 |
"text_dim": 4096,
|
| 23 |
"text_len": 512,
|
| 24 |
+
"use_img_emb": true
|
|
|
|
|
|
|
|
|
|
|
|
|
| 25 |
}
|
transformer/diffusion_pytorch_model-00001-of-00004.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:af9719a7623c9d1606e876b7387a5be4444c34334ba76f3f2fb9a46690ded25a
|
| 3 |
+
size 9874593104
|
transformer/diffusion_pytorch_model-00002-of-00004.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f4b73ff42e08584400120f3a519d021a337e3aeb8304980c90c357baed609a1c
|
| 3 |
+
size 9975379320
|
transformer/diffusion_pytorch_model-00003-of-00004.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:099d2a406ba1b72e1ef4a4396dbe38783b974831c334ae09c664541e2d0956bb
|
| 3 |
+
size 9954401600
|
transformer/diffusion_pytorch_model-00004-of-00004.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:01c7ab59033a407341cbfac1e90480f4a9816acf8a5f53fd84ef214e035f778f
|
| 3 |
+
size 2985521520
|
transformer/diffusion_pytorch_model.safetensors.index.json
CHANGED
|
The diff for this file is too large to render.
See raw diff
|
|
|