Wayne-King commited on
Commit
05e3807
·
verified ·
1 Parent(s): 114aca6

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +48 -0
README.md ADDED
@@ -0,0 +1,48 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ library_name: diffusers
4
+ pipeline_tag: text-to-video
5
+ tags:
6
+ - wan
7
+ - echo-memory
8
+ - world-model
9
+ - community-pipeline
10
+ ---
11
+
12
+ # Echo-Memory Diffusers pipeline
13
+
14
+ Community pipeline that overlays the Echo-Memory `context_k1` row onto official **Wan 2.1 1.3B** Diffusers weights.
15
+
16
+ - Paper: [arXiv:2606.09803](https://arxiv.org/abs/2606.09803)
17
+ - Code: [Echo-Team-Joy-Future-Academy-JD/Echo-Memory](https://github.com/Echo-Team-Joy-Future-Academy-JD/Echo-Memory)
18
+ - Original keys: [Echo-Team/Echo-Memory](https://huggingface.co/Echo-Team/Echo-Memory) `context_k1/epoch-0.safetensors`
19
+ - Converted transformer: this repo, `context_k1-diffusers/diffusion_pytorch_model.safetensors`
20
+
21
+ This is **not** the full multi-chunk camera-action / SSM research stack. It is the released DiT fine-tune remapped to Diffusers names (825 / 825 official Wan 1.3B transformer keys).
22
+
23
+ ```python
24
+ import torch
25
+ from diffusers import DiffusionPipeline
26
+ from diffusers.utils import export_to_video
27
+
28
+ pipe = DiffusionPipeline.from_pretrained(
29
+ "Wan-AI/Wan2.1-T2V-1.3B-Diffusers",
30
+ custom_pipeline="Wayne-King/echo-memory-diffusers",
31
+ torch_dtype=torch.bfloat16,
32
+ trust_remote_code=True,
33
+ )
34
+ pipe.load_echo_memory_weights() # remaps Echo-Team/Echo-Memory context_k1 on the fly
35
+ # or: pipe.load_converted_echo_memory_weights() # already-remapped transformer in this repo
36
+ pipe.to("cuda")
37
+
38
+ frames = pipe(
39
+ prompt="A golden retriever running across a sunny green field, cinematic camera follow.",
40
+ negative_prompt="blurry, static, low quality, deformed",
41
+ height=480,
42
+ width=832,
43
+ num_frames=33,
44
+ num_inference_steps=30,
45
+ guidance_scale=5.0,
46
+ ).frames[0]
47
+ export_to_video(frames, "echo_memory_context_k1.mp4", fps=16)
48
+ ```