Video-to-Video
Diffusers
Safetensors
English
JoyVideoEditPipeline
video
video-editing
reference-image-guided
autoregressive-diffusion
Instructions to use jdopensource/JoyAI-Video-Edit-Diffusers with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use jdopensource/JoyAI-Video-Edit-Diffusers with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("jdopensource/JoyAI-Video-Edit-Diffusers", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
| { | |
| "_class_name": "JoyVideoEditTransformer3DModel", | |
| "_diffusers_version": "0.40.0.dev0", | |
| "chunk_size": 1, | |
| "global_sink_chunk": true, | |
| "hidden_size": 4096, | |
| "in_channels": 64, | |
| "local_window_size": 3, | |
| "mlp_width_ratio": 4.0, | |
| "num_attention_heads": 32, | |
| "num_layers": 40, | |
| "out_channels": 64, | |
| "patch_size": [ | |
| 1, | |
| 1, | |
| 1 | |
| ], | |
| "rope_dim_list": [ | |
| 16, | |
| 56, | |
| 56 | |
| ], | |
| "source_id_rope_dim": 128, | |
| "source_id_rope_theta": 256.0, | |
| "text_dim": 4096, | |
| "theta": 256 | |
| } | |