Image-to-Video
Diffusers
Safetensors
English
4d-generation
image-to-4d
diffusion
novel-view-synthesis
point-trajectory
Instructions to use Yanran21/MoGe4D with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use Yanran21/MoGe4D with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image, export_to_video # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("Yanran21/MoGe4D", dtype=torch.bfloat16, device_map="cuda") pipe.to("cuda") prompt = "A man with short gray hair plays a red electric guitar." image = load_image( "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png" ) output = pipe(image=image, prompt=prompt).frames[0] export_to_video(output, "output.mp4") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -24,7 +24,7 @@ metrics:
|
|
| 24 |
|
| 25 |
<sup>1</sup>Department of Automation, Tsinghua University <sup>2</sup>GigaAI
|
| 26 |
|
| 27 |
-
<i><sup>*</sup>Equal Contribution <sup>β </sup>
|
| 28 |
|
| 29 |
<p align="center">
|
| 30 |
<a href="https://github.com/Zhangyr2022/MoGe4D"><img src="https://img.shields.io/badge/GitHub-Code-black?logo=github" alt="GitHub"></a>
|
|
@@ -35,6 +35,7 @@ metrics:
|
|
| 35 |
<a href="https://huggingface.co/Yanran21/MoGe4D"><img src="https://img.shields.io/badge/π€%20HuggingFace-Model-ffd21e" alt="HuggingFace Model"></a>
|
| 36 |
<a href="https://www.modelscope.cn/datasets/YanranZhang/TrajScene-60K"><img src="https://img.shields.io/badge/π€%20ModelScope-Dataset-4e29ff" alt="ModelScope Dataset"></a>
|
| 37 |
</p>
|
|
|
|
| 38 |
## π Paper Summary
|
| 39 |
|
| 40 |
Generating interactive and dynamic 4D scenes from a single static image is a core challenge. Existing methods decouple geometry from motion β either *generate-then-reconstruct* (geometric inconsistency) or *reconstruct-then-generate* (limited, externally-constrained motion) β causing spatiotemporal inconsistency and poor generalization.
|
|
|
|
| 24 |
|
| 25 |
<sup>1</sup>Department of Automation, Tsinghua University <sup>2</sup>GigaAI
|
| 26 |
|
| 27 |
+
<i><sup>*</sup>Equal Contribution <sup>β </sup>Corresponding Author</i>
|
| 28 |
|
| 29 |
<p align="center">
|
| 30 |
<a href="https://github.com/Zhangyr2022/MoGe4D"><img src="https://img.shields.io/badge/GitHub-Code-black?logo=github" alt="GitHub"></a>
|
|
|
|
| 35 |
<a href="https://huggingface.co/Yanran21/MoGe4D"><img src="https://img.shields.io/badge/π€%20HuggingFace-Model-ffd21e" alt="HuggingFace Model"></a>
|
| 36 |
<a href="https://www.modelscope.cn/datasets/YanranZhang/TrajScene-60K"><img src="https://img.shields.io/badge/π€%20ModelScope-Dataset-4e29ff" alt="ModelScope Dataset"></a>
|
| 37 |
</p>
|
| 38 |
+
|
| 39 |
## π Paper Summary
|
| 40 |
|
| 41 |
Generating interactive and dynamic 4D scenes from a single static image is a core challenge. Existing methods decouple geometry from motion β either *generate-then-reconstruct* (geometric inconsistency) or *reconstruct-then-generate* (limited, externally-constrained motion) β causing spatiotemporal inconsistency and poor generalization.
|