Instructions to use MIN-Lab/minWM with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use MIN-Lab/minWM with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image, export_to_video # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("MIN-Lab/minWM", dtype=torch.bfloat16, device_map="cuda") pipe.to("cuda") prompt = "A man with short gray hair plays a red electric guitar." image = load_image( "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png" ) output = pipe(image=image, prompt=prompt).frames[0] export_to_video(output, "output.mp4") - Notebooks
- Google Colab
- Kaggle
Add model card and metadata for Causal Forcing
#1
by nielsr HF Staff - opened
README.md
CHANGED
|
@@ -1,3 +1,66 @@
|
|
| 1 |
---
|
| 2 |
license: mit
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: mit
|
| 3 |
+
pipeline_tag: image-to-video
|
| 4 |
---
|
| 5 |
+
|
| 6 |
+
# Causal Forcing
|
| 7 |
+
|
| 8 |
+
[**Causal Forcing**](https://huggingface.co/papers/2602.02214) is a framework for high-quality real-time interactive video generation. It distills pretrained bidirectional video diffusion models into few-step autoregressive (AR) models by bridging the architectural gap between bidirectional and causal attention.
|
| 9 |
+
|
| 10 |
+
- **Project Page:** [https://thu-ml.github.io/CausalForcing.github.io/](https://thu-ml.github.io/CausalForcing.github.io/)
|
| 11 |
+
- **Code:** [https://github.com/thu-ml/Causal-Forcing](https://github.com/thu-ml/Causal-Forcing)
|
| 12 |
+
- **Paper:** [Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generation](https://huggingface.co/papers/2602.02214)
|
| 13 |
+
|
| 14 |
+
## Overview
|
| 15 |
+
|
| 16 |
+
Causal Forcing uses an autoregressive teacher for ODE initialization to bridge the architectural gap, then applies an asymmetric DMD procedure. It significantly outperforms existing baselines in visual quality and motion dynamics while maintaining inference efficiency. The frame-wise models natively support both Text-to-Video (T2V) and Image-to-Video (I2V) generation.
|
| 17 |
+
|
| 18 |
+
## Inference
|
| 19 |
+
|
| 20 |
+
Please refer to the [official GitHub repository](https://github.com/thu-ml/Causal-Forcing) for installation instructions.
|
| 21 |
+
|
| 22 |
+
### Text-to-Video (T2V)
|
| 23 |
+
|
| 24 |
+
To generate video using the chunk-wise model:
|
| 25 |
+
|
| 26 |
+
```bash
|
| 27 |
+
python inference.py \
|
| 28 |
+
--config_path configs/causal_forcing_dmd_chunkwise.yaml \
|
| 29 |
+
--output_folder output/chunkwise \
|
| 30 |
+
--checkpoint_path checkpoints/chunkwise/causal_forcing.pt \
|
| 31 |
+
--data_path prompts/demos.txt
|
| 32 |
+
```
|
| 33 |
+
|
| 34 |
+
### Image-to-Video (I2V)
|
| 35 |
+
|
| 36 |
+
The frame-wise setting natively supports I2V. Set the first latent initial frame as your conditional image:
|
| 37 |
+
|
| 38 |
+
```bash
|
| 39 |
+
python inference.py \
|
| 40 |
+
--config_path configs/causal_forcing_dmd_framewise.yaml \
|
| 41 |
+
--output_folder output/framewise \
|
| 42 |
+
--checkpoint_path checkpoints/framewise/causal_forcing.pt \
|
| 43 |
+
--data_path prompts/i2v \
|
| 44 |
+
--i2v \
|
| 45 |
+
--use_ema
|
| 46 |
+
```
|
| 47 |
+
|
| 48 |
+
## Citation
|
| 49 |
+
|
| 50 |
+
If you find this work useful, please cite:
|
| 51 |
+
|
| 52 |
+
```bibtex
|
| 53 |
+
@article{zhu2026causal,
|
| 54 |
+
title={Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generation},
|
| 55 |
+
author={Zhu, Hongzhou and Zhao, Min and He, Guande heg and Su, Hang and Li, Chongxuan and Zhu, Jun},
|
| 56 |
+
journal={arXiv preprint arXiv:2602.02214},
|
| 57 |
+
year={2026}
|
| 58 |
+
}
|
| 59 |
+
|
| 60 |
+
@article{zhao2026causal,
|
| 61 |
+
title={Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generation},
|
| 62 |
+
author={Zhao, Min and Zhu, Hongzhou and Zheng, Kaiwen and Zhou, Zihan and Yan, Bokai and Li, Xinyuan and Yang, Xiao and Li, Chongxuan and Zhu, Jun},
|
| 63 |
+
journal={arXiv preprint arXiv:2605.15141},
|
| 64 |
+
year={2026}
|
| 65 |
+
}
|
| 66 |
+
```
|