Image-to-Video
Diffusers
Safetensors
Video
WorldModels
Stream
Diffusion

Add model card and metadata for Causal Forcing

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +63 -0
README.md CHANGED
@@ -1,3 +1,66 @@
1
  ---
2
  license: mit
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: mit
3
+ pipeline_tag: image-to-video
4
  ---
5
+
6
+ # Causal Forcing
7
+
8
+ [**Causal Forcing**](https://huggingface.co/papers/2602.02214) is a framework for high-quality real-time interactive video generation. It distills pretrained bidirectional video diffusion models into few-step autoregressive (AR) models by bridging the architectural gap between bidirectional and causal attention.
9
+
10
+ - **Project Page:** [https://thu-ml.github.io/CausalForcing.github.io/](https://thu-ml.github.io/CausalForcing.github.io/)
11
+ - **Code:** [https://github.com/thu-ml/Causal-Forcing](https://github.com/thu-ml/Causal-Forcing)
12
+ - **Paper:** [Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generation](https://huggingface.co/papers/2602.02214)
13
+
14
+ ## Overview
15
+
16
+ Causal Forcing uses an autoregressive teacher for ODE initialization to bridge the architectural gap, then applies an asymmetric DMD procedure. It significantly outperforms existing baselines in visual quality and motion dynamics while maintaining inference efficiency. The frame-wise models natively support both Text-to-Video (T2V) and Image-to-Video (I2V) generation.
17
+
18
+ ## Inference
19
+
20
+ Please refer to the [official GitHub repository](https://github.com/thu-ml/Causal-Forcing) for installation instructions.
21
+
22
+ ### Text-to-Video (T2V)
23
+
24
+ To generate video using the chunk-wise model:
25
+
26
+ ```bash
27
+ python inference.py \
28
+ --config_path configs/causal_forcing_dmd_chunkwise.yaml \
29
+ --output_folder output/chunkwise \
30
+ --checkpoint_path checkpoints/chunkwise/causal_forcing.pt \
31
+ --data_path prompts/demos.txt
32
+ ```
33
+
34
+ ### Image-to-Video (I2V)
35
+
36
+ The frame-wise setting natively supports I2V. Set the first latent initial frame as your conditional image:
37
+
38
+ ```bash
39
+ python inference.py \
40
+ --config_path configs/causal_forcing_dmd_framewise.yaml \
41
+ --output_folder output/framewise \
42
+ --checkpoint_path checkpoints/framewise/causal_forcing.pt \
43
+ --data_path prompts/i2v \
44
+ --i2v \
45
+ --use_ema
46
+ ```
47
+
48
+ ## Citation
49
+
50
+ If you find this work useful, please cite:
51
+
52
+ ```bibtex
53
+ @article{zhu2026causal,
54
+ title={Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generation},
55
+ author={Zhu, Hongzhou and Zhao, Min and He, Guande heg and Su, Hang and Li, Chongxuan and Zhu, Jun},
56
+ journal={arXiv preprint arXiv:2602.02214},
57
+ year={2026}
58
+ }
59
+
60
+ @article{zhao2026causal,
61
+ title={Causal Forcing++: Scalable Few-Step Autoregressive Diffusion Distillation for Real-Time Interactive Video Generation},
62
+ author={Zhao, Min and Zhu, Hongzhou and Zheng, Kaiwen and Zhou, Zihan and Yan, Bokai and Li, Xinyuan and Yang, Xiao and Li, Chongxuan and Zhu, Jun},
63
+ journal={arXiv preprint arXiv:2605.15141},
64
+ year={2026}
65
+ }
66
+ ```