Text-to-Video
Diffusers
Safetensors
English
efficient
mobile video generation
dit
recurrent hybrid attention
mghafoor commited on
Commit
c91367a
·
1 Parent(s): ab5eb7c

Add MobileWan model weights and model card

Browse files
.gitattributes CHANGED
@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ assets/*.png filter=lfs diff=lfs merge=lfs -text
37
+ assets/*.mp4 filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -1,7 +1,123 @@
1
  ---
2
- license: bsd-3-clause-clear
 
 
 
 
 
 
 
 
 
 
 
3
  language:
4
  - en
5
  base_model:
6
  - Wan-AI/Wan2.2-TI2V-5B
7
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ license:
3
+ - bsd-3-clause-clear
4
+ - other
5
+ license_name: qualcomm-responsible-ai-license
6
+ license_link: >-
7
+ https://www.qualcomm.com/site/responsible-ai-license
8
+ pipeline_tag: text-to-video
9
+ tags:
10
+ - efficient
11
+ - mobile video generation
12
+ - dit
13
+ - recurrent hybrid attention
14
  language:
15
  - en
16
  base_model:
17
  - Wan-AI/Wan2.2-TI2V-5B
18
+ ---
19
+
20
+ <table>
21
+ <tr>
22
+ <td><img src="assets/logo.png" alt="MobileWan logo" width="100" /></td>
23
+ <td><h1>MobileWan: Closing the Quality Gap for Mobile Video Diffusion</h1></td>
24
+ </tr>
25
+ </table>
26
+
27
+ <video src="assets/samples.mp4" controls autoplay muted loop playsinline width="100%">
28
+ Your browser does not support the video tag. You can download the sample video from [assets/samples.mp4](assets/samples.mp4).
29
+ </video>
30
+
31
+ <p align="center">
32
+ <a href="https://qualcomm-ai-research.github.io/mobilewan"><img src="https://img.shields.io/badge/Project-Page-Green" alt="Project Page" /></a>
33
+ <a href="https://arxiv.org/abs/2607.06173"><img src="https://img.shields.io/badge/arXiv-2607.06173-b31b1b.svg" alt="arXiv" /></a>
34
+ <a href="https://huggingface.co/Qualcomm-AI-Research/mobilewan"><img src="https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Model-blue" alt="Hugging Face Model" /></a>
35
+ <a href="https://github.com/qualcomm-ai-research/mobilewan"><img src="https://img.shields.io/badge/GitHub-Code-181717?logo=github&logoColor=white" alt="GitHub Code" /></a>
36
+ </p>
37
+
38
+ <p align="center">
39
+ <strong><a href="https://www.qualcomm.com/research/artificial-intelligence">Qualcomm AI Research</a></strong>
40
+ </p>
41
+
42
+ <p align="center">
43
+ <a href="https://mohsenghafoorian.github.io">Mohsen Ghafoorian*</a>,
44
+ <a href="https://scholar.google.com/citations?user=ypspak0AAAAJ">Denis Korzhenkov*</a>,
45
+ <a href="https://scholar.google.com/citations?user=bN7UGiYAAAAJ&amp;hl=en">Adil Karjauv*</a>,
46
+ <a href="https://nl.linkedin.com/in/ioannis-lelekas-609bb5151">Ioannis Lelekas*</a>,
47
+ <a href="https://scholar.google.com/citations?user=M9BUCaUAAAAJ&amp;hl=en">Noor Fathima*</a>,
48
+ <a href="https://scholar.google.com/citations?user=qTA97GgAAAAJ&amp;hl=en">Spyridon Stasis</a>,
49
+ <a href="https://scholar.google.com/citations?user=UK3TEWUAAAAJ&amp;hl=en">Hanno Ackermann</a>,
50
+ <a href="https://scholar.google.com/citations?user=9BHYPnUAAAAJ&amp;hl=en">Boris van Breugel</a>,
51
+ <a href="https://scholar.google.com/citations?user=akNuBBEAAAAJ&amp;hl=en">Markus Nagel</a>,
52
+ <a href="https://scholar.google.com/citations?user=VpB8NZ8AAAAJ&amp;hl=en">Fatih Porikli</a>,
53
+ <a href="https://akanimax.github.io">Animesh Karnewar</a>,
54
+ <a href="https://habibian.github.io/">Amirhossein Habibian</a>
55
+ </p>
56
+
57
+ ## Citation
58
+
59
+ ```bibtex
60
+ @article{ghafoorian2026mobilewan,
61
+ title = {MobileWan: Closing the Quality Gap for Mobile Video Diffusion},
62
+ author = {Mohsen Ghafoorian and Denis Korzhenkov and Adil Karjauv and Ioannis Lelekas and Noor Fathima and Spyridon Stasis and Hanno Ackermann and Boris van Breugel and Markus Nagel and Fatih Porikli and Animesh Karnewar and Amirhossein Habibian},
63
+ journal = {arXiv preprint arXiv:2607.06173},
64
+ year = {2026}
65
+ }
66
+ ```
67
+
68
+ ## Overview
69
+
70
+ MobileWan starts from the [Wan-AI/Wan2.2-TI2V-5B](https://huggingface.co/Wan-AI/Wan2.2-TI2V-5B) text-to-video transformer and modifies it to make high-quality video diffusion more practical for mobile deployment. This checkpoint focuses on reducing the computational cost of the transformer while largely preserving generation quality.
71
+
72
+ The main transformer-side changes include:
73
+
74
+ - **Attention-head pruning:** We prune less important attention heads in the Wan2.2 5B transformer to reduce compute and memory costs while retaining the most useful attention pathways. This checkpoint specifically prunes ~23% of the heads.
75
+ - **Recurrent Hybrid Attention:** We use recurrent hybrid attention to make the transformer more efficient for video generation, reducing the cost of long spatio-temporal attention patterns with linear attention while keeping the more crucial local dependencies modeled through softmax attention.
76
+ - **Step distillation:** We reduce the number of diffusion steps required at inference time. For this checkpoint, the step-distillation stage uses the decoupled DMD objective, and our evaluations use sampling with 3 denoising steps.
77
+
78
+ For more details, please read the corresponding paper: [https://arxiv.org/pdf/2607.06173](https://arxiv.org/pdf/2607.06173).
79
+
80
+ ## How to Sample Videos
81
+
82
+ Please refer to: [https://github.com/qualcomm-ai-research/mobilewan](https://github.com/qualcomm-ai-research/mobilewan)
83
+
84
+ ## Model Description
85
+
86
+ - **Developed by:** Qualcomm AI Research, Generative Vision group, Amsterdam, Netherlands
87
+ - **Model type:** Mobile video generation with efficient diffusion transformer architecture
88
+ - **Model size:** ~5B parameters (DiT only)
89
+ - **Model precision:** torch.bfloat16 (BF16)
90
+ - **Model resolution:** This model is developed to generate 81-frame videos (5s @ 16fps) at [480 x 832] resolution directly on a Snapdragon-powered mobile phone.
91
+ - **Base model:** [Wan-AI/Wan2.2-TI2V-5B](https://huggingface.co/Wan-AI/Wan2.2-TI2V-5B)
92
+ - **Pipeline tag:** Text-to-video
93
+ - **Description:** This model can be used to generate videos based on provided text prompts. Note that the optimized video decoder is not released here; therefore, the sampling code uses the decoder from the original Wan2.2 5B pipeline.
94
+ - **Resources for more information:** Check out the [GitHub repository](https://github.com/qualcomm-ai-research/mobilewan) and the [technical report on arXiv](https://arxiv.org/abs/2607.06173).
95
+
96
+ ## License/Terms of Use
97
+
98
+ This model is released under the BSD 3-Clause Clear license and the Qualcomm responsible AI license: https://www.qualcomm.com/site/responsible-ai-license
99
+
100
+ ## Uses
101
+
102
+ The model is intended for research purposes. Possible research areas and tasks include:
103
+
104
+ - Research on efficient transformer or non-transformer based backbone architectures for video generation.
105
+ - Generation of video-based artworks and use in design and other artistic processes.
106
+ - Applications in educational or creative tools.
107
+ - Research on generative models.
108
+ - Safe deployment of models which have the potential to generate harmful content.
109
+ - Probing and understanding the limitations and biases of generative models.
110
+
111
+
112
+ ## Limitations and Bias
113
+
114
+ ### Limitations
115
+
116
+ - The model does not achieve perfect photorealism.
117
+ - The model cannot render complex legible text.
118
+ - The model's generation quality may be impacted by prompts that are too short.
119
+ - The model cannot produce videos with accurate physically compliant motion.
120
+
121
+ ### Bias
122
+
123
+ While the capabilities of the presented mobile video generation model are impressive, they can also reinforce or exacerbate social biases inherited from the base Wan model.
assets/logo.png ADDED

Git LFS Details

  • SHA256: 89147bf070ff64958394bc7710037f0a924a6e4d5fe797f0d0cb6697e6fcd9ea
  • Pointer size: 131 Bytes
  • Size of remote file: 691 kB
assets/samples.mp4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8b47b08485fd4c9e6824c05f4f9cbac3eb378f1fcabfdaf5ec185dfae5ba7e06
3
+ size 20408481
diffusion_pytorch_model-00001-of-00005.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c8405febbc3cc4354e57dfb318321a036574abee3277badef7dccd5bde8cd82a
3
+ size 2135864616
diffusion_pytorch_model-00002-of-00005.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd75f27ab1a3e686d904f4ed618bfe14e32b755eeb7d6654f21c5b1878526ab9
3
+ size 2063399376
diffusion_pytorch_model-00003-of-00005.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7916e86e301472c9601ed8d1f3c67078a63522ae9d48ecd0c4fdbcd41d926a26
3
+ size 2131001864
diffusion_pytorch_model-00004-of-00005.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:34b897857ed74d9d3faa6bf13027b9ad98789e9055cda1935c5fb6069773fda6
3
+ size 2140420632
diffusion_pytorch_model-00005-of-00005.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1957db93746bca8834c15a5c14958b65a6a1fea9fcfa39182b353c4bfc17a326
3
+ size 1455796080
diffusion_pytorch_model.safetensors.index.json ADDED
The diff for this file is too large to render. See raw diff