Add model card, pipeline tag, and links to paper/code

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +26 -3
README.md CHANGED
@@ -1,3 +1,26 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ pipeline_tag: video-text-to-text
4
+ ---
5
+
6
+ # VEGA-3D (Video Extracted Generative Awareness)
7
+
8
+ VEGA-3D is a plug-and-play framework that repurposes a pre-trained video diffusion model as a Latent World Simulator to enrich Multimodal Large Language Models (MLLMs) with implicit 3D spatial priors for scene understanding, spatial reasoning, and embodied decision making.
9
+
10
+ More details can be found in the paper: [Generation Models Know Space: Unleashing Implicit 3D Priors for Scene Understanding](https://huggingface.co/papers/2603.19235).
11
+
12
+ * **Project Page:** [https://h-embodvis.github.io/VEGA-3D/](https://h-embodvis.github.io/VEGA-3D/)
13
+ * **Repository:** [https://github.com/H-EmbodVis/VEGA-3D](https://github.com/H-EmbodVis/VEGA-3D)
14
+
15
+ ## Citation
16
+
17
+ If you find VEGA-3D useful in your research, please consider citing:
18
+
19
+ ```bibtex
20
+ @inproceedings{wu2026vega,
21
+ title={Generation Models Know Space: Unleashing Implicit 3D Priors for Scene Understanding},
22
+ author={Xianjin Wu and Dingkang Liang and Tianrui Feng and Kui Xia and Yumeng Zhang and Xiaofan Li and Xiao Tan and Xiang Bai},
23
+ booktitle={Proceedings of the European Conference on Computer Vision (ECCV)},
24
+ year={2026}
25
+ }
26
+ ```