Robotics
Safetensors
vision-language-action-model
world-model
manipulation
domino
hxma commited on
Commit
fc414b6
·
verified ·
1 Parent(s): 804a639

Add model card

Browse files
Files changed (1) hide show
  1. README.md +121 -0
README.md ADDED
@@ -0,0 +1,121 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-sa-4.0
3
+ base_model:
4
+ - InternRobotics/InternVLA-A1.5-RoboTwin
5
+ - InternRobotics/InternVLA-A1.5-base
6
+ - Qwen/Qwen3.5-2B
7
+ tags:
8
+ - robotics
9
+ - vision-language-action-model
10
+ - world-model
11
+ - manipulation
12
+ - domino
13
+ datasets:
14
+ - InternRobotics/InternData-A1
15
+ ---
16
+
17
+ # InternVLA-A1.5: Unifying Understanding, Latent Foresight, and Action for Compositional Generalization
18
+
19
+ <div style="display: flex; justify-content: center; align-items: center; margin: 10px 0;">
20
+ <img src="https://raw.githubusercontent.com/InternRobotics/InternVLA-A-series/master/assets/teaser.png" alt="InternVLA-A1.5 Teaser Image" style="max-width: 100%; border-radius: 10px; box-shadow: 0 4px 8px rgba(0, 0, 0, 0.1);">
21
+ </div>
22
+
23
+ [![Paper](https://img.shields.io/badge/Paper-arXiv-red.svg)](https://arxiv.org/pdf/2607.04988)
24
+ [![Code](https://img.shields.io/badge/GitHub-Code-800820?logo=github)](https://github.com/InternRobotics/InternVLA-A-series)
25
+ [![Models](https://img.shields.io/badge/Models-HuggingFace-blue?logo=huggingface)](https://huggingface.co/collections/InternRobotics/internvla-a15)
26
+ [![Data](https://img.shields.io/badge/Data-HuggingFace-blue?logo=huggingface)](https://huggingface.co/datasets/InternRobotics/InternData-A1)
27
+ [![Website](https://img.shields.io/badge/Website-Pages-blue.svg)](https://internrobotics.github.io/internvla-a15.github.io/)
28
+
29
+ <strong>InternVLA-A1.5</strong> unifies vision-language understanding, latent visual foresight, and action generation in one robot policy. It builds on a native Qwen3.5-2B VLM backbone, preserves semantic learning through VQA and subtask prediction, and attaches a lightweight unified action expert for continuous control.
30
+
31
+ This repository hosts <strong>InternVLA-A1.5-DOMINO</strong>, the checkpoint fine-tuned for DOMINO dynamic manipulation evaluation. It corresponds to the DOMINO SFT result reported for InternVLA-A1.5, where the model is adapted on the DOMINO ALOHA-AgileX Level-1 training split and evaluated on the clean Level-1 DOMINO suites.
32
+
33
+ Covering base and benchmark-specific checkpoints, we release the InternVLA-A1.5 series:
34
+
35
+ - [x] [InternVLA-A1.5-base](https://huggingface.co/InternRobotics/InternVLA-A1.5-base): base checkpoint for downstream fine-tuning and evaluation
36
+ - [x] [InternVLA-A1.5-RoboTwin](https://huggingface.co/InternRobotics/InternVLA-A1.5-RoboTwin): fine-tuned on RoboTwin 2.0
37
+ - [x] [InternVLA-A1.5-Libero](https://huggingface.co/InternRobotics/InternVLA-A1.5-Libero): fine-tuned on LIBERO
38
+ - [x] [InternVLA-A1.5-DOMINO](https://huggingface.co/InternRobotics/InternVLA-A1.5-DOMINO): fine-tuned on DOMINO
39
+
40
+ ## 🔑 Key Features
41
+
42
+ <div style="display: flex; justify-content: center; align-items: center; margin: 10px 0;">
43
+ <img src="https://raw.githubusercontent.com/InternRobotics/InternVLA-A-series/master/assets/model.png" alt="InternVLA-A1.5 Model" style="max-width: 100%; border-radius: 10px; box-shadow: 0 4px 8px rgba(0, 0, 0, 0.1);">
44
+ </div>
45
+
46
+ - 🔮 *The Core: Attaches a lightweight unified action expert to a native Qwen3.5-2B VLM backbone through shared full-attention layers, while preserving modality-specific Gated DeltaNet processing.*
47
+ - 🚀 *The Foresight: Uses learnable foresight tokens to query task-relevant future dynamics from the shared multimodal context, supervised by a frozen WAN2.2-5B video generation model during training.*
48
+ - âš¡ *The Output: Discards the video branch at inference and predicts continuous action chunks through flow matching, keeping deployment latency practical.*
49
+
50
+ ## Model Details
51
+
52
+ - **Model type:** Vision-Language-Action robot policy
53
+ - **Base checkpoints:** InternRobotics/InternVLA-A1.5-base and InternRobotics/InternVLA-A1.5-RoboTwin
54
+ - **Backbone:** Qwen/Qwen3.5-2B
55
+ - **Policy type:** `internvla_a1_5`
56
+ - **Fine-tuning target:** DOMINO ALOHA-AgileX Level-1 training split
57
+ - **Evaluation scope:** DOMINO SFT / dynamic-to-dynamic evaluation
58
+ - **Action head:** unified action expert with flow-matching action generation
59
+ - **State/action dimension:** up to 32
60
+ - **Image resolution:** 224 x 224
61
+ - **License:** CC BY-NC-SA 4.0
62
+
63
+ ## Usage
64
+
65
+ Please refer to our official repo [InternVLA-A-series](https://github.com/InternRobotics/InternVLA-A-series) for installation, training, fine-tuning, and evaluation.
66
+
67
+ For DOMINO fine-tuned evaluation:
68
+
69
+ ```bash
70
+ git clone https://github.com/InternRobotics/InternVLA-A-series.git
71
+ cd InternVLA-A-series
72
+ bash evaluation/DOMINO/eval.sh \
73
+ InternRobotics/InternVLA-A1.5-DOMINO \
74
+ outputs/domino/internvla_a1_5_domino_sft \
75
+ demo_clean_dynamic \
76
+ 8 \
77
+ fm \
78
+ 50 \
79
+ 100 \
80
+ 100000 \
81
+ 10 \
82
+ abs \
83
+ float32 \
84
+ 10
85
+ ```
86
+
87
+ For benchmark workflows, please see:
88
+
89
+ - [DOMINO Evaluation](https://github.com/InternRobotics/InternVLA-A-series/tree/master/evaluation/DOMINO)
90
+ - [RoboTwin Evaluation](https://github.com/InternRobotics/InternVLA-A-series/tree/master/evaluation/RoboTwin)
91
+
92
+ ## Demonstrations
93
+
94
+ **InternVLA-A1.5-DOMINO** corresponds to the DOMINO SFT result. SR is the primary success-rate metric, and MS denotes manipulation score.
95
+
96
+ | DOMINO Setting | SR (%) ↑ | MS ↑ |
97
+ | :--- | :---: | :---: |
98
+ | Fine-tuned / SFT dynamic manipulation | **29.3** | **42.5** |
99
+
100
+ For reference, the RoboTwin-tuned checkpoint reaches **27.7** SR and **39.8** MS in the DOMINO zero-shot setting.
101
+
102
+ ## License and Citation
103
+
104
+ All code within this repo is released under [CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/). Please consider citing our project if it helps your research.
105
+
106
+ ```BibTeX
107
+ @article{internvla_a15,
108
+ title={InternVLA-A1.5: Unifying Understanding, Latent Foresight, and Action for Compositional Generalization},
109
+ author={Ma, Haoxiang and Cai, Junhao and Xu, Xiaoxu and Li, Hao and Yang, Yuyin and Tian, Yang and Cao, Jiafei and Zhu, Hongrui and Qiu, Zherui and Zhaxizhuoma and Yang, Yuqiang and Peng, Jiaqi and Wei, Xueyuan and Zhu, Yangkun and Jiang, Jiahao and Gao, Xing and Wang, Hanqing and Yuan, Feng and Li, Kailin and Zhu, Xueyue and Wang, Tai and Ding, Yan and Pang, Jiangmiao and Zeng, Jia and Zhang, Jingjing and Zhou, Bowen and Mu, Yao and Shen, Chunhua and Zhang, Weinan},
110
+ journal={arXiv preprint arXiv:2607.04988},
111
+ year={2026}
112
+ }
113
+ ```
114
+
115
+ ## Acknowledgments
116
+
117
+ - [LeRobot](https://github.com/huggingface/lerobot)
118
+ - [openpi](https://github.com/Physical-Intelligence/openpi)
119
+ - [InternVLA-A1](https://github.com/InternRobotics/InternVLA-A1)
120
+ - [Qwen3.5](https://huggingface.co/Qwen/Qwen3.5-2B)
121
+ - [Wan](https://github.com/Wan-Video/Wan2.2)