Qwen-Drive-1.0: An Initial Step towards a Vision-Language Foundation Model for Autonomous Driving
Abstract
Qwen-Drive-1.0 is a vision-language foundation model for autonomous driving that unifies 3D perception, visual question answering, and motion planning via shared representations and staged training.
We present Qwen-Drive-1.0, an initial step towards a vision-language foundation model for autonomous driving. Qwen-Drive-1.0 retains the architecture of the pretrained vision-language model (VLM) and integrates 3D perception, visual question answering, and motion planning within a unified framework. An external bird's-eye-view (BEV) perception head jointly performs 3D object detection, semantic occupancy prediction, and BEV map segmentation. It serves as a probe of the 3D information accessible from the shared representations and provides an explicit, inspectable interface to 3D scene structure. A Planning Expert conditions on shared VLM representations to generate future ego trajectories. A staged training recipe combines driving supervision with general-purpose vision-language data to acquire driving-specific competence while helping preserve broad visual understanding and instruction-following capabilities. Experiments demonstrate strong 3D perception and driving scene understanding while largely preserving general vision-language capability. Comprehensive evaluations across open-loop, pseudo-closed-loop, and closed-loop settings further show highly competitive motion-planning performance.
Community
We introduce Qwen-Drive-1.0, the first vision-language foundation model for autonomous driving that unifies 3D perception and visual question answering at the pretraining stage and further extends to motion planning, while keeping the pretrained VLM architecture entirely untouched. Built on the natively multimodal Qwen3.5-4B, it attaches two external modules. A BEV perception head serves as an explicit, inspectable 3D probe, jointly performing 3D object detection, semantic occupancy prediction, and BEV map segmentation, and a Planning Expert generates future ego trajectories through flow matching. Through staged training, we substantially boost the autonomous driving capability of a general-purpose VLM and validate it on 3D perception, driving visual question answering, and motion planning tasks, forming a unified driving vision-language model that offers a new-generation VLM base for driving-scenario adaptation.
Really promising approach unifying 3D perception, visual Q&A, and motion planning within a single VLM framework without altering the Qwen backbone!
If you prefer listening to research paper breakdowns, here is a full audio podcast conversion of this paper with interactive synced transcripts and key concept summaries:
šļø Listen to the Qwen-Drive-1.0 Audio Breakdown: https://www.tensorbrife.site/podcast/be718e7b-7845-4e36-8ac8-a3398875a138
Hey, the huggingface url in the paper returns a 404. https://huggingface.co/Qwen/Qwen-Drive-1.0-4B
Will be made available today
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigation (2026)
- XCoT-VLA: Executable Chain-of-Thought for Vision-Language-Action Driving (2026)
- WNM-3D: A World Navigation Model with 3D Scene Conditioning for Closed-Loop VLN (2026)
- Geo-VLA: Geometry-Aware Vision-Language-Action Planning via Internalization of Map Semantics (2026)
- PixelPilot: Scalable Vision-Language-Action Models for End-to-End Autonomous Driving (2026)
- GaussianDWM++: Language-Grounded 3D Gaussian Driving World Model for Unified Scene Understanding, Editing, and Multi-Modal Generation (2026)
- Auto-JEPA: A Latent World Model of Continuous Intent for End-to-End Autonomous Driving (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2609.00111 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 1
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper