SolarWM: Open Data and Scalable Training for Long-Horizon Video World Models
Abstract
SolarWM provides an open framework and unified training recipe for building interactive video world models across diverse data sources and generator backbones, enabling long-horizon real-time rollouts.
We introduce SolarWM, a fully open foundation for building interactive video world models from data preparation through long-horizon inference. Training across heterogeneous data sources and video backbones is challenging: datasets differ in temporal scale, camera geometry, visual quality, motion, and captioning styles, while video generators use distinct representations and architectures. Naive data mixing and model-specific implementations therefore produce inconsistent supervision and make results difficult to reproduce and compare. SolarWM addresses this coupling with a reconfigurable multi-source data engine and a backbone-native adaptation framework. The engine converts 1.43 million canonical clips from 10 datasets into a unified, frame-aligned contract covering visual observations, metric camera geometry, captions, quality metadata, selection decisions, and provenance, while decoupling source processing from mixture construction. Under shared camera-conditioning, training, and inference interfaces, we instantiate four 5B--33B models based on Wan2.2, LTX-2.5, and MiniMax-H3 while preserving their native representations and objectives. A unified three-stage recipe combines bidirectional adaptation, teacher-forced autoregressive initialization, and distribution matching distillation. The resulting causal models enable real-time interaction over rollouts ranging from minutes to hours after being trained on only 5s sequences. By releasing the resulting data, pipeline, recipes, weights, and framework, SolarWM provides a reproducible and extensible foundation for interactive world-model research.
Community
We present SolarWM, a fully open foundation for building interactive video
world models from data preparation through scalable training and long-horizon
inference.
- Open, reconfigurable data infrastructure. SolarWM converts 1.43 million
canonical clips from 14 datasets into a unified, frame-aligned contract for
observations, metric camera geometry, captions, quality metadata, selection,
and provenance. Source processing is decoupled from training-mixture design. - A scalable, backbone-native model family. One framework supports four
5B–33B models across Wan2.2, LTX-2.5, and MiniMax-H3 while preserving each
backbone's native representation and objective. - A simple three-stage training recipe. Bidirectional adaptation,
teacher-forced autoregressive initialization, and distribution matching
distillation form a shared route across heterogeneous video backbones,
without specialized ODE or consistency-distillation initialization. - Long-horizon interaction from short training clips. After training only
on 5-second sequences, the resulting causal models support real-time
interaction with rollouts spanning minutes to hours, without long-sequence
fine-tuning or attention-sink mechanisms.
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- Wonder: Video World Model Done Better (2026)
- AlayaWorld: Interactive Long-Horizon World Modeling -- Full Technical Report (2026)
- Long-Horizon Audio-Visual Generation for Persistent Stories and Interactive Worlds (2026)
- ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPU (2026)
- MiniWorld: Democratizing the Training of Video World Models from Scratch (2026)
- MoWorld: A Flash World Model (2026)
- Alaya-EVOKE: From Linear-Scaling Supervision to Endless World (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2609.02886 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 5
junchaoh-cs/SolarWM
Datasets citing this paper 1
junchaoh-cs/SolarWM-Data
Spaces citing this paper 0
No Space linking this paper