Instructions to use AlayaLab/AlayaWorld with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use AlayaLab/AlayaWorld with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image, export_to_video # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("AlayaLab/AlayaWorld", dtype=torch.bfloat16, device_map="cuda") pipe.to("cuda") prompt = "A man with short gray hair plays a red electric guitar." image = load_image( "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png" ) output = pipe(image=image, prompt=prompt).frames[0] export_to_video(output, "output.mp4") - Notebooks
- Google Colab
- Kaggle
AlayaWorld โ Weights
Pretrained inference weights for AlayaWorld: Long-Horizon and Playable Video World Generation (Alaya Lab, Shanda AI Research Tokyo).
- Code: https://github.com/AlayaLab/AlayaWorld
- Technical report: https://arxiv.org/abs/2607.06291
Files
| File | Description |
|---|---|
merged_infer.safetensors |
Single bundle: DiT + VAE + text-encoder + history-encoder. Place under checkpoints/ per the code repo's README. |
The text encoder (Gemma-3) and the spatial-memory depth model (Depth-Anything-3) are not included here โ download them from their original sources as described in the code repository's README.
License
This project is based on LTX-2 by Lightricks Ltd. merged_infer.safetensors
is fine-tuned from the LTX-2.3-22B base and is a derivative of LTX-2.3;
accordingly it is released under the LTX-2 Community License Agreement
(https://github.com/Lightricks/LTX-2/blob/main/LICENSE), not Apache 2.0. All
original LTX-2 copyright and attribution notices are retained.
For academic research and non-commercial use only. For commercial use of LTX-2 or its derivatives, contact Lightricks Ltd.; entities with โฅ $10M annual revenue require a commercial license from Lightricks.
Citation
@article{team2026alayaworld,
title={AlayaWorld: Long-Horizon and Playable Video World Generation},
author={Team, AlayaWorld and Zhang, Kaipeng and Li, Chuanhao and Zhan, Yifan and Ge, Yongtao and Yin, Yuanyang and others},
journal={arXiv preprint arXiv:2607.06291},
year={2026}
}
- Downloads last month
- 55
Model tree for AlayaLab/AlayaWorld
Base model
Lightricks/LTX-2.3