Buckets:
| # LongCat-2.0 | |
| <div align="center"> | |
| <img src="figures/longcat_logo.svg" width="45%" alt="LongCat-2.0" /> | |
| </div> | |
| <hr> | |
| <div align="center" style="line-height: 1;"> | |
| <!-- <a href="https://longcat.ai/" target="_blank" style="margin: 2px;"> | |
| <img alt="Chat" src="https://img.shields.io/badge/๐ค%20Chat-LongCat--Flash--Chat-ADFF2F?color=29E154&logoColor=white" fill-opacity="1" style="display: inline-block; vertical-align: middle;"/> | |
| </a> --> | |
| <a href="https://huggingface.co/meituan-longcat" target="_blank" style="margin: 2px;"> | |
| <img alt="Hugging Face" src="https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-LongCat-ffc107?color=ffc107&logoColor=white" style="display: inline-block; vertical-align: middle;"/> | |
| </a> | |
| </div> | |
| <div align="center" style="line-height: 1;"> | |
| <a href="https://github.com/meituan-longcat/LongCat-2.0/blob/main/figures/wechat_official_accounts.png" target="_blank" style="margin: 2px;"> | |
| <img alt="Wechat" src="https://img.shields.io/badge/WeChat-LongCat-brightgreen?logo=wechat&logoColor=white" style="display: inline-block; vertical-align: middle;"/> | |
| </a> | |
| <!-- <a href="https://discord.gg/EXsG52D8SW"> | |
| <img src="https://img.shields.io/badge/Discord-Join%20Chat-5865F2?logo=discord&logoColor=white" /> | |
| </a> --> | |
| <a href="https://x.com/Meituan_LongCat" target="_blank" style="margin: 2px;"> | |
| <img alt="Twitter Follow" src="https://img.shields.io/badge/Twitter-LongCat-white?logo=x&logoColor=white" style="display: inline-block; vertical-align: middle;"/> | |
| </a> | |
| </div> | |
| <div align="center" style="line-height: 1;"> | |
| <a href="LICENSE" style="margin: 2px;"> | |
| <img alt="License" src="https://img.shields.io/badge/License-MIT-f5de53?&color=f5de53" style="display: inline-block; vertical-align: middle;"/> | |
| </a> | |
| </div> | |
| <p align="center"> | |
| <a href="https://longcat.chat/blog/longcat-2.0"><b>Tech Blog</b> ๐</a> | |
| </p> | |
| ## Model Introduction | |
| We introduce LongCat-2.0, a large-scale MoE language model with **1.6 trillion total parameters** and ~48 billion activated per token โ a substantial step up from previous LongCat models, accompanied by several architectural improvements. | |
| Both the full training run and the large-scale deployment are built entirely on **AI ASIC superpods**. Pretraining spans millions of accelerator-hours across more than 35 trillion tokens, with no rollbacks or irrecoverable loss spikes โ demonstrating that we have the capability to conduct frontier-scale training on alternative hardware platforms. | |
| To strengthen the model on long-horizon tasks, we introduce LongCat Sparse Attention and train LongCat-2.0 on hundreds of billions of tokens of **1M-context** data. Together with dedicated post-training, this gives LongCat-2.0 strong performance on coding and agentic tasks. | |
| --- | |
| > [!NOTE] | |
| > ๐๏ธ **Model weights coming soon** โ stay tuned! | |
Xet Storage Details
- Size:
- 2.86 kB
- Xet hash:
- d6a14f5fda376425acb77610f1621cad6567163c75290ab869ff326455065734
ยท
Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.