HypeNet
Collection
The models for the paper: Hybrid Linear Attention Done Right: Efficient Distillation and Effective Architectures for Extremely Long Contexts • 2 items • Updated
Links:
- GitHub repo: https://github.com/thunlp/hybrid-linear-attention
- Paper: https://arxiv.org/abs/2601.22156
This is the final HypeNet-5B checkpoint from the paper Hybrid Linear Attention Done Right: Efficient Distillation and Effective Architectures for Extremely Long Contexts, distilled from Qwen3-4B using the HALO pipeline proposed in our paper. For more information, please refer to our GitHub repo.
- Downloads last month
- 25
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support