Dynamic Multi-Byte Prediction With Hierarchical Language Models Paper • 2608.15454 • Published 28 days ago • 19
Continually Adding New Languages to Multilingual Language Models Paper • 2509.11414 • Published Sep 14, 2025
FLEXITOKENS: Flexible Tokenization for Evolving Language Models Paper • 2507.12720 • Published Jul 17, 2025 • 10
The NaijaVoices Dataset: Cultivating Large-Scale, High-Quality, Culturally-Rich Speech Data for African Languages Paper • 2505.20564 • Published May 26, 2025 • 1
MasakhaNEWS: News Topic Classification for African languages Paper • 2304.09972 • Published Apr 19, 2023
LCA-MBP: Dynamic Multi-Byte Prediction Collection 374M byte-level models from Dynamic Multi-Byte Prediction With Hierarchical Language Models — arxiv.org/abs/2608.15454 • 7 items • Updated 3 days ago