Article
Improving Hugging Face Training Efficiency Through Packing with Flash Attention 2
- +4
RQlee, ArthurZ, achikundu, lwtr, rganti, mayank-mishra
• • 41Mayank Mishra
mayank-mishra
AI & ML interests
Large Language Models, Distributed Training and Inference
Recent Activity
liked a model 4 days ago
rednote-hilab/dots.ocr updated a model 2 months ago
mayank-mishra/hybrid-mamba2-7b published a model 2 months ago
mayank-mishra/hybrid-mamba2-7bOrganizations
published an article almost 2 years ago
published an article almost 2 years ago
Article
Saving Memory Using Padding-Free Transformer Layers during Finetuning
mayank-mishra
• • 21 published an article about 2 years ago
Article
Aurora-M: The First Open Source Biden-Harris Executive Order Red teamed Multilingual Language Model
mayank-mishra
• • 7