ยท
AI & ML interests
I like training small languge models.
Organizations
published an article about 1 year ago view article Trainable Dynamic Mask Sparse Attention: Bridging Efficiency and Effectiveness in Long-Context Language Models
wubingheng
โข โข 7