BigScience Workshop

AI & ML interests

A one-year long research workshop on large language models: the Summer of Language Models 21 🌸

Recent Activity

stas  authored a paper about 4 hours ago

Arctic Long Sequence Training: Scalable And Efficient Training For Multi-Million Token Sequences

ybelkada  authored a paper 17 days ago

Learnable Multipliers: Freeing the Scale of Language Model Matrix Layers

christopher  new activity about 2 months ago

bigscience/bloomz-560m:Fails to load with transformers v4.57+

View all activity

Team members 328