BigScience Workshop

non-profit

https://bigscience.huggingface.co

bigscience-workshop

AI & ML interests

A one-year long research workshop on large language models: the Summer of Language Models 21 🌸

Recent Activity

christopher new activity 4 days ago

bigscience/bloom:[SPAM] Deleted

christopher new activity 11 days ago

bigscience/bloom:pretokenizer Regex issues?

nguyenvulebinh authored a paper 11 days ago

Beyond Transcripts: A Renewed Perspective on Audio Chaptering

View all activity

in bigscience/bloom 4 days ago

[SPAM] Deleted

#289 opened 4 days ago by

authored a paper 4 days ago

RbtAct: Rebuttal as Supervision for Actionable Review Feedback Generation

Paper • 2603.09723 • Published 6 days ago • 6

in bigscience/bloom 11 days ago

pretokenizer Regex issues?

#278 opened over 1 year ago by

in bigscience/bloom 16 days ago

Test PR

#286 opened 16 days ago by

Test discussion

#287 opened 16 days ago by

Test discussion

#288 opened 16 days ago by

authored a paper 24 days ago

References Improve LLM Alignment in Non-Verifiable Domains

Paper • 2602.16802 • Published 26 days ago • 2

submitted a paper to Daily Papers about 1 month ago

Shaping capabilities with token-level data filtering

Paper • 2601.21571 • Published Jan 29 • 27

pjox

authored a paper about 2 months ago

SciLaD: A Large-Scale, Transparent, Reproducible Dataset for Natural Scientific Language Processing

Paper • 2512.11192 • Published Dec 12, 2025

authored a paper about 2 months ago

PingPong: A Natural Benchmark for Multi-Turn Code-Switching Dialogues

Paper • 2601.17277 • Published Jan 24 • 6

authored a paper about 2 months ago

Patient-Similarity Cohort Reasoning in Clinical Text-to-SQL

Paper • 2601.09876 • Published Jan 14 • 7

shubhamagarwal92

authored a paper 3 months ago

BhashaKritika: Building Synthetic Pretraining Data at Scale for Indic Languages

Paper • 2511.10338 • Published Nov 13, 2025

in bigscience/bloomz-560m 3 months ago

Fails to load with transformers v4.57+

#14 opened 3 months ago by

posted an update 4 months ago

Post

448

PatchDNA, a DNA foundation model based on Meta's BLT tokenization strategy https://www.biorxiv.org/content/10.1101/2025.11.28.691095v1

in bigscience/petals-api 4 months ago

Bloom

#2 opened 4 months ago by

authored a paper 4 months ago

Grounding Computer Use Agents on Human Demonstrations

Paper • 2511.07332 • Published Nov 10, 2025 • 106

authored a paper 5 months ago

MixtureVitae: Open Web-Scale Pretraining Dataset With High Quality Instruction and Reasoning Data Built from Permissive-First Text Sources

Paper • 2509.25531 • Published Sep 29, 2025 • 9

authored a paper 5 months ago

BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution

Paper • 2510.08697 • Published Oct 9, 2025 • 39

authored a paper 5 months ago

BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution

Paper • 2510.08697 • Published Oct 9, 2025 • 39

posted an update 6 months ago

Post

466

Bio LLMs train on many genomes, but can we encode differences within a species? TomatoTomato adds pangenome tokens to represent a domestic tomato and a wild tomato in one sequence 🍅 🧬
monsoon-nlp/tomatotomato-gLM2-150M-v0.1