Running on CPU Upgrade 265 The Synthetic Data Playbook: Generating Trillions of the Finest Tokens π 265 Visualize syntheticβdata experiments as an interactive bookshelf
Running 118 Unlocking On-Policy Distillation for Any Model Family π 118 Explore on-policy distillation visualization for any model
Running on CPU Upgrade Featured 3.24k The Smol Training Playbook π 3.24k The secrets to building world-class LLMs
distilbert/distilbert-base-cased-distilled-squad Question Answering β’ 65.2M β’ Updated May 6, 2024 β’ 254k β’ β’ 269
Running 3.94k The Ultra-Scale Playbook π 3.94k The ultimate guide to training LLM on large GPU Clusters