The Synthetic Data Playbook: Generating Trillions of the Finest Tokens
📝
236
Explore synthetic data experiments on a virtual bookshelf
tm23
tm23hgf
AI & ML interests
None yet
Recent Activity
liked a Space 3 days ago
HuggingFaceFW/finephrase updated a model 14 days ago
tm23hgf/anime-sdxl-lora published a model 14 days ago
tm23hgf/anime-sdxl-loraOrganizations
None yet
liked a
Space 3 days ago
updated a
model 14 days ago
published a
model 14 days ago
commented on Strand-Rust-Coder-v1: Rust Coding Model Fine-Tuned on Peer-Ranked Synthetic Data 16 days ago
awesome work, i am going to start some research on reasoning SLM on rust wanted to know is the dataset publicly released?
liked a
Space 17 days ago
liked a
Space 23 days ago
updated a
Space 26 days ago
updated a
dataset 26 days ago
published a
dataset 26 days ago
published a
Space 27 days ago
updated a
model about 1 month ago
published a
model about 1 month ago
updated a
Space about 1 month ago
published a
Space about 2 months ago
updated a
Space about 2 months ago
published a
Space about 2 months ago
Not a good dataset
2
#2 opened 5 months ago
by tm23hgf
commented on Mixture of Experts Explained 6 months ago
Chinchilla paper actually shows that for a fixed compute budget, it is better to train a smaller model on more data rather than training a larger model for fewer steps.
upvoted an article 6 months ago
Article
Mixture of Experts Explained
- +4
osanseviero, lewtun, philschmid, smangrul, ybelkada, pcuenq
• • 1.13k