Motif-Technologies/Motif-3
Text Generation • 315B • Updated • 50
Wonho Song
wonhosong
AI & ML interests
Data, Evaluation, Large Language Model
Recent Activity
liked a model about 18 hours ago
Motif-Technologies/Motif-3 liked a model 11 days ago
LGAI-EXAONE/K-EXAONE-2.0-750B-A37B liked a dataset 12 days ago
tokyotech-llm/swallow-math-v2Organizations
liked a
model about 18 hours ago
liked a
model 11 days ago
liked a
dataset 12 days ago
liked a
model 13 days ago
upvoted a paper 14 days ago
liked a
model 15 days ago
liked a
model 20 days ago
liked a
model 21 days ago
authored 4
papers 7 months ago
SOLAR 10.7B: Scaling Large Language Models with Simple yet Effective Depth Up-Scaling
Paper • 2312.15166 • Published • 62
sDPO: Don't Use Your Data All at Once
Paper • 2403.19270 • Published • 41
Evalverse: Unified and Accessible Library for Large Language Model Evaluation
Paper • 2404.00943 • Published • 1
Solar Open Technical Report
Paper • 2601.07022 • Published • 67
liked a
model 7 months ago
upvoted 2
papers 7 months ago
liked a
model 7 months ago
liked a
model 8 months ago
liked a
Space 8 months ago
liked a
model about 1 year ago
commented on SmolLM3: smol, multilingual, long-context reasoner about 1 year ago
@loubnabnl Thank you for your response, it’s been extremely helpful.
While reviewing the dataset sources, I came across a few questions and would like to ask for clarification:
1. Regarding the pes2o dataset, I couldn’t find it in the shared pretraining collection. Is it referring to the allenai/peS2o dataset?
2. Based on the config, I noticed three datasets: pull-requests, jupyter-scripts, and github-issues. Could you please clarify the sources for each of these?
3. For the kaggle dataset, did you use the HuggingFaceTB/issues-kaggle-notebooks source? I saw that there are two subsets, issues and kaggle — did you use only the kaggle subset?
Thanks again!