Datasets for high quality small LM model pre-training.
George Grigorev
thepowerfuldeez
AI & ML interests
Building stuff with LLMs. Fine-tuning, context extension
Recent Activity
updated
a dataset
1 day ago
thepowerfuldeez/1226_imu1_base_decay_corpus
updated
a dataset
1 day ago
thepowerfuldeez/1218_imu1_base_stable_corpus
upvoted
a
paper
1 day ago
IMU-1: Sample-Efficient Pre-training of Small Language Models
Organizations
None yet
models
17
thepowerfuldeez/imu1_base
Text Generation
•
0.5B
•
Updated
•
46
•
1
thepowerfuldeez/1226_smollm_imu_checkpoints
Updated
thepowerfuldeez/0101_dclm_edu_boolq
Updated
thepowerfuldeez/1226_smollm_49ep_checkpoints
Updated
thepowerfuldeez/imu_1_midtrain
0.5B
•
Updated
•
1
•
1
thepowerfuldeez/imu_1_base
0.5B
•
Updated
•
4
•
1
thepowerfuldeez/seGPT-tokenizer
Updated
thepowerfuldeez/0925_bigbench_code_tokenizer
Updated
thepowerfuldeez/sft_saved_merged
Updated
thepowerfuldeez/Openthoughts-SFT-Qwen3-0.6B-GRPO
Updated
datasets
13
thepowerfuldeez/1226_imu1_base_decay_corpus
Updated
•
13
thepowerfuldeez/1218_imu1_base_stable_corpus
Updated
•
71
thepowerfuldeez/imu1_base_decay_corpus
Updated
•
2
thepowerfuldeez/imu1_base_midtrain_corpus
Updated
•
751
thepowerfuldeez/imu1_base_stable_corpus
Updated
thepowerfuldeez/the-stack-v2-extra-python-content
Viewer
•
Updated
•
10.6k
•
11
thepowerfuldeez/the-stack-v2-train-smol-ids-updated-content
Viewer
•
Updated
•
387k
•
49
thepowerfuldeez/the-stack-v2-train-smol-ids-updated
Viewer
•
Updated
•
409k
•
20
thepowerfuldeez/deepscale_r_math_problems_balanced
Viewer
•
Updated
•
14.7k
•
1
thepowerfuldeez/deepscale_r_math_problems
Viewer
•
Updated
•
79.5k
•
5