Datasets for high quality small LM model pre-training.
George Grigorev
thepowerfuldeez
AI & ML interests
Building stuff with LLMs. Fine-tuning, context extension
Recent Activity
liked a dataset 2 days ago
anhchanghoangsg/reddit_pushshift_dataset_cleaned updated a dataset about 1 month ago
thepowerfuldeez/massive-yt-edu-transcriptions updated a dataset about 1 month ago
thepowerfuldeez/massive-yt-edu-queueOrganizations
None yet
models 16
thepowerfuldeez/imu1_base
Text Generation • 0.5B • Updated • 33 • 2
thepowerfuldeez/1226_smollm_imu_checkpoints
Updated
thepowerfuldeez/0101_dclm_edu_boolq
Updated
thepowerfuldeez/1226_smollm_49ep_checkpoints
Updated
thepowerfuldeez/imu_1_midtrain
0.5B • Updated • 1 • 1
thepowerfuldeez/seGPT-tokenizer
Updated
thepowerfuldeez/0925_bigbench_code_tokenizer
Updated
thepowerfuldeez/sft_saved_merged
Updated
thepowerfuldeez/Openthoughts-SFT-Qwen3-0.6B-GRPO
Updated
thepowerfuldeez/nGPT-tokenizer
Updated
datasets 15
thepowerfuldeez/massive-yt-edu-transcriptions
Preview • Updated • 37 • 1
thepowerfuldeez/massive-yt-edu-queue
Viewer • Updated • 4.49M • 59
thepowerfuldeez/1226_imu1_base_decay_corpus
Updated • 227
thepowerfuldeez/1218_imu1_base_stable_corpus
Updated • 97
thepowerfuldeez/imu1_base_decay_corpus
Updated • 208
thepowerfuldeez/imu1_base_midtrain_corpus
Updated • 36
thepowerfuldeez/imu1_base_stable_corpus
Updated • 30
thepowerfuldeez/the-stack-v2-extra-python-content
Viewer • Updated • 10.6k • 25
thepowerfuldeez/the-stack-v2-train-smol-ids-updated-content
Viewer • Updated • 387k • 101
thepowerfuldeez/the-stack-v2-train-smol-ids-updated
Viewer • Updated • 409k • 31