Theskywalker07
/

ablation_7_active

Model card Files Files and versions

ablation_7_active

Ctrl+K

Ctrl+K

1 contributor

History: 17 commits

Theskywalker07's picture

Upload full run contents (scripts, checkpoints, and results)

77e3746 verified 7 days ago

babylm_eval_repo
Upload full run contents (scripts, checkpoints, and results) (part 13) 7 days ago
checkpoints
Upload full run contents (scripts, checkpoints, and results) (part 13) 7 days ago
hf_cache
Upload full run contents (scripts, checkpoints, and results) (part 13) 7 days ago
.DS_Store

6.15 kB
Update strict-small architecture files (SwiGLU, sliding window [64, 16, 8, 4], ln3, ln_post_moe, no res3) 7 days ago
.gitattributes

1.52 kB
Upload full run contents (scripts, checkpoints, and results) 7 days ago
README-2.md

3.26 kB
Update strict-small architecture files (SwiGLU, sliding window [64, 16, 8, 4], ln3, ln_post_moe, no res3) 7 days ago
configuration_xpertgpt.py

1.08 kB
Update strict-small architecture files (SwiGLU, sliding window [64, 16, 8, 4], ln3, ln_post_moe, no res3) 7 days ago
modeling_xpertgpt.py

18 kB
Update strict-small architecture files (SwiGLU, sliding window [64, 16, 8, 4], ln3, ln_post_moe, no res3) 7 days ago
train.py

72.6 kB
Update strict-small architecture files (SwiGLU, sliding window [64, 16, 8, 4], ln3, ln_post_moe, no res3) 7 days ago
upload_all_hf.py

3.71 kB
Update strict-small architecture files (SwiGLU, sliding window [64, 16, 8, 4], ln3, ln_post_moe, no res3) 7 days ago
upload_project_hf.py

3.28 kB
Update strict-small architecture files (SwiGLU, sliding window [64, 16, 8, 4], ln3, ln_post_moe, no res3) 7 days ago