Hugging Face's logo

moderntalker
/
efficient_pretrain_checkpoints

Model card Files
xet
 Community
moderntalker commited on
Commit
5a6dcad
·
verified ·
1 Parent(s): 5d9e6c6

Upload intermediate checkpoint for fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 100000

Browse files
Files changed (3) hide show
  1. intermediate-checkpoints/4C_2gpus/fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-100000/main.pt +3 -0
  2. intermediate-checkpoints/4C_2gpus/fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-100000/worker_0.pt +3 -0
  3. intermediate-checkpoints/4C_2gpus/fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-100000/worker_1.pt +3 -0
intermediate-checkpoints/4C_2gpus/fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-100000/main.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa7d06024ec1a4b67931884ea7534293ec1d03bdaa5f241350767ca097b1510b
3
+ size 2513856385
intermediate-checkpoints/4C_2gpus/fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-100000/worker_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aeb04e095179e0b9d6e7f53b0232d81b5f868bd44c7e9a6c6768797dc506944b
3
+ size 31070
intermediate-checkpoints/4C_2gpus/fineweb_galore_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C/inter-ckpt-100000/worker_1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f39a9927344f48f613ffacc329252fbd0c6614999cf2e4fd73799d2fc3a2767e
3
+ size 99806