Hugging Face's logo

moderntalker
/
efficient_pretrain_checkpoints

Model card Files
xet
 Community
moderntalker commited on
Commit
e41b08a
·
verified ·
1 Parent(s): e942caf

Upload intermediate checkpoint for warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C at iteration 67911

Browse files
Files changed (9) hide show
  1. intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-67911/main.pt +3 -0
  2. intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-67911/worker_0.pt +3 -0
  3. intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-67911/worker_1.pt +3 -0
  4. intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-67911/worker_2.pt +3 -0
  5. intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-67911/worker_3.pt +3 -0
  6. intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-67911/worker_4.pt +3 -0
  7. intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-67911/worker_5.pt +3 -0
  8. intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-67911/worker_6.pt +3 -0
  9. intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-67911/worker_7.pt +3 -0
intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-67911/main.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:96af4d0ad53ca269986659e21483d947232d8a2d93c8cbb527e5477ea2589ac2
3
+ size 14259865902
intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-67911/worker_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e7ea08af81deff937b7e1c9d06739ac03cd8f3c569c86b533dbe4a06b41c58d9
3
+ size 186910
intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-67911/worker_1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e0da4bb46c50148e3fcc36c16378731bf988a2f5e15b3b77046b1aebeeba002
3
+ size 119198
intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-67911/worker_2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a06c3402cf8c45b206b7fba79a273bf768e90abf68479e232afc706137d4ade4
3
+ size 197982
intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-67911/worker_3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2aa90b5ee8d882ff44751e412ec837d9e5017eb31f27cd2ed1878c4a29290301
3
+ size 68318
intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-67911/worker_4.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e8da4131b467d99aab8d091a16ce14e3f03e61dd646da624510e61de1e24d9aa
3
+ size 41950
intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-67911/worker_5.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:54c62808b403ac608f2c70204ec72e079ac5f2ed0267f01a02ac110167774ede
3
+ size 124638
intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-67911/worker_6.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:16fbed1beb7e477a4a8b9b79ddcf61ab3c55e2bb61ac848e12f194e67e6306ed
3
+ size 83038
intermediate-checkpoints/2C_8gpus/warmup2000_fineweb_shampoo_lr1e-2_wd1e-2_bf16_grad_clip1e0_2C/inter-ckpt-67911/worker_7.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:55f62e40d76b1c1712597ed29dbc4516f7ed71a2ca29aeb5a1c352038db16d60
3
+ size 26014