efficient_pretrain_checkpoints / intermediate-checkpoints

Commit History

  1. Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C at iteration 157000

    Verified signature
    c818d06
  2. Upload intermediate checkpoint for fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 157000

    Verified signature
    067dcb0
  3. Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C at iteration 141300

    Verified signature
    18a8b9f
  4. Upload intermediate checkpoint for fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 141300

    Verified signature
    fdaa4f5
  5. Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C at iteration 100000

    Verified signature
    85caaca
  6. Upload intermediate checkpoint for fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 157000

    Verified signature
    afc6714
  7. Upload intermediate checkpoint for fineweb_apollo_adamw_lr2e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 157000

    Verified signature
    ae7ace4
  8. Upload intermediate checkpoint for fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 141300

    Verified signature
    88979af
  9. Upload intermediate checkpoint for fineweb_apollo_adamw_lr2e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 141300

    Verified signature
    c29369e
  10. Upload intermediate checkpoint for fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 100000

    Verified signature
    30e423b
  11. Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C at iteration 70650

    Verified signature
    b4463b9
  12. Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C at iteration 50000

    Verified signature
    f625a35
  13. Upload intermediate checkpoint for fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 100000

    Verified signature
    f4423d2
  14. Upload intermediate checkpoint for fineweb_apollo_adamw_lr2e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 100000

    Verified signature
    ac2e10a
  15. Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C at iteration 35325

    Verified signature
    b818caf
  16. Upload intermediate checkpoint for fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 70650

    Verified signature
    e585009
  17. Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C at iteration 15000

    Verified signature
    f03a2d3

  1. Upload intermediate checkpoint for fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 70650

    Verified signature
    73104e2
  2. Upload intermediate checkpoint for fineweb_apollo_adamw_lr2e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 70650

    Verified signature
    248d9ef
  3. Upload intermediate checkpoint for fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 50000

    Verified signature
    6860e0e
  4. Upload intermediate checkpoint for fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 50000

    Verified signature
    58fbced
  5. Upload intermediate checkpoint for fineweb_apollo_adamw_lr2e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 50000

    Verified signature
    4408b01
  6. Upload intermediate checkpoint for fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 35325

    Verified signature
    c4b3088
  7. Upload intermediate checkpoint for fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 35325

    Verified signature
    1894e42
  8. Upload intermediate checkpoint for fineweb_apollo_adamw_lr2e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 35325

    Verified signature
    81abebc
  9. Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C at iteration 35325

    Verified signature
    09e5ef9
  10. Upload intermediate checkpoint for fineweb_galore_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 15000

    Verified signature
    b79a646
  11. Upload intermediate checkpoint for fineweb_apollo_adamw_lr2e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 15000

    Verified signature
    815e1a3
  12. Upload intermediate checkpoint for fineweb_slim_adam_lr5e-4_wd0.1_fp32_grad_clip1e0_4C at iteration 15000

    Verified signature
    c443f8b
  13. Upload intermediate checkpoint for fineweb_coord_adamw_lr1e-3_wd0.1_fp32_grad_clip1e0_4C at iteration 15000

    Verified signature
    060a0b4

  1. Upload intermediate checkpoint for Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 157000

    Verified signature
    65ce22a
  2. Upload intermediate checkpoint for fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 157000

    Verified signature
    98d065d
  3. Upload intermediate checkpoint for Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 141300

    Verified signature
    46b4f16
  4. Upload intermediate checkpoint for fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 141300

    Verified signature
    8fa231f

  1. Upload intermediate checkpoint for Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 100000

    Verified signature
    bf19381
  2. Upload intermediate checkpoint for fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 100000

    Verified signature
    5fa8f13
  3. Upload intermediate checkpoint for Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 70650

    Verified signature
    fce2793
  4. Upload intermediate checkpoint for fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 70650

    Verified signature
    d936480
  5. Upload intermediate checkpoint for Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 50000

    Verified signature
    9ed9fd4
  6. Upload intermediate checkpoint for fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 50000

    Verified signature
    15646e2
  7. Upload intermediate checkpoint for Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 35325

    Verified signature
    365802e
  8. Upload intermediate checkpoint for fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 35325

    Verified signature
    f632a84
  9. Upload intermediate checkpoint for Loss_Scaling_fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 15000

    Verified signature
    3a28804
  10. Upload intermediate checkpoint for fineweb_adamw_lr1e-3_wd0.1_bf16_grad_clip1e0_4C at iteration 15000

    Verified signature
    d43fabc

  1. Upload intermediate checkpoint for Loss_Scaling_fineweb_shampoo_lr1e-2_wd0.01_bf16_grad_clip1e0_4C at iteration 157000

    Verified signature
    c46d0ff
  2. Upload intermediate checkpoint for Loss_Scaling_fineweb_shampoo_lr1e-2_wd0.01_bf16_grad_clip1e0_4C at iteration 141300

    Verified signature
    fac70f2
  3. Upload intermediate checkpoint for Loss_Scaling_fineweb_shampoo_lr1e-2_wd0.01_bf16_grad_clip1e0_4C at iteration 100000

    Verified signature
    8ffa37d

  1. Upload intermediate checkpoint for Loss_Scaling_fineweb_shampoo_lr1e-2_wd0.01_bf16_grad_clip1e0_4C at iteration 70650

    Verified signature
    1d56c8a
  2. Upload intermediate checkpoint for Loss_Scaling_fineweb_shampoo_lr1e-2_wd0.01_bf16_grad_clip1e0_4C at iteration 50000

    Verified signature
    985ab08
  3. Upload intermediate checkpoint for Loss_Scaling_fineweb_shampoo_lr1e-2_wd0.01_bf16_grad_clip1e0_4C at iteration 35325

    Verified signature
    58f6a60