ChrisMcCormick
/

decoderstack-d24

Model card Files Files and versions

decoderstack-d24 / base_checkpoints /d24_decoderstack

12.6 GB

Ctrl+K

Ctrl+K

1 contributor

History: 4 commits

ChrisMcCormick's picture

meta_001950.json: add user_config so chat_sft inherits the run's LRs

1bfa5e5 verified about 2 months ago

meta_001950.json

4.17 kB
meta_001950.json: add user_config so chat_sft inherits the run's LRs about 2 months ago
meta_005568.json

3.14 kB
Correct optimizer-state notes: SFT needs only the weights; W_O axis is a no-op at d24 about 2 months ago
model_005568.pt

4.23 GB
xet

Add nanochat-format d24 checkpoint (step 5568) + world_size=8 optimizer shards about 2 months ago
optim_005568_rank0.pt

1.04 GB
xet

Add nanochat-format d24 checkpoint (step 5568) + world_size=8 optimizer shards about 2 months ago
optim_005568_rank1.pt

1.04 GB
xet

Add nanochat-format d24 checkpoint (step 5568) + world_size=8 optimizer shards about 2 months ago
optim_005568_rank2.pt

1.04 GB
xet

Add nanochat-format d24 checkpoint (step 5568) + world_size=8 optimizer shards about 2 months ago
optim_005568_rank3.pt

1.04 GB
xet

Add nanochat-format d24 checkpoint (step 5568) + world_size=8 optimizer shards about 2 months ago
optim_005568_rank4.pt

1.04 GB
xet

Add nanochat-format d24 checkpoint (step 5568) + world_size=8 optimizer shards about 2 months ago
optim_005568_rank5.pt

1.04 GB
xet

Add nanochat-format d24 checkpoint (step 5568) + world_size=8 optimizer shards about 2 months ago
optim_005568_rank6.pt

1.04 GB
xet

Add nanochat-format d24 checkpoint (step 5568) + world_size=8 optimizer shards about 2 months ago
optim_005568_rank7.pt

1.04 GB
xet

Add nanochat-format d24 checkpoint (step 5568) + world_size=8 optimizer shards about 2 months ago