ChrisMcCormick
/

decoderstack-d24

Model card Files Files and versions

decoderstack-d24

27.8 GB

Ctrl+K

Ctrl+K

1 contributor

History: 5 commits

ChrisMcCormick's picture

Converter now emits nanochat optimizer shards for an SFT warm-start

412ea12 verified about 1 month ago

base_checkpoints
Correct optimizer-state notes: SFT needs only the weights; W_O axis is a no-op at d24 about 1 month ago
checkpoints
Upload folder using huggingface_hub about 1 month ago
code
Add model card, meta.json, logs, tokenizer, training source, and nanochat converter about 1 month ago
logs
Add model card, meta.json, logs, tokenizer, training source, and nanochat converter about 1 month ago
tokenizer
Add model card, meta.json, logs, tokenizer, training source, and nanochat converter about 1 month ago
.gitattributes

1.52 kB
initial commit about 1 month ago
README.md

10.8 kB
Converter now emits nanochat optimizer shards for an SFT warm-start about 1 month ago
convert_ckpt_to_nanochat.py

26.3 kB
Converter now emits nanochat optimizer shards for an SFT warm-start about 1 month ago
test_convert_ckpt_to_nanochat.py

13.9 kB
Converter now emits nanochat optimizer shards for an SFT warm-start about 1 month ago