ChrisMcCormick
/

decoderstack-d24

Model card Files Files and versions

decoderstack-d24

40.4 GB

Ctrl+K

Ctrl+K

1 contributor

History: 8 commits

ChrisMcCormick's picture

meta_001950.json: add user_config so chat_sft inherits the run's LRs

1bfa5e5 verified about 2 months ago

base_checkpoints
meta_001950.json: add user_config so chat_sft inherits the run's LRs about 2 months ago
checkpoints
Upload folder using huggingface_hub about 2 months ago
code
Add model card, meta.json, logs, tokenizer, training source, and nanochat converter about 2 months ago
logs
Add model card, meta.json, logs, tokenizer, training source, and nanochat converter about 2 months ago
tokenizer
Add model card, meta.json, logs, tokenizer, training source, and nanochat converter about 2 months ago
.gitattributes

1.52 kB
initial commit about 2 months ago
README.md

11.9 kB
Flag that val bpb is not comparable across the batched/varlen pipelines about 2 months ago
convert_ckpt_to_nanochat.py

26.3 kB
Converter now emits nanochat optimizer shards for an SFT warm-start about 2 months ago
test_convert_ckpt_to_nanochat.py

13.9 kB
Converter now emits nanochat optimizer shards for an SFT warm-start about 2 months ago