ChrisMcCormick
/

decoderstack-d24

Model card Files Files and versions

decoderstack-d24 / tokenizer

545 kB

Ctrl+K

Ctrl+K

1 contributor

History: 2 commits

ChrisMcCormick's picture

tokenizer: regenerate token_bytes.pt with upstream 2ce972a raw-bytes fix (191/32768 ids corrected)

47b3fec verified about 2 months ago

token_bytes.pt

133 kB
xet

tokenizer: regenerate token_bytes.pt with upstream 2ce972a raw-bytes fix (191/32768 ids corrected) about 2 months ago
tokenizer.pkl
Detected Pickle imports (1)
- "tiktoken.core.Encoding"
How to fix it?
412 kB
xet

Add model card, meta.json, logs, tokenizer, training source, and nanochat converter about 2 months ago