scaled-base / tokenizer.json

Commit History

Add gpt2 tokenizer: tokenizer.json
ec995f3
verified

ml-ryanlee commited on