Hugging Face's logo

ThingAI
/
msqark-tokenizer

Model card Files
xet
 Community
msqark-tokenizer / tokenizer_config.json

Commit History

Update tokenizer_config.json
5a2e01b
verified

ThingsAI commited on

BPE tokenizer 32768 vocab with thinking/tool tokens
f862712
verified

ThingsAI commited on