CloverLM / tokenizer_config.json
mansaripo's picture
Upload folder using huggingface_hub
812abc2 verified
raw
history blame contribute delete
175 Bytes
{
"tokenizer_class": "CloverLMTokenizer",
"auto_map": {
"AutoTokenizer": [
"tokenization_cloverlm.CloverLMTokenizer",
null
]
},
"use_fast": false
}