A.X-Encoder-base / tokenizer_config.json

Commit History

Set tokenizer "model_max_length" property to 16384 (#1)
9708f9c
verified

Minsang yjoonjang commited on

Upload 9 files
9085fb6
verified

Minsang commited on