Models
Datasets
Spaces
Buckets new
Docs
Enterprise
Pricing
Log In
Sign Up

faisaltareque
/

BengaliByteLevelBPETokenizerFast

Model card Files Files and versions

BengaliByteLevelBPETokenizerFast

1.62 MB

Ctrl+K

Ctrl+K

1 contributor

History: 3 commits

faisaltareque's picture

Upload tokenizer

f9b6141 over 2 years ago

.gitattributes
1.52 kB
initial commit over 2 years ago
special_tokens_map.json
297 Bytes
Upload tokenizer over 2 years ago
tokenizer.json
1.62 MB
Upload tokenizer over 2 years ago
tokenizer_config.json
234 Bytes
Upload tokenizer over 2 years ago