Models
Datasets
Spaces
Buckets new
Docs
Enterprise
Pricing
Log In
Sign Up

bigscience-data
/

tokenizer_alpha_NFKC_250k

Model card Files Files and versions

tokenizer_alpha_NFKC_250k

17.9 MB

Ctrl+K

Ctrl+K

1 contributor

History: 3 commits

afilguer's picture

Create README.md

56a1b85 verified 11 days ago

.gitattributes

1.22 kB
Initial commit about 4 years ago
README.md

0 Bytes
Create README.md 11 days ago
special_tokens_map.json

85 Bytes
xet

Initial commit about 4 years ago
tokenizer.json

17.9 MB
xet

Initial commit about 4 years ago
tokenizer_config.json

131 Bytes
xet

Initial commit about 4 years ago