Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
DatarrX
/
myX-Tokenizer
like
1
Follow
DatarrX
4
Feature Extraction
kalixlouiis/myX-Corpus
Burmese
English
tokenizer
burmese
myanmar
nlp
sentencepiece
unigram
syllable-aware
datarrx
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
main
myX-Tokenizer
Commit History
Delete tokenizer.json
1166228
verified
kalixlouiis
commited on
1 day ago
Delete tokenizer_config.json
2b30524
verified
kalixlouiis
commited on
1 day ago
Upload tokenizer_config.json with huggingface_hub
f3446fb
verified
kalixlouiis
commited on
1 day ago
Upload tokenizer.json with huggingface_hub
2c36fe4
verified
kalixlouiis
commited on
1 day ago
Upload tokenizer_config.json with huggingface_hub
d8d7872
verified
kalixlouiis
commited on
1 day ago
Upload tokenizer.json with huggingface_hub
391ae65
verified
kalixlouiis
commited on
1 day ago
Update README.md
5f64a9f
verified
kalixlouiis
commited on
4 days ago
Update README.md
c53acfa
verified
kalixlouiis
commited on
4 days ago
Update README.md
eec8fe6
verified
kalixlouiis
commited on
4 days ago
Update README.md
aecfae1
verified
kalixlouiis
commited on
4 days ago
Create README.md
0d072f5
verified
kalixlouiis
commited on
4 days ago
Upload myX-Tokenizer.vocab with huggingface_hub
6d3f728
verified
kalixlouiis
commited on
5 days ago
Upload myX-Tokenizer.model with huggingface_hub
872d697
verified
kalixlouiis
commited on
5 days ago
initial commit
c625984
verified
kalixlouiis
commited on
5 days ago