Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
Ethosoft
/
NedoTurkishTokenizer
like
1
Follow
Ethosoft
3
Token Classification
Transformers
Turkish
nedo-turkish-tokenizer
tokenizer
morphology
turkish
nlp
License:
mit
Model card
Files
Files and versions
xet
Community
Use this model
main
NedoTurkishTokenizer
32.4 MB
Ctrl+K
Ctrl+K
2 contributors
History:
27 commits
nmstech
Upload folder using huggingface_hub
532470d
verified
2 days ago
nedo_turkish_tokenizer
Upload folder using huggingface_hub
2 days ago
.gitattributes
Safe
1.64 kB
Zemberek LFS ile eklendi
4 days ago
.gitignore
Safe
75 Bytes
Fix broken placeholder mechanism: replace with segment-based tokenization
6 days ago
README.md
6.27 kB
Upload folder using huggingface_hub
2 days ago
pyproject.toml
1.16 kB
Rename project from TurkTokenizer to NedoTurkishTokenizer
4 days ago
tokenization_nedo_turkish.py
6.45 kB
Rename project from TurkTokenizer to NedoTurkishTokenizer
4 days ago
tokenizer_config.json
388 Bytes
Rename project from TurkTokenizer to NedoTurkishTokenizer
4 days ago
