Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
CMSManhattan
/
JiRackTokenizer
like
2
Follow
Center Business Solutions inc
8
License:
cms-manhattan-jirack-v1.2
Model card
Files
Files and versions
xet
Community
main
JiRackTokenizer
17.2 MB
Ctrl+K
Ctrl+K
1 contributor
History:
28 commits
kgrabko
Update tokenizer_config.json
7f7a401
verified
2 days ago
.gitattributes
Safe
1.57 kB
Initial upload of JiRackTokenizer
about 1 month ago
JiRackTernaryPyTorch_1b.py
Safe
6.62 kB
Update JiRackTernaryPyTorch_1b.py
8 days ago
LICENSE
Safe
3.28 kB
Update LICENSE
about 1 month ago
README.md
Safe
2.55 kB
Update README.md
8 days ago
TestTokenizerSize.py
Safe
194 Bytes
Rename TestTokenizer.py to TestTokenizerSize.py
8 days ago
copy_weights.py
Safe
2.64 kB
Update copy_weights.py
8 days ago
special_tokens_map.json
Safe
301 Bytes
Initial upload of JiRackTokenizer
about 1 month ago
tokenizer.json
Safe
17.2 MB
xet
Initial upload of JiRackTokenizer
about 1 month ago
tokenizer_config.json
379 Bytes
Update tokenizer_config.json
2 days ago