Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
antalvdb
/
lib-tokenizer
like
0
MLZoo/edu-fineweb-10B
English
tokenizer
lib
less-is-better
supra-word
cognitively-inspired
License:
gpl-3.0
Model card
Files
Files and versions
xet
Community
main
lib-tokenizer
Commit History
Upload tokenizer.json with huggingface_hub
ee771eb
verified
antalvdb
commited on
10 days ago
Update README.md
53cc5cc
verified
antalvdb
commited on
10 days ago
Update README.md
048c2df
verified
antalvdb
commited on
10 days ago
Upload README.md with huggingface_hub
811acf2
verified
antalvdb
commited on
10 days ago
Upload tokenizer.json with huggingface_hub
1489718
verified
antalvdb
commited on
12 days ago
initial commit
d2b3ac2
verified
antalvdb
commited on
12 days ago