Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
MCplayer
/
XY_Tokenizer
like
0
PyTorch
xy_tokenizer
custom_code
arxiv:
2506.23325
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
1
Copy to bucket
new
main
XY_Tokenizer
2.14 GB
Ctrl+K
Ctrl+K
1 contributor
History:
7 commits
MCplayer
add middle overlap type
f038693
11 months ago
examples
XY_Tokenizer AutoModel version support
12 months ago
.gitattributes
1.56 kB
XY_Tokenizer AutoModel version support
12 months ago
README.md
3.29 kB
pre-release version
12 months ago
config.json
3.31 kB
pre-release version
12 months ago
configuration_xy_tokenizer.py
3.49 kB
XY_Tokenizer AutoModel version support
12 months ago
feature_extraction_xy_tokenizer.py
10.5 kB
add middle overlap type
11 months ago
modeling_xy_tokenizer.py
61.5 kB
add middle overlap type
11 months ago
preprocessor_config.json
293 Bytes
add middle overlap type
11 months ago
pytorch_model.bin
2.14 GB
xet
XY_Tokenizer AutoModel version support
12 months ago
