tinystories-50m / tokenizer.json
Compactbot's picture
v2: 12288-vocab BPE tokenizer (was 8192) (#5)
3ebcad6
Raw
History Contribute Delete
830 kB
File too large to display, you can check the raw version instead.