tinystories-50m / tokenizer.json
Compactbot's picture
v2: 12288-vocab BPE tokenizer (was 8192)
15b1964 verified
Raw
History
830 kB
File too large to display, you can check the raw version instead.