srmty
/

tiny-mistral-tokenizer

Model card Files Files and versions

srmty commited on Apr 5

Commit

750f9b6

·

verified ·

1 Parent(s): 32d1aa7

Upload tokenizer

Files changed (1) hide show

tokenizer.json +1 -1

tokenizer.json CHANGED Viewed

@@ -124,7 +124,7 @@
       "</s>": {
         "id": "</s>",
         "ids": [
-          2
         ],
         "tokens": [
           "</s>"

       "</s>": {
         "id": "</s>",
         "ids": [
+          3
         ],
         "tokens": [
           "</s>"