Reizxn commited on
Commit
18b5b5d
·
verified ·
1 Parent(s): d344882

Upload folder using huggingface_hub

Browse files
tokenizer/special_tokens.json ADDED
@@ -0,0 +1,24 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "special_tokens": [
3
+ "<|system|>",
4
+ "<|user|>",
5
+ "<|assistant|>",
6
+ "<|search|>",
7
+ "<|result|>",
8
+ "<|evidence|>",
9
+ "<|reasoning|>",
10
+ "<|finish|>",
11
+ "<|end|>"
12
+ ],
13
+ "token_ids": {
14
+ "<|system|>": 32000,
15
+ "<|user|>": 32001,
16
+ "<|assistant|>": 32002,
17
+ "<|search|>": 32003,
18
+ "<|result|>": 32004,
19
+ "<|evidence|>": 32005,
20
+ "<|reasoning|>": 32006,
21
+ "<|finish|>": 32007,
22
+ "<|end|>": 32008
23
+ }
24
+ }
tokenizer/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer/tokenizer_agent.json ADDED
The diff for this file is too large to render. See raw diff