Update README.md

README.md

@@ -11,7 +11,8 @@ license_link: LICENSE
  pad_token_id: None
  eos_token_id: 128001
  }
-- Compatible with Llama 3 • Optimized for Code
+- Compatible with Llama 3 • Optimized for Code . Use resize function without adaptation, see examples below
+- It need 100k example to fully adapt routing features for RAG Routing model . So check llama modification tokenizer rules
 - A Llama 3-based tokenizer enhanced with FIM markers from Microsoft datasets (
     <|fim_prefix|>,
     <|fim_middle|>,