Instructions to use devngho/llama-2-ko-tokenizer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use devngho/llama-2-ko-tokenizer with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("devngho/llama-2-ko-tokenizer", dtype="auto") - Notebooks
- Google Colab
- Kaggle
- Xet hash:
- 078e6c5168dae4641355fef7770264b8db724c6ca56633edf93063987b727024
- Size of remote file:
- 780 kB
- SHA256:
- 7e56904744ef55ee9f6fc9348e26df0658594250c32308ed65984d8f253b8a09
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.