| | --- |
| | license: apache-2.0 |
| | tags: |
| | - generated_from_trainer |
| | base_model: mistralai/Mistral-7B-Instruct-v0.1 |
| | model-index: |
| | - name: fiveflow/ATOMM-v0.18 |
| | results: [] |
| | language: |
| | - ko |
| | --- |
| | |
| | How to use |
| |
|
| | ```Python |
| | from transformers import AutoModelForCausalLM, AutoTokenizer, TextGenerationPipeline |
| | model_path = 'fiveflow/ATOMM' |
| | tokenizer = AutoTokenizer.from_pretrained(model_path) |
| | model = AutoModelForCausalLM.from_pretrained(model_path, |
| | device_map="auto", |
| | # load_in_4bit=True, |
| | low_cpu_mem_usage=True) |
| | |
| | pipe = TextGenerationPipeline(model = model, tokenizer = tokenizer) |
| | ``` |
