How to use edpowers/data with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("mistralai/Mistral-7B-Instruct-v0.2") model = PeftModel.from_pretrained(base_model, "edpowers/data")
2d1b4f0 bdfb628 bb7f189 bdfb628 2d1b4f0 bdfb628 2d1b4f0
1
2
3
4
5
6
7
8
{ "epoch": 5.923076923076923, "eval_loss": 1.1831614971160889, "eval_runtime": 5.4341, "eval_samples": 169, "eval_samples_per_second": 16.378, "eval_steps_per_second": 2.208 }
