Instructions to use minsik-oh/dpo-model-sample with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use minsik-oh/dpo-model-sample with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("meta-llama/Llama-3.1-8B-Instruct") model = PeftModel.from_pretrained(base_model, "minsik-oh/dpo-model-sample") - Notebooks
- Google Colab
- Kaggle
This directory includes a few sample datasets to get you started.
california_housing_data*.csvis California housing data from the 1990 US Census; more information is available at: https://docs.google.com/document/d/e/2PACX-1vRhYtsvc5eOR2FWNCwaBiKL6suIOrxJig8LcSBbmCbyYsayia_DvPOOBlXZ4CAlQ5nlDD8kTaIDRwrN/pubmnist_*.csvis a small sample of the MNIST database, which is described at: http://yann.lecun.com/exdb/mnist/anscombe.jsoncontains a copy of Anscombe's quartet; it was originally described inAnscombe, F. J. (1973). 'Graphs in Statistical Analysis'. American Statistician. 27 (1): 17-21. JSTOR 2682899.
and our copy was prepared by the vega_datasets library.