Instructions to use minsik-oh/dpo-model-sample with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use minsik-oh/dpo-model-sample with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("meta-llama/Llama-3.1-8B-Instruct") model = PeftModel.from_pretrained(base_model, "minsik-oh/dpo-model-sample") - Notebooks
- Google Colab
- Kaggle
| This directory includes a few sample datasets to get you started. | |
| * `california_housing_data*.csv` is California housing data from the 1990 US | |
| Census; more information is available at: | |
| https://docs.google.com/document/d/e/2PACX-1vRhYtsvc5eOR2FWNCwaBiKL6suIOrxJig8LcSBbmCbyYsayia_DvPOOBlXZ4CAlQ5nlDD8kTaIDRwrN/pub | |
| * `mnist_*.csv` is a small sample of the | |
| [MNIST database](https://en.wikipedia.org/wiki/MNIST_database), which is | |
| described at: http://yann.lecun.com/exdb/mnist/ | |
| * `anscombe.json` contains a copy of | |
| [Anscombe's quartet](https://en.wikipedia.org/wiki/Anscombe%27s_quartet); it | |
| was originally described in | |
| Anscombe, F. J. (1973). 'Graphs in Statistical Analysis'. American | |
| Statistician. 27 (1): 17-21. JSTOR 2682899. | |
| and our copy was prepared by the | |
| [vega_datasets library](https://github.com/altair-viz/vega_datasets/blob/4f67bdaad10f45e3549984e17e1b3088c731503d/vega_datasets/_data/anscombe.json). | |