Instructions to use WenWW/Sparse8B_TO_DPO_Lora with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use WenWW/Sparse8B_TO_DPO_Lora with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("neuralmagic/Sparse-Llama-3.1-8B-2of4") model = PeftModel.from_pretrained(base_model, "WenWW/Sparse8B_TO_DPO_Lora") - Notebooks
- Google Colab
- Kaggle
- Xet hash:
- 32d0abcc36da9e88118a09ea124be6f02a60644cce435e772d57c3bcc0354189
- Size of remote file:
- 17.2 MB
- SHA256:
- 9400df98529060210393c40f08cb127f7c0df584338b3fbfdba8cf82a33c1ade
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.