Instructions to use busycaesar/tinystarcoder-rlhf-model with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use busycaesar/tinystarcoder-rlhf-model with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="busycaesar/tinystarcoder-rlhf-model")# Load model directly from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoTokenizer.from_pretrained("busycaesar/tinystarcoder-rlhf-model") model = AutoModelForSequenceClassification.from_pretrained("busycaesar/tinystarcoder-rlhf-model") - Notebooks
- Google Colab
- Kaggle
| base_model: bigcode/tiny_starcoder_py | |
| library_name: transformers | |
| model_name: tinystarcoder-rlhf-model | |
| tags: | |
| - generated_from_trainer | |
| - reward-trainer | |
| - trl | |
| licence: license | |
| # Model Card for tinystarcoder-rlhf-model | |
| This model is a fine-tuned version of [bigcode/tiny_starcoder_py](https://huggingface.co/bigcode/tiny_starcoder_py). | |
| It has been trained using [TRL](https://github.com/huggingface/trl). | |
| ## Quick start | |
| ```python | |
| from transformers import pipeline | |
| text = "The capital of France is Paris." | |
| rewarder = pipeline(model="busycaesar/tinystarcoder-rlhf-model", device="cuda") | |
| output = rewarder(text)[0] | |
| print(output["score"]) | |
| ``` | |
| ## Training procedure | |
| This model was trained with Reward. | |
| ### Framework versions | |
| - TRL: 1.2.0 | |
| - Transformers: 5.0.0 | |
| - Pytorch: 2.10.0+cu128 | |
| - Datasets: 4.8.4 | |
| - Tokenizers: 0.22.2 | |
| ## Citations | |
| Cite TRL as: | |
| ```bibtex | |
| @software{vonwerra2020trl, | |
| title = {{TRL: Transformers Reinforcement Learning}}, | |
| author = {von Werra, Leandro and Belkada, Younes and Tunstall, Lewis and Beeching, Edward and Thrush, Tristan and Lambert, Nathan and Huang, Shengyi and Rasul, Kashif and Gallouédec, Quentin}, | |
| license = {Apache-2.0}, | |
| url = {https://github.com/huggingface/trl}, | |
| year = {2020} | |
| } | |
| ``` |