Instructions to use PeterBrendan/Prebid_Module_GPT2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use PeterBrendan/Prebid_Module_GPT2 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="PeterBrendan/Prebid_Module_GPT2")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("PeterBrendan/Prebid_Module_GPT2") model = AutoModelForCausalLM.from_pretrained("PeterBrendan/Prebid_Module_GPT2") - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use PeterBrendan/Prebid_Module_GPT2 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "PeterBrendan/Prebid_Module_GPT2" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "PeterBrendan/Prebid_Module_GPT2", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/PeterBrendan/Prebid_Module_GPT2
- SGLang
How to use PeterBrendan/Prebid_Module_GPT2 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "PeterBrendan/Prebid_Module_GPT2" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "PeterBrendan/Prebid_Module_GPT2", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "PeterBrendan/Prebid_Module_GPT2" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "PeterBrendan/Prebid_Module_GPT2", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use PeterBrendan/Prebid_Module_GPT2 with Docker Model Runner:
docker model run hf.co/PeterBrendan/Prebid_Module_GPT2
Commit ·
65e1f8d
1
Parent(s): 2578577
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,25 @@
|
|
| 1 |
---
|
| 2 |
license: mit
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: mit
|
| 3 |
---
|
| 4 |
+
|
| 5 |
+
**Model:** GPT-2
|
| 6 |
+
|
| 7 |
+
**Model name:** Prebid_Module_GPT2
|
| 8 |
+
|
| 9 |
+
**Model description:** This fine-tuned version of the GPT-2 model was trained on a dataset of 1100+ publisher domains' Prebid installed modules. It aims to provide insights into what Prebid modules other publishers install with their Prebid set-up. Given a Prebid module, such as ***'appnexusBidAdapter'***, the model can generate a sample Prebid installed Prebid modules based on the collected data. It helps publishers gain an understanding of how different publishers use Prebid modules.
|
| 10 |
+
|
| 11 |
+
**Intended uses:** This model is intended to assist publishers in understanding and exploring how other publishers use Prebid modules. It serves as a reference to gain insights into common configurations, best practices, and different approaches used by publishers across various domains.
|
| 12 |
+
|
| 13 |
+
**Limitations:** It's important to note that the generated installed Prebid modules are based on the data from the training set and may not cover all possible combinations or reflect the specific requirements of a particular domain. Publishers should carefully review and adapt the generated installed Prebid modules to their specific needs and business rules.
|
| 14 |
+
|
| 15 |
+
**How to use:** To use this model, provide a Prebid module, such as ***'gptPreAuction',***. The model will generate a sample Prebid installed modules combination related to that input based on the collected data.
|
| 16 |
+
|
| 17 |
+
**Training data:** This model was trained on a dataset consisting of over 1100+ publisher domains Prebid modules. The dataset was collected from a variety of publishers and represents a wide range of Prebid settings used in the industry.
|
| 18 |
+
|
| 19 |
+
**Training procedure:** The model was fine-tuned using the GPT-2 base model with the aforementioned dataset.
|
| 20 |
+
|
| 21 |
+
**Evaluation results:** The evaluation of this model focuses on its ability to generate coherent and valid Prebid configuration settings based on the provided Prebid config setting. Human evaluators reviewed the generated configurations for relevance and accuracy.
|
| 22 |
+
|
| 23 |
+
**Safety and bias considerations:** The model is trained on data from actual Prebid config files and aims to provide accurate insights into publishers' configurations. However, it's important to note that biases may exist in the original data itself, as the training data is based on real-world configurations. Users should review and validate the generated configurations to ensure they align with their specific requirements and guidelines.
|
| 24 |
+
|
| 25 |
+
Users are encouraged to exercise caution and use their expertise in interpreting and adapting the generated Prebid module combinations for their own use. The model should be seen as a helpful tool to gain inspiration and understanding of common Prebid settings but not as a substitute for thorough testing and manual review of the final configurations.
|