Text Generation
Transformers
Safetensors
JAX
PyTorch
English
llama
code
sql
text2sql
instruction_tuned
1b
expert
text-generation-inference
Instructions to use PipableAI/pip-SQL-1B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use PipableAI/pip-SQL-1B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="PipableAI/pip-SQL-1B")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("PipableAI/pip-SQL-1B") model = AutoModelForCausalLM.from_pretrained("PipableAI/pip-SQL-1B") - Notebooks
- Google Colab
- Kaggle
- Local Apps
- vLLM
How to use PipableAI/pip-SQL-1B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "PipableAI/pip-SQL-1B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "PipableAI/pip-SQL-1B", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/PipableAI/pip-SQL-1B
- SGLang
How to use PipableAI/pip-SQL-1B with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "PipableAI/pip-SQL-1B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "PipableAI/pip-SQL-1B", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "PipableAI/pip-SQL-1B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "PipableAI/pip-SQL-1B", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use PipableAI/pip-SQL-1B with Docker Model Runner:
docker model run hf.co/PipableAI/pip-SQL-1B
Update README.md
Browse files
README.md
CHANGED
|
@@ -31,8 +31,8 @@ We used a unique pipeline which involved the model working on two objectives alt
|
|
| 31 |
1. Maximizing the log prob of all tokens in the sequence (including the prompt tokens)
|
| 32 |
2. Minimizng the difference between the true value and the predicted maximum value of the output tokens i.e generated tokens for the sql query slice of the entire sequence.
|
| 33 |
|
| 34 |
-
During our research on training models of different param sizes, we have seen recurring pattern where
|
| 35 |
-
pip-SQL-1B is demonstrative
|
| 36 |
|
| 37 |
|
| 38 |
|
|
|
|
| 31 |
1. Maximizing the log prob of all tokens in the sequence (including the prompt tokens)
|
| 32 |
2. Minimizng the difference between the true value and the predicted maximum value of the output tokens i.e generated tokens for the sql query slice of the entire sequence.
|
| 33 |
|
| 34 |
+
During our research on training models of different param sizes, we have seen recurring pattern where zero shot inference capabilities on questions that need decuctive reasoning, is an attribute that models with params higher than 2.7B exhibit.
|
| 35 |
+
pip-SQL-1B is demonstrative, refer to pip-SQL-7B and pip-SQL-3B(coming soon)for SOTA models open sourced by pipable
|
| 36 |
|
| 37 |
|
| 38 |
|