How to use from
vLLM
Install from pip and serve model
# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "trl-internal-testing/tiny-PaliGemmaForConditionalGeneration"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "trl-internal-testing/tiny-PaliGemmaForConditionalGeneration",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'
Use Docker
docker model run hf.co/trl-internal-testing/tiny-PaliGemmaForConditionalGeneration
Quick Links

Tiny PaliGemmaForConditionalGeneration

This is a minimal model built for unit tests in the TRL library.

Downloads last month
18
Safetensors
Model size
6.12M params
Tensor type
F32
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Spaces using trl-internal-testing/tiny-PaliGemmaForConditionalGeneration 2

Collection including trl-internal-testing/tiny-PaliGemmaForConditionalGeneration