Spaces:
Paused
Paused
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -7,9 +7,9 @@ sdk: docker
|
|
| 7 |
app_port: 7860
|
| 8 |
---
|
| 9 |
|
| 10 |
-
# Gemma
|
| 11 |
|
| 12 |
-
This Space runs `
|
| 13 |
|
| 14 |
## Endpoint
|
| 15 |
|
|
@@ -24,7 +24,7 @@ client = OpenAI(
|
|
| 24 |
)
|
| 25 |
|
| 26 |
response = client.chat.completions.create(
|
| 27 |
-
model="gemma-
|
| 28 |
messages=[
|
| 29 |
{"role": "user", "content": "Write a short poem about coding."}
|
| 30 |
]
|
|
|
|
| 7 |
app_port: 7860
|
| 8 |
---
|
| 9 |
|
| 10 |
+
# Gemma 4 E4B OpenAI-Compatible API
|
| 11 |
|
| 12 |
+
This Space runs `google_gemma-4-E4B-it` (Q4_K_M GGUF) via `llama-cpp-python[server]`, providing an OpenAI-compatible API endpoint.
|
| 13 |
|
| 14 |
## Endpoint
|
| 15 |
|
|
|
|
| 24 |
)
|
| 25 |
|
| 26 |
response = client.chat.completions.create(
|
| 27 |
+
model="gemma-4-E4B-it-Q4_K_M", # Model name is ignored if there's only one, but good practice
|
| 28 |
messages=[
|
| 29 |
{"role": "user", "content": "Write a short poem about coding."}
|
| 30 |
]
|