Spaces:
Sleeping
Sleeping
havinashpatil commited on
Commit ·
27a8fcf
1
Parent(s): a8bc575
Fix HF Spaces TGI launch entrypoint to avoid unexpected argument error
Browse files- Dockerfile +2 -2
Dockerfile
CHANGED
|
@@ -32,5 +32,5 @@ RUN mkdir -p /.triton && chmod 777 /.triton
|
|
| 32 |
EXPOSE 7860
|
| 33 |
EXPOSE 8080
|
| 34 |
|
| 35 |
-
#
|
| 36 |
-
|
|
|
|
| 32 |
EXPOSE 7860
|
| 33 |
EXPOSE 8080
|
| 34 |
|
| 35 |
+
# Override the TGI base image entrypoint and start both TGI + FastAPI
|
| 36 |
+
ENTRYPOINT ["/bin/sh", "-c", "text-generation-inference --model-id TinyLlama/TinyLlama-1.1B-Chat-v1.0 --port 8080 --hostname 0.0.0.0 & uvicorn server.app:app --host 0.0.0.0 --port 7860"]
|