havinashpatil commited on
Commit
27a8fcf
·
1 Parent(s): a8bc575

Fix HF Spaces TGI launch entrypoint to avoid unexpected argument error

Browse files
Files changed (1) hide show
  1. Dockerfile +2 -2
Dockerfile CHANGED
@@ -32,5 +32,5 @@ RUN mkdir -p /.triton && chmod 777 /.triton
32
  EXPOSE 7860
33
  EXPOSE 8080
34
 
35
- # Start both FastAPI server and TGI in background
36
- CMD ["sh", "-c", "text-generation-inference --model-id TinyLlama/TinyLlama-1.1B-Chat-v1.0 --port 8080 --hostname 0.0.0.0 & uvicorn server.app:app --host 0.0.0.0 --port 7860"]
 
32
  EXPOSE 7860
33
  EXPOSE 8080
34
 
35
+ # Override the TGI base image entrypoint and start both TGI + FastAPI
36
+ ENTRYPOINT ["/bin/sh", "-c", "text-generation-inference --model-id TinyLlama/TinyLlama-1.1B-Chat-v1.0 --port 8080 --hostname 0.0.0.0 & uvicorn server.app:app --host 0.0.0.0 --port 7860"]