Spaces:
Running on T4
Running on T4
serving: manual load + GenerationMixin + use_cache=False + streaming
Browse files- requirements.txt +2 -1
requirements.txt
CHANGED
|
@@ -1,8 +1,9 @@
|
|
| 1 |
fastapi==0.115.6
|
| 2 |
uvicorn[standard]==0.34.0
|
| 3 |
torch
|
| 4 |
-
transformers
|
| 5 |
huggingface_hub>=0.25
|
|
|
|
| 6 |
safetensors
|
| 7 |
accelerate
|
| 8 |
sentencepiece
|
|
|
|
| 1 |
fastapi==0.115.6
|
| 2 |
uvicorn[standard]==0.34.0
|
| 3 |
torch
|
| 4 |
+
transformers==5.3.0
|
| 5 |
huggingface_hub>=0.25
|
| 6 |
+
hf_transfer
|
| 7 |
safetensors
|
| 8 |
accelerate
|
| 9 |
sentencepiece
|