Spaces:
Paused
Paused
Update README.md
Browse files
README.md
CHANGED
|
@@ -141,3 +141,22 @@ deactivate
|
|
| 141 |
βββ README.md
|
| 142 |
βββ requirements.txt
|
| 143 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 141 |
βββ README.md
|
| 142 |
βββ requirements.txt
|
| 143 |
```
|
| 144 |
+
|
| 145 |
+
ERROR:
|
| 146 |
+
|
| 147 |
+
INFO: 127.0.0.1:60874 - "POST /api/v1/model/download?model_name=microsoft%2FPhi-3.5-mini-instruct HTTP/1.1" 200 OK
|
| 148 |
+
2025-01-13 16:18:45,409 - api_routes - INFO - Received request to initialize model: microsoft/Phi-3.5-mini-instruct
|
| 149 |
+
2025-01-13 16:18:45,409 - llm_api - INFO - Initializing generation model: microsoft/Phi-3.5-mini-instruct
|
| 150 |
+
2025-01-13 16:18:45,412 - llm_api - INFO - Loading model from local path: main/models/Phi-3.5-mini-instruct
|
| 151 |
+
The `load_in_4bit` and `load_in_8bit` arguments are deprecated and will be removed in the future versions. Please, pass a `BitsAndBytesConfig` object in `quantization_config` argument instead.
|
| 152 |
+
Could not find the bitsandbytes CUDA binary at PosixPath('/home/aurelio/Desktop/Projects/LLMServer/myenv/lib/python3.13/site-packages/bitsandbytes/libbitsandbytes_cuda124.so')
|
| 153 |
+
g++ (GCC) 14.2.1 20240910
|
| 154 |
+
Copyright (C) 2024 Free Software Foundation, Inc.
|
| 155 |
+
This is free software; see the source for copying conditions. There is NO
|
| 156 |
+
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
|
| 157 |
+
|
| 158 |
+
2025-01-13 16:18:45,982 - llm_api - ERROR - Failed to initialize generation model microsoft/Phi-3.5-mini-instruct: Failed to import transformers.integrations.bitsandbytes because of the following error (look up to see its traceback):
|
| 159 |
+
Dynamo is not supported on Python 3.13+
|
| 160 |
+
2025-01-13 16:18:45,982 - api_routes - ERROR - Error initializing model: Failed to import transformers.integrations.bitsandbytes because of the following error (look up to see its traceback):
|
| 161 |
+
Dynamo is not supported on Python 3.13+
|
| 162 |
+
INFO: 127.0.0.1:38330 - "POST /api/v1/model/initialize?model_name=microsoft%2FPhi-3.5-mini-instruct HTTP/1.1" 500 Internal Server Error
|