| | --- |
| | license: mit |
| | tags: |
| | - llama-cpp |
| | - llama-cpp-python |
| | - wheel |
| | - windows |
| | - cuda-12 |
| | - blackwell |
| | - sm_100 |
| | - sm_90 |
| | - sm_89 |
| | - sm_86 |
| | - sm_80 |
| | - sm_75 |
| | - sm_72 |
| | - sm_70 |
| | - sm_62 |
| | - sm_61 |
| | - cp312 |
| | library_name: llama-cpp-python |
| | --- |
| | |
| |
|
| | # llama-cpp-python (Windows CUDA build) |
| |
|
| | Prebuilt wheel for: |
| |
|
| | - llama_cpp_python 0.3.16 |
| | - Windows x64 |
| | - Python 3.12 (cp312) |
| | - CUDA enabled |
| | - AVX512 disabled |
| | - Supports NVIDIA 10 / 20 / 30 / 40 / 50 series GPUs |
| | - Trajis SmartSRT 1.0.0 |
| |
|
| | --- |
| |
|
| | ## Install |
| |
|
| | Direct install: |
| |
|
| | pip install "https://huggingface.co/trajis-tech/llama-cpp-python-trajis-tech-nonavx512-cuda/resolve/main/llama_cpp_python-0.3.16-cp312-cp312-win_amd64.whl" |
| | |
| | Or download manually and install: |
| | |
| | pip install llama_cpp_python-0.3.16-cp312-cp312-win_amd64.whl |
| |
|
| | --- |
| |
|
| | ## Uninstall |
| |
|
| | pip uninstall llama-cpp-python |
| |
|
| | --- |
| |
|
| | ## Requirements |
| |
|
| | - Windows 64-bit |
| | - Python 3.12 |
| | - NVIDIA GPU |
| | - CUDA Toolkit installed |
| |
|
