README.md

metadata

license: mit
tags:
  - llama-cpp
  - llama-cpp-python
  - wheel
  - windows
  - cuda-12
  - blackwell
  - sm_100
  - sm_90
  - sm_89
  - sm_86
  - sm_80
  - sm_75
  - sm_72
  - sm_70
  - sm_62
  - sm_61
  - cp312
library_name: llama-cpp-python

llama-cpp-python (Windows CUDA build)

Prebuilt wheel for:

• llama_cpp_python 0.3.16
• Windows x64
• Python 3.12 (cp312)
• CUDA enabled
• AVX512 disabled
• Supports NVIDIA 10 / 20 / 30 / 40 / 50 series GPUs
• Trajis SmartSRT 1.0.0

---

Install

Direct install:

pip install "https://huggingface.co/trajis-tech/llama-cpp-python-trajis-tech-nonavx512-cuda/resolve/main/llama_cpp_python-0.3.16-cp312-cp312-win_amd64.whl"

Or download manually and install:

pip install llama_cpp_python-0.3.16-cp312-cp312-win_amd64.whl

---

Uninstall

pip uninstall llama-cpp-python

---

Requirements

• Windows 64-bit
• Python 3.12
• NVIDIA GPU
• CUDA Toolkit installed