---
license: mit
tags:
  - llama-cpp
  - llama-cpp-python
  - wheel
  - windows
  - cuda-12
  - blackwell
  - sm_100
  - sm_90
  - sm_89
  - sm_86
  - sm_80
  - sm_75
  - sm_72
  - sm_70
  - sm_62
  - sm_61
  - cp312
library_name: llama-cpp-python
---


# llama-cpp-python (Windows CUDA build)

Prebuilt wheel for:

- llama_cpp_python 0.3.16
- Windows x64
- Python 3.12 (cp312)
- CUDA enabled
- AVX512 disabled
- Supports NVIDIA 10 / 20 / 30 / 40 / 50 series GPUs
- Trajis SmartSRT 1.0.0

---

## Install

Direct install:

pip install "https://huggingface.co/trajis-tech/llama-cpp-python-trajis-tech-nonavx512-cuda/resolve/main/llama_cpp_python-0.3.16-cp312-cp312-win_amd64.whl"

Or download manually and install:

pip install llama_cpp_python-0.3.16-cp312-cp312-win_amd64.whl

---

## Uninstall

pip uninstall llama-cpp-python

---

## Requirements

- Windows 64-bit
- Python 3.12
- NVIDIA GPU
- CUDA Toolkit installed