Upload README.md
Browse filesAdded Debian based installation
README.md
CHANGED
|
@@ -94,7 +94,74 @@ The `models/` folder is excluded from git. GGUFs are never committed to this rep
|
|
| 94 |
|
| 95 |
---
|
| 96 |
|
| 97 |
-
## Installation — Linux (
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 98 |
|
| 99 |
### First you must install the c++ compiler (Fedora RedHat)
|
| 100 |
|
|
|
|
| 94 |
|
| 95 |
---
|
| 96 |
|
| 97 |
+
## Installation — Linux (Debian/Ubuntu)
|
| 98 |
+
|
| 99 |
+
### First you must install the C++ compiler and build tools (Debian/Ubuntu)
|
| 100 |
+
On Debian, the `build-essential` package includes `gcc`, `g++` (C++ compiler), and `make`. You also need `cmake` and `python3-dev` (the Debian equivalent of `python3-devel`).
|
| 101 |
+
|
| 102 |
+
```bash
|
| 103 |
+
sudo apt update
|
| 104 |
+
sudo apt install -y build-essential cmake python3-dev python3-venv git
|
| 105 |
+
```
|
| 106 |
+
|
| 107 |
+
### 1. Clone the repo
|
| 108 |
+
|
| 109 |
+
```bash
|
| 110 |
+
git clone https://huggingface.co/AIMindLink/lambda-mindlink-memotron
|
| 111 |
+
cd lambda-mindlink-memotron
|
| 112 |
+
```
|
| 113 |
+
|
| 114 |
+
### 2. Create a virtual environment
|
| 115 |
+
|
| 116 |
+
```bash
|
| 117 |
+
python3 -m venv .venv
|
| 118 |
+
source .venv/bin/activate
|
| 119 |
+
```
|
| 120 |
+
|
| 121 |
+
### 3.1 Install `llama-cpp-python` with CUDA support (NVIDIA)
|
| 122 |
+
*Note: Ensure the NVIDIA CUDA Toolkit is installed on your system before running this.*
|
| 123 |
+
|
| 124 |
+
```bash
|
| 125 |
+
CMAKE_ARGS="-DGGML_CUDA=on" pip install llama-cpp-python --upgrade --force-reinstall --no-cache-dir
|
| 126 |
+
```
|
| 127 |
+
|
| 128 |
+
### 3.2 Install `llama-cpp-python` with ROCm support (AMD Ryzen iGPU/dGPU)
|
| 129 |
+
*Note: For AMD GPUs on Debian, you may need to install ROCm libraries (`hipblas-dev`, `rocblas-dev`) via `apt` or the AMD repository first. The flag `-DGGML_HIPBLAS=on` is often used, but newer versions of llama.cpp may prefer `-DGGML_HIP=on`.*
|
| 130 |
+
|
| 131 |
+
```bash
|
| 132 |
+
# Optional: Install ROCm dependencies via apt if not already present
|
| 133 |
+
# sudo apt install hipblas-dev rocblas-dev
|
| 134 |
+
|
| 135 |
+
CMAKE_ARGS="-DGGML_HIPBLAS=on" pip install llama-cpp-python --upgrade --force-reinstall --no-cache-dir
|
| 136 |
+
```
|
| 137 |
+
|
| 138 |
+
### 3.3 Install `llama-cpp-python` for CPU-only (no GPU)
|
| 139 |
+
```bash
|
| 140 |
+
pip install llama-cpp-python --upgrade --force-reinstall --no-cache-dir
|
| 141 |
+
```
|
| 142 |
+
|
| 143 |
+
### 4. Install remaining dependencies
|
| 144 |
+
|
| 145 |
+
```bash
|
| 146 |
+
pip install -r requirements.txt
|
| 147 |
+
```
|
| 148 |
+
|
| 149 |
+
### 5. Place your models
|
| 150 |
+
|
| 151 |
+
```bash
|
| 152 |
+
mkdir -p models
|
| 153 |
+
# Copy or move your .gguf files into models/
|
| 154 |
+
ls models/
|
| 155 |
+
```
|
| 156 |
+
|
| 157 |
+
### 6. Run
|
| 158 |
+
|
| 159 |
+
```bash
|
| 160 |
+
python main.py
|
| 161 |
+
```
|
| 162 |
+
---
|
| 163 |
+
|
| 164 |
+
## Installation — Linux (Fedora)
|
| 165 |
|
| 166 |
### First you must install the c++ compiler (Fedora RedHat)
|
| 167 |
|