AIMindLink commited on
Commit
2969c74
·
verified ·
1 Parent(s): 9f27538

Upload README.md

Browse files

Added Debian based installation

Files changed (1) hide show
  1. README.md +68 -1
README.md CHANGED
@@ -94,7 +94,74 @@ The `models/` folder is excluded from git. GGUFs are never committed to this rep
94
 
95
  ---
96
 
97
- ## Installation — Linux (Fedora / Ubuntu)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
98
 
99
  ### First you must install the c++ compiler (Fedora RedHat)
100
 
 
94
 
95
  ---
96
 
97
+ ## Installation — Linux (Debian/Ubuntu)
98
+
99
+ ### First you must install the C++ compiler and build tools (Debian/Ubuntu)
100
+ On Debian, the `build-essential` package includes `gcc`, `g++` (C++ compiler), and `make`. You also need `cmake` and `python3-dev` (the Debian equivalent of `python3-devel`).
101
+
102
+ ```bash
103
+ sudo apt update
104
+ sudo apt install -y build-essential cmake python3-dev python3-venv git
105
+ ```
106
+
107
+ ### 1. Clone the repo
108
+
109
+ ```bash
110
+ git clone https://huggingface.co/AIMindLink/lambda-mindlink-memotron
111
+ cd lambda-mindlink-memotron
112
+ ```
113
+
114
+ ### 2. Create a virtual environment
115
+
116
+ ```bash
117
+ python3 -m venv .venv
118
+ source .venv/bin/activate
119
+ ```
120
+
121
+ ### 3.1 Install `llama-cpp-python` with CUDA support (NVIDIA)
122
+ *Note: Ensure the NVIDIA CUDA Toolkit is installed on your system before running this.*
123
+
124
+ ```bash
125
+ CMAKE_ARGS="-DGGML_CUDA=on" pip install llama-cpp-python --upgrade --force-reinstall --no-cache-dir
126
+ ```
127
+
128
+ ### 3.2 Install `llama-cpp-python` with ROCm support (AMD Ryzen iGPU/dGPU)
129
+ *Note: For AMD GPUs on Debian, you may need to install ROCm libraries (`hipblas-dev`, `rocblas-dev`) via `apt` or the AMD repository first. The flag `-DGGML_HIPBLAS=on` is often used, but newer versions of llama.cpp may prefer `-DGGML_HIP=on`.*
130
+
131
+ ```bash
132
+ # Optional: Install ROCm dependencies via apt if not already present
133
+ # sudo apt install hipblas-dev rocblas-dev
134
+
135
+ CMAKE_ARGS="-DGGML_HIPBLAS=on" pip install llama-cpp-python --upgrade --force-reinstall --no-cache-dir
136
+ ```
137
+
138
+ ### 3.3 Install `llama-cpp-python` for CPU-only (no GPU)
139
+ ```bash
140
+ pip install llama-cpp-python --upgrade --force-reinstall --no-cache-dir
141
+ ```
142
+
143
+ ### 4. Install remaining dependencies
144
+
145
+ ```bash
146
+ pip install -r requirements.txt
147
+ ```
148
+
149
+ ### 5. Place your models
150
+
151
+ ```bash
152
+ mkdir -p models
153
+ # Copy or move your .gguf files into models/
154
+ ls models/
155
+ ```
156
+
157
+ ### 6. Run
158
+
159
+ ```bash
160
+ python main.py
161
+ ```
162
+ ---
163
+
164
+ ## Installation — Linux (Fedora)
165
 
166
  ### First you must install the c++ compiler (Fedora RedHat)
167