---
license: apache-2.0
language:
- en
library_name: gguf
tags:
- gguf
- shell
- macos
- terminal
- command-line
- qwen2
- lora
- ollama
base_model: Qwen/Qwen2.5-1.5B
model_name: harshell
pipeline_tag: text-generation
quantized_by: josharsh
---

# Harshell - Natural Language to macOS Shell Commands

**Harshell** is a fine-tuned Qwen 2.5 1.5B model that converts natural language into macOS shell commands. It returns only the command — no explanations, no markdown, just the shell command you need.

## Model Details

| Property | Value |
|---|---|
| Base Model | Qwen 2.5 1.5B |
| Fine-tuning | LoRA (rank 8, 1000 iterations) |
| Quantization | Q8_0 GGUF |
| File Size | ~1.5 GB |
| License | Apache 2.0 |

## Quick Start with Ollama

1. Download the GGUF and Modelfile from this repo
2. Create the model:
```bash
ollama create harshell -f Modelfile
```
3. Run it:
```bash
ollama run harshell "list all pdf files in my downloads folder"
```

### Example Usage

| Input | Output |
|---|---|
| list all pdf files in downloads | `find ~/Downloads -name "*.pdf"` |
| show disk usage of current folder | `du -sh .` |
| kill the process on port 3000 | `lsof -ti:3000 \| xargs kill` |
| compress this folder into a zip | `zip -r archive.zip .` |
| show my ip address | `ifconfig \| grep "inet " \| grep -v 127.0.0.1` |

## System Prompt

The model uses this system prompt:

> You are a macOS terminal assistant. Convert natural language into safe shell commands. Return only the command, nothing else.

## Ollama Modelfile

The included `Modelfile` configures:
- **Temperature**: 0.3 (low for deterministic command output)
- **Top-p**: 0.9
- **Max tokens**: 128
- **Chat template**: ChatML format (`<|im_start|>` / `<|im_end|>`)

## Training Details

- **Method**: LoRA (Low-Rank Adaptation)
- **LoRA Rank**: 8
- **Training iterations**: 1000
- **Base model**: Qwen/Qwen2.5-1.5B
- **Dataset**: Curated natural language → macOS shell command pairs
- **Quantization**: Converted to GGUF Q8_0 using llama.cpp

## Files

- `harsh-shell-q8_0.gguf` — The quantized model (Q8_0, ~1.5GB)
- `Modelfile` — Ollama configuration file

## Limitations

- Optimized for **macOS** commands; Linux/Windows commands may be less accurate
- Best for single-line commands; complex multi-line scripts may not generate correctly
- Always review generated commands before running them, especially destructive operations (`rm`, `mv`, etc.)