mobile-agent / README.md
3morixd's picture
Upload README.md with huggingface_hub
b6e7ead verified
|
Raw
History Blame Contribute Delete
1.43 kB
---
title: Mobile Agent
emoji: πŸ€–
colorFrom: blue
colorTo: indigo
sdk: gradio
sdk_version: "4.44.0"
app_file: app.py
pinned: true
license: apache-2.0
tags:
- agent
- mobile
- on-device
- smolagents
- mcp
- dispatchai
models:
- dispatchAI/Llama-3.2-1B-Instruct-Q4-mobile
---
# πŸ€– dispatchAI Mobile Agent
**A real AI agent running on a 1B parameter model β€” small enough for your pocket.**
This Space proves that useful AI agents can run on phone-sized models. The agent is powered by [Llama-3.2-1B-Instruct-Q4-mobile](https://huggingface.co/dispatchAI/Llama-3.2-1B-Instruct-Q4-mobile) β€” a 1B parameter model quantized to 4-bit, with a 700MB file size that runs at 18 tokens/sec on a Snapdragon 865.
## Features
- πŸ’¬ **Chat** β€” Conversational AI on a 1B model
- πŸ‘¨β€πŸ’» **Code generation** β€” Python code from natural language
- πŸ”§ **MCP server** β€” Add this agent as a tool in Claude Desktop / Cursor
## The Point
This isn't about matching GPT-4. It's about proving that a 1B model on a phone can be genuinely useful. For the tasks people actually do on phones β€” quick answers, code snippets, summaries, classifications β€” a 1B model is enough.
## Run On Your Phone
```bash
hf download dispatchAI/Llama-3.2-1B-Instruct-Q4-mobile model.gguf
llama-cli -m model.gguf -p "Hello!" -n 100 -t 4
```
πŸš€ [dispatchAI](https://huggingface.co/dispatchAI) β€” Small. Mobile. Free. UAE-built.