Walid Sobhi commited on
Commit
bf0e3a6
Β·
verified Β·
1 Parent(s): 50d4214

Add Space README

Browse files
Files changed (1) hide show
  1. README.md +113 -6
README.md CHANGED
@@ -1,12 +1,119 @@
1
  ---
2
- title: Stack X Ultimate Inference
3
- emoji: 🐠
4
- colorFrom: pink
5
- colorTo: indigo
6
  sdk: gradio
7
- sdk_version: 6.13.0
8
  app_file: app.py
9
  pinned: false
 
 
 
 
 
 
 
 
 
10
  ---
 
11
 
12
- Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ title: Stack X Ultimate
3
+ emoji: πŸ€–
4
+ colorFrom: purple
5
+ colorTo: blue
6
  sdk: gradio
7
+ sdk_version: 5.16.0
8
  app_file: app.py
9
  pinned: false
10
+ description: Open-source agentic model with tool calling. Deploy on your own GPU β€” no API costs.
11
+ tags:
12
+ - agentic
13
+ - tool-calling
14
+ - llm
15
+ - qwen
16
+ - open-source
17
+ - local-ai
18
+ license: apache-2.0
19
  ---
20
+ # Stack X Ultimate β€” Agentic Tool-Calling Model
21
 
22
+ <div align="center">
23
+
24
+ **Open-source agentic model that calls real tools. Deploy on your GPU β€” no API key required.**
25
+
26
+ [![Model](https://img.shields.io/badge/Model-Qwen2.5--Coder--3B--Instruct-blue)](https://huggingface.co/Qwen/Qwen2.5-Coder-3B-Instruct)
27
+ [![Quantization](https://img.shields.io/badge/Quantization-QLoRA%204--bit-purple)](https://github.com/QwenLM/Qwen2.5-Coder)
28
+ [![License](https://img.shields.io/badge/License-Apache%202.0-green)](LICENSE)
29
+
30
+ </div>
31
+
32
+ ---
33
+
34
+ ## What It Does
35
+
36
+ Stack X Ultimate is a fine-tuned Qwen2.5-Coder-3B-Instruct optimized for **agentic tool-calling workflows**:
37
+
38
+ - πŸ”’ **Calculator** β€” evaluates mathematical expressions
39
+ - πŸ• **Current Time** β€” returns live UTC timestamp
40
+ - πŸ“ **File Search** β€” glob-based file discovery in directory trees
41
+ - ⚑ **Command Execution** β€” runs shell commands and returns structured output
42
+
43
+ The model decides *when* to call tools and *how* to interpret results β€” mirroring how GPT-4 and Claude handle function calling, but running entirely on your infrastructure.
44
+
45
+ ---
46
+
47
+ ## Quick Start
48
+
49
+ ### Try in Browser
50
+ Use the chat interface above β€” try the pre-loaded examples or type your own query.
51
+
52
+ ### Run Locally
53
+
54
+ ```bash
55
+ # Clone the model
56
+ git lfs install
57
+ git clone https://huggingface.co/my-ai-stack/Stack-X-Ultimate
58
+
59
+ # Run with llama.cpp
60
+ ./llama.cpp -m ./Stack-X-Ultimate/unsloth.Q4_K_M.gguf \
61
+ -n 8192 \
62
+ --ctx-size 8192 \
63
+ -p "You are a helpful AI assistant with tool calling."
64
+
65
+ # Or with transformers
66
+ python3 -c "
67
+ from transformers import AutoModelForCausalLM, AutoTokenizer
68
+ model = AutoModelForCausalLM.from_pretrained('my-ai-stack/Stack-X-Ultimate')
69
+ tok = AutoTokenizer.from_pretrained('my-ai-stack/Stack-X-Ultimate')
70
+ print('Model loaded!')
71
+ "
72
+ ```
73
+
74
+ ---
75
+
76
+ ## Architecture
77
+
78
+ | Component | Detail |
79
+ |---|---|
80
+ | Base Model | Qwen/Qwen2.5-Coder-3B-Instruct |
81
+ | Fine-tune Method | QLoRA 4-bit (r=32, all 7 target modules) |
82
+ | Training Data | 27,000+ agentic tool-call examples |
83
+ | Sequence Length | 8,192 tokens |
84
+ | VRAM Required | ~6 GB (Q4_K_M GGUF) |
85
+ | Min. Hardware | Single V100 16GB or equivalent |
86
+
87
+ ---
88
+
89
+ ## Available Tools
90
+
91
+ | Tool | Description | Example |
92
+ |---|---|---|
93
+ | `calculator` | Evaluate math expressions | `1500 * 0.07 * 30` |
94
+ | `get_current_time` | Return current UTC time | β€” |
95
+ | `search_files` | Glob-based file search | `*.py` in `./src` |
96
+ | `run_command` | Execute shell commands | `git status` |
97
+
98
+ ---
99
+
100
+ ## Enterprise Deployment
101
+
102
+ Need tool integrations specific to your stack? Want to deploy inside your VPC?
103
+
104
+ πŸ“¬ **[Contact Stack AI β†’](https://www.stack-ai.me/contact)**
105
+
106
+ - Custom tool integrations (APIs, databases, internal systems)
107
+ - VPC-isolated deployment (AWS / GCP / Azure)
108
+ - Air-gapped / on-prem installation
109
+ - Custom LoRA fine-tuning on your data
110
+
111
+ ---
112
+
113
+ ## License
114
+
115
+ Apache 2.0 β€” free for commercial and personal use.
116
+
117
+ ---
118
+
119
+ *Stack AI β€” Sovereign AI Infrastructure. [huggingface.co/my-ai-stack](https://huggingface.co/my-ai-stack) Β· [stack-ai.me](https://www.stack-ai.me)*