File size: 7,132 Bytes

# 🚀 NeuralAI Development Roadmap

**Version Target: 6.0 (The Workstation Pivot) + 7.2 Resilient Runtime**
**Last Updated: July 15, 2026**

---

## ✅ Completed Milestones (NeuralAI Legacy)

### Phase 0: Core System ✓

- [x] SmolLM2-360M base model fine-tuned with QLoRA

- [x] Chat streaming (SSE) working

- [x] Web UI deployed (NeuralAI → NeuralAI v1.0)

- [x] Unified Service Migration: Consolidated Model + UI + Terminal into `file neural_core_service.py`

- [x] Fixed Chat streaming and Terminal consistency

- [x] Improved SSE responsiveness with tool execution indicators and non-blocking stream chunks.

### Phase 1: Tool Ecosystem ✓

- [x] Code Execution Sandbox, File Manager, Web Fetcher, DB Connector, Git Assistant

- [x] Tool detection and routing in chat

### Phase 2: DPO Alignment ✓

- [x] DPO training pipeline implemented

- [x] Preference dataset expanded to 244 pairs (v12.0)

- [x] Memphis Culture & Founder Context integration

---

## 🏗️ Phase 3: NeuralAI Evolution (In Progress)

### 1. Workstation Orchestration

- [x] Establish distinction: NeuralAI (Model) vs. NeuralAI (Hub)

- [x] UI Overhaul: Added "Workstation Dashboard" tab with project/model/shell status

- [x] Robust Multi-Turn Context Support (10-message sliding window)

- [x] Integrated Multi-Modal Speech-to-Speech (Gemini Live + ElevenLabs Fallback)

- [ ] Transition UI from Chat-Only to Multi-Panel Workstation (Expand dashboard features)

- [ ] Implement System-Wide Context Layer

- [ ] Add "Vibe Stack" Workflow Registry

### 2. Neural Knowledge Graph

- [ ] Implement Persistent Memory (Graph-based)

- [ ] Automate Infrastructure Learning

- [ ] Sync with Supermemory

---

## 📊 System Status

- **Main Service:** **READY & RESILIENT** (`webui_service.py` v7.2.0 — auto-restart, memory watchdog, ZO-native inference backend)
- **Voice Service:** **READY** (ElevenLabs v2 Migrated)
- **Model:** SmolLM2-360M-Instruct + DPO v15.0 (Deployed)
- **Context:** System-wide (Expanding)

### Latest DPO Run (v15.0)

- **Training samples:** 597 (expanded from 302)
- **Epochs:** 3
- **Steps:** 450
- **Final training loss:** `0.305`
- **Reward margin:** `~0.5` → `~3.5`
- **Hardware:** Apple Silicon MPS (MacBook Air M4)
- **Duration:** `730.5s` (~12 min)
- **Completed:** `2026-07-11 20:00 UTC`
- **Adapter:** live on HF `Subject-Emu-5259/NeuralAI`

### Deployment & Inference (updated July 15, 2026)

- **Host:** ZO Computer (Free plan, 4 GB RAM) at `neuralai-deandrewharris.zocomputer.io`
- **Inference backend:** `LLM_BACKEND=zo` → ZO native `/zo/ask` using the user's own BYOK model (`byok:0d3567f7-f521-42b0-8adf-65c9b036cf89`). Uses **0 MB local RAM**.
- **Why not local:** Loading PyTorch + SmolLM2-360M on a 4 GB box used ~6.2 GB → OOM-kill loop that paused the service. The ZO backend removes that dependency entirely (see `docs/INCIDENT-2026-07-14-NEURALAI-PAUSES.md`).
- **Local PyTorch backend:** still available via `LLM_BACKEND=local` on GPU/Colab-class machines (≥8 GB RAM) for offline/private inference.
- **Resilience:** supervisor auto-restart, `/api/health` keepalive, and a memory watchdog that runs GC before any OOM. Service verified stable after the July 15 fix (free RAM returned to ~3 GB).

---

## 🎯 Next Steps (Priority Order)

### 1. Training Data Expansion

**Status:** In progress (500+ samples reached, target 1000+)

**Categories to expand:**

- Symbolic Logic & Formal Proofs: +50 samples
- Security & Vulnerability Analysis: +50 samples
- Multi-Step Algorithmic Reasoning: +50 samples
- Advanced Mathematics (Calculus/Linear Algebra): +50 samples

### 2. Evaluation Suite

**Status:** Created, pending execution

**Benchmarks:**

- Code correctness: Generated code runs
- Response helpfulness: Quality scoring
- Safety: Refuses harmful requests
- Latency: Inference speed

---

## 🚀 Future Phases (The Agentic Horizon)

### Phase 4: Agentic Autonomy & Computer Use

**Goal:** Transition from "Assistant" to "Operator"

- [ ] **Browser Agent Integration**: Implement autonomous web navigation and interaction (Computer Use).

- [ ] **Multi-Agent Orchestration**: Ability to spawn and manage specialized sub-agents for parallel task execution.

- [ ] **Long-Horizon Planning**: Implement hierarchical planning for tasks requiring 10+ steps.

- [ ] **Third-Party App Integration**: Direct agentic control over productivity tools (Calendar, Email, CRM).

### Phase 5: Universal Knowledge Integration (The "World-Brain" Training)

**Goal:** Massive expansion of general-world intelligence and cultural context.

- [ ] **Natural World**: Plants, animals, creatures, ecosystems, and biology.

- [ ] **Humanity & Culture**: History, religions, beliefs, sociology, and anthropology.

- [ ] **The Arts**: Music theory, cinematic history, fine arts, and literature.

- [ ] **Global Systems**: Geography, geopolitics, economics, and planetary sciences.

### Phase 6: Model Capability Upgrades

**Goal:** Integration of frontier reasoning and multimodal capabilities.

- [ ] **Deep Reasoning Integration**: Implement "Think" modes for complex mathematical and logical deduction.

- [ ] **Native Multimodal Understanding**: Unified processing of video, audio, and images in a single context window.

- [ ] **Test-Time Compute Optimization**: Optimize inference to allow the model to "think longer" for harder problems.

---

## 📊 Data Files

```markdown
data/
├── train.jsonl              # 347 original samples
├── train_v3.jsonl           # 404 samples (latest)
├── train_dpo.jsonl          # 13 DPO pairs
├── train_dpo_expanded.jsonl # 31 DPO pairs
└── train_expanded.jsonl     # 363 samples
```

## 📁 Project Structure

```markdown
NeuralAI/
├── checkpoints/final_model/    # LoRA adapter
├── data/                       # Training data
├── eval/benchmarks.py          # Evaluation suite
├── from-scratch/web_ui/        # Flask app + static files
│   ├── app.py                  # Main Flask server
│   ├── neuralai_engine.py      # Model + tools
│   └── neuralai_router.py      # Routing logic
├── tools/                      # Tool implementations
│   ├── code_sandbox.py
│   ├── file_manager.py
│   ├── web_fetcher.py
│   ├── db_connector.py
│   └── git_assistant.py
└── training/                   # Training scripts
    ├── train_dpo.py
    ├── generate_training_v3.py
    └── NeuralAI_TPU_Training.ipynb
```

---

## 🔗 Quick Links

- **Live Chat:** https://neuralai-deandrewharris.zocomputer.io
- **GitHub:** https://github.com/Subject-Emu-5259/NeuralAI
- **Local Dev:** http://localhost:5000

---

## 📝 Commands

```bash
# Start the service
cd /home/workspace/Projects/NeuralAI/from-scratch/web_ui
python3 app.py

# Generate v5 DPO data
python3 training/generate_dpo_v5.py

# DPO training (currently running in background)
python3 training/train_dpo.py
```

---

**Next Session Goals:**

1. Run evaluation benchmarks
2. Expand training data to 1000+ samples
3. Request GPU or prepare Colab notebook for DPO training