# Executive Visualization - Usage Guide This guide shows how to use the new executive-friendly visualization features for stakeholder demonstrations. ## ๐ŸŽฏ Overview The visualization module transforms technical logging into business-friendly reports that highlight: - **Decision Reasoning**: Why the agent chose a particular approach - **Execution Journey**: Timeline of attempts and refinements - **Confidence Metrics**: Quality indicators based on execution patterns - **Clear Outcomes**: Success/failure with actionable insights ## ๐Ÿ“‹ Commands Available ### 1. Run Task with Executive Mode (Live Demo) **Use this for:** Live demonstrations to executives ```bash # Run with executive-friendly display (modern, clean output) uv run dabench run-lang-task task_355 --config configs/react_baseline.azure.yaml --display-mode=executive # Run with technical display (default - detailed logs) uv run dabench run-lang-task task_355 --config configs/react_baseline.azure.yaml --display-mode=technical ``` **What you see:** - Executive mode: Clean panels showing strategy, execution timeline, and results - Technical mode: Original detailed logging (unchanged, default behavior) ### 2. View Executive Report (Post-Run Analysis) **Use this for:** Analyzing completed tasks, preparing presentations ```bash # View report for a specific task from a run uv run dabench view-exec-report task_355 20260601T075638Z # Or use full path uv run dabench view-exec-report task_355 /data3/dataFAIR/kdd-dev/public/artifacts/runs/20260601T075638Z ``` **What you see:** - ๐Ÿ“Š Executive Summary with status and timing - ๐Ÿง  Decision Reasoning (the "why" behind the approach) - โš™๏ธ Execution Timeline (refinement cycles) - ๐Ÿ“ฆ Deliverables (output location) ### 3. Run Multiple Tasks with Executive Display ```bash # Run multiple tasks for comprehensive demo uv run dabench run-lang-task task_355 task_330 task_418 \ --config configs/react_baseline.azure.yaml \ --display-mode=executive ``` ## ๐ŸŽจ Visual Style The executive mode uses: - โœ… โŒ Status emojis for quick scanning - ๐Ÿ” ๐Ÿ“‹ โš™๏ธ Phase indicators - ๐ŸŸข ๐ŸŸก ๐ŸŸ  ๐Ÿ”ด Confidence color coding - Rounded panels with clear typography - Business terminology (not technical jargon) ## ๐Ÿ“Š Example Output ### Executive Mode Output ``` โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” ๐Ÿ“Š Executive Summary: task_355 โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ”โ” โ•ญโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ Overview โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ•ฎ โ”‚ Status โœ… Success โ”‚ โ”‚ Completion Time โฑ๏ธ 1m 41s โ”‚ โ”‚ Refinement Cycles ๐Ÿ”„ 5 attemptsโ”‚ โ”‚ Confidence Level ๐ŸŸ  Moderate โ”‚ โ•ฐโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ•ฏ โ•ญโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ ๐Ÿง  Decision Reasoning โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ•ฎ โ”‚ ๐Ÿ’ก Strategy: Find records where expense โ”‚ โ”‚ description matches 'Water, Veggie tray and โ”‚ โ”‚ supplies', then connect to member records to โ”‚ โ”‚ retrieve first_name, last_name, and cost. โ”‚ โ”‚ โ”‚ โ”‚ ๐Ÿ“‹ Target Output: first_name, last_name, cost โ”‚ โ”‚ ๐Ÿ“Š Expected Result: single row(s) โ”‚ โ•ฐโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ•ฏ โš™๏ธ Execution & Refinement Timeline โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ” โ”‚ Attempt โ”‚ Status โ”‚ Insight / Action Taken โ”‚ โ”œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ค โ”‚ #1 โ”‚ โŒ Refineโ”‚ No matching records found - โ”‚ โ”‚ โ”‚ โ”‚ refining search criteria โ”‚ โ”‚ #2 โ”‚ โŒ Refineโ”‚ Search criteria too โ”‚ โ”‚ โ”‚ โ”‚ restrictive - broadening โ”‚ โ”‚ #3 โ”‚ โŒ Refineโ”‚ No matching records found - โ”‚ โ”‚ โ”‚ โ”‚ refining search criteria โ”‚ โ”‚ #4 โ”‚ โŒ Refineโ”‚ No matching records found - โ”‚ โ”‚ โ”‚ โ”‚ refining search criteria โ”‚ โ”‚ #5 โ”‚ โŒ Refineโ”‚ No matching records found - โ”‚ โ”‚ โ”‚ โ”‚ refining search criteria โ”‚ โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜ โ•ญโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ ๐Ÿ“ฆ Deliverables โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ•ฎ โ”‚ ๐Ÿ“ Results File .../prediction.csvโ”‚ โ”‚ ๐Ÿ“Š Output Columns first_name, โ”‚ โ”‚ last_name, cost โ”‚ โ•ฐโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ•ฏ ``` ## ๐Ÿ”„ Migration Notes ### Backward Compatibility - **Default behavior unchanged**: All existing commands work exactly as before - **Opt-in only**: Executive mode is only active when explicitly requested - **No breaking changes**: Technical mode is still the default ### When to Use Each Mode | Audience | Recommended Mode | Why | |----------|-----------------|-----| | Software Engineers | `technical` | Full debugging details, logs, stack traces | | Data Scientists | `technical` | Technical validation, performance metrics | | Senior Executives | `executive` | Business outcomes, decision reasoning | | Stakeholder Demos | `executive` | Clear narrative, visual appeal | | Post-Run Analysis | Use `view-exec-report` | Polished presentation of results | ## ๐Ÿš€ Quick Start for Demo For your executive demonstration: ```bash # 1. Run a task with executive display uv run dabench run-lang-task task_355 \ --config configs/react_baseline.azure.yaml \ --display-mode=executive # 2. Or view a report for an already-completed run uv run dabench view-exec-report task_355 20260601T075638Z ``` ## ๐Ÿ“ Files Created ``` src/data_agent_baseline/visualization/ โ”œโ”€โ”€ __init__.py # Module exports โ”œโ”€โ”€ trace_parser.py # Parse trace.json structure โ”œโ”€โ”€ executive_reporter.py # Generate formatted reports โ”œโ”€โ”€ narratives.py # Technical โ†’ Business language mapping โ””โ”€โ”€ live_display.py # Live demo display (future enhancement) ``` ## ๐Ÿ”ง Technical Details - **trace.json parsing**: Extracts decision reasoning, execution attempts, timing - **Narrative translation**: Maps technical actions to business-friendly descriptions - **Rich formatting**: Uses Rich library for beautiful terminal output - **No side effects**: Read-only operations, doesn't modify any data