Article
Where Model-Driven Screen Interaction Actually Runs Out of Room
NatalieY
• • 1Natalie Y PRO
NatalieY
AI & ML interests
AI agents, edge AI, on-device LLM, embedded systems, autonomous agents
Recent Activity
upvoted an article 1 day ago
Where Model-Driven Screen Interaction Actually Runs Out of Room published an article 2 days ago
Where Model-Driven Screen Interaction Actually Runs Out of Room reacted to theirpost with 🔥 21 days ago
Spent a while chasing a genuinely strange iOS bug while building Aiden (a physical agent that drives phones over USB HID): modifier-key shortcuts like Cmd+V would silently fail while plain keystrokes worked fine every time.
Turned out iOS was routing the command to the wrong process (SpringBoard, not the actual foreground app) whenever a keyboard and mouse were both present at the same time as AssistiveTouch. Confirmed it wasn't specific to our hardware, reproduced it on a completely unrelated gaming keyboard and a Bluetooth keyboard too.
Full writeup with the actual experiment table and log output: https://huggingface.co/blog/NatalieY/debugging-aiden
Curious if anyone here has hit this same failure mode building on iOS accessibility APIs.
Repo: https://github.com/AidenAI-IO/aiden-firmwareOrganizations
published an article 2 days ago
published an article about 1 month ago
Article
Aiden: a physical AI agent that controls phones over USB HID
AidenAgent
• • 1 published an article 2 months ago
Article
Aiden Hardware: The AI Agent Device That Plugs In and Acts
NatalieY
• • 2