## What I Built
Aiden is an external AI agent prototype that lets an AI observe and operate a connected phone. Aiden receives the phone's display output, sends the current screen to an AI model, and sends the selected action back through USB HID.
## How It Works
1. Capture the current phone screen.
2. Send the screen and task context to the AI model.
3. Let the model choose the next action.
4. Send keyboard, pointer, or touch input through the hardware.
5. Capture the new screen and repeat until the task is complete.
This video shows Aiden capturing the phone screen, sending the task context to the AI model, and controlling the phone through Aiden Bridge or USB HID.
## Result
The prototype can inspect the current interface, navigate across screens, enter text, and verify the resulting state through real hardware input.
## Limitations
This is a development prototype. Operation depends on the target device's video-output support, USB HID support, connection and power conditions, and application behavior. iPhone pointer control also requires AssistiveTouch.
Comments