▲ 894 today2.1k starsRust
Agent Desktop lets AI control apps without pixel hunting
What is agent-desktop?
It offers a CLI and C library that reads the OS accessibility tree and returns a JSON snapshot of every UI element with a stable reference. An AI agent can act on those refs, click, type, read, then snapshot again to verify, avoiding fragile pixel-matching.
Who it is for
If you’re building an AI assistant or automation that needs reliable desktop interaction, this gives you a programmatic UI map instead of guessing from screenshots.
How to try it
npm install -g agent-desktop