DesktopCtl
DesktopCtl is a local launcher and command-line tool that lets AI agents observe and control a computer through its screen, mouse, and keyboard.
What DesktopCtl is
DesktopCtl is a local launcher and command-line tool that lets AI agents observe and control a computer through its screen, mouse, and keyboard. It works with desktop apps without requiring app integrations or APIs, and supports CLI-capable agents with any AI model, including local LLMs. Local GPU-accelerated text recognition and computer vision capture the interface and extract structured content; the CLI provides deterministic actions such as clicking, typing, and waiting. Its macOS launcher offers keyboard-first navigation, active-window context, and ways to run or resume sessions with multiple local agents. The maker says screen recognition runs locally and screenshots stay local by default rather than being shared with agents. A visual indicator appears when an agent accesses the screen, mouse, or keyboard, and OS-level permissions are granted only to DesktopCtl. DesktopCtl is open source under the MIT License and is free. The repository says it currently supports macOS on Apple Silicon only. Release builds use a local ad-hoc signature and are not Developer ID signed or notarized.
Good
- Works with desktop apps without integrations or APIs.
- Supports any model, including local LLMs.
- Provides deterministic clicking, typing, and waiting actions.
- Screenshots stay local by default, according to the maker.
- Free and open source under the MIT License.
Watch out
- Currently supports macOS on Apple Silicon only.
- Release builds are not Developer ID signed or notarized.
Who it suits
DesktopCtl is for people using CLI-capable AI agents to interact with desktop applications. It may suit users who want a local setup that can work with different models and apps.
Verdict
DesktopCtl offers local screen-based control for CLI-capable agents, with a launcher and explicit access indicators. Its Apple Silicon-only support and signing status are important considerations before installation.
Plans and prices
From DesktopCtl's own pricing page, checked 4 Oct 2001.
| Plan | Price | What it gives you |
|---|---|---|
| Free and open source | Free | No integrations required · works with any desktop app |
The facts
Each one read from DesktopCtl's own pages, with the date it was checked.
What it does
- Access controls
- The maker says a visual indicator appears when the agent accesses the screen, mouse, or keyboard, and OS-level permissions are granted only to DesktopCtl.checked 4 Oct 2001
- Agent support
- It supports agents that can use a CLI and lets users bring any AI model, including local LLMs.checked 4 Oct 2001
- Automation
- Its CLI provides deterministic actions including clicking, typing, and waiting.checked 4 Oct 2001
- Installation
- The repository gives an install command that downloads the latest release and places the CLI at ~/.local/bin/desktopctl and the app at ~/Applications/DesktopCtl.app.checked 4 Oct 2001
- Intended users
- The maker describes DesktopCtl as a tool for AI agents to control desktop applications, with any CLI-capable agent able to use it.checked 4 Oct 2001
- Launcher
- The macOS launcher provides keyboard-first navigation, active-window context, and the ability to run and resume sessions with multiple local agents.checked 4 Oct 2001
- License
- The homepage identifies DesktopCtl as open source under the MIT License.checked 4 Oct 2001
- Privacy
- The maker says computer vision and text recognition run locally and screenshots stay local by default rather than being shared with AI agents.checked 4 Oct 2001
- Purpose
- DesktopCtl is a local launcher and CLI for AI agents to observe and control a computer using its screen, mouse, and keyboard.checked 4 Oct 2001
- Signing
- The repository says release builds use a local ad-hoc signature and are not Developer ID signed or notarized.checked 4 Oct 2001
- UI perception
- It uses local GPU-accelerated text recognition and computer vision to capture the UI and extract structured content.checked 4 Oct 2001
Where it runs
- App compatibility
- It works with any desktop app and requires no app integrations or APIs.checked 4 Oct 2001
- Platform support
- The maker’s repository says DesktopCtl currently supports macOS on Apple Silicon only.checked 4 Oct 2001
Alternatives to DesktopCtl
- 1
Claude Code
Free planAndroidiOSWebWindows7.4From $17 a month - 2
Gemini
Free planAndroidiOSWebWindows6.9Free plan - 3
Computer Use OOTB
Free planWebmacOSSelf-hostedWindows6.8Free plan - 4
Lapu AI
Free planmacOSWindows6.7From €16 a month - 5
QuickDesk
Free planAndroidWebAPImacOS6.5Free plan - 6
Contop
AndroidiOSLinuxmacOS6.4