official announcement: Copilot now drives your desktop apps
GitHub opened desktop application control in public preview — clicking, typing, and crossing steps between programs. Including those old programs that never had an API.
- ai
- automation
- github
Copilot grew hands. GitHub released computer use in public preview in the Copilot CLI and the Copilot app, on macOS and Windows. In practice it now operates desktop applications: it reads the screen contents, clicks controls, types and edits text, presses keys, scrolls, drags, and chains together a flow that crosses several programs.
The stated target is exactly the software with no way out: legacy and GUI-only systems, with no API, no command line, no integration. Copilot asks for approval before taking control of an app, whatever you allowed stays reviewable and can be undone — and organization-managed configuration can turn the whole feature off.
Official source: GitHub Changelog, October 1, 2026 — nothing here is ProxFrito's opinion; it is what the announcement says.