Skill UI

Empowers building AI agents that perceive screens, plan via vision-language reasoning, and control mouse/keyboard for desktop automation, with attention to sandboxing and safety across Anthropic, OpenAI, and open-source paradigms.

Use for live Windows or macOS GUI tasks that structured tools cannot complete. Discover approved apps and windows, observe current state, act via semantic elements or shortcuts, and verify every requested outcome. Includes an operating loop for reliable desktop automation and visual verification.

Build AI agents that interact with computers like humans, performing tasks such as viewing screens, moving cursors, clicking buttons, and typing text. This skill covers Anthropic's Computer Use, OpenAI's Operator, and open-source alternatives. It emphasizes sandboxing, security, and handling vision-based control challenges for desktop automation and GUI interaction.