Skill UI

Empowers building AI agents that perceive screens, plan via vision-language reasoning, and control mouse/keyboard for desktop automation, with attention to sandboxing and safety across Anthropic, OpenAI, and open-source paradigms.

This guide provides comprehensive technical guidance for performance tuning and automating workflows using TechSmith Snagit COM API and Camtasia. It details key considerations for robust scripting, including using PowerShell and Python interop, defining various input/output types (like desktop, window, clipboard, or file), and solving common errors (such as COM registration failures or permission issues). Use this skill when building complex, automated pipelines for screen capture and video editing.

XcodeBuildMCP is a unified skill set designed to streamline the entire mobile and desktop development lifecycle. It replaces raw command-line tools like xcodebuild, xcrun, and simctl, providing structured workflows for iOS, macOS, watchOS, tvOS, and visionOS. Capabilities include project discovery, managing simulator and physical device workflows, advanced UI automation (gestures, view inspection), robust logging, and deep debugging using LLDB. It simplifies complex build, test, and run operations across multiple platforms.

A comprehensive guide and toolkit for performing End-to-End (E2E) testing on native Windows desktop applications (WPF, WinForms, Win32, Qt) using pywinauto and the Windows UI Automation (UIA) API. Covers setup, locator strategies, and page object modeling for robust desktop automation.

A comprehensive framework for performing end-to-end (E2E) testing on various Windows native desktop applications. It utilizes pywinauto and the Windows UI Automation (UIA) API, supporting major frameworks including WPF, WinForms, Win32/MFC, UWP, and Qt. This skill helps automate complex GUI interactions, making it ideal for CI/CD integration and building robust desktop test suites.

Use for live Windows or macOS GUI tasks that structured tools cannot complete. Discover approved apps and windows, observe current state, act via semantic elements or shortcuts, and verify every requested outcome. Includes an operating loop for reliable desktop automation and visual verification.

Manage and run Power Automate Desktop (RPA) flows and machine groups. Use this skill to list, trigger, and monitor desktop flows, as well as manage machine infrastructure for automation tasks.

Build AI agents that interact with computers like humans, performing tasks such as viewing screens, moving cursors, clicking buttons, and typing text. This skill covers Anthropic's Computer Use, OpenAI's Operator, and open-source alternatives. It emphasizes sandboxing, security, and handling vision-based control challenges for desktop automation and GUI interaction.

Automate browser and Windows desktop application interactions using Playwright and OpenReverse for reverse engineering, evidence collection, and UI-driven workflows. Supports network observation and structured UI operations for security analysis tasks.

Prepare, validate, submit, and monitor Windows desktop apps in Microsoft Partner Center, covering MSIX packaging, Store identity, listings, WACK testing, certification, and publishing automation.

Drive native desktop apps through an Automation REPL: bind applications, inspect accessibility trees, type text, click, and capture screenshots while honoring OS permissions and user stop requests.