技能 编程开发 移动端自动化控制

移动端自动化控制

v20260909
mobile-automation
控制 Android 和 iOS 设备、模拟器与仿真器,支持启动应用、点击、滑动、输入、截图及读取无障碍树。适用于移动端 UI 测试、应用调试和手机 Bug 复现。
获取技能
283 次下载
概览

Mobile Automation with Mobile MCP

Tools for driving real phones, emulators and simulators. All tools are
prefixed mobile_.

Workflow

  1. Pick a device. Call mobile_list_available_devices and use one of the

returned devices for every subsequent call. If no device is available, ask
the user to connect one (Android: adb devices must show it; iOS:
simulator booted or device paired).

  1. See the screen. Prefer mobile_list_elements_on_screen — it returns

the accessibility tree with element labels and coordinates. It is faster,
cheaper, and more reliable than screenshots. Fall back to
mobile_take_screenshot only when elements are missing or you need visual
confirmation (games, canvas-drawn UI, image content).

  1. Act. mobile_click_on_screen_at_coordinates, mobile_swipe_on_screen,

mobile_type_keys, mobile_press_button (HOME, BACK, VOLUME, ENTER),
mobile_launch_app / mobile_terminate_app / mobile_list_apps,
mobile_open_url.

  1. Verify after every action. Re-list elements (or re-screenshot) to

confirm the UI changed as expected before the next step. Mobile UIs
animate; if the expected element is not there yet, wait briefly and check
again rather than tapping blind.

Tips

  • Click the center of an element's bounds, not its top-left corner.
  • To type, first tap the input field, confirm it is focused, then

mobile_type_keys.

  • Use mobile_save_screenshot when the user wants the image as a file;

mobile_start_screen_recording / mobile_stop_screen_recording for videos.

  • App crashed? mobile_list_crashes and mobile_get_crash fetch crash logs.
  • Screen size from mobile_get_screen_size; coordinates are in that space.
  • Real devices in the cloud (no local hardware): mobile_login_to_cloud_provider,

then mobile_list_remote_devices / mobile_allocate_remote_device, and
release with mobile_release_remote_device when done. See
https://mobilenext.ai/docs for details.

信息
分类 编程开发
名称 mobile-automation
版本 v20260909
大小 2.29KB
更新时间 2026-09-12
语言