AIAny
GitHub

mobile-mcp

Gives an LLM agent direct control of iOS and Android apps over one MCP interface, across simulators, emulators, and real devices. Reads the native accessibility tree to pick elements deterministically, using screenshot coordinates only as fallback.

Introduction

Mobile UI automation has long meant brittle, platform-specific scripts — XPath selectors that break on the next release, or vision models guessing where to tap. The bet here is different: a phone's accessibility tree is already a structured, labeled description of the screen, so an LLM can reason over it the way it reasons over a DOM. That turns "tap the login button" into a deterministic lookup rather than a pixel gamble, and the same agent code runs unchanged across iOS and Android.

What Sets It Apart
  • One platform-agnostic API spans iOS and Android, simulators, emulators, and real devices — you write the automation once instead of maintaining separate Appium/XCUITest stacks per platform.
  • Accessibility-first element selection means no computer-vision model in the loop for labeled UIs, which is cheaper, faster, and far more stable than coordinate-based tapping.
  • A screenshot-plus-coordinate fallback covers custom-drawn or unlabeled screens, so the agent degrades gracefully instead of failing when accessibility data runs out.
  • Speaking native MCP, it plugs straight into Claude, Copilot, Gemini, or any MCP client without glue code.
Who It's For

Great fit if you want an AI agent to explore, test, or drive real mobile apps end-to-end, or to build reproducible mobile test flows without hand-writing selectors. Look elsewhere if you need a polished record-and-replay GUI, guaranteed support for heavily custom-rendered (game-engine) UIs, or a managed cloud device farm out of the box — this is developer tooling you run against your own simulators and devices, and the accessibility advantage shrinks on apps with poor accessibility hygiene.

Information

  • Websitegithub.com
  • AuthorsMobile Next
  • Published date2025/03/28

More Items

GitHub
AI Infra2026

Compresses tool outputs, logs, files and RAG chunks locally before they reach the LLM to reduce token usage while caching originals for on-demand retrieval. Provides proxy/library/wrap modes, JSON- and code-aware compressors, and reversible compression.

GitHub
AI Infra2026

Provides a self‑hosted OpenAI‑compatible gateway that exposes one API endpoint to route requests to 40+ model providers, issue revocable virtual keys, enforce budgets before spend, and record usage.

GitHub
AI Coding2023

A statically typed, parallel programming language that prevents AI-introduced bugs by making correctness claims (laws) require machine-checked proofs. Compiles to native code and targets CPU/GPU parallelism with a fast proof checker.