AIAny
Icon for item

mobile-mcp

Gives an LLM agent direct control of iOS and Android apps over one MCP interface, across simulators, emulators, and real devices. Reads the native accessibility tree to pick elements deterministically, using screenshot coordinates only as fallback.

Introduction

Mobile UI automation has long meant brittle, platform-specific scripts — XPath selectors that break on the next release, or vision models guessing where to tap. The bet here is different: a phone's accessibility tree is already a structured, labeled description of the screen, so an LLM can reason over it the way it reasons over a DOM. That turns "tap the login button" into a deterministic lookup rather than a pixel gamble, and the same agent code runs unchanged across iOS and Android.

What Sets It Apart
  • One platform-agnostic API spans iOS and Android, simulators, emulators, and real devices — you write the automation once instead of maintaining separate Appium/XCUITest stacks per platform.
  • Accessibility-first element selection means no computer-vision model in the loop for labeled UIs, which is cheaper, faster, and far more stable than coordinate-based tapping.
  • A screenshot-plus-coordinate fallback covers custom-drawn or unlabeled screens, so the agent degrades gracefully instead of failing when accessibility data runs out.
  • Speaking native MCP, it plugs straight into Claude, Copilot, Gemini, or any MCP client without glue code.
Who It's For

Great fit if you want an AI agent to explore, test, or drive real mobile apps end-to-end, or to build reproducible mobile test flows without hand-writing selectors. Look elsewhere if you need a polished record-and-replay GUI, guaranteed support for heavily custom-rendered (game-engine) UIs, or a managed cloud device farm out of the box — this is developer tooling you run against your own simulators and devices, and the accessibility advantage shrinks on apps with poor accessibility hygiene.

Information

  • Websitegithub.com
  • AuthorsMobile Next
  • Published date2025/03/28

More Items

GitHub

Provides a local-first web-intelligence layer for AI agents: search, fetch, crawl, extract, cache, find-similar and agent-style research without API keys or per-query billing, running as an MCP server, REST daemon, or SDK.

Enables RL post-training with million-token prompts under a fixed GPU budget by evaluating shared prompt state without autograd, retaining only minimal model state, and replaying short response branches; instantiated as GRPO and demonstrated on Qwen3.6-27B and GLM-5.2 up to multi-million token execution.

GitHub
AI Client2026

Transforms unstructured documents into strongly-typed Knowledge Abstracts with one CLI command, extracting entities and relations into graphs, hypergraphs, and spatio‑temporal structures. Includes 80+ templates, multiple RAG engines, local vLLM support, Obsidian export and an MCP server.