Back to AI News
arxiv

MobileProbe: Trajectory-Aware Red-Teaming for Mobile GUI Agents

MobileProbe is a red-teaming framework for mobile GUI agents that adaptively evaluates susceptibility to environmental injection attacks, where malicious instructions are embedded in ordinary UI content. Unlike fixed-point benchmarks that pin hand-crafted payloads to a fixed step of a fixed task, it automates discovery of attacker-controllable content surfaces, localizes vulnerable decision points along the agent's trajectory, and iteratively refines context-aware payloads via a surrogate-filtered evolutionary loop. The authors build a benchmark of 83 long-horizon attack instances across 12 mobile applications, each annotated with a Confidentiality, Integrity, or Availability attack goal. On three representative agent architectures, MobileProbe reports higher attack success rates than human-written, zero-shot LLM, and prior automated red-teaming baselines adapted to the mobile domain.

AI Brief

It offers a reusable pre-deployment auditing method and benchmark for teams shipping mobile agents, addressing a coverage gap in fixed-step security testing.

arXiv:2611.16693v1 Announce Type: cross Abstract: Mobile GUI agents read the screen of a phone and operate apps on a user's behalf to complete multi-step tasks such as online shopping or messaging. Because the agent acts on whatever the screen shows, an attacker can embed malicious instructions into ordinary UI content and redirect its actions. We refer to this threat as environmental injection attack (EIA). Existing benchmarks measure this risk by pinning hand-crafted payloads to a fixed step of a fixed task. This approach faces two limitations. First, each payload is bound to one task in one app and does not transfer without manual redesign. Second, agents given the same task may follow different routes, so an agent that never reaches the injected page is recorded as safe without being tested. This insufficient test coverage can cause fixed-point benchmarks to underestimate the security risk of deployed mobile agents. In this work, we propose MobileProbe, a trajectory-aware red-teaming framework that evaluates mobile agents adaptively. MobileProbe discovers attacker-controllable content surfaces through automated pentesting, localizes vulnerable decision points along the agent's trajectory, and iteratively refines context-aware payloads through a surrogate-filtered evolutionary loop. We construct a benchmark of 83 long-horizon attack instances spanning 12 mobile applications. Each is annotated with a Confidentiality, Integrity, or Availability (CIA) attack goal to cover the principal categories of security threats facing mobile agents. On three representative agent architectures, MobileProbe attains higher attack success rates than human-written, zero-shot LLM, and prior automated red-teaming baselines adapted to the mobile domain. MobileProbe can serve as a pre-deployment auditing tool to systematically uncover vulnerabilities and inform security hardening of mobile agents.
Be the first to rate this article.

Comments & Questions (0)

Captcha
Please be respectful — let's keep the conversation friendly.

No comments yet

Be the first to comment!