iOSWorld: A Benchmark for Personally Intelligent Phone Agents
arXiv:2606. 09764v1 Announce Type: new Abstract: A useful phone agent needs to be personally intelligent.
The paper examines the use of large language models (LLMs) to reverse‑engineer the protobuf schemas that iPhones send to Apple’s location services. Using Claude Opus 4.8 and Codex GPT‑Sol 5.6, the authors find that most AI‑generated schemas contain significant errors that are difficult to detect, making direct AI assistance unsuitable for forensic or privacy analysis. However, they demonstrate that an LLM can be employed to build a reliable Python tool, Extractor, which accurately recovers protobuf schemas from Apple binaries and successfully decodes network traffic from a jailbroken iPhone 8 running iOS 16.7.11.
arXiv:2606. 09764v1 Announce Type: new Abstract: A useful phone agent needs to be personally intelligent.
arXiv:2609.23980v1 Announce Type: cross Abstract: AI agents now report vulnerabilities faster than maintainers can review them. Reports often depend on security properties specific to the application...
arXiv:2609.22724v1 Announce Type: cross Abstract: Mobile agents powered by foundation models now automate complex, multi-step workflows on real devices, but their trajectories can violate app-specifi...
arXiv:2512. 20872v2 Announce Type: replace-cross Abstract: Function call graphs (FCGs) have emerged as a powerful abstraction for malware detection, capturing the behavioral structure of applications beyond surface-level signatures.
arXiv:2610.14855v1 Announce Type: new Abstract: The growing deployment of compact large language models on smartphones is enabling autonomous on-device decision-making, such as emerging mobile GUI ag...
MobileWorldSafety is a benchmark that evaluates the safety of large language model–powered GUI agents on Android by exposing them to 142 real-world risk tasks involving environmental injection attacks. The benchmark uses a two‑stage verification pipeline—rule‑based checks for clear cases and an LLM judge for ambiguous ones—to distinguish safety failures from capability failures. Experiments on six agents show high vulnerability, with attack success rates between 40.4% and 66.9%, highlighting that current agents often fail to remain safe when faced with adversarial content presented as normal mobile context.
arXiv:2606. 10173v1 Announce Type: cross Abstract: As AI systems move into operating systems, privacy no longer turns only on whether a model runs locally.
arXiv:2607. 19424v1 Announce Type: cross Abstract: The assessment of jailbreak attacks against large language models currently suffers from inconsistent evaluation criteria and methods, leading to unreliable estimates of attack success rates.
arXiv:2510. 24411v3 Announce Type: replace Abstract: Computer-using agents powered by Vision-Language Models (VLMs) have demonstrated human-like capabilities in operating digital environments like mobile platforms.
arXiv:2605. 29524v2 Announce Type: replace-cross Abstract: Relay and reseller APIs increasingly intermediate access to large language models (LLMs), but users have no direct way to verify that a claimed endpoint is actually serving the advertised model.
arXiv:2510. 15476v3 Announce Type: replace-cross Abstract: Large Language Models (LLMs) are increasingly used as interfaces to information, code, and real-world services, making prompt-level security failures a practical concern.
arXiv:2606. 26707v1 Announce Type: cross Abstract: Adversarial APKs are Android applications modified in the problem space to evade machine-learning malware detectors.