arXiv Computation and Language By Zhitao He, Chi Him Zhang, Chengru Han, Yi R Fung

Multimodal-SEA: Benchmarking AI Agent Security under Multimodal Social Engineering Attacks

Read the original on arXiv Computation and Language →

The paper introduces Multimodal-SEA, a benchmark of 608 expert-designed tasks that test personal AI agents against multimodal social engineering attacks. It covers 14 domains, 152 attack scenarios, and four difficulty levels, reflecting Chinese and English cultural contexts. Seven multimodal models were evaluated, all showing vulnerability with attack success rates ranging from 7.1% to 34.5%, and multimodal content increased success rates despite higher verification coverage.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv AI
Oct 19

MobileInject: Evaluating Reasoning-to-Action Security of MLLM-Based Mobile Agents under Cross-Modal Consistency Injection

MobileInject is a benchmark that evaluates the security of multimodal large language model (MLLM)-based mobile agents against multimodal injection attacks. It offers a high‑fidelity interactive framework with 11 scenarios, 9 risk categories, and 108 executable risk instances, and introduces Cross‑Modal Consistency Injection along with two advanced attack methods—Multi‑Role Collaborative Deception and Reasoning‑Camouflage Injection—to intensify trust manipulation and reasoning hijacking. Experiments show that mobile agents are broadly vulnerable, especially to early‑stage reasoning hijacking, establishing MobileInject as a systematic tool for studying and improving mobile agent security.

By Songping Wang, Peiyang Li, Yi Huang, Fengting Li, Xuhao Ran, Yueming Lyu, Chao Feng, Caifeng Shan
arXiv AI
Aug 6

Temporal Context Awareness: A Defense Framework Against Multi-turn Manipulation Attacks on Large Language Models

arXiv:2503. 15560v1 Announce Type: cross Abstract: Large Language Models (LLMs) are increasingly vulnerable to sophisticated multi-turn manipulation attacks, where adversaries strategically build context through seemingly benign conversational turns to circumvent safety measures and elicit harmful or unauthorized responses.

By Prashant Kulkarni, Assaf Namer
arXiv AI
Jun 8

EVA: Evolving Semantic Adversaries for Red-Teaming GUI Agents Against Environmental Injection Attacks

arXiv:2505. 14289v2 Announce Type: replace Abstract: Graphical User Interface (GUI) agents powered by Multimodal Large Language Models (MLLMs) are increasingly deployed yet vulnerable to Environmental Injection Attacks (EIAs).

By Yijie Lu, Manman Zhao, Tianjie Ju, Zihe Yan, Xinbei Ma, Yuan Guo, Daizong Ding, Gongshen Liu, Zhuosheng Zhang