The paper introduces Multimodal-SEA, a benchmark of 608 expert-designed tasks that test personal AI agents against multimodal social engineering attacks. It covers 14 domains, 152 attack scenarios, and four difficulty levels, reflecting Chinese and English cultural contexts. Seven multimodal models were evaluated, all showing vulnerability with attack success rates ranging from 7.1% to 34.5%, and multimodal content increased success rates despite higher verification coverage.
Personal AI agents face social engineering attacks supported by forged multimodal content, but existing evaluations mainly focus on text-based dialogue, leaving their intrinsic security under such att...
arXiv:2608. 15893v1 Announce Type: new Abstract: The rise of social media bots poses a persistent threat, enabling misinformation, opinion manipulation, and the erosion of trust in online platforms.
MobileInject is a benchmark that evaluates the security of multimodal large language model (MLLM)-based mobile agents against multimodal injection attacks. It offers a high‑fidelity interactive framework with 11 scenarios, 9 risk categories, and 108 executable risk instances, and introduces Cross‑Modal Consistency Injection along with two advanced attack methods—Multi‑Role Collaborative Deception and Reasoning‑Camouflage Injection—to intensify trust manipulation and reasoning hijacking. Experiments show that mobile agents are broadly vulnerable, especially to early‑stage reasoning hijacking, establishing MobileInject as a systematic tool for studying and improving mobile agent security.
arXiv:2503. 15560v1 Announce Type: cross Abstract: Large Language Models (LLMs) are increasingly vulnerable to sophisticated multi-turn manipulation attacks, where adversaries strategically build context through seemingly benign conversational turns to circumvent safety measures and elicit harmful or unauthorized responses.
arXiv:2505. 14289v2 Announce Type: replace Abstract: Graphical User Interface (GUI) agents powered by Multimodal Large Language Models (MLLMs) are increasingly deployed yet vulnerable to Environmental Injection Attacks (EIAs).
arXiv:2512. 23128v2 Announce Type: replace-cross Abstract: Web-based agents powered by large language models are increasingly used for tasks such as email management or professional networking.
arXiv:2602. 09222v2 Announce Type: replace-cross Abstract: Large language model (LLM) based web agents are increasingly deployed to automate complex online tasks by directly interacting with web sites and performing actions on users' behalf.
Machine learning-based Intrusion Detection Systems (IDS) have demonstrated superior performance in securing Unmanned Aerial Vehicle (UAV) networks. However, the 'black-box' nature of these models, combined with the high dimensionality of multimodal cyber-physical data, poses significant interpretability challenges.
arXiv:2603.04364v2 Announce Type: replace-cross Abstract: Multimodal web agents that process both screenshots and accessibility trees are increasingly deployed to interact with web interfaces, yet th...
arXiv:2608. 10434v1 Announce Type: new Abstract: Machine learning-based Intrusion Detection Systems (IDS) have demonstrated superior performance in securing Unmanned Aerial Vehicle (UAV) networks.
arXiv:2609.00578v1 Announce Type: new Abstract: Large Language Models (LLMs) can solve complex problems, but their misuse in high-risk domains can lead to severe consequences. Model providers therefo...
Large Language Models (LLMs) can solve complex problems, but their misuse in high-risk domains can lead to severe consequences. Model providers therefore restrict assistance for potentially harmful re...