arXiv AI By Shuo Hong, Jiaxin Ma, Xidi Cai, Qianli Ma

Erase the Injected Region: Multimodal Prompt-Injection Defense with On-Policy Self-Distillation

Read the original on arXiv AI →

The paper introduces ERASE, a multimodal defense against indirect prompt injection that erases malicious instructions directly within the input media. By replacing the injected region with modality‑appropriate blank content and using on‑policy self‑distillation, ERASE trains a student model to learn from a frozen base model’s erased view, providing token‑level feedback during its own rollouts. Experiments on image, audio, and video tasks show near‑zero attack success while preserving task performance close to clean‑input levels, with significant improvements over prior methods such as ARGUS.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Sep 30

Render Before Reading: Visual Rendering as a Prompt Injection Defense

The paper investigates how multimodal large language models are more susceptible to prompt injection when adversarial instructions are presented as text rather than as non-textual inputs like images. It proposes a training‑free defense that renders untrusted payloads into typographic images (or audio) before they reach the model, a method called Pictionary. Experiments on ten models and two benchmarks show that this approach significantly lowers attack success rates while maintaining normal functionality, and that fine‑tuning on image‑rendered instructions can further reduce the modality gap.

By Jie Zhang, Andrei Baroian, Jan N. van Rijn, Avital Shafran, Florian Tram\`{e}r