arXiv AI June 8, 2026 By Anirudh Sekar, Mrinal Agarwal, Rachel Sharma, Akitsugu Tanaka, Jasmine Zhang, Arjun Damerla, Kevin Zhu

Zero-Shot Embedding Drift Detection: A Lightweight Defense Against Prompt Injections in LLMs

Read the original on arXiv AI →

arXiv:2601. 12359v1 Announce Type: cross Abstract: Prompt injection attacks have become an increasing vulnerability for LLM applications, where adversarial prompts exploit indirect input channels such as emails or user-generated content to circumvent alignment safeguards and induce harmful or unintended outputs.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Computer Vision

6d ago

Region-Level Black-Box Defense Against Stealthy Embedding-Space Backdoors in CLIP

arXiv:2609.31558v1 Announce Type: new Abstract: Contrastive Language--Image Pretraining (CLIP) has emerged as a dominant vision backbone due to its strong transferability and zero-shot capabilities....

By Ahmed Abdelnaby, Mohamed Elmahallawy

rag safety

Hugging Face Trending Papers

Aug 17

DSPrompt: Dynamic Soft Prompt Defense Against M-RAG Corruption

Multimodal Retrieval Augmented Generation (M-RAG) is increasingly vulnerable to adversarial attacks where malicious data are crafted to produce embeddings that align with benign entries in the vector...

rag multimodal benchmarks safety

arXiv Computer Vision

Sep 4

Beyond Small Patches: Black-Box Detection and Purification of Diverse Backdoor Triggers

The paper introduces TRIM, a black‑box defense for backdoor attacks in computer vision models. TRIM identifies and removes malicious trigger regions at inference time using region‑based segmentation, adaptive trigger discovery via inpainting and diffusion, and selective purification, without needing model internals, training data, or clean samples. Experiments on various datasets and trigger types show TRIM reduces attack success rates to as low as 1.16% while maintaining high clean accuracy.

By Ahmed Abdelnaby, Mohamed Elmahallawy

rag diffusion computer-vision multimodal

arXiv AI

2d ago

UniGuardian: A Unified Defense for Detecting Prompt Injection, Backdoor Attacks and Adversarial Attacks in Large Language Models

UniGuardian is a training‑free detector for large language models that jointly identifies prompt injection, backdoor, and adversarial attacks—collectively called Prompt Trigger Attacks (PTA). It measures how structured prompt perturbations shift the model’s output distribution and uses a single‑forward strategy to detect attacks while generating text in a shared batched forward pass. Experiments show that UniGuardian accurately and efficiently identifies trigger‑activated prompts in LLMs.

By Huawei Lin, Yingjie Lao, Tony Geng, Tan Yu, Weijie Zhao

llms safety

arXiv Machine Learning

Aug 4

DeepDefense: Robust Learning via Layer-Wise Gradient-Feature Alignment

arXiv:2511. 13749v2 Announce Type: replace Abstract: Deep neural networks are known to be vulnerable to adversarial perturbations, which are small, carefully crafted inputs that lead to incorrect predictions.

By Ci Lin, Tet Yeap, Iluju Kiringa

safety

arXiv AI

Sep 1

Robustness of Vision Language Models Against Split-Image Harmful Input Attacks

arXiv:2602.08136v2 Announce Type: replace-cross Abstract: Vision-Language Models (VLMs) are now a core part of modern AI. Recent work proposed several visual jailbreak attacks using single/ holistic...

By Md Rafi Ur Rashid, MD Sadik Hossain Shanto, Vishnu Asutosh Dasu, Shagufta Mehnaz

llms reinforcement-learning fine-tuning efficiency multimodal benchmarks safety