Hugging Face Trending Papers

ICO: Enhancing Semantic-Shift Jailbreaks via Iterative Context Optimization

Read the original on Hugging Face Trending Papers →

Foundation models have achieved remarkable success across diverse tasks, but they remain vulnerable. To investigate such vulnerabilities, semantic-shift jailbreaks have recently emerged as a promising attack paradigm.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at Hugging Face Trending Papers.

arXiv AI
Aug 20

Jailbreaking in the Haystack

The paper "Jailbreaking in the Haystack" introduces NINJA, a jailbreak technique that exploits long-context language models by appending benign, model-generated content to harmful user goals. It demonstrates that the position of harmful goals within the context is crucial for safety, and shows that NINJA significantly boosts attack success rates on models such as LLaMA, Qwen, Mistral, and Gemini. Unlike previous methods, NINJA is low-resource, transferable, less detectable, and compute‑optimal, revealing that carefully crafted benign long contexts can expose fundamental vulnerabilities in modern LMs.

By Rishi Rajesh Shah, Chen Henry Wu, Shashwat Saxena, Ziqian Zhong, Alexander Robey, Aditi Raghunathan
arXiv Machine Learning
6d ago

Harmful Responses Are Jailbreak Templates: Transferring Autoregressive Jailbreaks to Diffusion Language Models

The paper introduces RMT-Jailbreak, a method that transfers autoregressive jailbreak attacks to diffusion large language models (dLLMs). By masking tokens in a harmful response generated by an autoregressive model, the approach creates a high‑mask‑ratio template that, when fed to a dLLM, prompts it to reconstruct the harmful content. Experiments show that this technique effectively transfers jailbreak attacks across different models, highlighting a new vulnerability in diffusion-based language models.

By Jinwei Gan, Zifeng Cheng, Zhiwei Jiang, Ran Sun, Shiping Ge, Qing Gu