arXiv AI

Reject, Remember, Retry: Why Multi-Turn Attackers Should Remember Their Mistakes

The paper introduces $R^3$ (Reject, Remember, Retry), a black-box multi-LLM framework that improves multi-turn jailbreak attacks by conditioning on a compact state instead of the full conversation transcript. In $R^3$, failed attack turns are removed from the target’s context but stored by the attacker along with the reason for failure, creating an asymmetric memory. Experiments on two benchmarks and six target LLMs show that $R^3$ outperforms state‑of‑the‑art baselines by up to 53% in ASR@5 under matched query budgets, and even a low‑capacity attacker using $R^3$’s state can surpass high‑capacity attackers without it by up to 34% in ASR@5.

arXiv AI
Oct 26

$M^3$: A Multi-LLM System for Multi-Turn Jailbreaking as a Markov Decision Process

$M^3$ is an automated red‑teaming framework that models multi‑turn jailbreaking as a finite‑horizon Markov Decision Process. It lets an attacker LLM interact with a target LLM while using a state LLM to maintain a compact internal state. Across two benchmarks and six target models, $M^3$ outperforms existing methods, boosting attack success rates by up to 53% at five turns and improving consistency and risk escalation metrics.

By Yuqing Huang, Jack Ji, Jithin Pradeep, Sagarika Suresh, Jekaterina Novikova
arXiv AI
Oct 19

Multiple Turns, Short Horizons: Measuring Effective-Horizon Compression in Jailbreaks

The paper investigates how much of a multi-turn jailbreak attack’s query history is necessary to achieve the same progress. By removing early attacker queries and re-running the remaining sequence, the authors define the effective horizon as the shortest query set that reproduces the attack outcome. They find that, on average, about half of the original queries suffice, a phenomenon they term effective-horizon compression, and demonstrate that this shorter history can improve attack continuation, training efficiency, and maintain defense calibration.

By Zhipeng Wei, Michael Lee, N. Benjamin Erichson
arXiv Computation and Language
Sep 16

Benchmarking Factual Robustness of LLMs via Multi-conversation Persuasion

The paper introduces the SAST-IR framework to evaluate large language models’ robustness against persuasion attacks in a memory‑less setting, revealing a flaw called "Refusal Inertia" that masks true vulnerability. Using the CP‑Agent and a custom CounterFact‑Strict dataset, the authors demonstrate that simple, diverse attack strategies achieve a 96% success rate, while complex attacks often trigger defensive compliance. The study highlights severe brittleness in current state‑of‑the‑art models when deprived of conversation history.

By Zhuoang Cai
arXiv AI
Aug 19

Fair ASR: Re-Evaluating Black-Box Jailbreaks under Shared Target-Call Budgets

The paper introduces Fair-ASR, a protocol for evaluating black‑box jailbreak attacks using a shared target‑call budget, addressing the bias of prior studies that rely solely on attack success rate. Re‑evaluating 11 attacks under this protocol shows significant shifts in rankings and highlights that many methods are not efficient in both target and attacker calls. The authors then present ReCode, a budget‑efficient attack that combines desensitization rewriting with low‑cost primitives, achieving 85% ASR on GPT‑5 with only 7.19 attacker calls per request under a 20‑target‑call budget.

By Zhida He, Xiaoyu Wen, Han Qi, Ziyuan Zhou, Peng Yu, Jiajia Li, Chaochao Lu, Qiaosheng Zhang
arXiv Computation and Language
Sep 21

CASCADE Against Jailbreaks: Combination Across Stages with Controlled Attack-Defense Evaluation

The paper presents a systematic study of combining defenses against jailbreak attacks on Large Language Models across different pipeline stages. It introduces a standardized evaluation framework that defines attack-success-rate, controls query budgets, and applies explicit fairness rules. Across 19 attacks and 15 defenses, the study finds that no single defense dominates, but carefully selected combinations can provide strong safety with minimal loss of utility, offering practical guidance for layered defense pipelines.

By Jiale Luo, Eric Han
Hugging Face Trending Papers
Aug 18

Fair ASR: Re-Evaluating Black-Box Jailbreaks under Shared Target-Call Budgets

The paper introduces Fair-ASR, a new evaluation protocol for black-box jailbreak attacks that uses shared target-call budgets to provide a fair comparison across methods. Re‑evaluating 11 attacks under this protocol shows that rankings shift significantly with different budgets, and that simple perturbations and templates remain competitive. The authors also present ReCode, a budget‑efficient attack that combines desensitization rewriting with low‑cost primitives, achieving 85% ASR on GPT‑5 with only 7.19 attacker calls per request under a 20‑call budget.