arXiv AI

Efficient LLM Moderation with Multi-Layer Latent Prototypes

arXiv:2502. 16174v4 Announce Type: replace-cross Abstract: Although modern LLMs are aligned with human values during post-training, robust moderation remains essential to prevent harmful outputs at deployment time.

arXiv AI
Sep 15

An Efficient and Modular Framework for Targeted Harm Mitigation in LLMS

The paper introduces a modular correction framework for large language models that uses Activated LoRA adapters and a context-aware routing mechanism to mitigate harmful outputs. By allowing expert adapters to activate mid-sequence without invalidating the KV cache, the system achieves low-latency, targeted correction during generation. Experiments show improved alignment on safety benchmarks while maintaining task performance, presenting a lightweight, scalable approach to safer LLM deployments.

By Roberto Campbell, Momin Abbass, Muneeza Azmat, Michal Ulewicz, Raya Horesh, Kristjan Greenewald, Rog\'erio Abreu de Paula, Nathalie Baracaldo
arXiv Computation and Language
Aug 31

EvoHarmBench: Breaking Content Moderation with Iterative Human-Like Evasion

EvoHarmBench is a dynamic adversarial evaluation framework that simulates how users iteratively modify harmful content to evade moderation. It uses an optimization loop that evolves evasion strategies at the semantic-cluster level while maintaining human readability, and tests 229 semantic sub-clusters across five violation categories derived from 5,002 real-world adversarial samples. The study shows that even state‑of‑the‑art LLM‑based moderators can be bypassed with an 80.3% success rate after twelve iterations, highlighting significant vulnerabilities in current systems.

By Ruijie Jian, Benlei Cui, Ting Ma, Haidong Ding, Kangwei Liu, Ziwen Xu, Longtao Huang, Hui Xue, Ziqiang Zhu, Junjie Li, Haiwen Hong
arXiv Computation and Language
Sep 4

Evaluating Criterion-Conditioned Behaviour of Large Language Models in Content Moderation

The paper introduces DECO, a diagnostic framework that factorises content into independent moderation criteria, allowing controlled evaluation of large language models (LLMs) at the criterion level. Using pairwise evaluation across four datasets and four LLMs, the authors find that high aggregate benchmark scores can mask significant failures when decisions hinge on specific content aspects required by individual criteria. The study underscores that aggregated labels do not guarantee reliable criterion-conditioned performance, highlighting the need for evaluation methods that explicitly assess this behavior.

By Danting Zhang, Bei Peng, Robert Loftin
arXiv Machine Learning
Sep 2

Training-Free Policy Violation Detection via Activation-Space Whitening in LLMs

The paper introduces a training‑free approach to detect policy violations in large language models by treating the task as an out‑of‑distribution problem in the model’s activation space. It uses whitening‑inspired techniques to compute policy‑violation scores directly from normalized hidden activations, requiring only the policy text and a few illustrative examples. Experiments on several LLMs and policy benchmarks show the method achieves up to 86.0% F1, outperforming fine‑tuned and LLM‑as‑a‑judge baselines while being computationally lightweight.

By Oren Rachmil, Avishag Shapira, Roy Betser, Omer Hofman, Itay Gershon, Asaf Shabtai, Yuval Elovici, Roman Vainshtein
arXiv AI
Sep 23

EDGEGEN: Improving Tool-Calling Agents Beyond Happy Paths with Synthetic Edge Case Generation

EDGEGEN is a synthetic task generation framework that extracts compliance rules from a tool‑calling agent’s specification to create database‑grounded edge‑case tasks that violate those rules. By combining EdgeGen with existing synthetic data generation methods, it forms a fully automated closed‑loop system that requires no human annotation. Experiments show that finetuning on EdgeGen data improves performance by 2–42 % on the tau2bench airline domain, while harness optimization yields 10–30 % gains over human‑curated and base harnesses for the Gemma‑4‑e4b model.

By Harshavardhan Abichandani, Penny Chong, Jiyuan Shen, Gunraj Singh, Ashutosh Hathidara, Marcus Duigan Xing Yu, Jane Lo, Atin Ghosh, Yipeng Li, Daniel Dahlmeier