arXiv AI By Mohammed Abu Baker, Lakshmi Babu-Saheer

Fuzzing Large Language Models to Elicit Hidden Behaviours

Read the original on arXiv AI →

arXiv:2606. 29646v1 Announce Type: cross Abstract: Sleeper agents are the canonical model organism of deception: models trained to behave normally but to emit an unsafe behaviour on a specific trigger.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
Jul 30

ToxScreen: Detecting Whether an LLM Has Been Poisoned

arXiv:2607. 26849v1 Announce Type: cross Abstract: As large language models (LLMs) are deployed in high-stakes domains, adversaries may poison training data to implant backdoors: hidden triggers that covertly manipulate model behavior at inference time.

By Anthony Hughes, Nicole Xing, Collin Francel, Andy Kim, Andrew Draganov
Hugging Face Trending Papers
Jul 29

ToxScreen: Detecting Whether an LLM Has Been Poisoned

As large language models (LLMs) are deployed in high-stakes domains, adversaries may poison training data to implant backdoors: hidden triggers that covertly manipulate model behavior at inference time. We ask whether a defender can recover such a trigger under realistic affordances, namely white-box access to the weights and knowledge of the behavior of concern, but no training data, no trusted reference model, no knowledge of the trigger, and no certainty that the model is poisoned.

arXiv AI
Aug 19

Probing the Prefill: Detecting Code Vulnerabilities via Latent Activations

The paper investigates whether the hidden activations of large language models (LLMs) contain signals about the vulnerability of C/C++ code when the code is provided as context. By extracting prefill token activations from four LLMs and training small MLP probes, the authors achieve an average F1 score of 41.7% across four benchmarks, with the best probe matching state‑of‑the‑art fine‑tuned classifiers on the Devign dataset. The results suggest that a coding LLM’s internal representation can inform vulnerability detection, opening the door to lightweight, model‑native screening methods.

By Alizishaan Khatri
arXiv AI
Aug 28

NeuronFuzz: Safety Neuron Guided Fuzzing for LLM Safety Evaluation

NeuronFuzz is a white‑box fuzzing framework that uses internal safety neurons of large language models as continuous feedback for safety evaluation, eliminating the need to generate full model responses during testing. It constructs a SafetyOracle that converts neuron activations into a differentiable safety alarm score, enabling gradient‑based identification of sensitive template positions and fluent, context‑compatible prompt mutations. Evaluated on 21 text and multimodal models, NeuronFuzz achieves a 76‑100% jailbreak discovery rate on five white‑box source models and demonstrates strong zero‑shot transfer to open‑weight and proprietary targets.

By Zhiyuan Xu, Muhammad Firhard Roslan, Joseph Gardiner, Sana Belguith, Lichao Wu