arXiv AI

A Blind Spot in Alignment: Quantifying Biosecurity Risks in Large Language Models

arXiv:2608. 02684v1 Announce Type: cross Abstract: Large Language Models (LLMs) are accelerating biological research, yet this same capability poses a critical biosecurity threat: models that assist in protein engineering can equally be prompted to generate predicted toxin-like sequences, potentially lowering the barrier to biological misuse.

Hugging Face Trending Papers
Jul 20

An Early Warning of Emerging Biosecurity Risks in Frontier LLMs

Frontier large language models (LLMs) are increasingly integrated into scientific workflows, yet their growing biological capabilities may outpace current safeguards. To assess the biological risks of frontier models, we develop Intern-BioBreaker, a specialized bio-red-teaming model, together with an integrated computational-to-physical framework that couples model-level stress testing with wet-lab validation.

arXiv AI
Aug 28

NeuronFuzz: Safety Neuron Guided Fuzzing for LLM Safety Evaluation

NeuronFuzz is a white‑box fuzzing framework that uses internal safety neurons of large language models as continuous feedback for safety evaluation, eliminating the need to generate full model responses during testing. It constructs a SafetyOracle that converts neuron activations into a differentiable safety alarm score, enabling gradient‑based identification of sensitive template positions and fluent, context‑compatible prompt mutations. Evaluated on 21 text and multimodal models, NeuronFuzz achieves a 76‑100% jailbreak discovery rate on five white‑box source models and demonstrates strong zero‑shot transfer to open‑weight and proprietary targets.

By Zhiyuan Xu, Muhammad Firhard Roslan, Joseph Gardiner, Sana Belguith, Lichao Wu
arXiv AI
Aug 26

NeuronGuard: Robust LLM Safety Alignment via Ablation-Aware Safety Signal Redistribution

NeuronGuard is a fine‑tuning defense for large language models that hardens them against both jailbreak and neuron‑level attacks. It redistributes safety signals across many neurons by identifying safety‑critical ones with per‑layer linear classifiers, enforcing refusal behavior when those neurons are ablated, and applying KL‑divergence regularization for consistency. A randomized gradient projection preserves task performance, and the authors provide a formal guarantee that NeuronGuard lowers the attack success rate upper bound, with experiments showing near‑zero success rates across multiple models and attack strategies.

By Anjun Gao, Yueyang Quan, Yufei Xia, Zhuqing Liu, Minghong Fang