arXiv Machine Learning

MARGIN: Margin-Aware Regularized Geometry for Imbalanced Vulnerability Detection

arXiv:2605. 10240v3 Announce Type: replace-cross Abstract: Software vulnerability detection is critical for ensuring software security and reliability.

arXiv AI
Sep 18

Local Sparsity Enables Unsupervised LLM Safety Detection

The paper proposes a new unsupervised safety detection method for large language models that relies on anomaly detection rather than supervised training on unsafe data. By leveraging local sparsity in a linear representation space obtained via a sparse autoencoder, the authors develop a framework for locally masked SAE-based anomaly detection, providing theoretical support and empirical validation across multiple architectures and datasets. When calibrated with only 1% out-of-distribution data, the method achieves near‑optimal performance while using just 1–2% of SAE neurons for computation.

By Xin Chen, Gil Kur, Alexander Shevchenko, Andreas Krause