arXiv AI

A Systematic Comparison of Training Objectives for Out-of-Distribution Detection in Image Classification

arXiv:2603. 07571v3 Announce Type: replace-cross Abstract: Out-of-distribution (OOD) detection is critical in safety-sensitive applications.

arXiv Machine Learning
Sep 11

Optimizing Three Critical Factors for Practical and Effective OOD Detection Fine-Tuning

The paper introduces a framework for out-of-distribution (OOD) detection that addresses the trade‑off between detection performance and classification accuracy caused by fine‑tuning with auxiliary outlier data. It optimizes three factors—model reminder, data sampling, and representation learning—by proposing Self‑Knowledge Distillation to preserve accuracy, Semi‑hard Outlier Sampling to enhance detection with minimal data, and Outlier‑aware Supervised Contrastive Learning to improve ID‑OOD separability. The combined approach yields cumulative gains, outperforming existing methods on diverse benchmarks, especially in long‑tailed scenarios, and offers a robust baseline for real‑world OOD detection.

By Hyunjun Choi, JaeHo Chung, Hawook Jeong
arXiv Machine Learning
Sep 3

MM++: Post-Hoc Scale-Invariant Multilayer OOD Detection via Top-K Gated Feature Fusion

MM++ (Multilayer Mahalanobis++) is a post‑hoc, scale‑invariant framework for out‑of‑distribution detection that builds a joint feature space by selecting discriminative intermediate layers based on entropy density drops and fusing them with the final representation. It uses a Ledoit‑Wolf regularized tied covariance matrix to stabilize the space, allowing reliable distance estimation without requiring auxiliary OOD data, classifier fine‑tuning, or architectural changes. The method achieves robust performance across different architectures for both near‑ and far‑OOD scenarios.

By Rahim Hossain, Md Tawheedul Islam Bhuian, Md Farhan Shadiq, Kyoung-Don Kang
arXiv Machine Learning
Sep 14

PLSP (Pre-hoc Liminal Space Profiling): OOD Prediction over Detection -- An Anticipatory Approach for Machine Learning Model Reliability

The paper introduces PLSP (Pre-hoc Liminal Space Profiling), an anticipatory framework for predicting out-of-distribution (OOD) data before inference. It proposes a dataset‑independent metric called the CREDibility Score (CREDS) and introduces credibility curves and heat maps to analyze a model’s maximum credibility and behavior across datasets. Experiments on multiple datasets show that CREDS can improve model robustness to OOD prediction.

By Vipul Bansal, Himanshu Buckchash, Balasubramanian Raman, Deepak Dhungana
arXiv Machine Learning
Jul 21

AOE: Exhaustive Out-of-Distribution Detection via Recalibrating Outlier Labels

arXiv:2605. 28021v2 Announce Type: replace Abstract: Out-of-distribution (OOD) detection is essential for deploying machine learning models in open-world and safety-critical scenarios, where test inputs may deviate from the training distribution and overconfident predictions on unknown samples can lead to unreliable decisions.

By Fengqiang Wan, Qing-Yuan Jiang, Fu Shen, Yang Yang
Hugging Face Trending Papers
Sep 8

Layer Selection in VLMs for Zero-Shot OOD Detection via Multi-Resolution Entropy Estimation

The paper investigates zero‑shot out‑of‑distribution (OOD) detection in medical imaging using vision‑language models (VLMs). It shows that intermediate layers, rather than only the final layer, provide valuable OOD signals and that the best layer depends on the imaging modality. To overcome instability in entropy‑based layer selection, the authors introduce a multi‑resolution entropy estimation that aggregates histogram statistics across scales, achieving consistent improvements over state‑of‑the‑art methods on the MIDOG and OASIS benchmarks.