Leak detection models for multiphase pipelines often degrade when deployed under flow regimes that differ from training. Existing evaluations typically assess performance under in-distribution operating conditions, masking failures caused by regime transitions such as bubble-to-slug flow.
Detecting out-of-distribution (OOD) data is crucial for reliable machine learning deployment. Among detection strategies, post-hoc methods are particularly attractive due to their efficiency, as they operate directly on pre-trained networks without requiring retraining.
The paper "Mind the Gap: Robustness Risks in PII Detection Systems" examines how modern PII detection methods—encoder-based NER, rule-based hybrid detection, and generative LLM extraction—fail when faced with realistic distribution shifts such as noisy, unstructured, and informal inputs. A stress‑test benchmark covering seven categories of natural shift reveals that each architecture degrades in distinct ways: encoder models struggle with unseen surface forms and boundary detection, rule‑based systems falter on non‑standard formats, and LLMs suffer from entity‑type confusion and generation instability. The authors argue that aggregate benchmark scores hide these deployment‑critical weaknesses and propose a hybrid detection pipeline with a QA‑driven feedback loop to iteratively mitigate risks, also releasing the benchmark for OOD‑aware evaluation.
By Adeel Zafar, Slawomir Nowaczyk
arXiv:2606. 29952v1 Announce Type: cross Abstract: Detecting out-of-distribution (OOD) data is crucial for reliable machine learning deployment.
By Seonghwan Park, Hyunji Jung, Dongyeop Lee, Namhoon Lee
arXiv:2607. 16283v1 Announce Type: cross Abstract: The rapid advancement of generative AI has outpaced our ability to reliably detect its outputs, particularly when detectors encounter generators they have not seen before.
By Md Faraz Kabir Khan, Saeed Anwar, Ghulam Mubashar Hassan
arXiv:2604. 26633v2 Announce Type: replace-cross Abstract: Industrial surface defect inspection suffers from a fundamental data bottleneck: defects are rare, annotations require expert knowledge, and collecting balanced training sets is slow and costly.
By Paul Julius K\"uhn, Mika Pommeranz, Arjan Kuijper, Saptarshi Neil Sinha