arXiv Machine Learning

Leakage-Robust Evaluation and Data-Scale Sensitivity of Attention-Enhanced Multi-Task Learning for Joint Fault Diagnosis and Remaining Useful Life Estimation

arXiv:2607. 16493v1 Announce Type: new Abstract: Multi-task deep learning models that jointly perform fault classification and remaining useful life (RUL) regression are increasingly used in predictive maintenance, yet reported performance can be strongly affected by how sliding-window sequences are split into training and test sets.

arXiv Machine Learning
Jul 14

Vertical Fusion: Condensing Internal Representations for Robust ViT Classification

arXiv:2607. 10391v1 Announce Type: cross Abstract: Despite exposing rich intermediate representations, Vision Transformers (ViTs) are almost exclusively utilized as black-box feature extractors, where only the last layer is considered for downstream tasks.

By Francesco Di Salvo, Shyam Nandan Rai, Hamed Damirchi, Ignacio Meza De la Jara, Sebastian Doerrich, Marco Lents, Christian Ledig
arXiv AI
Sep 24

What Changed? Drift Detection with Real, Virtual, and Incomparable Diagnosis

The paper investigates drift detection in deep learning models, showing that sharing a deep encoder alone does not eliminate confounding in task-comparison scores. By introducing a conditional two‑discriminator discrepancy into the embedding space, the authors create a two‑axis gate that remains stable under input rotations and accurately tracks label‑permutation drift. This approach outperforms traditional exchange or novelty triggers, achieving high AUROC in distinguishing semantic novelty from photometric shift across multiple backbones and datasets.

By Kentaro Oda
arXiv AI
Sep 17

TRIPROBE: Probing Task Separability Beyond Classification for XAI

TRIPROBE is a multi-level probing framework designed to diagnose task separability in machine learning pipelines. It evaluates separability across input spaces, learned feature representations, and classifier outputs by decomposing multi-task problems into binary subtasks and applying Foundational, Latent, and Final probes. Using Maximum Fisher's Discriminant Ratio, TRIPROBE identifies bottlenecks and task pairs that affect performance, as demonstrated on the Roshambo sEMG benchmark.

By Amirhossein Sadough, Freek Hens, Aleksa Bok\v{s}an, Mohammad Mahdi Dehshibi, Mahyar Shahsavari