arXiv Statistics ML

Multi-Task Active Learning with Efficient Resource Allocation

arXiv Machine Learning
1d ago

Deconstructing Multi-Task Active Learning: The Paradox of Gradient Conflict and Orthogonal Decomposition

The paper critiques current multi‑task active learning (MTL‑AL) methods that use linear scalarization of objectives like uncertainty, diversity, and gradient conflict, arguing that such combinations miss Pareto‑optimal trade‑offs. It introduces a new framework that separates acquisition into informativeness and exploration, decouples conflict scoring from candidate ranking, and uses gradient surgery during training. The authors also propose a cross‑task mutual information metric and demonstrate consistent improvements on COCO, Cityscapes, and NYUv2 datasets compared to recent baselines.

By Juho Jung, Seongjae Kang, Jinyoung Han
arXiv Machine Learning
4d ago

Beyond Fixed Acquisition Functions: Temporal Difference Active Learning for Perturbation Discovery

The paper introduces Temporal Difference Active Learning (TDAL), a method that learns an acquisition function online for perturbation discovery by treating the problem as a sequential decision task. TDAL uses temporal difference learning with the Hellinger distance to weight future value and employs leave‑batch‑out to create virtual transitions, thereby addressing data scarcity. Evaluated on eight public screens involving single, double, and triple perturbations, TDAL outperforms eleven baseline methods, achieving an average rank of 1.63 and topping four tasks.

By Xudong Zhang, Jianzhe Li, Yitong Tang, Peijie Zhou
arXiv Machine Learning
Aug 11

Coupled Training with Privileged Information and Unlabeled Data

arXiv:2605. 23268v2 Announce Type: replace-cross Abstract: In many prediction problems, we have extra information during training (for example, measurements that are expensive or slow to collect) that will not be available when the model is deployed.

By Jiahao Shi, Omar Hagrass, Jason M. Klusowski
arXiv AI
Jun 8

REMEDI: A Benchmark for Retention and Unlearning Evaluation in Multi-label Clinical Disease Inference

arXiv:2606. 07141v1 Announce Type: cross Abstract: Language models trained for clinical disease inference are trained on patient data, which may include sensitive and private information, and data owners may request the removal of their data from a trained model due to privacy or copyright concerns.

By Anurag Sharma, Sai Teja Chunchu, Prasenjit Mitra, Sandipan Sikdar, Koustav Rudra