arXiv Machine Learning
Jun 8
An Adaptive Data cleaning Framework for Noisy Label Detection
arXiv:2606. 07086v1 Announce Type: cross Abstract: Deep neural networks (DNNs) excel in computer vision tasks given large annotated datasets.
Forget or Fine-tune? A Comparative Study of Machine Unlearning Strategies for Noisy Label Correction
The paper compares five machine unlearning (MU) methods—NegGrad, Fine‑Tuning (FT), Random Labeling (RL), SalUn, and MUNBa—on noisy‑label correction across CIFAR‑10, CIFAR‑100, and Food‑101N. Results show that the best MU strategy depends on the noise type: FT works well for most closed‑set noise, RL and SalUn are robust and nearly match retraining accuracy under instance‑dependent noise, while MUNBa excels only under extreme symmetric noise. In open‑set noise, retraining on the cleaned data actually hurts performance, indicating that approximating retraining is not suitable in that regime, yet all MU methods still achieve near‑retraining accuracy on Food‑101N with much lower runtime.
Related stories
arXiv AI
Jun 11
Noise-Aware Framework for Correcting Corrupted Labels
arXiv:2606. 11695v1 Announce Type: cross Abstract: High-quality labeled data is essential for training reliable ML/DL models.
arXiv Machine Learning
Jul 14
Random Label Prediction Heads for Studying Memorization in Deep Neural Networks
arXiv:2607. 11541v1 Announce Type: new Abstract: We introduce a straightforward yet effective method to empirically study memorization in deep neural networks for classification tasks.
arXiv Machine Learning
Sep 30
Reference-Guided Machine Unlearning
Reference-Guided Machine Unlearning (ReGUn) is a vision unlearning framework that prioritizes distributional indistinguishability over degradation-based heuristics. It uses disjoint held-out data to create a class-conditioned reference distribution for distillation, guiding forget samples toward non-member behavior without explicitly degrading predictions. Experiments across various architectures and datasets show that ReGUn achieves a competitive forgetting–utility trade-off and closely matches retrain-like membership inference behavior.
arXiv Machine Learning
Jul 17
Interleaved Noise Injection Improves Clean, Corrupted, and OOD Performance
arXiv:2607. 14466v1 Announce Type: new Abstract: Noise injection is a well-known technique in stochastic optimization.
arXiv Machine Learning
Jun 16
Benchmarking Instance-Dependent Label Noise with Controlled Corruptions
arXiv:2606. 14965v1 Announce Type: new Abstract: Synthetic instance-dependent label noise (IDN) benchmarks are widely used to evaluate noisy-label learning methods, yet existing approaches typically generate noise through imperfect annotators or classifier raters, leaving the source of ambiguity implicit.
arXiv Computer Vision
Oct 7
Not Every Subject Should Stay: Machine Unlearning for Noisy Engagement Recognition
The paper investigates subject-level machine unlearning as a post‑hoc sanitization technique for engagement recognition datasets that are subject‑indexed and often noisy. By ranking harmful subjects with a model‑dependent proxy and applying a lightweight approximate unlearning update, the authors compare the resulting model to an oracle retrained from scratch on the remaining subjects. Experiments on DAiSEE and EngageNet show that the unlearned model recovers roughly 90–93% of the oracle’s performance at about one‑quarter the retraining cost, with effectiveness peaking at intermediate forget‑set sizes.
arXiv AI
Oct 1
Unmerge: Efficient Machine Unlearning via Task Arithmetic
The paper introduces Unmerge, an efficient machine unlearning algorithm that treats unlearning as the inverse of task arithmetic. By representing the forget component as a low‑rank basis at each layer, Unmerge optimizes three goals—matching the merged vector, suppressing leakage, and bounding correction size—to limit forget leakage and retain damage. Experiments on ResNet‑50, ViT‑S/16, and Llama‑3.2‑3B show significant performance gains over existing methods while maintaining privacy and feature‑distribution fidelity.
arXiv AI
Jun 2
PECKER: A Precisely Efficient Critical Knowledge Erasure Recipe For Machine Unlearning in Diffusion Models
arXiv:2604. 05634v2 Announce Type: replace Abstract: Machine unlearning (MU) has become a critical technique for GenAI models' safe and compliant operation.
arXiv Machine Learning
Jul 21
Orthogonal Gradient Constraints Shape Noisy-Label Memorization Dynamics
arXiv:2607. 16231v1 Announce Type: new Abstract: Modern neural networks can fit corrupted training labels, making noisy-label learning a useful setting for studying memorization-driven overfitting.
arXiv Machine Learning
Jun 11
A Data-Centric Framework for Detecting and Correcting Corrupted Labels
arXiv:2606. 11699v1 Announce Type: new Abstract: The performance of machine learning and deep learning models largely depends on the quality of the training data.
arXiv AI
Jun 9
LoTUS: Large-Scale Machine Unlearning with a Taste of Uncertainty
arXiv:2503. 18314v5 Announce Type: replace-cross Abstract: We present LoTUS, a novel Machine Unlearning (MU) method that eliminates the influence of training samples from pre-trained models, avoiding retraining from scratch.