arXiv AI

Learning Dynamics of Logits Debiasing for Long-Tailed Semi-Supervised Learning

arXiv Machine Learning
Aug 27

JEPAMatch: Geometric Representation Shaping for Semi-Supervised Learning

JEPAMatch introduces a new semi‑supervised learning framework that replaces traditional output‑thresholding with explicit geometric shaping of latent representations. By combining the FlexMatch loss with a latent‑space regularization inspired by LeJEPA, the method encourages isotropic Gaussian structure in the embedding space, mitigating class imbalance and noisy pseudo‑labels. Experiments on CIFAR‑100, STL‑10, and Tiny‑ImageNet show consistent performance gains and faster convergence compared to existing FixMatch‑based baselines.

By Ali Aghababaei-Harandi, Aude Sportisse, Massih-Reza Amini
arXiv Machine Learning
Oct 22

Shortcut-Resistant CAM Distillation for Long-Tailed Recognition

The paper introduces Shortcut-Resistant CAM Distillation (SRCD), a plug‑and‑play framework that mitigates shortcut learning in long‑tailed recognition tasks. SRCD transfers object‑focused explanations from head classes to tail classes by aggregating Class Activation Maps (CAMs) into a shortcut‑resistant teacher and distilling it to tail‑class CAMs. The authors provide a theoretical analysis of shortcut reliance in CAM space and demonstrate consistent improvements over strong baselines on long‑tailed benchmarks.

By Wenhai Wan, Teng Zhang, Shao-Yuan Li, Xinrui Wang, Qiang-Sheng Hua, Songcan Chen