arXiv Machine Learning
5d ago

Beyond Scarcity: When Encoder Adaptation Is Worthwhile

The paper introduces a controlled evaluation framework to determine when encoder adaptation is beneficial after correcting for class imbalance in long‑tailed recognition tasks. By separating unique support from representation allocation and comparing classifier‑only versus full‑network continuations, the study shows that encoder updates become worthwhile only when representation allocation is highly imbalanced, a transition that persists across various corrections and scales to ImageNet. The framework uses stage‑specific controls, multiple objectives, whole‑distribution metrics, and hierarchical inference to robustly estimate incremental encoder value.

By Zexing Zhang, Jichao Li, Tianyang Lei, Yiyin Zhang, Kewei Yang
arXiv Machine Learning
Jul 14

A Strong Balanced-Softmax Classifier-Retraining Baseline for Long-Tailed Recognition

arXiv:2607. 09832v1 Announce Type: new Abstract: Long-tailed recognition methods often modify losses, margins, or representations to reduce the dominance of frequent classes.

By Juan Terven, Diana Margarita C\'ordova Esparza, Julio Alejandro Romero Gonzalez, Edgar Arturo Ch\'avez Urbiola, Francisco Javier Willars Rodriguez, Juan Bautista Hurtado Ramos, Alfonso Ramirez Pedraza
arXiv Machine Learning
Jul 14

Vertical Fusion: Condensing Internal Representations for Robust ViT Classification

arXiv:2607. 10391v1 Announce Type: cross Abstract: Despite exposing rich intermediate representations, Vision Transformers (ViTs) are almost exclusively utilized as black-box feature extractors, where only the last layer is considered for downstream tasks.

By Francesco Di Salvo, Shyam Nandan Rai, Hamed Damirchi, Ignacio Meza De la Jara, Sebastian Doerrich, Marco Lents, Christian Ledig