arXiv Machine Learning
Jul 14

Vertical Fusion: Condensing Internal Representations for Robust ViT Classification

arXiv:2607. 10391v1 Announce Type: cross Abstract: Despite exposing rich intermediate representations, Vision Transformers (ViTs) are almost exclusively utilized as black-box feature extractors, where only the last layer is considered for downstream tasks.

By Francesco Di Salvo, Shyam Nandan Rai, Hamed Damirchi, Ignacio Meza De la Jara, Sebastian Doerrich, Marco Lents, Christian Ledig
arXiv Machine Learning
Sep 24

CORE-STACK+: Meta-Learning for Deep Stacked Generalization

CORE-STACK+ is a new meta‑learning framework for deep stacked generalization that tackles two key problems in heterogeneous vision ensembles: prediction‑space multicollinearity and calibration collapse. It introduces a four‑step preconditioning pipeline—kernelized redundancy filtering, a lightweight differentiable meta‑feature gate, a spectrum‑adaptive ridge penalty, and a Laplace‑approximate Bayesian blender—to jointly improve conditioning and calibration. Across six vision benchmarks, CORE‑STACK+ boosts accuracy, reduces model count and inference cost, and significantly lowers expected calibration error compared to existing methods.

By Noor Islam S. Mohammad
arXiv Machine Learning
4d ago

Beyond Scarcity: When Encoder Adaptation Is Worthwhile

The paper introduces a controlled evaluation framework to determine when encoder adaptation is beneficial after correcting for class imbalance in long‑tailed recognition tasks. By separating unique support from representation allocation and comparing classifier‑only versus full‑network continuations, the study shows that encoder updates become worthwhile only when representation allocation is highly imbalanced, a transition that persists across various corrections and scales to ImageNet. The framework uses stage‑specific controls, multiple objectives, whole‑distribution metrics, and hierarchical inference to robustly estimate incremental encoder value.

By Zexing Zhang, Jichao Li, Tianyang Lei, Yiyin Zhang, Kewei Yang