arXiv AI

DirMixE: Harnessing Test Agnostic Long-tail Recognition with Hierarchical Label Variations

arXiv:2405. 07780v3 Announce Type: replace-cross Abstract: This paper explores test-agnostic long-tail recognition, a challenging long-tail task where the test label distributions are unknown and arbitrarily imbalanced.

arXiv Machine Learning
1d ago

Learning to Predict Distributions over Weight Updates for Test-Time Adaptation

The paper introduces query‑conditioned hypernetworks that predict distributions over LoRA weight updates for large language models. By learning a distribution rather than a single point estimate, the method allows sampling multiple adapted models for the same query, improving performance over deterministic hypernetworks and token‑sampling baselines. The study also shows that these learned updates can transfer across different queries, indicating reusable adaptation patterns.

By Azal Ahmad Khan, Keshav Ramji, Tahira Naseem, Ali Anwar, Ram\'on Fernandez Astudillo
arXiv Machine Learning
Aug 19

RoBell-RVFL: A Robust Generalized Bell Random Vector Functional Link Network

RoBell-RVFL is a lightweight, quality‑aware generalized bell random vector functional link network designed to address class imbalance and noisy data in real‑world datasets. It uses a dual‑strategy sample‑level weighting: unit weights preserve minority class information, while a probability‑weighted generalized bell membership function suppresses noisy majority samples in a kernel‑induced feature space. Experiments on UCI and KEEL benchmarks, including tests with up to 40% label noise, show that RoBell‑RVFL consistently outperforms recent RVFL variants, demonstrating the importance of adaptive, quality‑aware sample weighting for robust learning.

By A. Rahaman, A. Quadir, M. Tanveer
arXiv AI
Sep 7

VICAL: Vicinal Consistency Alignment for Long-Tailed Visual Recognition

VICAL is a framework for long‑tailed visual recognition that focuses on reducing prediction variance rather than increasing expert diversity. It combines Self‑Consistency Learning, which smooths the loss landscape and mitigates overfitting on tail classes, with Deep Ensemble Distillation, which encourages low‑frequency semantic agreement across experts. Experiments on CIFAR‑LT, ImageNet‑LT, and iNaturalist 2018 demonstrate that VICAL consistently outperforms state‑of‑the‑art methods.

By Jiangang Zhu, Zheng Wang, Bin Zhu, Yi-Ping Phoebe Chen, Jingjing Chen
arXiv AI
Jun 18

Generalized Kullback-Leibler Divergence Loss

arXiv:2503. 08038v2 Announce Type: replace-cross Abstract: In this paper, we delve deeper into the Kullback-Leibler (KL) Divergence loss and mathematically prove that it is equivalent to the Decoupled Kullback-Leibler (DKL) Divergence loss that consists of (1) a weighted Mean Square Error (wMSE) loss and (2) a Cross-Entropy loss incorporating soft labels.

By Jiequan Cui, Beier Zhu, Qingshan Xu, Zhuotao Tian, Xiaojuan Qi, Bei Yu, Hanwang Zhang, Richang Hong