arXiv AI

Triple Expert Learning from Noisy Labels for Semi-Supervised Vision Foundation Model Adaptation

arXiv:2608. 09052v1 Announce Type: cross Abstract: Semi-supervised adaptation of vision foundation models (VFMs) commonly freezes the pretrained backbone and updates lightweight modules such as LoRA.

arXiv AI
Sep 7

VICAL: Vicinal Consistency Alignment for Long-Tailed Visual Recognition

VICAL is a framework for long‑tailed visual recognition that focuses on reducing prediction variance rather than increasing expert diversity. It combines Self‑Consistency Learning, which smooths the loss landscape and mitigates overfitting on tail classes, with Deep Ensemble Distillation, which encourages low‑frequency semantic agreement across experts. Experiments on CIFAR‑LT, ImageNet‑LT, and iNaturalist 2018 demonstrate that VICAL consistently outperforms state‑of‑the‑art methods.

By Jiangang Zhu, Zheng Wang, Bin Zhu, Yi-Ping Phoebe Chen, Jingjing Chen
arXiv Machine Learning
Oct 9

Learning What to Trust in Multimodal Learning under Noisy Supervision

The paper introduces REFINE, a multimodal label‑noise detection framework that leverages both fused and unimodal representations to identify trustworthy examples in noisy supervision settings. By constructing discriminative eigenvectors for target and background classes, REFINE selects trusted representation spaces and measures alignment of instance representations within these spaces, combining the resulting subsets to provide cleaner supervision for the multimodal classifier. Experiments across various tasks show that REFINE outperforms baseline methods, improving model generalization while reducing the impact of mislabeled data.

By Jiashuo Zou, Xiaobo Xia
arXiv Computer Vision
Aug 28

DOD-SA: Infrared-Visible Decoupled Object Detection with Single-Modality Annotations

The paper introduces DOD-SA, a framework for infrared-visible object detection that uses only single-modality annotations. It employs a Collaborative Teacher-Student Network with a single-modality branch and a dual-modality decoupled branch to transfer knowledge across modalities, and a Progressive and Self‑Tuning Training Strategy to refine pseudo‑labels. A Pseudo Label Assigner is also designed to align labels between modalities during training.

By Hang Jin, Chenqiang Gao, Junjie Guo, Fangcen Liu, Qinyao Chang, Kanghui Tian, Deyu Meng