arXiv Computer Vision
Sep 22

0.5\%>100\%: Bidirectional Reciprocal Learning for Referring Image Segmentation

The paper introduces Bidirectional Reciprocal Learning (BRL), a parameter‑efficient fine‑tuning framework for referring image segmentation that operates on frozen vision foundation models. BRL employs two lightweight adapters—Reciprocal Attention Adapter (RAA) for token‑level cross‑modal attention and Reciprocal Gate Adapter (RGA) for channel‑level gating—to enable hierarchical, bidirectional information flow between vision and language. Experiments on RefCOCO, RefCOCO+, and RefCOCOg show that BRL outperforms existing methods while updating fewer than 0.5% of backbone parameters.

By Xiaoqiang Lu, Licheng Jiao, Lingling Li, Yuting Yang, Long Sun, Wenping Ma, Xu Liu, Fang Liu
arXiv AI
Oct 9

CARE: Constrained Attention Refinement for Fine-Grained Visual Classification via Teacher-Student Distillation

CARE introduces a constrained attention refinement framework that uses teacher‑student distillation to improve fine‑grained visual classification while maintaining interpretability. The method keeps the final prediction and explanation within a class‑specific attention student, while a training‑only auxiliary teacher reads selected intermediate DINOv2 layers with learnable queries to fuse multi‑level representations and transfer class‑discriminative knowledge. Additional diversity and sparsity regularizers refine the student’s attention heads, reducing redundancy and encouraging compact trait localization, achieving 78.5% Top‑1 accuracy on CUB and demonstrating faithful explanations via insertion and deletion metrics.

By Ruibo Wen, Hang Shao, Yiming Lei