arXiv AI

Relational Semantic Grounding for Test-Time Discovery

arXiv Computer Vision
Sep 14

TestDG: Test-time Domain Generalization for Continual Test-time Adaptation

This paper introduces TestDG, an online test-time domain generalization framework for continual test-time adaptation (CTTA). TestDG learns features invariant to both current and past test domains during testing, using a new model architecture, adaptation strategy, and prototype selection/update mechanisms. It achieves state‑of‑the‑art results on four CTTA benchmarks and demonstrates superior generalization to unseen test domains.

By Sohyun Lee, Nayeong Kim, Juwon Kang, Seong Joon Oh, Suha Kwak
arXiv Computer Vision
Oct 23

ReCoG: Relational Concept Graph for Training-Free Personalization

ReCoG introduces a Relational Concept Graph that enhances training‑free personalization of vision‑language models by representing concepts as nodes linked with directed edges capturing discriminative cues between concept pairs. During inference, the graph retrieves a shortlist and resolves ambiguity through explicit pairwise comparisons guided by these relational edges, ensuring the selected concept consistently outperforms competitors. The method demonstrates significant improvements on the new FINGER benchmark for confusable concept sets and also outperforms prior approaches on established personalization tasks such as captioning and VQA.

By Changseon Yu, Hyeokjun Kweon
Hugging Face Trending Papers
Jul 23

CRAG-MM-Diagnostics: Enabling Stage-Wise Analysis of Knowledge-Intensive VQA

Knowledge-Intensive Visual Question Answering (KI-VQA) benchmarks evaluate Vision-Language Models (VLMs) as multimodal knowledge assistants by requiring external information beyond a provided image to answer questions. KI-VQA involves multiple sub-problems -referring expression understanding, visual grounding, object recognition, knowledge retrieval, and reasoning-yet existing benchmarks typically report only end-task accuracy, obscuring where failures arise.