arXiv Computer Vision

Talk in Pieces, See in Whole: Disentangled and Hierarchical Representation Learning in Language-based Object Detection

arXiv Computer Vision
Oct 12

Low, High, and Semantic-Level Vision-Language Learning for AI-Generated Image Detection

The paper introduces LHSDet, a detector for AI‑generated images that treats detection as a visual question answering task. It employs a triple‑branch architecture: a low‑level visual branch for local texture cues, a high‑level visual branch using SigLIP2 for global perception, and a semantic‑level textual branch that generates captions with BLIP‑2. Experiments show that LHSDet achieves strong accuracy and robustness across various generative models.

By Qian Yao, Luming Yang, Jun-Jie Huang, Yongjun Wang, Xinwang Liu, Meng Wang
arXiv Computer Vision
Sep 24

VIVAS: Vitalizing Visual Perception in VLM Pre-training via Vision-language Unified Autoregressive Supervision

VIVAS is a new Vision‑Language Model pre‑training framework that addresses the lack of fine‑grained visual perception in existing VLMs. It introduces a unified token space and a dense‑structural‑semantic vision tokenizer that expands the textual vocabulary with visual tokens, enabling vision‑language unified autoregressive supervision over both visual details and linguistic content. Trained on 12.4 T tokens, VIVAS achieves state‑of‑the‑art results on 7 tasks and 39 multimodal benchmarks.

By Zhehan Kan, Yubo Zhu, Xinghua Jiang, Zhixiang Wei, Shifeng Liu, Wei Tong, Sheng Zhong, Qingmin Liao, Wenming Yang, Xin Li, Yinsong Liu, Deqiang Jiang, Xing Sun
arXiv Computer Vision
4d ago

SetCon: Towards Open-Ended Referring Segmentation via Set-Level Concept Prediction

SetCon reformulates open-ended referring segmentation as set-level concept prediction, using LVLM-generated natural-language concepts instead of segmentation-specific tokens. It employs a hierarchical semantic decomposition that first predicts a shared set-level concept and then refines it into fine-grained concept groups aligned with target subsets. The method, supported by a two-stage annotation pipeline adding hierarchical semantic supervision, achieves state-of-the-art results on multiple image and video benchmarks, with performance gains increasing as the number of referred targets grows.

By Zhixiong Zhang, Yizhuo Li, Shuangrui Ding, Yuhang Zang, Shengyuan Ding, Long Xing, Yibin Wang, Qiaosheng Zhang, Jiaqi Wang