← Back to all news
arXiv Computer Vision By Yujie Qi, Luyan Zhang

DRAgent: Discriminative Reasoning Agent for Referring Expression Segmentation

Read the original on arXiv Computer Vision →

DRAgent introduces a discriminative reasoning framework for Referring Expression Segmentation that replaces direct coordinate prediction with a two‑stage selection process. First, a detector generates candidate boxes; then a multimodal large language model (MLLM) discriminates the correct target through high‑recall screening and instance‑wise verification. The chosen box serves as a spatial prompt for a foundation segmentation model, and a self‑consistency‑filtered data pipeline is used for LoRA‑based fine‑tuning, yielding competitive results on RefCOCO, RefCOCO+, and RefCOCOg.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

Related stories

arXiv Computer Vision
Sep 22

0.5\%>100\%: Bidirectional Reciprocal Learning for Referring Image Segmentation

The paper introduces Bidirectional Reciprocal Learning (BRL), a parameter‑efficient fine‑tuning framework for referring image segmentation that operates on frozen vision foundation models. BRL employs two lightweight adapters—Reciprocal Attention Adapter (RAA) for token‑level cross‑modal attention and Reciprocal Gate Adapter (RGA) for channel‑level gating—to enable hierarchical, bidirectional information flow between vision and language. Experiments on RefCOCO, RefCOCO+, and RefCOCOg show that BRL outperforms existing methods while updating fewer than 0.5% of backbone parameters.

By Xiaoqiang Lu, Licheng Jiao, Lingling Li, Yuting Yang, Long Sun, Wenping Ma, Xu Liu, Fang Liu
computer-visionfine-tuningmultimodalbenchmarkssafety
More like this →
arXiv Computer Vision
Oct 15

ReferFlow: Beyond Final-Target Localization for Complex Referring Expressions

arXiv:2610.20352v1 Announce Type: new Abstract: Multimodal Large Language Models have made significant progress in referring expression comprehension (REC), yet most REC benchmarks still focus on fin...

By Tianyi Gao, Han Fang, Xin Wei, Yaoyao Zhong, Zhaoyan Pan, Weijie Zhu, Hongbo Sun, Zhiyu Lin, Kaicheng Yang, Jinglin Xu, Ye Yuan, Hao Li, Hao Sun, Jingmin Xin
llmsmultimodalbenchmarks
More like this →
arXiv AI
Jul 29

RefBench-PRO: Perceptual and Reasoning Oriented Benchmark for Referring Expression Comprehension

arXiv:2512. 06276v3 Announce Type: replace-cross Abstract: Referring Expression Comprehension (REC) is a vision-language task that localizes a specific image region based on a textual description.

By Tianyi Gao, Hao Li, Han Fang, Xin Wei, Xiaodong Dong, Hongbo Sun, Ye Yuan, Zhongjiang He, Jinglin Xu, Jingmin Xin, Hao Sun
llmsreinforcement-learningmultimodalbenchmarks
More like this →
arXiv AI
2d ago

PSGAgent: Enhancing MLLMs' Dynamic Visual Perception for Panoptic Scene Graph Generation via Agentic Reasoning

PSGAgent is an agentic framework that improves Multimodal Large Language Models’ performance on Panoptic Scene Graph generation by enabling dynamic visual perception. It introduces a think‑act‑observe loop with a Region Zoom‑In Tool for detailed local exploration and a Visual Highlight Tool for focused segmentation, reducing noise from irrelevant context. A two‑stage training pipeline—first building a high‑quality, error‑aware Multimodal Chain‑of‑Thought dataset, then applying a hierarchical reward mechanism with Group Sequence Policy Optimization—optimizes tool usage and achieves state‑of‑the‑art results on the PSG benchmark.

By Qingyun Liu, Yuankun Liu, Jiaye Feng, Jie Huang, Zonghong Dai, Haochen Li, Jingkun Wang, Weiping Li, Tong Mo
llmsagentscomputer-visionmultimodalbenchmarks
More like this →