arXiv Computer Vision

LocalAgent: Collaborative Agentic Verification for Fine-Grained Instance-Level Consistency

LocalAgent is a collaborative framework that combines a general multimodal large language model (MLLM) with lightweight specialist verifiers to verify fine‑grained instance‑level consistency between images. The MLLM first identifies suspicious local regions, which are then examined by the Local Evidence Verifier (LEV) toolkit—comprising Local Appearance Consistency (LAC) and Local Geometric Correspondence (LGC)—to provide structured scalar evidence for the final decision. Experiments demonstrate a 4.9% accuracy gain over the strongest baseline while invoking the verifier on only 12.13% of samples, preserving the MLLM’s general multimodal capabilities.

arXiv AI
Jul 21

Seeing What Is Actually There: PriVE-Bench and PriVE-Tools for Counterfactual Evaluation of Agentic Visual Evidence in VLMs

arXiv:2607. 16311v1 Announce Type: cross Abstract: Vision-language models (VLMs) often answer visual questions using learned language and category priors rather than grounding their predictions in the image itself.

By Jingyu Sun, Jiachen Tu, Yuyang Xue, Yaoxin Jiang, Guoyi Xu, Zhengtao Yao, Rui Qian, Yizheng Sun, Hongpeng Zhou, Jingyuan Sun, Yan Lin
arXiv Computer Vision
Oct 7

FindIt: A Format-Informed Visual Detection Benchmark for Generalist Multimodal LLMs

The paper introduces FindIt, the first comprehensive benchmark for evaluating the promptable localization abilities of generalist multimodal large language models (MLLMs). It covers four core task categories—object detection, referring expression detection, instance-level detection, and video-based detection—and provides a unified framework that standardizes inputs, enforces parsable bounding box outputs, and defines transparent evaluation protocols. Using this benchmark, the authors assess a range of open-source and proprietary MLLMs, revealing both their strengths and limitations, particularly their sensitivity to formatting constraints and difficulty generalizing to minor variations.

By Eshika Khandelwal, Jingjing Pan, Mingfang Zhang, Quan Kong, Lorenzo Garattoni, Hilde Kuehne
arXiv Computer Vision
Oct 12

TerraAgent: Demonstration-Grounded Multi-Agent Reasoning for Long-Context Remote Sensing Visual Question Answering

The paper introduces TerraAgent, a training‑free framework that enhances remote sensing visual question answering by integrating three modules: GDR for demonstration retrieval, MACE for evidence‑typed sub‑question decomposition, and CVA for counterfactual evidence auditing. It demonstrates significant improvements on multiple benchmarks, raising accuracy, visual‑dependency scores, and reducing prior‑only answers and hallucinations without fine‑tuning.

By Jingwen Huang, Yiming Fang, Hanxiao Wu, Boyuan He, Keyi Luo
arXiv Computer Vision
Oct 21

LADBench: A Benchmark for Logical Fault Detection in Images

LADBench is a new benchmark comprising over 1,000 synthetic images that contain logical anomalies across four domains—Residential, Urban, Collaborative, and Nature. It introduces a Tiered Prompting Protocol that progressively discloses information to test how much explicit help a model needs to locate and reason about these faults. Evaluation of leading foundation models shows that even the best only reaches 70.11% accuracy, indicating that implicit logical fault detection remains largely unsolved.

By Sahasra Kondapalli, Lara Radovanovic, Aadi Palnitkar, Mingyang Mao, Xiaomin Lin
arXiv Computer Vision
Oct 9

WorldFact-Bench: Beyond Image-Internal Plausibility to Image-World Consistency

WorldFact-Bench is a new benchmark that tests image‑world consistency by presenting 1,274 real‑fake image pairs across four verification regimes and ten semantic domains, each pair containing a factual conflict while keeping the image visually plausible. The evaluation requires both images in a pair to be classified correctly, and the benchmark focuses on single‑image assessment without predefined claims. The authors also introduce PERSIST‑Agent, an iterative verification system that maintains a persistent state linking candidate facts, visual observations, evidence, and verification statuses, and shows improved pair accuracy over baseline methods on 8B backbones.

By Zhuohong Chen, Zhengxian Wu, Yunyao Yu, Hangrui Xu, Zijian Yu, Hao Tan, Zhifang Liu, Peng Jiao, Jun Lan, Haoqian Wang