arXiv AI By Bach Nguyen, Zhaonan Li, Mau Son Nguyen, Sanika Chavan, Nilay Kumar, Hong Anh Nguyen, Khoa Vo, Ben Zhou

How Well Do LLMs Reason with Noisy Evidence? An Active Visual Reasoning Benchmark

Read the original on arXiv AI →

The paper introduces VisualNoiseQA, a benchmark that tests large language models (LLMs) on active reasoning tasks involving noisy visual feedback. In this setup, a text-only LLM must solve visual question answering (VQA) problems by repeatedly querying an off-the-shelf vision-language model (VLM) that acts as a stochastic sensor. Each query generates multiple samples, and the resulting empirical uncertainty is exposed via self‑consistency, allowing the LLM to decide what to ask next and when to stop. The benchmark is automatically constructed from diverse VQA sources and two noisy VLMs, retaining only questions where the sensor is inconsistent yet solvable by humans, and evaluates several LLM reasoners on 1,000 instances covering perception, chart understanding, and knowledge-intensive reasoning.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Oct 16

CoWorld Reasoner: Agentic Multimodal Reasoning with the Evolving Video World Model-Driven Harness

CoWorld Reasoner is an agentic framework that leverages a Video World Model (VWM) as a unified visual reasoning engine for Vision‑Language Models (VLMs). It exposes multiple visual operations through tools and skills, allowing the VLM to decide when to imagine, select an operation, generate visual content, and interpret the resulting evidence. The framework includes a VLM‑VWM Harness Co‑Evolution mechanism that jointly refines tools, skills, and execution code based on feedback, while keeping model weights fixed. Across seven benchmarks covering spatial, temporal, causal, and perceptual reasoning, CoWorld Reasoner outperforms direct VLM reasoning and improves accuracy on all benchmarks, achieving notable gains on MMSI and ERQA.

By Dongjie Cheng, Ruifeng Yuan, Ran Wei, Ning Song, Yongqi Li, Wenjie Li
arXiv AI
Jun 10

V-REX: Benchmarking Exploratory Visual Reasoning via Chain-of-Questions

arXiv:2512. 11995v2 Announce Type: replace-cross Abstract: While many vision-language models (VLMs) are developed to answer well-defined, straightforward questions with highly specified targets, as in most benchmarks, they often struggle in practice with complex open-ended tasks, which usually require multiple rounds of exploration and reasoning in the visual space.

By Chenrui Fan, Yijun Liang, Shweta Bhardwaj, Kwesi Cobbina, Ming Li, Tianyi Zhou
arXiv Computer Vision
Oct 21

LADBench: A Benchmark for Logical Fault Detection in Images

LADBench is a new benchmark comprising over 1,000 synthetic images that contain logical anomalies across four domains—Residential, Urban, Collaborative, and Nature. It introduces a Tiered Prompting Protocol that progressively discloses information to test how much explicit help a model needs to locate and reason about these faults. Evaluation of leading foundation models shows that even the best only reaches 70.11% accuracy, indicating that implicit logical fault detection remains largely unsolved.

By Sahasra Kondapalli, Lara Radovanovic, Aadi Palnitkar, Mingyang Mao, Xiaomin Lin
arXiv Computer Vision
Oct 22

CAVE: A Structured Credit Assignment Approach for Fragmented Visual Evidence Reasoning

The paper introduces CAVE, a structured credit assignment method that enhances Vision‑Language Models by evaluating intermediate reasoning steps through belief updates, evidence acquisition, and adaptive focus control. CAVE is built on a GRPO framework and guides models to optimize each action, improving reliability in fragmented visual reasoning. The authors also present TRACER‑Bench, a new benchmark covering nonlocal and semantically confusable reasoning dimensions, and show that CAVE boosts performance on both public datasets and this benchmark while maintaining strong general multimodal results.

By Tengda Guo, Jie Leng, Hanlei Li, Yaoyuan Liang, Qingyue Zhang, Dian Yang, Mingyu Zhang, Yuhua Fu, Shao-Lun Huang