arXiv AI
Jul 13
OmniMapBench: Benchmarking Visual-Centric Reasoning on Diverse Map Documents
arXiv:2607. 09068v1 Announce Type: cross Abstract: Recent advancements in LVLMs necessitate robust benchmarks for complex, visually grounded reasoning.
TestHallVQA: Exploring LVLMs' Document-Level Reasoning under Redundant Contexts from Scientific Exams
Related stories
arXiv Computation and Language
Oct 16
VELD-QA: A Large-Scale Dataset for Visual Evidence Grounding and Question Answering in Long Documents
VELD-QA is a large-scale benchmark for visual evidence grounding and question answering in long documents, comprising 15,000 human-authored question-answer pairs across 5,859 PDFs with 372,445 pages. The dataset includes detailed annotations of supporting pages, visual evidence elements, and descriptions of cited visual content, enabling separate evaluation of retrieval, localization, and interpretation. Experiments on nine vision-language models and various retrieval-augmented systems reveal significant gaps in evidence localization and visual interpretation, with oracle accuracy peaking at 81.7% and enrichment of visual-element annotations narrowing performance gaps by 17–24%.
arXiv AI
Jul 14
SynthDocBench: Controlled Benchmark for Long-Context Visual Document Understanding
arXiv:2607. 10400v1 Announce Type: cross Abstract: Vision language models (VLMs) have achieved strong performance on visual document understanding benchmarks such as DocVQA, ChartQA, and MMLongBench-Doc.
arXiv Computer Vision
Sep 22
Pay More Attention To Text In High-Resolution MLLMs
The paper introduces EviSpec, a training‑free compiler that generates complementary evidence specifications to improve high‑resolution multimodal large language models (MLLMs). By explicitly guiding visual search with structured evidence specifications, EviSpec achieves significant relative gains—up to 14.8% over random evidence—across five MLLMs and three benchmarks, and also sets new state‑of‑the‑art results on VQA and hallucination‑focused tasks.
arXiv AI
Jun 10
V-REX: Benchmarking Exploratory Visual Reasoning via Chain-of-Questions
arXiv:2512. 11995v2 Announce Type: replace-cross Abstract: While many vision-language models (VLMs) are developed to answer well-defined, straightforward questions with highly specified targets, as in most benchmarks, they often struggle in practice with complex open-ended tasks, which usually require multiple rounds of exploration and reasoning in the visual space.
arXiv AI
4d ago
ClueTracer: Question-to-Vision Clue Tracing for Training-Free Hallucination Suppression in Multimodal Reasoning
ClueTracer is a training‑free, parameter‑free plugin that suppresses hallucinations in multimodal reasoning models by tracing how visual clues propagate from the question through the model’s reasoning pathway. It localizes task‑relevant image patches while ignoring irrelevant regions, thereby addressing the problem of reasoning drift where models over‑focus on question‑irrelevant entities. The method improves performance across various reasoning architectures by an average of 1.21× on reasoning benchmarks.
arXiv AI
Aug 7
Look Twice: Training-Free Evidence Highlighting for Knowledge-based Visual Question Answering
arXiv:2604. 01280v2 Announce Type: replace-cross Abstract: Knowledge-based Visual Question Answering (KB-VQA) requires Multimodal Large Language Models (MLLMs) to identify and combine fine-grained visual cues with retrieved textual evidence.
arXiv AI
Oct 26
Cycle-of-Thought: Self-Evaluative Iterative Reasoning for Table Visual Question Answering in Document Images
The paper introduces Self-RefineVQA, a training‑free, inference‑time framework that lets a single Vision‑Language Model iteratively generate, critique, and refine its own answers for table visual question answering. By forming a closed self‑feedback loop guided by prompts, the method corrects common reasoning errors such as spatial misalignment and logical hallucinations without requiring additional labeled data or model updates. Experiments on tabular VQA benchmarks show consistent accuracy gains across monolingual and cross‑lingual settings, especially for lightweight models, while keeping inference cost linear and eliminating the need for expensive supervised fine‑tuning.
arXiv Machine Learning
Jul 9
Comparative Study of Domain-adapted VLMs for General Document Visual Question Answering
arXiv:2607. 07179v1 Announce Type: cross Abstract: Document Visual Question Answering (DocVQA) presents a complex multimodal challenge, requiring models to exploit visual, textual, and layout information from documents.
arXiv AI
Oct 16
DocPilot: Interactive Agent Orchestration and Training for Long Visual Document Understanding
DocPilot is an agentic framework for long visual document understanding that orchestrates evidence seeking through page-level navigation and fine-grained localization, integrating visual inspection, code-based numerical reasoning, and cross-modal reasoning. It employs curriculum-based agentic training to enable small language models to learn complex document solving, progressing from single-ability learning to adaptive orchestration. Experiments on benchmarks such as MMLongBench-Doc, DocBench, FinRAGBench-V, and MADQA show that DocPilot achieves strong gains with frontier VLM backbones, and its 4B variant competes with much larger models, demonstrating effectiveness and generalization across diverse long-document reasoning tasks.
arXiv Computation and Language
Sep 23
ICDAR2026 Competition on Multimodal Reasoning over Documents in Multiple Domains
The ICDAR2026 Competition on Multimodal Reasoning over Documents in Multiple Domains introduced a new Visual Question Answering benchmark that tests reasoning over documents from eight distinct domains such as business reports, scientific papers, and engineering drawings. Twenty valid submissions from eight teams were evaluated, featuring approaches ranging from zero‑shot vision‑language models to multi‑agent ensembles and fine‑tuned multimodal systems. Results indicate that the most effective systems employ structured evidence extraction, retrieval, verification, and orchestration across multiple components rather than single‑pass prompting.
arXiv Computation and Language
Oct 23
A Task-Centric Survey of Long-Document Visual Question Answering: Taxonomy, Evolution, and Future Directions
The paper surveys long-document visual question answering (VQA) from a task-centric perspective, breaking it down into document parsing, evidence organization and retrieval, generator organization and learning, and evaluation. It introduces a detailed taxonomy for each component, tracks how research priorities have shifted over time—from multimodal content understanding to evidence acquisition and management—and highlights the importance of explicit retrieval alongside direct reading. The authors propose future research directions focused on evidence sufficiency, verifiable and correctable understanding, budget-aware coordination, and continual document understanding.