DocPilot is an agentic framework for long visual document understanding that orchestrates evidence seeking through page-level navigation and fine-grained localization, integrating visual inspection, code-based numerical reasoning, and cross-modal reasoning. It employs curriculum-based agentic training to enable small language models to learn complex document solving, progressing from single-ability learning to adaptive orchestration. Experiments on benchmarks such as MMLongBench-Doc, DocBench, FinRAGBench-V, and MADQA show that DocPilot achieves strong gains with frontier VLM backbones, and its 4B variant competes with much larger models, demonstrating effectiveness and generalization across diverse long-document reasoning tasks.
arXiv:2608. 03292v1 Announce Type: new Abstract: Long Document Visual Question Answering (LongDocVQA) requires Multimodal Large Language Models (MLLMs) to locate, integrate, and reason over heterogeneous document elements distributed across multiple pages.
DocHop is a new benchmark that tests multimodal large language models on integrated chart‑context reasoning within document‑style images. The benchmark presents narrative text that imposes multi‑step compositional constraints, while charts supply the data needed to answer questions grounded in semantic reference labels. It contains 2,074 examples across six task categories, generated via a stochastic logic‑first pipeline that controls reasoning depth and visual density, and shows a large performance gap between humans (over 90% accuracy) and the best models (62.83%).
arXiv:2604. 13731v2 Announce Type: replace Abstract: Multi-page Document Visual Question Answering requires reasoning over semantics, layouts, and visual elements in long, visually dense documents.
arXiv:2606. 29648v1 Announce Type: cross Abstract: Different retrievers, including lexical, semantic, and multimodal approaches, provide highly complementary strengths for multimodal document understanding, yet most systems combine them through fixed pipelines that cannot adapt to the demands of individual reasoning steps.
arXiv:2604. 09508v2 Announce Type: replace-cross Abstract: Visual Retrieval-Augmented Generation (VRAG) empowers Vision-Language Models to retrieve and reason over visually rich documents.
SLVR (Structured Latent Visual Reasoning) is a training framework that blends explicit chain-of-thought with latent reasoning for multimodal large language models. It organizes reasoning into typed latent stages—planning, grounding, evidence selection, and integration—each supervised by corresponding signals such as plans, bounding boxes, visual evidence, and final rationales. Built on Qwen2.5‑VL‑7B, SLVR consistently improves performance on multimodal reasoning benchmarks, achieving significant gains on MMVP, BLINK Relation, V*, MathVista, and ChartQA.
arXiv:2606. 05749v1 Announce Type: cross Abstract: Iterative retrieval-reasoning agents have recently shown promise for multimodal long-document question answering.
arXiv:2610.22273v1 Announce Type: cross Abstract: Reasoning over long document contexts remains a challenge for large language models (LLMs). Standard retrieval methods are inherently reactive, bottl...
arXiv:2608. 07527v1 Announce Type: cross Abstract: Long-document understanding requires models to find and combine evidence across many pages, layouts, tables, figures, and charts.
SAGE is a multi‑agent framework that transforms Chinese ancient document understanding from direct answer generation into evidence‑grounded inference. It orchestrates specialized agents for planning, evidence acquisition, claim verification, and bounded replanning within a shared‑state runtime, enabling evidence seeking, answer revision, and abstention when grounding is lacking. Experiments on the AncientDoc benchmark show that SAGE outperforms direct‑answering baselines across three LVLM backbones, and even a 9B‑parameter Qwen3.5 model surpasses larger monolithic LVLMs, underscoring the value of structured, evidence‑grounded inference over mere model scaling.
arXiv:2608.22429v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) capable of thinking with images often rely on external tools for fine-grained perception. However, this relian...
Retrieval-Augmented Generation (RAG) streamlines long-document understanding by leveraging retrieval mechanisms to restrict input images to a highly curated subset. However, existing multimodal RAG pipelines primarily face two critical challenges: first, standard semantic similarity retrievers frequently fetch topically overlapping yet answer-void distractor pages that mislead downstream generation; second, rigid single-pass pipelines heavily depend on initial retrieval success, where any omission of core evidence inevitably causes cascading errors.