arXiv Computer Vision By Chongzhi Zhang, Yuqi Zuo, Aixin Sun

Defining Page-Centric Visual Document Retrieval and Evaluating Existing Benchmarks

Read the original on arXiv Computer Vision →

The paper introduces page‑centric Visual Document Retrieval (VDR), treating pages as the primary indexing units while leveraging document context for relevance assessment. It distinguishes page and document retrieval granularities and three retrieval paradigms—independent‑item, evidence‑set, and iterative—then evaluates 42 existing benchmarks across eight criteria. The analysis reveals that most current VDR research focuses on page‑level independent‑item retrieval, with limited support for document‑level, evidence‑set, and iterative settings, and that realistic user queries and graded relevance judgments are rarely used, highlighting gaps between application needs and evaluation protocols.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
Aug 27

VisDocAgentBench: Benchmarking Agents for Visually Rich Document Retrieval

VisDocAgentBench is a closed‑corpus benchmark that evaluates static versus agentic retrieval for visually rich documents, using 2,375 pages from 100 documents and 120 queries that span direct, one‑bridge, and two‑bridge evidence structures. The benchmark includes semantic, relational, and visual queries, full‑document review, and hard‑negative validation. Results show that a strong visual retriever performs well on direct items but poorly on two‑bridge items, while agents improve performance, especially when using visual retrieval and iterative search capabilities.

By Lexiang Hu, Yanzhao Zhang, Mingxin Li, Dingkun Long, Yikang Li, Fuwei Zhang, Yisen Wang, Zhouchen Lin