arXiv Computer Vision

Document Retrieval-Aware Chunking (D-RAC): Universal Retrieval-Aware Ingestion of Enterprise Documents via PDF Normalization and Multimodal Markdown Conversion

arXiv AI
Oct 16

Loud and Clear: Making Visual Evidence Count in Multimodal Document RAG

The paper introduces Loud and Clear (LoC), a method that enhances multimodal document retrieval-augmented generation by fully utilizing visual token capacity and refining retrieved pages to highlight evidence. LoC combines higher-resolution pages with OCR of query-relevant regions, achieving significant accuracy gains over eight prior methods on multiple benchmarks. The study demonstrates that the way retrieved pages are presented to the generator is a critical bottleneck beyond retrieval itself.

By Eunchan Jo, Seounghyun Jang, Sangwoo Mo
arXiv AI
Oct 7

Smart Content Ingestion for Generative AI Workloads

The paper introduces a production-ready content‑extraction system tailored for generative AI workloads, addressing the heterogeneity of enterprise data formats such as PDFs, spreadsheets, and scanned documents. It features selective OCR routing, a scarcity‑first curation engine with a reference‑based extraction scorer, a deterministic structure‑aware chunker, and a read‑only retrieval evaluator that generates grounded questions and reports metrics like Hit@k and MRR. On a 180‑document corpus, the system achieves high accuracy (97.4/100 character score, 0.13% error rate) and strong retrieval performance (Hit@1 68.6%, Hit@10 92.8%, MRR 0.77).

By Abbas Raza Ali, Muhammad Ajmal Siddiqui, Moona Zahid
arXiv Computation and Language
Sep 23

Layout-Guided Masking for GROBID: Lightweight Structural Gains in Large-Scale Scientific PDF Ingestion

The paper introduces a lightweight CPU-based extension to GROBID that uses layout-guided masking to identify figure, table, and paratext regions in scientific PDFs. By routing tokens to specialized GROBID models or discarding them, the method improves structural accuracy on PMC corpora and enhances figure caption recovery. It also achieves competitive table detection and body‑text precision compared to vision‑based GPU parsers while operating entirely on CPU and costing significantly less.

By Luca Foppiano, Sana Khamassi, Vipul Gupta
arXiv Computation and Language
Oct 23

Chunk Recomputation under Real Document Revisions: Measuring Update Cost and Retrieval Quality of Fixed, Recursive, and Content-Defined Chunking

The paper evaluates how different chunking strategies—fixed-size, recursive paragraph-first, and content-defined—affect the cost of updating embeddings when Wikipedia documents are revised. Using 120 pairs of Chinese and English revisions, the authors find that fixed-size chunking requires the most recomputation (57‑68 % of the workload), while recursive and content-defined chunking need less (38‑56 % and 43‑54 % respectively). Despite these differences, evidence recall under a 2048‑token retrieval budget varies by less than two percentage points across methods and languages.

By Yuning Bian, Lele Xu, Yifan Yuan, Xinyu Yin, Chengyan Zhan
arXiv Computation and Language
6d ago

Unlimited OCR Works 2

Unlimited OCR 2 is a document parsing model that processes only the text it transcribes, avoiding re‑scanning earlier pages. It replaces all decoder attention with Sparse Reference Sliding Window Attention (SR‑SWA), keeping computational costs constant regardless of document length. The model achieves significant per‑step speedups over Full Attention and R‑SWA, and sets new state‑of‑the‑art results on the MPDocBench and MarathonDocBench benchmarks for hundred‑page documents.

By Shu Wei, Jingjing Wu, Qunyi Xie, Lingshu Zhang, Xiangcheng Du, Yannian Fu, Mengjie Wang, Zuyi Wang, Zhichao Liu, Yangliu Xu, Youyang Yin, Huanhuan Liu, YY, Yi Yang
arXiv AI
Oct 12

Locate, Judge, Read: Role-Specialized Tool Agents over a Knowledge-Point Index for Open-Domain Multimodal Document QA

KnowForge is a modular pipeline for open‑domain multimodal document question answering that separates retrieval, judging, and reading into distinct agents. It uses a hybrid‑retrieval knowledge‑point index, a Locator agent for searching, a Bridge Judge to enforce a second hop, a Deep Reader that handles text, images, and tables, and a synthesizer with format checking. On the M3DocVQA benchmark it achieves an F1 of 47.5, outperforming prior systems by 11 points, and shows strong gains on MultiHop‑RAG and MMLongBench‑Doc as well.

By Wenlin Lin, Fanzhe Wei
arXiv Computation and Language
Oct 28

ShredBench: Evaluating the Semantic Reasoning Capabilities of Multimodal LLMs in Document Reconstruction

ShredBench is a new benchmark for evaluating multimodal large language models (MLLMs) on the task of reconstructing documents from shredded fragments. It uses an automated pipeline that generates fragmented documents from Markdown, covering English, Chinese, code, and table scenarios with varying fragmentation levels. Experiments show that while MLLMs perform well on intact documents, their performance drops sharply when documents are shredded, revealing a gap in fine‑grained cross‑modal reasoning.

By Zichun Guo, Yuling Shi, Wenhao Zeng, Chao Hu, Haotian Lin, Terry Yue Zhuo, Jiawei Chen, Xiaodong Gu, Wenping Ma
arXiv AI
3d ago

AmbiHTMLBench: A Benchmark for HTML-based Visually Rich Document parsing

AmbiHTMLBench is a new benchmark that evaluates how well models can convert real-world documents into executable HTML while preserving content, organization, and visual appearance. It contains 1,115 pages with structured annotations and uses both objective metrics (table fidelity, text error, layout consistency) and a reference-anchored subjective protocol (LLM judges aligned with human preferences). Results show that different systems excel in objective versus subjective measures, and fine‑tuning a small expert model improves performance, highlighting the benchmark’s role as a diagnostic tool for advanced document parsing.

By Boyu Niu, Yingjie Xiong, Shurui Li, Linhan Pang, Yuntong Zhang, Han Wang, Hao Wu, Kai Zuo, Xu Tang, Xuanhe Zhou, Fan Wu