Towards Data Science

Loop Engineering for Hierarchical Retrieval: Reading a Long Document by Its Table of Contents

Enterprise Document Intelligence [Vol. 1 #7quater] - A 492-page document has a 358-entry table of contents.

Towards Data Science
Jul 22

Loop Engineering for RAG Generation: Iterate top-k One at a Time

Enterprise Document Intelligence [Vol. 1 #8bis] - Two regimes for sending retrieved candidates to the generation brick, the sufficiency signal that picks between them, and the per-question type dispatch that makes it cheap The post Loop Engineering for RAG Generation: Iterate top-k One at a Time appeared first on Towards Data Science .

By Kezhan Shi
Towards Data Science
Aug 22

Multi-Document RAG: A Folder of Unrelated PDFs Is One Long Document with a Nested Outline

The article discusses a method for handling a folder of unrelated PDFs as a single long document with a nested outline. It highlights that without shared fields, an index cannot be built, so the approach uses one summary line per file and each file’s own table of contents, with retrieval routes extending down two levels. This structure enables retrieval-augmented generation (RAG) across multiple documents.

By angela shi
Towards Data Science
Aug 5

Building Document Structure with Loop Engineering: Recovering a PDF’s Outline from Body Typography for RAG

Enterprise Document Intelligence [Vol. 1 #5octies] - Rules propose, LLM validates: six deterministic signals on span-level typography surface heading candidates, one bounded loop keeps the real ones, and the same toc_df drops back into the RAG pipeline The post Building Document Structure with Loop Engineering: Recovering a PDF’s Outline from Body Typography for RAG appeared first on Towards Data Science .

By angela shi