The article discusses how Enterprise Document Intelligence should begin by parsing the folder structure rather than just PDFs, emphasizing that the index must reflect the case type’s requirements before any folder is accessed. It highlights that the two key questions to develop are not retrieval questions but rather focus on the relational tables needed for Retrieval-Augmented Generation (RAG) in a case file context.
By angela shi
Enterprise Document Intelligence [Vol. 1 #5septies] - When a PDF prints a contents page but exposes no outline, two ways to turn it back into structure, plus the page-alignment step everyone forgets The post Reconstructing the Table of Contents a PDF Forgot to Ship, So RAG Can Scope by Section appeared first on Towards Data Science .
By Kezhan Shi
Enterprise Document Intelligence [Vol. 1 #5A] - Document signals (metadata, native TOC, source software) and page-level content (text vs scans, tables, images, columns, page profile) The post Beyond extract_text: The Two Layers of a PDF That Drive RAG Quality appeared first on Towards Data Science .
By Kezhan Shi
Enterprise Document Intelligence [Vol. 1 #9B] - One call wires the four upgraded bricks together, run on a paper, a NIST standard, and a report with a broken TOC The post One RAG Pipeline, Four Very Different PDFs: Same Four Bricks, Every Answer Typed and Cited appeared first on Towards Data Science .
By angela shi
Enterprise Document Intelligence [Vol. 1 #5sexies] - image_df tells you where every picture is.
By Kezhan Shi
The article discusses a case study in enterprise document intelligence where a single document type contains a million files. It outlines a workflow that takes about an hour with two people to extract six to ten structured fields, emphasizing the importance of identifying two key signals that distinguish a valid column from one that could break a filter later. The focus is on converting unstructured documents into a structured SQL table for Retrieval-Augmented Generation (RAG) queries.
By Angela and Kezhan Shi
Enterprise Document Intelligence [Vol. 1 #9A] - Same paper, same question as Article 1.
By angela shi
Enterprise Document Intelligence [Vol. 1 #9B] - One call wires the four upgraded bricks together, run on a paper, a NIST standard, and a report with a broken TOC The post A Production RAG Pipeline in Action: Every Answer Typed and Cited appeared first on Towards Data Science .
By angela shi
Enterprise Document Intelligence [Vol. 1 #5B] - One PDF in, a relational set of DataFrames out: lines, pages, TOC, images, cross-references, captions, spans, and a parsing summary The post Stop Returning Flat Text from a PDF: The Relational Shape RAG Needs appeared first on Towards Data Science .
By Kezhan Shi
The article explains that enterprise document intelligence can be categorized into three distinct corpus types, each requiring a specific architecture. It outlines how to determine the shape of a document collection through three key questions. The piece also discusses the costs associated with building a system for the incorrect corpus type.
By angela shi
Enterprise Document Intelligence [Vol. 1 #7quater] - A 492-page document has a 358-entry table of contents.
By Kezhan Shi
Enterprise Document Intelligence [Vol. 1 #5B] - One PDF in, a relational set of DataFrames out: lines, pages, TOC, images, cross-references, captions, spans, and a parsing summary The post Stop Returning Flat Text from a PDF: The Relational Tables RAG Needs appeared first on Towards Data Science .
By Kezhan Shi