Enterprise Document Intelligence [Vol. 1 #7B] - Retrieval is filtering on structured tables: keywords first, TOC second, embeddings last The post Finding the right anchors for RAG: keyword, embedding, and TOC signals in parallel appeared first on Towards Data Science .
By angela shi
Enterprise Document Intelligence [Vol. 1 #7A] - Stop searching strings.
By angela shi
Enterprise Document Intelligence [Vol. 1 #7quater] - A 492-page document has a 358-entry table of contents.
By Kezhan Shi
Enterprise Document Intelligence [Vol. 1 #7C] - One LLM call ranks the candidates with reasons.
By angela shi
Enterprise Document Intelligence [Vol. 1 #7sexies] - The unit of retrieval doesn’t have to be a page or a paragraph.
By Kezhan Shi
Enterprise Document Intelligence [Vol. 1 #9B] - One call wires the four upgraded bricks together, run on a paper, a NIST standard, and a report with a broken TOC The post A Production RAG Pipeline in Action: Every Answer Typed and Cited appeared first on Towards Data Science .
By angela shi
The article explains that enterprise document intelligence can be categorized into three distinct corpus types, each requiring a specific architecture. It outlines how to determine the shape of a document collection through three key questions. The piece also discusses the costs associated with building a system for the incorrect corpus type.
By angela shi
Enterprise Document Intelligence [Vol. 1 #2] Why the same vector search that handles synonyms and paraphrase silently fails on negation, exact identifiers, and your company’s acronyms, and what to use when it does.
By angela shi
Enterprise Document Intelligence [Vol. 1 #6ter] - Six positions on the question-parsing brick that contradict the mainstream RAG playbook The post The Untaught Lessons of RAG Question Parsing: Structure Before You Search appeared first on Towards Data Science .
By angela shi
The article argues that Retrieval-Augmented Generation (RAG) is only one tool in NLP, and many real-world problems—such as request classification, free‑text matching, table reading, and OCR noise cleaning—are better served by simpler, cheaper techniques. It emphasizes the importance of selecting the appropriate method for each task and highlights the engineering challenge of knowing which technique to apply.
By Kezhan Shi
Enterprise Document Intelligence [Vol. 1 #7ter] - Six positions on the retrieval brick that contradict the cosine-first reflex of mainstream RAG The post The Untaught Lessons of RAG Retrieval: Cosine Is Not the Foundation appeared first on Towards Data Science .
By Kezhan Shi
Enterprise Document Intelligence [Vol. 1 #12] - The category of question most RAG pipelines silently fail on, and the pipeline shape that handles them The post Loop Engineering for Listing Questions: When the Answer Is Every Passage, Not the Top One appeared first on Towards Data Science .
By angela shi