Towards Data Science

Before Full Agentic RAG: Know How You Decide, and the Parsing Methods You Pick From

Enterprise Document Intelligence [Vol. 1 #5nonies] - Nature, plan, execute, synthesize: closing brick 1 with a dispatcher that reads each PDF’s nature and picks the method that fits, fitz, Docling, PaddleOCR, EasyOCR, MinerU or Surya, then folds the outputs into one corpus The post Before Full Agentic RAG: Know How You Decide, and the Parsing Methods You Pick From appeared first on Towards Data Science .

Towards Data Science
Jun 18

Dispatching the Parsed RAG Question: Chunk Strategy, Model Tier, Activations, Audit

Enterprise Document Intelligence [Vol. 1 #6c] - The decisions the parser makes on top of the user string, using the document’s profile: dispatch, activations, full schema, three approaches to deciding what fires, the audit _meta block, and a broker-corpus walkthrough The post Dispatching the Parsed RAG Question: Chunk Strategy, Model Tier, Activations, Audit appeared first on Towards Data Science .

By angela shi
Towards Data Science
Aug 20

Three Kinds of RAG Corpus, and What It Costs to Build for the Wrong One

The article explains that enterprise document intelligence can be categorized into three distinct corpus types, each requiring a specific architecture. It outlines how to determine the shape of a document collection through three key questions. The piece also discusses the costs associated with building a system for the incorrect corpus type.

By angela shi
Towards Data Science
Aug 29

RAG Is Not the Whole Toolkit: The NLP Techniques Real Problems Still Need

The article argues that Retrieval-Augmented Generation (RAG) is only one tool in NLP, and many real-world problems—such as request classification, free‑text matching, table reading, and OCR noise cleaning—are better served by simpler, cheaper techniques. It emphasizes the importance of selecting the appropriate method for each task and highlights the engineering challenge of knowing which technique to apply.

By Kezhan Shi
Towards Data Science
Aug 31

FAQ as RAG: When You Get to Design the Corpus

The article discusses how an FAQ can invert the traditional Retrieval-Augmented Generation (RAG) pipeline. It explains that parsing becomes trivial, retrieval functions as a cache, and few‑shot prompting is reframed as a retrieval problem. The piece highlights the practical implications of designing a corpus around an FAQ structure for enterprise document intelligence.

By Kezhan Shi