Towards Data Science
2d ago
Loop Engineering for RAG: The Small Loops Inside Each Step, the Big Loops Across the Pipeline
Enterprise Document Intelligence [Vol. 1 #13bis] - The four bricks return useful results most of the time.
Loop Engineering for RAG Generation: An LLM Cascade from a Cheap Local Model Up to a Hosted Flagship
Enterprise Document Intelligence [Vol. 1 #8quater] - Two angles on the cascade, cost and a validation loop, backed by a real sweep of twenty local models against a hosted flagship The post Loop Engineering for RAG Generation: An LLM Cascade from a Cheap Local Model Up to a Hosted Flagship appeared first on Towards Data Science .
Related stories
Towards Data Science
Jul 22
Loop Engineering for RAG Generation: Iterate top-k One at a Time
Enterprise Document Intelligence [Vol. 1 #8bis] - Two regimes for sending retrieved candidates to the generation brick, the sufficiency signal that picks between them, and the per-question type dispatch that makes it cheap The post Loop Engineering for RAG Generation: Iterate top-k One at a Time appeared first on Towards Data Science .
Towards Data Science
6d ago
Cut an Enterprise RAG Pipeline’s Latency and Cost by Calling the LLM Less, Not by Buying a Faster Model
Enterprise Document Intelligence [Vol. 1 #9ter] - The pipeline from Article 9 calls a model at several steps to be sure it is right.
Towards Data Science
Aug 6
Loop Engineering for Cross-References: When RAG Answers ‘see Section 7.2’ Instead of the Actual Answer
Enterprise Document Intelligence [Vol. 1 #11] - When the first answer points elsewhere in the document, the pipeline loops back to fetch the linked context The post Loop Engineering for Cross-References: When RAG Answers ‘see Section 7.
Towards Data Science
May 29
RAG Is Burning Money — I Built a Cost Control Layer to Fix It
Most RAG systems are optimized for answer quality, not cost—and that blind spot gets expensive fast. In this article, I break down a production-ready cost control layer combining semantic caching, query routing, token budgeting, and circuit breaking, achieving an 85% reduction in LLM costs without sacrificing answer quality.
Towards Data Science
Aug 9
How to Implement Structured Output with Local LLMs
Why use it? How to implement it?
Towards Data Science
Aug 7
Loop Engineering for Listing Questions: When the Answer Is Every Passage, Not the Top One
Enterprise Document Intelligence [Vol. 1 #12] - The category of question most RAG pipelines silently fail on, and the pipeline shape that handles them The post Loop Engineering for Listing Questions: When the Answer Is Every Passage, Not the Top One appeared first on Towards Data Science .
Towards Data Science
Aug 3
Prompt, Context, Loop: The Three Engineering Layers Every RAG System Is Built On
Enterprise Document Intelligence [Vol. 1 #M2] - Every RAG system is built in three engineering layers stacked on one LLM call: prompt (the call itself), context (what fills the model’s window), loop (when the next call fires and when it stops).
Towards Data Science
5d ago
RAG Workflow and Loop Engineering: The Dispatcher That Decides When to Loop and When to Stop
Enterprise Document Intelligence [Vol. 1 #13] - Putting the patterns together, and why this is what “agentic RAG” should look like The post RAG Workflow and Loop Engineering: The Dispatcher That Decides When to Loop and When to Stop appeared first on Towards Data Science .
Towards Data Science
Jul 19
Loop Engineering for RAG Question Parsing: The Small Loop That Runs Before Retrieval
Enterprise Document Intelligence [Vol. 1 #6quinquies] - Prompt engineering, then context engineering, then loop engineering.
Towards Data Science
Jul 17
A Production RAG Pipeline in Action: Every Answer Typed and Cited
Enterprise Document Intelligence [Vol. 1 #9B] - One call wires the four upgraded bricks together, run on a paper, a NIST standard, and a report with a broken TOC The post A Production RAG Pipeline in Action: Every Answer Typed and Cited appeared first on Towards Data Science .
Towards Data Science
Jun 24
Anchor Detection for RAG: Parallel Detectors, Then One LLM Call at the End
Enterprise Document Intelligence [Vol. 1 #7B] - Retrieval is filtering on structured tables: keywords first, TOC second, embeddings last The post Anchor Detection for RAG: Parallel Detectors, Then One LLM Call at the End appeared first on Towards Data Science .