Towards Data Science

Does Stacking Beat Your Best Model?

The article discusses the effectiveness of stacking in machine learning, noting that it only provides benefits when the individual models involved make different mistakes. It highlights that stacking can improve performance under these conditions, but may not be advantageous if the models are similar in their errors.

Towards Data Science
Sep 3

My Model Worked Perfectly. Then I Tried to Make It Useful.

The article describes how to deploy a trained churn classifier as a FastAPI service so that other software can call it. It focuses on the practical steps needed to transform a model that performs well in isolation into a usable, callable API. The post is aimed at readers who want to make their machine‑learning models accessible in real-world applications.

By Ibrahim Salami
Towards Data Science
Jul 24

Loop Engineering for RAG Generation: An LLM Cascade from a Cheap Local Model Up to a Hosted Flagship

Enterprise Document Intelligence [Vol. 1 #8quater] - Two angles on the cascade, cost and a validation loop, backed by a real sweep of twenty local models against a hosted flagship The post Loop Engineering for RAG Generation: An LLM Cascade from a Cheap Local Model Up to a Hosted Flagship appeared first on Towards Data Science .

By Kezhan Shi
Towards Data Science
Aug 20

How to Fine-Tune an LLM: An End-to-End Guide

The article "How to Fine-Tune an LLM: An End-to-End Guide" offers a practical, hands‑on walkthrough for fine‑tuning large language models in real‑world scenarios. It covers the entire process from data preparation to deployment, providing readers with actionable steps to adapt LLMs to specific tasks. The guide is aimed at practitioners looking to implement fine‑tuning in a structured, end‑to‑end manner.

By Sam Black
Towards Data Science
Oct 23

Your Six AI Models Are Really Two: The Math of Correlated Mistakes

The article explains that when multiple AI models are asked the same question and their answers are aggregated by voting, the resulting opinions are often less independent than the number of models suggests. It presents a formula that estimates the effective number of independent models and validates this with six open models evaluated on 1,500 exam questions.

By Utkarsh Mangal
Towards Data Science
Oct 29

Is the #1 AI Model Really #1?

The article examines the performance of AI models on a 2,000-question test, finding that the top two models were indistinguishable at the conventional 5% significance level. When the test was reduced to 200 questions, a different model would have claimed first place roughly three times out of ten trials. The piece questions the reliability of declaring a single model as the best based on limited testing.

By Utkarsh Mangal
Towards Data Science
Jul 22

Loop Engineering for RAG Generation: Iterate top-k One at a Time

Enterprise Document Intelligence [Vol. 1 #8bis] - Two regimes for sending retrieved candidates to the generation brick, the sufficiency signal that picks between them, and the per-question type dispatch that makes it cheap The post Loop Engineering for RAG Generation: Iterate top-k One at a Time appeared first on Towards Data Science .

By Kezhan Shi