Towards Data Science By Utkarsh Mangal

Why a Tiny GPT Can Know Two Facts and Still Not Connect Them

Read the original on Towards Data Science →

A tiny GPT model was trained to memorize every fact presented to it, yet it failed to answer any question that required combining two of those facts. The author tested a one-line fix suggested in a recent paper, which only partially resolved the issue. The post highlights the limitations of small language models in integrating multiple pieces of information.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at Towards Data Science.

Towards Data Science
Sep 2

A RAG That Says “Not in This Document” Has to Show Four Kinds of Evidence

The article discusses the importance of a Retrieval-Augmented Generation (RAG) system providing clear evidence when it states that information is not present in a document. It outlines four distinct types of evidence that should accompany such a claim to avoid presenting a confident but incorrect answer or an unsupported “no answer.” The piece emphasizes that each evidence type serves as a safeguard against misinformation in enterprise document intelligence.

By Kezhan Shi
Towards Data Science
Oct 6

A Google Team Measured Half of My Argument, and Left the Other Half Open

The article titled "A Google Team Measured Half of My Argument, and Left the Other Half Open" is part of a series on spec‑driven test automation (Part 3). It discusses how a Google team evaluated only half of the author’s argument, leaving the remaining portion unresolved. The post was originally published on the Towards Data Science platform.

By Gal Arav
Towards Data Science
Oct 22

Same Answer, Different Reason: What a Reasoning Model Says When It Follows a Planted Hint

The article examines how a small reasoning model responds when presented with incorrect answers to 200 exam questions. By inserting wrong answers and observing the model’s reasoning, the author explores whether the model’s justification aligns with the planted hint or diverges. The study highlights the model’s tendency to follow misleading cues and the implications for evaluating its reasoning process.

By Utkarsh Mangal