Towards Data Science By Utkarsh Mangal

Same Answer, Different Reason: What a Reasoning Model Says When It Follows a Planted Hint

Read the original on Towards Data Science →

The article examines how a small reasoning model responds when presented with incorrect answers to 200 exam questions. By inserting wrong answers and observing the model’s reasoning, the author explores whether the model’s justification aligns with the planted hint or diverges. The study highlights the model’s tendency to follow misleading cues and the implications for evaluating its reasoning process.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at Towards Data Science.

Towards Data Science
Sep 2

A RAG That Says “Not in This Document” Has to Show Four Kinds of Evidence

The article discusses the importance of a Retrieval-Augmented Generation (RAG) system providing clear evidence when it states that information is not present in a document. It outlines four distinct types of evidence that should accompany such a claim to avoid presenting a confident but incorrect answer or an unsupported “no answer.” The piece emphasizes that each evidence type serves as a safeguard against misinformation in enterprise document intelligence.

By Kezhan Shi
arXiv AI
Oct 16

When Reasoning Traces Conflict with Evidence: How Answer Configuration Shapes Evidence Following

The study investigates how a retained reasoning trace influences answer accuracy and its interaction with evidence. By comparing two answer configurations—continuation of the model’s own thinking versus a separate answer call—across GPT‑OSS, Gemma4, and Qwen3 on HotpotQA and MuSiQue, the authors find that the separate call significantly improves evidence‑following while the trace itself remains crucial for accuracy. The analysis also reveals that the final line of a trace is most valuable, that gold evidence aids early reasoning, and that distractors weaken correction under a separate call.

By Shaoang Li, Yanhang Shi, Jian Li