Towards Data Science By Maria Mouschoutzi

Water Cooler Small Talk, Ep. 11: Overfitting in RAG evaluation

Read the original on Towards Data Science →

Why memorizing for the exam doesn't mean you understand the subject The post Water Cooler Small Talk, Ep. 11: Overfitting in RAG evaluation appeared first on Towards Data Science .

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at Towards Data Science.

Towards Data Science
1d ago

Why a Tiny GPT Can Know Two Facts and Still Not Connect Them

A tiny GPT model was trained to memorize every fact presented to it, yet it failed to answer any question that required combining two of those facts. The author tested a one-line fix suggested in a recent paper, which only partially resolved the issue. The post highlights the limitations of small language models in integrating multiple pieces of information.

By Utkarsh Mangal
Towards Data Science
Jun 9

10 Common RAG Mistakes We Keep Seeing in Production

Enterprise Document Intelligence [Vol. 1 #4bis] - A coauthor note on the brick-by-brick pitfalls that justified the four-brick split, before Part II walks the fixes The post 10 Common RAG Mistakes We Keep Seeing in Production appeared first on Towards Data Science .

By Kezhan Shi
arXiv Computation and Language
2d ago

"I Wrote, I Paused, I Rewrote": A Mixed-Methods Study of Learner Perceptions of Process-Aware LLM Feedback

The study examined how undergraduate English learners perceive feedback from large language models that incorporate process-aware data such as intermediate drafts and keystroke records. Forty‑three participants completed a timed essay, received LLM‑generated feedback based on the final draft, intermediate snapshots, and interaction logs, and then rated the feedback on six Likert items and answered open‑ended questions. Ratings were largely positive, with 74.4%–95.3% of participants giving 4 or 5 stars, and qualitative analysis revealed that most learners found the feedback accurate, though some noted misinterpretations or time constraints.

By Samra Zafar, Shifa Yousaf