arXiv AI
What the Abstention Option Measures: Refusal Loss, Sampling Churn, and Option Capture in Distilled Small Language Models
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Aug 3
The Asymmetric Effects of Knowledge Distillation on Bias in Small Language Models
arXiv:2607. 28639v1 Announce Type: cross Abstract: We show that knowledge distillation in small instruction-tuned language models has asymmetric effects on bias.
arXiv AI
Oct 12
A Privileged Teacher That Only Scores Cannot Search: Critique-Conditioned On-Policy Self-Distillation for Reasoning
The paper examines on‑policy self‑distillation, where a teacher scores a student’s rollout to provide dense token‑level credit. Experiments show that the raw scoring signals neither localize errors nor effectively penalize incorrect tokens, because locating errors is a search problem that the teacher is not explicitly asked to perform. Introducing a critique‑conditioned approach—first generating a critique of the rollout and then conditioning the teacher on it—produces signals that accurately localize errors, correct erroneous spans, and guide the policy toward backtracking tokens, improving performance on math problems and in cold‑start GRPO settings.
arXiv Computation and Language
Oct 27
Strong yet Controllable LLM Abstention without Learning to Abstain
arXiv:2610.16318v2 Announce Type: replace Abstract: Large language models (LLMs) can reduce hallucination by abstaining from questions they would likely get wrong. Abstention can be implemented outsi...
arXiv AI
Aug 28
Why RAGs Hallucinate: Penalty-Aware Evaluation of Retrieval-Augmented Generation Systems with Knowledge-Gap Canaries
The paper introduces a penalty‑aware evaluation framework for Retrieval‑Augmented Generation (RAG) systems that uses asymmetric scoring, knowledge‑gap canaries, and a failure‑attribution pipeline. Applying this framework to three commercial RAG products and a baseline on SimpleQA‑Verified, the authors find that while overall accuracy is similar across systems, canary violation rates vary dramatically, showing that systems differ more in when they answer than in what they answer. The study demonstrates that penalty‑aware scoring can reorder system rankings and is robust across different penalty settings.
arXiv Computation and Language
Oct 21
DeclineCraft: A RAG Abstention Benchmark for Jointly Measuring Combined Retrieval and Parametric Knowledge
DeclineCraft is a dynamic abstention benchmark for retrieval‑augmented generation (RAG) that tests whether models can recognize when neither retrieved documents nor parametric knowledge can answer a question. The benchmark uses unanswerable Minecraft feature‑addition queries that appear after a corpus cut‑off, allowing evaluation of future models. Across 27 large language models, the study measures Correct Abstention Rate (CAR), Answerable Attempt Rate, and Answer Accuracy, finding that single‑shot retrieval boosts CAR, iterative RAG reduces CAR with minimal impact on accuracy, and larger models improve accuracy but not CAR.
arXiv AI
Oct 1
A helps B while B hurts A: directed transfer in instruction-tuning mixture
arXiv:2609.39702v1 Announce Type: new Abstract: Adapting a language model to a specialized corpus means choosing which instruction-tuning tasks to train on under a fixed budget, and testing one choic...