Hugging Face Trending Papers
When Should LLMs Abstain? Chain-of-Self-Questioning for Selective Risk Control
Read the original on Hugging Face Trending Papers →The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
Related stories
arXiv AI
Sep 16
When Should LLMs Abstain? Chain-of-Self-Questioning for Selective Risk Control
arXiv:2609.17516v1 Announce Type: cross Abstract: Large language models can produce fluent answers when their factual support is weak. This paper introduces Chain-of-Self-Questioning (CoSQ), a prompt...
arXiv AI
Aug 18
I-CALM: Incentivizing Confidence-Aware Abstention for LLM Selective Answering
arXiv:2604. 03904v2 Announce Type: replace-cross Abstract: Large language models (LLMs) often produce confident but incorrect answers, in part because standard evaluation incentives reward guessing over expressing uncertainty.
arXiv AI
Oct 7
Penalty-Framed No-Valid-Option MCQA: Analyzing LLM Abstention under Invalid Choices
The paper introduces a new evaluation setting called penalty‑framed no‑valid‑option MCQA, where multiple‑choice questions may contain no correct answer. By removing the correct option from the MMLU‑Pro mathematics subset and allowing models to either pick an option or abstain, the authors penalize forced‑choice responses that are invalid. Experiments reveal that even models with high standard MCQA accuracy can still produce invalid forced‑choice answers, indicating that traditional accuracy metrics miss an important aspect of model reliability.
arXiv AI
Jul 17
Simplicity Paradox: Debunking myths about prompting and datasets for LLM evaluation
arXiv:2607. 14109v1 Announce Type: cross Abstract: Probing the capabilities of Large Language Models (LLMs) and building robust solutions for Multiple-Choice Question Answering (MCQA) remain central challenges in natural language understanding.
arXiv Computation and Language
Sep 23
ReasonLab: A Controlled and Auditable Evaluation of Prompting Techniques for Multiple-Choice QA
arXiv:2607.14109v2 Announce Type: replace Abstract: Probing the capabilities of Large Language Models (LLMs) and building robust solutions for Multiple-Choice Question Answering (MCQA) remain central...
arXiv AI
Jul 31
Ask don't tell: Reducing sycophancy in large language models
arXiv:2602. 23971v4 Announce Type: replace-cross Abstract: Sycophancy, the tendency of large language models to favour user-affirming responses over critical engagement, has been identified as an alignment failure, particularly in high-stakes advisory and social contexts.