arXiv Machine Learning
Honesty over Accuracy: Trustworthy Language Models through Reinforced Hesitation
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv AI
Jun 10
TruthRL: Incentivizing Truthful LLMs via Reinforcement Learning
arXiv:2509. 25760v2 Announce Type: replace-cross Abstract: While large language models (LLMs) have demonstrated strong performance on factoid question answering, they are still prone to hallucination and untruthful responses, particularly when tasks demand information outside their parametric knowledge.
arXiv AI
Aug 18
I-CALM: Incentivizing Confidence-Aware Abstention for LLM Selective Answering
arXiv:2604. 03904v2 Announce Type: replace-cross Abstract: Large language models (LLMs) often produce confident but incorrect answers, in part because standard evaluation incentives reward guessing over expressing uncertainty.
arXiv Machine Learning
Jul 7
On the effectiveness of reward functions in reinforcement learning for confidence calibration of large language models
arXiv:2607. 04332v1 Announce Type: new Abstract: In this paper, we consider the setting where large language models (LLMs) are trained using reinforcement learning (RL) to simultaneously improve reasoning accuracy and verbalize its confidence.
arXiv Machine Learning
Jul 1
Addressing Over-Refusal in LLMs with Competing Rewards
arXiv:2606. 31748v1 Announce Type: new Abstract: Safety training on language models often induces over-refusal: improved safety on harmful prompts at the cost of increased refusal on harmless ones.
arXiv AI
Aug 18
Delay, Plateau, or Collapse: Evaluating the Impact of Systematic Verification Error on RLVR
arXiv:2605. 02909v2 Announce Type: replace-cross Abstract: Reinforcement Learning with Verifiable Rewards (RLVR) has become a powerful approach for improving the reasoning capabilities of large language models (LLMs).
arXiv AI
Sep 30
The Commit-Abstain Circuit: Why Language Models Hallucinate Instead of Abstaining
arXiv:2609.32964v2 Announce Type: replace Abstract: Language models (LMs) often hallucinate by committing to confident answers rather than abstaining, even when they do not have enough information to...