arXiv Computation and Language
Free Lunch for LLMs Confidence: The RL Critic Already Knows
Read the original on arXiv Computation and Language →The Flow has not summarised this story yet — read it at arXiv Computation and Language.
Related stories
arXiv Machine Learning
Aug 11
Process Supervision of Confidence Margin for Calibrated LLM Reasoning
arXiv:2604. 23333v2 Announce Type: replace Abstract: Scaling test-time computation with reinforcement learning (RL) has emerged as a reliable path to improve large language models (LLM) reasoning ability.
arXiv AI
Sep 16
Post-Training Large Language Models via Reinforcement Learning from Self-Feedback
arXiv:2507.21931v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) often produce plausible but poorly-calibrated answers, limiting their reliability on reasoning-intensive tasks....
arXiv Computation and Language
1d ago
Reinforcement Learning Done Right for Explicit Confidence Targets
arXiv:2610.35059v1 Announce Type: cross Abstract: Large language models (LLMs) can produce plausible but incorrect answers when they are uncertain, which can mislead users and undermine model reliabi...
Hugging Face Trending Papers
Jul 14
Critic Experience Bank: Self-Evolving Step-Level Confidence Estimation for LLM Agents
LLM agents act in external environments where each action changes the state that later decisions condition on, and where a single wrong step can waste interaction budget or trigger irreversible side effects long before the final failure is observed. Reliable deployment therefore requires \emph{step-level confidence estimation}: a calibrated probability that each proposed action is productive, available \emph{before} the action is executed.
arXiv AI
Jul 15
Critic Experience Bank: Self-Evolving Step-Level Confidence Estimation for LLM Agents
arXiv:2607. 12397v1 Announce Type: new Abstract: LLM agents act in external environments where each action changes the state that later decisions condition on, and where a single wrong step can waste interaction budget or trigger irreversible side effects long before the final failure is observed.
arXiv AI
Sep 30
Privy to the Foil: Recasting Value Estimation with a Self-Privileged Critic for RLVR
arXiv:2609.37825v1 Announce Type: cross Abstract: Assigning credit to intermediate steps remains a central challenge in training Large Language Models (LLMs) on multi-step reasoning tasks with sparse...