arXiv Machine Learning July 7, 2026 By Chee Heng Tan, Zhuoyi Lin, Mehul Motani, Wee Sun Lee

On the effectiveness of reward functions in reinforcement learning for confidence calibration of large language models

Read the original on arXiv Machine Learning →

arXiv:2607. 04332v1 Announce Type: new Abstract: In this paper, we consider the setting where large language models (LLMs) are trained using reinforcement learning (RL) to simultaneously improve reasoning accuracy and verbalize its confidence.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning

Aug 11

Process Supervision of Confidence Margin for Calibrated LLM Reasoning

arXiv:2604. 23333v2 Announce Type: replace Abstract: Scaling test-time computation with reinforcement learning (RL) has emerged as a reliable path to improve large language models (LLM) reasoning ability.

By Liaoyaqi Wang, Chunsheng Zuo, William Jurayj, Benjamin Van Durme, Anqi Liu

llms reinforcement-learning benchmarks safety

arXiv AI

Jul 3

Scaling with Confidence: Calibrating Confidence of LLMs for Adaptive Test Time Scaling

arXiv:2607. 01612v1 Announce Type: new Abstract: Training large language models (LLMs) with reinforcement learning (RL) has significantly advanced their performance on reasoning and question-answering tasks.

By Xuqing Yang, Yi Yuan, Shanzhe Lei, Xuhong Wang

llms reinforcement-learning multimodal benchmarks

arXiv Machine Learning

Jun 9

ConSteer-RL: Steering Reasoning Capabilities in Large Language Models via Confidence-Aware Reinforcement Learning

arXiv:2606. 08088v1 Announce Type: new Abstract: Reinforcement Learning from Verifiable Rewards (RLVR) has recently become a key paradigm for improving the reasoning abilities of Large Language Models (LLMs), yet it remains limited by sparse binary rewards and its ignorance of model-internal uncertainty.

By Qing Miao, Yiming Zhao, Jing Yang, Chenxi Liu, Yuehai Chen, Yuewen Liu, Shaoyi Du, Badong Chen

llms reinforcement-learning

arXiv AI

Jul 7

Gradient Regularization Mitigates Reward Hacking in Reinforcement Learning from Human Feedback and Verifiable Rewards

arXiv:2602. 18037v2 Announce Type: replace-cross Abstract: Reinforcement Learning from Human Feedback (RLHF) or Verifiable Rewards (RLVR) are two key steps in the post-training of modern Language Models (LMs).

By Johannes Ackermann, Michael Noukhovitch, Takashi Ishida, Masashi Sugiyama

llms reinforcement-learning safety

arXiv AI

Aug 18

Delay, Plateau, or Collapse: Evaluating the Impact of Systematic Verification Error on RLVR

arXiv:2605. 02909v2 Announce Type: replace-cross Abstract: Reinforcement Learning with Verifiable Rewards (RLVR) has become a powerful approach for improving the reasoning capabilities of large language models (LLMs).

By Kazuki Egashira, Mark Vero, Jasper Dekoninck, Florian E. Dorner, Robin Staab, Martin Vechev

llms reinforcement-learning

arXiv Computation and Language

Sep 1

Small Reward Models via Backward Inference

arXiv:2602.13551v3 Announce Type: replace Abstract: Reward models (RMs) play a central role throughout the language model (LM) pipeline, particularly in non-verifiable domains. However, the dominant...

By Yike Wang, Faeze Brahman, Shangbin Feng, Teng Xiao, Hannaneh Hajishirzi, Yulia Tsvetkov

llms reinforcement-learning

One email a morning, machine-written

Related stories

Process Supervision of Confidence Margin for Calibrated LLM Reasoning

Scaling with Confidence: Calibrating Confidence of LLMs for Adaptive Test Time Scaling

ConSteer-RL: Steering Reasoning Capabilities in Large Language Models via Confidence-Aware Reinforcement Learning

Gradient Regularization Mitigates Reward Hacking in Reinforcement Learning from Human Feedback and Verifiable Rewards

Delay, Plateau, or Collapse: Evaluating the Impact of Systematic Verification Error on RLVR

Small Reward Models via Backward Inference