arXiv Machine Learning
Aug 4
CriPO: Enhancing Rubric-based RL via Self-Distillation
arXiv:2607. 18082v3 Announce Type: replace Abstract: Rubric-based RL has recently shown promise in improving LLMs on open-ended tasks.
The Mechanism Matters: When Knowledge Graphs Help Reinforcement Learning
arXiv:2607. 19616v1 Announce Type: new Abstract: Knowledge graphs (KGs) are widely used to inject prior knowledge into reinforcement learning (RL), yet the literature is dominated by single-domain, positive-result method papers, so we lack a systematic account of when KG structure helps an agent, when it is neutral, and when it hurts.
Related stories
arXiv AI
Jul 21
Enhancing Rubric-based RL via Self-Distillation
arXiv:2607. 18082v1 Announce Type: cross Abstract: Rubric-based RL has recently shown promise in improving LLMs on open-ended tasks.
arXiv AI
Jul 9
RLVP: Penalize the Path, Reward the Outcome
arXiv:2607. 07435v1 Announce Type: cross Abstract: Agents acting on our behalf in the real world (e.
arXiv Machine Learning
Jun 3
Skill-RM: Unifying Heterogeneous Evaluation Criteria via Agent Skill
arXiv:2606. 03980v1 Announce Type: new Abstract: Reward models (RMs) provide critical feedback signals for LLM post-training, notably in reinforced fine-tuning (RFT) and reinforcement learning (RL) pipelines.
arXiv AI
Jul 15
Knowledge- and Gradient-Guided Reinforcement Learning for Parametrized Action Markov Decision Processes
arXiv:2607. 12924v1 Announce Type: new Abstract: In this paper, we study Reinforcement Learning in Parametrized Action Markov Decision Processes (PAMDP), where each decision consists of a symbolic action and numerical parameters.
arXiv AI
Jun 2
ReSkill: Reconciling Skill Creation with Policy Optimization in Agentic RL
arXiv:2606. 01619v1 Announce Type: new Abstract: Agentic reinforcement learning (RL) enables LLM agents to improve continuously from environment rewards, yet the resulting policies do not systematically accumulate reusable strategies that generalize across tasks.
arXiv AI
Jul 24
When RLVR Shrinks the Reasoning Boundary: Diagnosing Pass@k Inversion
arXiv:2607. 20543v1 Announce Type: cross Abstract: Reinforcement learning with verifiable rewards (RLVR) can improve one-sample accuracy while making a model worse under repeated sampling.
arXiv AI
Jun 18
Learning from Own Solutions: Self-Conditioned Credit Assignment for Reinforcement Learning with Verifiable Rewards
arXiv:2606. 18810v1 Announce Type: cross Abstract: Reinforcement learning with verifiable rewards (RLVR) has driven substantial progress in training LLMs for reasoning tasks, but representative methods such as GRPO assign uniform credit across all tokens, wasting gradient on routine tokens while under-crediting pivotal reasoning steps.
arXiv AI
Jun 15
Unsupervised Learning of Efficient Exploration: Pre-training Adaptive Policies via Self-Imposed Goals
arXiv:2601. 19810v2 Announce Type: replace-cross Abstract: Unsupervised pre-training can equip reinforcement learning agents with prior knowledge and accelerate learning in downstream tasks.
arXiv AI
Aug 5
Agentic Reinforcement Learning with Self-Distilled Reward Shaping
arXiv:2608. 03223v1 Announce Type: cross Abstract: Agentic reinforcement learning enables LLM agents to learn through interaction, but sparse trajectory-level rewards reveal success without identifying which intermediate decisions deserve credit.
arXiv AI
Aug 10
ResidencyRL: Reinforcement Learning in Simulated Clinical Environments
arXiv:2608. 07418v1 Announce Type: new Abstract: In medical education, physicians convert academic knowledge into clinical expertise through residency: years of training across thousands of encounters, with diverse sources of feedback and progressively greater autonomy.
arXiv Machine Learning
Jun 16
ExpRL: Exploratory RL for LLM Mid-Training
arXiv:2606. 17024v1 Announce Type: new Abstract: Sparse reward reinforcement learning (RL) has become a standard tool for improving LLM reasoning, but its success depends critically on the coverage present in the base model.