arXiv AI By Difan Jiao, Raghav Singhal, Robert West, Ashton Anderson

Tandem Reinforcement Learning with Verifiable Rewards

Read the original on arXiv AI →

arXiv:2606. 28166v1 Announce Type: new Abstract: Reinforcement learning with verifiable rewards (RLVR) has significantly improved the reasoning capability of large language models, reaching expert or even superhuman performance in domains such as competition math.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Sep 7

CoSkill: Joint Reinforcement Learning of Reasoning and Meta-Skill Agents for Hierarchical Skill Evolution

CoSkill introduces a unified multi‑agent reinforcement learning framework that jointly trains a Reasoning Agent and a learnable Meta‑Skill Agent over a hierarchical skill library. By treating the meta‑skill workflow as a trainable agent and sharing a single backbone, CoSkill enables end‑to‑end co‑adaptation, allowing the Reasoning Agent to condition actions on retrieved task and step skills while the Meta‑Skill Agent refines those skills based on task performance. Experiments on ALFWorld and WebShop demonstrate that CoSkill outperforms prior skill‑based and RL baselines, achieving higher success rates and improved sample, asymptotic, and wall‑clock efficiency.

By Jinyuan Feng, Dongmin Li, Yiqun Chen, Yang Gao, Xing Chen, Huimu Wang, Zhiqiang Pu
arXiv AI
Sep 10

To Mix or To Merge: Toward Multi-Domain Reinforcement Learning for Large Language Models

The paper investigates how to apply Reinforcement Learning with Verifiable Rewards (RLVR) to large language models across multiple domains. It compares two training paradigms—mixed multi-task RLVR and separate RLVR followed by model merging—using tasks such as math, coding, science, instruction following, and agent. Experiments show that RLVR across domains causes minimal interference and that reasoning-intensive domains can synergize, with insights drawn from information constraints, prediction behavior, and self-verification.

By Haoqing Wang, Xiang Long, Ziheng Li, Yilong Xu, Tingguang Li, Yehui Tang
arXiv Machine Learning
Jun 9

RLVE: Scaling Up Reinforcement Learning for Language Models with Adaptive Verifiable Environments

arXiv:2511. 07317v2 Announce Type: replace-cross Abstract: We introduce Reinforcement Learning (RL) with Adaptive Verifiable Environments (RLVE), an approach using verifiable environments that procedurally generate problems and provide algorithmically verifiable rewards, to scale up RL for language models (LMs).

By Zhiyuan Zeng, Hamish Ivison, Yiping Wang, Lifan Yuan, Shuyue Stella Li, Zhuorui Ye, Siting Li, Jacqueline He, Runlong Zhou, Tong Chen, Chenyang Zhao, Yulia Tsvetkov, Simon Shaolei Du, Natasha Jaques, Hao Peng, Pang Wei Koh, Hannaneh Hajishirzi