Reinforcement learning

Policy optimisation, reward modelling and RLHF — how models are trained by feedback rather than by labels.

7,004 stories · RSS feed

arXiv Machine Learning

Jul 22

A Self-Evolving Default Action for Cooperative Tasks with Continuous Action Space

arXiv:2607. 18597v1 Announce Type: new Abstract: Counterfactual credit assignment has proven effective in multi-agent reinforcement learning (MARL) for discrete action spaces, yet its extension to continuous-action cooperative tasks remains challenging.

By Shuangyao Huang

agents reinforcement-learning benchmarks safety

arXiv AI

Jul 22

Comparative Study of Multi-Agent Actor-Critic Algorithms in Parameterized Action Reinforcement Learning

arXiv:2607. 19117v1 Announce Type: new Abstract: Parameterized action reinforcement learning has shown strong performance in environments requiring both discrete action selection and continuous parameterization.

By Ubayd Ali Bapoo, Clement N Nyirenda

agents reinforcement-learning benchmarks

arXiv AI

Jul 22

Measuring Reward-Seeking via Contrastive Belief Updates

arXiv:2607. 18966v1 Announce Type: new Abstract: Language models trained with reinforcement learning may learn to optimize the grader's judgment rather than the intended objective.

By Axel H{\o}jmark, J\'er\'emy Scheurer, Evgenia Nitishinskaya, Felix Hofst\"atter, Jason Wolfe, Theodore Ehrenborg, Bronson Schoen, Alexander Meinke

llms reinforcement-learning fine-tuning safety

arXiv AI

Jul 22

AgentJet: A Distributed Swarm Training Framework for Agentic Reinforcement Learning

arXiv:2606. 04484v2 Announce Type: replace Abstract: Training reinforcement learning (RL) policies for large language model (LLM) agents requires optimizing multi-turn trajectories that interact with external environments.

By Qingxu Fu, Boyin Liu, Shuchang Tao, Zhaoyang Liu, Cheng Chen, Xuanfa Jin, Rong Zhu, Bolin Ding

llms agents reinforcement-learning

arXiv AI

Jul 22

Toward Learning POMDPs Beyond Full-Rank Actions and State Observability

arXiv:2601. 18930v4 Announce Type: replace-cross Abstract: We are interested in enabling autonomous agents to learn and reason about systems with hidden states, such as locking mechanisms.

By Seiji Shaw, Travis Manderson, Chad Kessens, Nicholas Roy

agents reinforcement-learning

arXiv AI

Jul 22

Preference-Conditioned Multi-Objective Reinforcement Learning for Runtime-Tunable Transit Signal Priority

arXiv:2607. 18286v1 Announce Type: cross Abstract: Transit signal priority (TSP) requires balancing competing objectives: reducing bus delay while limiting adverse impacts on non-bus traffic and avoiding extreme waits for a subset of vehicles.

By Philip-Roman Adam, Stefanie Schmidtner

reinforcement-learning

arXiv Machine Learning

Jul 22

H$^2$SD: Hybrid Hindsight Self-Distillation

arXiv:2607. 18955v1 Announce Type: new Abstract: Reinforcement learning with verifiable rewards (RLVR) has substantially improved the reasoning capabilities of large language models on tasks such as mathematical reasoning and code generation.

By Qiye Cai, Yichuan Ma, Linyang Li, Peiji Li, Yongkang Chen, Qipeng Guo, Yicheng Zou, Tao Gui, Xiaocheng Feng, Bing Qin

llms reinforcement-learning efficiency benchmarks

arXiv AI

Jul 22

Copy Less, Ground More: Overcoming Repetitive Copying in Long-Context Reasoning via Evidence-Aware Reinforcement Learning

arXiv:2607. 19345v1 Announce Type: cross Abstract: Large language models that generate step-by-step reasoning traces have achieved strong performance on complex tasks, and extending them to long-context settings has emerged as an important frontier.

By Lizhe Fang, Weizhou Shen, Tianyi Tang, Yisen Wang

llms reinforcement-learning benchmarks

arXiv AI

Jul 22

Fishing Out Free Riders: Shapley-Based Reward Attribution for Parallel Reasoning via Reinforcement Learning

arXiv:2607. 18979v1 Announce Type: new Abstract: Large Language Models (LLMs) excel at multi-step reasoning, yet current parallel reasoning approaches often fail to distinguish the contributions of individual reasoning paths.

By Wentao Zhang, Haoyu Zhang, Xinke Jiang, Yuxuan Cheng, Yuhan Pan, Miao Li, Zhipeng Qiao, Tao Feng, Zhen Tao, Dengji Zhao

llms reinforcement-learning benchmarks

arXiv Machine Learning

Jul 22

JD-BP: A Joint-Decision Generative Framework for Auto-Bidding and Pricing

arXiv:2604. 05845v2 Announce Type: replace-cross Abstract: Auto-bidding services optimize real-time bidding strategies for advertisers under key performance indicator (KPI) constraints such as target return on investment and budget.

By Linghui Meng, Chun Gan, Shengsheng Niu, Chengcheng Zhang, Chenchen Li, Chuan Yang, Yi Mao, Xin Zhu, Jie He, Zhangang Lin, Ching Law

reinforcement-learning benchmarks safety

arXiv AI

Jul 22

Reasoning Before Translation: Enhancing Legal Machine Translation with Structured Reasoning

arXiv:2607. 19181v1 Announce Type: cross Abstract: Neural machine translation (NMT) in the legal domain is a linguistically and conceptually demanding task, primarily due to the complexity of legal language and the high level of precision it requires.

By Aixiu An, Michael Jungo, Eloi Eynard, Mark Drenhaus, Andreas Fischer, Jean Hennebert, S\'ebastien Rumley

llms nlp reinforcement-learning fine-tuning benchmarks

arXiv Machine Learning

Jul 22

Conservative Query and Adaptive Regularization for Offline RL Under Uncertainty Estimation

arXiv:2607. 19199v1 Announce Type: new Abstract: Offline reinforcement learning (RL) aims to learn an effective policy from a static dataset, but its performance is fundamentally limited by dataset coverage.

By Li-Rong Zhou, Qin-Wen Luo, Sheng-Jun Huang

reinforcement-learning benchmarks

arXiv AI

Jul 22

Intelligent Multi-UAV Navigation in ITNTNs: A Hierarchical LLM Approach

arXiv:2607. 18604v1 Announce Type: cross Abstract: The deployment of high-speed Uncrewed Aerial Vehicles (UAVs) in 3D aerial highways necessitates robust coordination of physical flight kinematics and multi-tier network handovers.

By Zijiang Yan, Hao Zhou, Wael Jaafar, Jianhua Pei, Ping Wang, Halim Yanikomeroglu, Hina Tabassum

llms agents reinforcement-learning efficiency

arXiv Machine Learning

Jul 22

Scalable Policy Optimization for Networked Multi-Agent Reinforcement Learning with Continuous State-Action Spaces

arXiv:2607. 18554v1 Announce Type: cross Abstract: We develop the Continuous Distributed Coupled Policy Gradient (CDCPG) algorithm for cooperative reinforcement learning in networked Markov decision processes with continuous state and action spaces.

By Dongming Wang, Pengcheng Dai, Wenwu Yu, Wei Ren

agents reinforcement-learning benchmarks

arXiv Machine Learning

Jul 22

Reinforcement Learning for Delivery Drone-Based Participatory Sensing in Dynamic Environments

arXiv:2607. 18874v1 Announce Type: new Abstract: Using Unmanned Aerial Vehicle (UAV) for urban sensing has emerged as a powerful paradigm to monitor the status of the city, e.

By Xin Ouyang, Songxin Lei, Xusen Guo, Yutian Jiang, Sijie Ruan, Yuxuan Liang

rag reinforcement-learning robotics

arXiv AI

Jul 22

Circuit Claims Depend on What Is Extracted and How It Is Compared

arXiv:2607. 18921v1 Announce Type: cross Abstract: Circuit extraction identifies a small set of model components whose presence preserves a target behavior under ablation, and the resulting circuit is often read as the mechanism behind that behavior.

By Yang Sheng, Jie Fu

llms reinforcement-learning efficiency benchmarks

arXiv AI

Jul 22

Athena-Brain Technical Report: An Efficient Robot Brain for General Intelligence and Embodied Interactio

arXiv:2607. 18985v1 Announce Type: new Abstract: Large language models (LLMs) have demonstrated remarkable capabilities in language understanding, reasoning, and world knowledge.

By Jialian Li, Junhong Liu, Yuchen Cao, Weiran Guo, Jiaming Song, Xutao Wang, Yi Zhao, Jiangpin Liu, Jie Chen

llms agents reinforcement-learning robotics fine-tuning benchmarks

arXiv Machine Learning

Jul 22

TD-DPO: Difference-Aware Preference Optimization for Mitigating Sycophancy in Clinical Autism Intervention Dialogue

arXiv:2607. 18304v1 Announce Type: new Abstract: The sycophancy of large language models can increase the safety risk in intervention dialogue for autistic children.

By Shuzhong Lai, Junhong Lai, Chenxi Li, Qing Zhou, Haifeng Li, Gang Pan, Lin Yao, Yueming Wang

llms reinforcement-learning fine-tuning safety

arXiv AI

Jul 22

ISO: An RLVR-Native Optimization Stack

arXiv:2607. 19331v1 Announce Type: cross Abstract: Reinforcement learning with verifiable rewards (RLVR) is rapidly advancing the reasoning capabilities of language models, yet the optimization layer that converts reward feedback into weight-space updates remains poorly understood.

By Hanqing Zhu, Wenyan Cong, Zhizhou Sha, Sagnik Mukherjee, Xinyuan Song, David Gonz\'alez-Mart\'inez, Xiaoxia Wu, Yuandong Tian, Shiwei Liu, David Z. Pan, Zhangyang "Atlas" Wang

llms reinforcement-learning efficiency

arXiv Machine Learning

Jul 22

HERAKLES: Hierarchical Skill Compilation for Open-ended LLM Agents

arXiv:2508. 14751v2 Announce Type: replace Abstract: We study goal-conditioned reinforcement learning in partially observable environments with sparse rewards and large, structured goal spaces.

By Thomas Carta, Cl\'ement Romac, Loris Gaven, Pierre-Yves Oudeyer, Olivier Sigaud, Sylvain Lamprier

llms agents reinforcement-learning

Get the daily briefing