arXiv Machine Learning June 9, 2026 By Ousmane Amadou Dia

Variational Proximal Policy Optimization

Read the original on arXiv Machine Learning →

arXiv:2606. 08032v1 Announce Type: cross Abstract: Reinforcement Learning from Human Feedback via Proximal Policy Optimization often suffers from policy mode collapse, brittle exploration loops, and distribution drift.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI

Jul 24

Expert Behavior Prior Reinforcement Learning

arXiv:2607. 21302v1 Announce Type: new Abstract: Behavior prior reinforcement learning (BPRL) has emerged as a promising paradigm to improve sample efficiency in online reinforcement learning (RL) by leveraging policy priors derived from offline demonstrations.

By Gong Gao, Weidong Zhao, Xianhui Liu, Ning Jia

agents reinforcement-learning robotics benchmarks

arXiv AI

Jun 2

Implicit Drifting Policy: One-Step Action Generation via Conditional Expert Geometry

arXiv:2606. 01098v1 Announce Type: cross Abstract: Generative action policies based on diffusion or flow matching excel in behavior cloning, yet their iterative sampling is prohibitive for high-frequency robot control.

By Zemin Yang, Yaoyu He, Yiming Zhong, Yuhao Zhang, Xinge Zhu, Yao Mu, Qingqiu Huang, Yuexin Ma

diffusion robotics efficiency

arXiv AI

Jul 2

Selective Expert Guidance for Effective and Diverse Exploration in Reinforcement Learning of LLMs

arXiv:2510. 04140v2 Announce Type: replace Abstract: Reinforcement Learning with Verifiable Rewards (RLVR) has become a widely adopted technique for enhancing the reasoning ability of Large Language Models (LLMs).

By Zishang Jiang, Jinyi Han, Tingyun Li, Xinyi Wang, Sihang Jiang, Jiaqing Liang, Zhaoqian Dai, Shuguang Ma, Fei Yu, Yanghua Xiao

llms reinforcement-learning

arXiv AI

Aug 11

Parameter Exploration for RLVR via Variational Learning

arXiv:2608. 09805v1 Announce Type: cross Abstract: Exploration has been a focus of reinforcement learning research for a long time.

By Vatsal Venkatkrishna, Nico Daheim, Iryna Gurevych

llms reinforcement-learning

arXiv Machine Learning

Sep 18

Improving Online Reinforcement Learning via Bidirectional Behavior Prior Distillation

The paper introduces Bidirectional Behavior Prior Distillation (B2PD), a method that uses action‑value priors to train a conditional variational autoencoder for generating high‑value behavior support. These expert behavior priors are then distilled into the online reinforcement learning agent, reducing inefficient exploration and stabilizing policy updates. Experiments on state‑ and pixel‑based tasks show that B2PD improves sample efficiency while maintaining stable learning dynamics.

By Gong Gao, Xiao Lai, Jiaji Shen, Ning Jia, Xianhui Liu, Weidong Zhao

agents reinforcement-learning efficiency

arXiv Computation and Language

Sep 14

Expert-Space Exploration in MoE Reinforcement Learning

arXiv:2609.13058v1 Announce Type: new Abstract: Reinforcement learning (RL) has become central to post-training of large language models. Recent advances in RL for Mixture-of-Experts (MoE) models hav...

By Hongyi He, Zhenghao Lin, Xiao Liu, Peng Cheng, Yan Lu, Yeyun Gong

llms reinforcement-learning

One email a morning, machine-written

Related stories

Expert Behavior Prior Reinforcement Learning

Implicit Drifting Policy: One-Step Action Generation via Conditional Expert Geometry

Selective Expert Guidance for Effective and Diverse Exploration in Reinforcement Learning of LLMs

Parameter Exploration for RLVR via Variational Learning

Improving Online Reinforcement Learning via Bidirectional Behavior Prior Distillation

Expert-Space Exploration in MoE Reinforcement Learning