arXiv Machine Learning June 25, 2026 By Guozheng Ma, Lu Li, Zilin Wang, Pierre-Luc Bacon, Dacheng Tao

Beyond One-Size-Fits-All: Diagnosis-Driven Online Reinforcement Learning with Offline Priors

Read the original on arXiv Machine Learning →

arXiv:2606. 25527v1 Announce Type: new Abstract: Online reinforcement learning (RL) agents increasingly depend on knowledge acquired offline to achieve practical efficiency.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning

4d ago

From Static Policies to Adaptive Priors in Offline Reinforcement Learning

arXiv:2609.35880v1 Announce Type: new Abstract: Offline reinforcement learning (RL) has traditionally focused on learning policies for direct deployment under conservative objectives, where uncertain...

By Tianwei Ni, Vineet Jain, Akash Karthikeyan, Pierre-Luc Bacon

reinforcement-learning fine-tuning

arXiv Machine Learning

Jun 16

Efficient Reinforcement Learning by Guiding World Models with Non-Curated Data

arXiv:2502. 19544v3 Announce Type: replace Abstract: Leveraging offline data is a promising way to improve the sample efficiency of online reinforcement learning (RL).

By Yi Zhao, Aidan Scannell, Wenshuai Zhao, Yuxin Hou, Tianyu Cui, Le Chen, Dieter B\"uchler, Arno Solin, Juho Kannala, Joni Pajarinen

reinforcement-learning robotics fine-tuning

arXiv AI

Jul 7

The Three Regimes of Offline-to-Online Reinforcement Learning

arXiv:2510. 01460v4 Announce Type: replace-cross Abstract: Offline-to-online reinforcement learning (RL) has emerged as a practical paradigm that leverages offline datasets for pretraining and online interactions for fine-tuning.

By Lu Li, Tianwei Ni, Yihao Sun, Pierre-Luc Bacon

reinforcement-learning fine-tuning

arXiv Machine Learning

Sep 18

Improving Online Reinforcement Learning via Bidirectional Behavior Prior Distillation

The paper introduces Bidirectional Behavior Prior Distillation (B2PD), a method that uses action‑value priors to train a conditional variational autoencoder for generating high‑value behavior support. These expert behavior priors are then distilled into the online reinforcement learning agent, reducing inefficient exploration and stabilizing policy updates. Experiments on state‑ and pixel‑based tasks show that B2PD improves sample efficiency while maintaining stable learning dynamics.

By Gong Gao, Xiao Lai, Jiaji Shen, Ning Jia, Xianhui Liu, Weidong Zhao

agents reinforcement-learning efficiency

arXiv Machine Learning

Jul 14

Reinforcement Learning in the Real World: A Survey of Statistical Challenges and Future Directions

arXiv:2601. 15353v2 Announce Type: replace-cross Abstract: Reinforcement learning (RL) has achieved remarkable success in real-world decision-making across diverse domains, including gaming, robotics, online advertising, public health, and natural language processing.

By Asim H. Gazi, Yongyi Guo, Daiqi Gao, Ziping Xu, Kelly W. Zhang, Susan A. Murphy

agents nlp reinforcement-learning robotics

arXiv Machine Learning

Aug 24

Decoupling Policy Extraction for Offline Reinforcement Learning

arXiv:2608.20909v1 Announce Type: new Abstract: Offline RL methods commonly jointly train the actor and critic, where the critic is used to guide the actor toward higher-value actions. This coupled l...

By Xuyao Lin, Yixiang Shan, Jinru Duan, Tao Yang, Xinyu Zhao, Runyu Lei, Yiming Zhao, Jiaxin Fan, Zongbao Feng, Peng Jia

rag reinforcement-learning

One email a morning, machine-written

Related stories

From Static Policies to Adaptive Priors in Offline Reinforcement Learning

Efficient Reinforcement Learning by Guiding World Models with Non-Curated Data

The Three Regimes of Offline-to-Online Reinforcement Learning

Improving Online Reinforcement Learning via Bidirectional Behavior Prior Distillation

Reinforcement Learning in the Real World: A Survey of Statistical Challenges and Future Directions

Decoupling Policy Extraction for Offline Reinforcement Learning