Hugging Face Trending Papers July 13, 2026

Active Offline-to-Online Reinforcement Learning

Read the original on Hugging Face Trending Papers →

Background: Offline reinforcement learning (RL) enables effective policies to be trained from large, previously collected datasets and subsequently improved through limited online interaction. This offline-to-online RL (O2O-RL) paradigm is particularly promising in nonstationary domains where interaction is costly or potentially hazardous.

Summary generated by The Flow from the publisher's feed. The full article lives at Hugging Face Trending Papers.

arXiv AI

Jul 14

Active Offline-to-Online Reinforcement Learning

arXiv:2607. 11720v1 Announce Type: cross Abstract: Background: Offline reinforcement learning (RL) enables effective policies to be trained from large, previously collected datasets and subsequently improved through limited online interaction.

By Alper Kamil Bozkurt, Shangtong Zhang, Yuichi Motai

reinforcement-learning fine-tuning

arXiv AI

Jul 7

The Three Regimes of Offline-to-Online Reinforcement Learning

arXiv:2510. 01460v4 Announce Type: replace-cross Abstract: Offline-to-online reinforcement learning (RL) has emerged as a practical paradigm that leverages offline datasets for pretraining and online interactions for fine-tuning.

By Lu Li, Tianwei Ni, Yihao Sun, Pierre-Luc Bacon

reinforcement-learning fine-tuning

arXiv Machine Learning

Jun 16

Efficient Reinforcement Learning by Guiding World Models with Non-Curated Data

arXiv:2502. 19544v3 Announce Type: replace Abstract: Leveraging offline data is a promising way to improve the sample efficiency of online reinforcement learning (RL).

By Yi Zhao, Aidan Scannell, Wenshuai Zhao, Yuxin Hou, Tianyu Cui, Le Chen, Dieter B\"uchler, Arno Solin, Juho Kannala, Joni Pajarinen

reinforcement-learning robotics fine-tuning

arXiv AI

Jul 23

Leveraging Offline Supervision for Efficient and Generalizable Reinforcement Learning in Large-Scale Vision-Language-Action Models

arXiv:2607. 19399v1 Announce Type: cross Abstract: It is commonly observed that online reinforcement learning (RL) produces better-performing strategies than offline methods across a broad range of performance measures.

By Dmitriy Poyarkov, Aleksei Staroverov, Aleksandr I. Panov

reinforcement-learning fine-tuning multimodal benchmarks

arXiv AI

Aug 12

Critic-Free Pretraining for Efficient Online Reinforcement Learning Fine-Tuning

arXiv:2608. 10473v1 Announce Type: cross Abstract: Offline-to-online (O2O) reinforcement learning aims to leverage policies pretrained on static datasets while improving them through online interaction.

By Daoyi Li, Yixian Zhang, Chao Yu, Wenbo Ding, Yu Wang

reinforcement-learning fine-tuning

arXiv Machine Learning

Jun 17

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach

arXiv:2510. 19528v2 Announce Type: replace-cross Abstract: We investigate the fundamental problem of leveraging offline data to accelerate online reinforcement learning - a direction with strong potential but limited theoretical grounding.

By Sebastian Reboul, H\'el\`ene Halconruy

reinforcement-learning fine-tuning

Related stories

Active Offline-to-Online Reinforcement Learning

The Three Regimes of Offline-to-Online Reinforcement Learning

Efficient Reinforcement Learning by Guiding World Models with Non-Curated Data

Leveraging Offline Supervision for Efficient and Generalizable Reinforcement Learning in Large-Scale Vision-Language-Action Models

Critic-Free Pretraining for Efficient Online Reinforcement Learning Fine-Tuning

Learning Upper Lower Value Envelopes to Shape Online RL: A Principled Approach