arXiv Machine Learning

Regularised RL improves sim-to-real transfer

arXiv Machine Learning
Aug 11

V-Simba: Unleashing the Architectural Potential of RL in Visual Continuous Control

arXiv:2608. 07870v1 Announce Type: new Abstract: Improving sample efficiency remains a core challenge in reinforcement learning (RL), especially in real-world settings like robotics, where data collection is costly.

By Donghu Kim, Youngdo Lee, Hojoon Lee, Johan Obando-Ceron, Byungkun Lee, Aaron Courville, Pablo Samuel Castro, Jaegul Choo, Clare Lyle
arXiv AI
Aug 18

Contraction-Aware Reinforcement Learning for Nonlinear Control with Statistical Robustness

arXiv:2506. 15700v2 Announce Type: replace-cross Abstract: Control contraction metrics (CCMs)-defined by Riemannian metrics under which a closed-loop system is incrementally exponentially stable-offer a constructive framework for synthesizing contracting policies in nonlinear path-tracking problems.

By Minjae Cho, Hiroyasu Tsukamoto, Huy T. Tran
arXiv AI
Oct 31

Towards Batch-to-Streaming Deep Reinforcement Learning for Continuous Control

The paper introduces two new streaming deep reinforcement learning algorithms—Streaming Soft Actor-Critic (S2AC) and Streaming Deterministic Actor-Critic (SDAC)—designed to work with state‑of‑the‑art batch RL methods and suitable for on‑device fine‑tuning, such as Sim2Real transfer. These algorithms achieve performance comparable to existing streaming baselines on standard benchmarks without the need for extensive per‑environment hyperparameter tuning. The authors also examine the challenges of transitioning from batch to streaming RL, demonstrating that a naive approach can degrade pre‑trained policy performance and propose a principled solution to mitigate this issue.

By Riccardo De Monte, Matteo Cederle, Gian Antonio Susto