arXiv Machine Learning

Arrive and Survive: Scaling Safe Goal-Conditioned Policy Learning from One-Bit Failure Signals

The paper introduces Safe Contrastive Reinforcement Learning (Safe-CRL), a method that corrects bias in contrastive RL caused by failure-terminated Markov decision processes. By applying mass-weighted InfoNCE and a log-survival-mass score, Safe-CRL uses only a one-bit failure signal to improve survival and goal-reaching performance across twelve robot navigation and locomotion tasks. The approach demonstrates complex failure-avoidance behaviors and completes the theoretical foundation of contrastive RL under failure termination.

arXiv Machine Learning

Jul 13

SafeExplorer: An Unbiased Policy Gradient for Reinforcement Learning with Recovery Interventions

arXiv:2607. 08925v1 Announce Type: new Abstract: Training reinforcement-learning agents directly on physical robots makes every fall costly, since a fall can damage the platform and cannot be undone like a simulator reset; the goal is therefore to minimize falls during training rather than trade them off against return, as constrained Markov decision process (MDP) formulations do.

By Elham Daneshmand, Majid Khadiv, Glen Berseth, Hsiu-Chin Lin

agents reinforcement-learning robotics benchmarks safety

arXiv AI

Aug 25

Beyond Success and Failure: Length-Aware Contrastive Learning for GUI Agents

arXiv:2608.21830v1 Announce Type: new Abstract: Graphical User Interface (GUI) agents powered by Multimodal Large Language Models (MLLMs) have shown strong potential for automating tasks across diver...

By Chengyang Gu, Le Zhang, Jingbo Zhou, Yize Chen, Yu Shi, Siqi Bao, Zheng-Fan Wu, Hua Wu, Hui Xiong

llms agents reinforcement-learning multimodal benchmarks

arXiv Machine Learning

3d ago

Locally-Guided Actor-Critic: Training a Goal-conditioned Actor with a Subgoal-aware Critic

arXiv:2608.30406v1 Announce Type: new Abstract: Goal-conditioned reinforcement learning struggles with long horizons when rewards are sparse. While a planner can provide subgoals to guide a low-level...

By Olivier Serris, St\'ephane Doncieux, Olivier Sigaud

agents reinforcement-learning

arXiv Machine Learning

Jun 25

Consistent Zero-Shot Imitation with Contrastive Goal Inference

arXiv:2510. 17059v2 Announce Type: replace Abstract: Zero-shot imitation learning requires an agent to reproduce expert behavior from a single demonstration without additional environment interaction or gradient updates at test time.

By Kathryn Wantlin, Chongyi Zheng, Benjamin Eysenbach

agents reinforcement-learning benchmarks

arXiv AI

Jul 2

FAR: Failure-Aware Retry for Test-Time Recovery and Continual Policy Improvement

arXiv:2607. 01111v1 Announce Type: cross Abstract: Robot policies inevitably encounter failures when deployed in real environments.

By Haoran Hao, Shahram Najam Syed, Jeffrey Ichnowski, Jeff Schneider

diffusion robotics

arXiv AI

Aug 7

Autonomous Learning From Success and Failure: Goal-Conditioned Supervised Learning with Negative Feedback

arXiv:2509. 03206v2 Announce Type: replace-cross Abstract: Learning from reward functions and imitation learning of demonstrations are the two principal approaches for training autonomous systems that interact with an environment through action and observation.

By Zeqiang Zhang, Fabian Wurzberger, Gerrit Schmid, Sebastian Gottwald, Daniel A. Braun

agents

arXiv Machine Learning

Jul 10

Beyond Success Rates: Trainability and Extractability for Offline GCRL

arXiv:2602. 05459v2 Announce Type: replace Abstract: Offline goal-conditioned reinforcement learning (GCRL) is typically benchmarked by the best tuned success rate of each method.

By Jan Malte T\"opperwien, Aditya Mohan, Marius Lindauer

reinforcement-learning robotics

arXiv Machine Learning

Jun 11

UniIntervene: Agentic Intervention for Efficient Real-World Reinforcement Learning

arXiv:2606. 12372v1 Announce Type: cross Abstract: Human-in-the-loop reinforcement learning (HiL-RL) has emerged as an effective paradigm for real-world robotic manipulation, enabling online policy improvement with human guidance.

By Haoyuan Deng, Yitong Gao, Yudong Lin, Haichao Liu, Zhenyu Wu, Ziwei Wang

agents reinforcement-learning robotics benchmarks

arXiv AI

Jun 10

SHAPO: Sharpness-Aware Policy Optimization for Safe Exploration

arXiv:2606. 10228v1 Announce Type: cross Abstract: Safe exploration is a prerequisite for deploying reinforcement learning (RL) agents in safety-critical domains.

By Kaustubh Mani, Yann Pequignot, Vincent Mai, Liam Paull

agents reinforcement-learning safety

arXiv AI

Aug 12

Threat-guided Policy-aware Scene Perturbation for Safe Autonomous Driving with Online Reinforcement Learning

arXiv:2608. 10403v1 Announce Type: new Abstract: Reinforcement learning (RL) has shown promising performance in autonomous driving, yet ensuring the safety of online RL policies remains challenging due to insufficient exposure to safety-critical driving scenes.

By Xincong Hu (Nanjing University), Lei Ou (Nanjing University), Maosen Li (Yinwang Intelligent Technology Co., Ltd), Jingtao Zhang (Yinwang Intelligent Technology Co., Ltd), Liguo Hou (Yinwang Intelligent Technology Co., Ltd), Zongzhang Zhang (Nanjing University)

agents reinforcement-learning robotics benchmarks safety

arXiv AI

Jun 15

CSPO: Constraint-Sensitive Policy Optimization for Safe Reinforcement Learning

arXiv:2606. 14415v1 Announce Type: new Abstract: Safe reinforcement learning (Safe RL) aims to maximize expected return while satisfying safety constraints, typically modeled as Constrained Markov Decision Processes (CMDPs).

By Ayoub Belouadah, Sylvain Kubler, Yves Le Traon

reinforcement-learning robotics benchmarks safety

arXiv AI

Jul 10

Safe Flow Q-Learning: Offline Safe Reinforcement Learning with Reachability-Based Flow Policies

arXiv:2603. 15136v2 Announce Type: replace-cross Abstract: Offline safe reinforcement learning (RL) seeks reward-maximizing policies from static datasets under strict safety constraints.

By Mumuksh Tayal, Manan Tayal, Ravi Prakash

diffusion reinforcement-learning efficiency safety

Related stories