arXiv AI
Aug 21
Adaptive Probabilistic Shielding by Learning MDPs for Safe Reinforcement Learning
arXiv:2608. 19836v1 Announce Type: cross Abstract: Probabilistic shielding is a technique for safe reinforcement learning (RL).
Safe Reinforcement Learning via Recovery-based Shielding with Gaussian Process Dynamics Models
The paper presents a recovery‑based shielding framework that guarantees a provable safety lower bound for reinforcement learning in unknown, non‑linear continuous dynamical systems. It combines a backup policy (shield) with the RL agent and uses Gaussian process models to quantify uncertainty and predict safety violations, enabling dynamic recovery to safe trajectories only when needed. The shielded agent’s experience trains the GP models, and policy optimization is performed via internal model‑based sampling, allowing unrestricted exploration and sample‑efficient learning while maintaining strict safety compliance in continuous control tasks.
Related stories
arXiv AI
Jun 2
Robust Shielding for Safe Reinforcement Learning
arXiv:2606. 00270v1 Announce Type: new Abstract: Shielding is an effective approach to formally guarantee the safety of reinforcement learning agents in Markov decision processes (MDPs).
arXiv AI
Oct 12
Sampling-Based Safe Reinforcement Learning
Sampling-Based Safe Reinforcement Learning (SBSRL) is a model‑based RL algorithm that enforces safety by jointly constraining a finite set of dynamics samples, approximating a worst‑case optimization over uncertain dynamics. It introduces an exploration strategy that limits epistemic uncertainty, removing the need for explicit exploration bonuses. The authors provide high‑probability safety guarantees and a finite‑time sample complexity bound, and demonstrate safe, efficient exploration in both simulation and real robotic hardware, with extensions to deep‑ensemble implementations for high‑dimensional continuous control.
arXiv AI
Oct 19
RECREG: Recovery-based Shielding for Regular Safety Properties in Reinforcement Learning
The paper introduces RecReg, a safe reinforcement learning framework that enforces non‑Markovian regular safety properties through recovery‑based shielding. It provides theoretical foundations and rigorous safety and convergence guarantees in the tabular setting, and demonstrates empirical effectiveness using the MASA‑Safe‑RL library. The authors also outline an extension of RecReg to deep RL with state‑of‑the‑art model‑based methods.
arXiv AI
Jun 16
Safe Exploration via Policy Priors
arXiv:2601. 19612v3 Announce Type: replace-cross Abstract: Safe exploration is a key requirement for reinforcement learning (RL) agents to learn and adapt online, beyond controlled (e.
arXiv Machine Learning
Jul 9
Safe Reinforcement Learning using Ideas from Model Predictive Control
arXiv:2607. 07252v1 Announce Type: new Abstract: Reinforcement learning (RL) enables the synthesis of control policies directly from data, making it highly appealing for complex cyber-physical systems (CPSs) and robotics.
Hugging Face Trending Papers
Jul 8
Safe Reinforcement Learning using Ideas from Model Predictive Control
Reinforcement learning (RL) enables the synthesis of control policies directly from data, making it highly appealing for complex cyber-physical systems (CPSs) and robotics. A persistent challenge, however, is ensuring strict, hard safety constraints during the active learning phase.
arXiv Machine Learning
Sep 15
Safe Meta-Reinforcement Learning via Information Space Reachability
arXiv:2609.15915v1 Announce Type: new Abstract: Meta-reinforcement learning (meta-RL) enables agents to adapt to unseen tasks with limited experience. Despite its promise, the application of meta-RL...
arXiv Machine Learning
Jun 2
All Models are Wrong, Knowing Where is Useful: On Model Uncertainty in Reinforcement Learning
arXiv:2606. 01363v1 Announce Type: new Abstract: Model-based reinforcement learning (MBRL) infers information about the environment from a learned dynamics model and bears the potential to address open problems such as data efficient and safe learning in robotics.
arXiv Machine Learning
Aug 11
Uncertainty-Aware Predictive Safety Filters for Probabilistic Neural Network Dynamics
arXiv:2604. 26836v3 Announce Type: replace Abstract: Predictive safety filters (PSFs) leverage model predictive control to enforce constraint satisfaction during deep reinforcement learning (RL) exploration, yet their reliance on first-principles models or Gaussian processes limits scalability and broader applicability.
arXiv AI
Jun 10
SHAPO: Sharpness-Aware Policy Optimization for Safe Exploration
arXiv:2606. 10228v1 Announce Type: cross Abstract: Safe exploration is a prerequisite for deploying reinforcement learning (RL) agents in safety-critical domains.
arXiv AI
Jun 12
PolicyGuard: Towards Test-time and Step-level Adversary Defense for Reinforcement Learning Agent
arXiv:2606. 12896v1 Announce Type: cross Abstract: While real-world applications of reinforcement learning (RL) are becoming increasingly popular, the security of RL systems deserve more attention and exploration.