arXiv Machine Learning

Enumeration-Guided Training of Neural Hamilton-Jacobi Safety Certificates

arXiv AI
Sep 24

Turning Safety into Competence: Minimally Exploitable Robot Policies via Safety-Filtered Reinforcement Learning

The paper introduces Safety to Competence (S2C), a two‑stage reinforcement learning framework that first learns a safety filter and then trains a competitive task policy while embedding the filter. By separating safety synthesis from task learning, S2C reduces training complexity and prevents the policy from being exploited by adversarial attacks. Experiments on simulated touchdown games show that S2C achieves higher win rates, better Elo ratings, and lower exploitability than eight safe‑RL baselines, and hardware tests confirm its competence against a human opponent.

By Ruihan Wu, Rui Yang, Donggeon David Oh, Duy Nguyen, Haimin Hu
arXiv Machine Learning
Aug 11

Uncertainty-Aware Predictive Safety Filters for Probabilistic Neural Network Dynamics

arXiv:2604. 26836v3 Announce Type: replace Abstract: Predictive safety filters (PSFs) leverage model predictive control to enforce constraint satisfaction during deep reinforcement learning (RL) exploration, yet their reliance on first-principles models or Gaussian processes limits scalability and broader applicability.

By Bernd Frauenknecht, Lukas Kesper, Daniel Mayfrank, Henrik Hose, Sebastian Trimpe
arXiv Machine Learning
Sep 24

LEAP-CBF: A Safety Filter for Uncertain Systems with Least-Effort Adversarial Potentials

The paper introduces LEAP-CBF, a safety filter that uses Least‑Effort Adversarial Potentials to quantify how much disturbance effort is needed to cause failure in nonlinear dynamical systems. LEAP serves as a control barrier function for the undisturbed system and can be combined with a robust safety filter that tolerates disturbances with bounded cumulative effort. The authors develop a deep reinforcement learning method to construct LEAPs and validate their effectiveness through simulations of multi‑agent systems and hardware experiments on a quadruped and quadrotors.

By Oswin So, Eric Yu, Chuchu Fan
arXiv AI
Oct 26

SEVI: Safe Evidential Real-World Reinforcement Learning

SEVI (Safe Evidential Real-World Reinforcement Learning) is a framework that adds a safety intervention layer to real‑world policy learning. It uses an Evidential Safety Critic to estimate both future constraint‑violation risk and epistemic uncertainty in a single forward pass, and overrides unsafe or poorly supported actions with an offline‑trained recovery policy. Experiments on simulated manipulation tasks and a real‑world USB insertion task show that SEVI improves trajectory‑level safety prediction, task success, and reduces unsafe events by 13.4–57.1% compared to other safe RL baselines.

By Shaekh Mohammad Shithil, Lantao Liu