The paper introduces Counterfactual KKT (CF‑KKT), a framework that learns unknown constraints from locally optimal demonstrations without requiring known dynamics or risky exploration. CF‑KKT uses a learned differentiable dynamics model to apply KKT‑inspired optimality conditions and generates counterfactual behaviors that reveal infeasible data, enabling safer and more data‑efficient constraint recovery. Experiments on high‑dimensional robotic control tasks show that neural constraint representations learned with CF‑KKT achieve better safety and data efficiency than state‑of‑the‑art offline inverse constrained reinforcement learning baselines.
arXiv:2602.16543v2 Announce Type: replace Abstract: Safe reinforcement learning (Safe RL) learns robotic controllers that optimize task rewards under safety constraints, yet observation perturbations...
arXiv:2607. 12784v1 Announce Type: cross Abstract: Reinforcement Learning has revolutionized the landscape of robotic research, allowing robust learning of complex robotic skills in simulation.
arXiv:2609.36851v1 Announce Type: new Abstract: End-to-end autonomous driving policies are commonly trained via imitation learning on logged demonstrations without observing the consequences of their...
arXiv:2410. 24035v2 Announce Type: replace-cross Abstract: Generating robust and reactive manipulation strategies that can adapt to changing context information is a challenging task in robotics.
Reinforcement Learning has revolutionized the landscape of robotic research, allowing robust learning of complex robotic skills in simulation. However, real-world deployment in open-ended environments requires strong safety guarantees to prevent dangerous or harmful behaviors.
Sampling-Based Safe Reinforcement Learning (SBSRL) is a model‑based RL algorithm that enforces safety by jointly constraining a finite set of dynamics samples, approximating a worst‑case optimization over uncertain dynamics. It introduces an exploration strategy that limits epistemic uncertainty, removing the need for explicit exploration bonuses. The authors provide high‑probability safety guarantees and a finite‑time sample complexity bound, and demonstrate safe, efficient exploration in both simulation and real robotic hardware, with extensions to deep‑ensemble implementations for high‑dimensional continuous control.
arXiv:2607. 21302v1 Announce Type: new Abstract: Behavior prior reinforcement learning (BPRL) has emerged as a promising paradigm to improve sample efficiency in online reinforcement learning (RL) by leveraging policy priors derived from offline demonstrations.
arXiv:2609.34426v2 Announce Type: replace Abstract: This paper addresses the problem of safe offline reinforcement learning, which involves training a policy to satisfy safety constraints using an of...
The paper introduces Q-learning Penalized Transformer (QPT), a training–inference consistent framework for safe offline reinforcement learning. QPT trains a Transformer policy that generates actions conditioned on trajectory context and target return/cost while incorporating a Q-shaped penalty to balance safety, reward maximization, and behavior regularization. The method consistently outperforms strong baselines on 38 DSRL benchmark tasks and adapts robustly to varying constraint thresholds.
The paper introduces Policy Gradient Penalty (PGP), a single‑loop policy‑space method that enforces convex occupancy‑measure constraints via quadratic‑penalty regularization. PGP constructs pseudo‑rewards to estimate gradients of the penalized objective and uses the classical Policy Gradient Theorem, establishing smoothness and global last‑iterate convergence guarantees for an ε‑optimal constrained entropy value with ε‑bounded constraint violation. The authors validate PGP with ablations on a grid‑world benchmark and demonstrate scalability on two challenging continuous‑control tasks.
arXiv:2608. 10634v1 Announce Type: new Abstract: Model-based reinforcement learning (MBRL), which learns environment dynamics to generate synthetic experience, is a promising approach to sample-efficient decision making.
arXiv:2607. 07252v1 Announce Type: new Abstract: Reinforcement learning (RL) enables the synthesis of control policies directly from data, making it highly appealing for complex cyber-physical systems (CPSs) and robotics.