arXiv Machine Learning By Zongyou Yu, Ao Zhou, Xiongbo Shi, Jiayi Guan, Shihang Du, Xudong Zhang, Shangding Gu, Junqiao Zhao, Hanli Wang, Guang Chen

RBGA: Residual-Budget Guide Arbitration for Offline-to-Online Safe Reinforcement Learning in Dexterous Manipulation

Read the original on arXiv Machine Learning →

The paper introduces RBGA, an algorithm for offline-to-online safe reinforcement learning in dexterous manipulation. RBGA tracks the remaining safety budget during an episode and uses it to arbitrate between offline guidance and an evolving online policy, comparing cost-to-go estimates at each step. The authors provide theoretical analysis of safety implications and demonstrate through experiments that RBGA improves online policy performance while preserving safety.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Oct 5

UniIntervene++: An Adaptive Intervention Agent for Efficient Real-World Reinforcement Learning

UniIntervene++ is an adaptive intervention agent that learns to balance autonomous execution and assisted behaviors during online reinforcement learning. It models the evolving policy, trajectory correction, and task-structured CodePolicy as Options in a unified semi‑Markov decision process, learning their values online. The agent periodically probes the policy to keep control allocation responsive, and uses coupled experience learning to improve both the policy and future interventions, achieving an 89.67% success rate on five real‑world tasks while cutting human intervention by 94.6%.

By Yudong Lin, Haoyuan Deng, Zhuoxuan Yuan, Zaijia Yang, Yuanjiang Xue, Ziwei Wang
arXiv AI
Oct 26

SEVI: Safe Evidential Real-World Reinforcement Learning

SEVI (Safe Evidential Real-World Reinforcement Learning) is a framework that adds a safety intervention layer to real‑world policy learning. It uses an Evidential Safety Critic to estimate both future constraint‑violation risk and epistemic uncertainty in a single forward pass, and overrides unsafe or poorly supported actions with an offline‑trained recovery policy. Experiments on simulated manipulation tasks and a real‑world USB insertion task show that SEVI improves trajectory‑level safety prediction, task success, and reduces unsafe events by 13.4–57.1% compared to other safe RL baselines.

By Shaekh Mohammad Shithil, Lantao Liu