arXiv Machine Learning
22h ago

SHORE: Stability-Hybrid On-Policy Reinforcement Learning for Online Bin Packing

SHORE (Stability‑Hybrid On‑Policy Reinforcement Learning) tackles online 3D bin packing by jointly deciding which box to pack, its orientation, and placement while ensuring stack stability. It learns a stability probability via a 3D U‑Net from both executed outcomes and simulated alternatives, and incorporates these predictions into a discrete on‑policy actor‑critic that gates the influence of an untrained model. In Isaac Gym experiments, SHORE achieves 73 % space utilization in 0.4 M steps—twice as fast as a baseline without stability modeling—and outperforms the GOPT baseline on a 60‑box set, albeit with a slightly higher placement‑failure rate. whyItMatters":"The method demonstrates that integrating learned stability predictions into reinforcement learning accelerates learning and improves packing efficiency in realistic, high‑risk bin‑packing scenarios."

By Chang Shi, Ann Majewicz Fey
arXiv Statistics ML
Sep 15

Harnessing human expertise for high-precision robotic assembly in industrialized construction: A sample-efficient installer-in-the-loop interactive reinforcement learning framework

arXiv:2609.13234v1 Announce Type: cross Abstract: Industrialized construction imposes stringent precision requirements on robotic assembly of modular components such as prefabricated window units. In...

By Zekai Jin, Huiguang Wang, Xiaoning Sun, Yi Shao
arXiv AI
Jul 14

Robo-ValueRL: Reliable Value Estimation for Offline-to-Online Reinforcement Learning

arXiv:2607. 09866v1 Announce Type: cross Abstract: Offline-to-online reinforcement learning is promising for generalizable robotic manipulation, yet its full-stack complexity obscures reproduction and diagnosis.

By Wenke Xia, Pei Ren, Wenbo Yu, Yizhuo Zhang, Jifan Li, Yixue Zhang, Yinuo Zhao, Qingyang Gao, Jianlong Fu, Jian Tang, Ji-Rong Wen, Zhengping Che, Di Hu
arXiv Machine Learning
Oct 28

RBGA: Residual-Budget Guide Arbitration for Offline-to-Online Safe Reinforcement Learning in Dexterous Manipulation

The paper introduces RBGA, an algorithm for offline-to-online safe reinforcement learning in dexterous manipulation. RBGA tracks the remaining safety budget during an episode and uses it to arbitrate between offline guidance and an evolving online policy, comparing cost-to-go estimates at each step. The authors provide theoretical analysis of safety implications and demonstrate through experiments that RBGA improves online policy performance while preserving safety.

By Zongyou Yu, Ao Zhou, Xiongbo Shi, Jiayi Guan, Shihang Du, Xudong Zhang, Shangding Gu, Junqiao Zhao, Hanli Wang, Guang Chen
arXiv AI
Aug 18

Robo-Dopamine 2.0: History-Conditioned and OOD-Aware Process Reward Modeling for Robotic Manipulation

arXiv:2608. 15680v1 Announce Type: cross Abstract: Vision-language-action (VLA) models improve robotic manipulation but remain vulnerable to compounding errors, scene changes, and off-trajectory states.

By Yijie Xu, Haopeng Jin, Run Zhou, Shengbang Liu, Sixiang Chen, Hongyang Cheng, Sicheng Hu, Peterson Co, Jinwen Luo, Huajie Tan, Shanghang Zhang