OpenAI Blog

Domain randomization and generative models for robotic grasping

arXiv AI
Sep 4

Adaptive Vision-Language Grasping via Composable Foundation Priors and Generalizable Grasp Synthesis

AdaRoboVLG is a Vision‑Language‑Grasp framework that separates a generalizable base grasp policy from task‑specific understanding. The base policy generates and evaluates physically feasible grasp candidates using kinematic mapping and force‑closure stability, while foundation‑model modules supply composable spatial, cognitive, and temporal priors that adapt grasp synthesis to different robotic hands and environments without retraining. Experiments show strong cross‑hand generalization, effective handling of diverse grasping challenges, and functional grasping in cluttered, dynamic settings.

By Sixu Yan, Shikang Wang, Binhua Huang, Xuanlai Tang, Guohua Fan, Fan Huang, Haoxuan Li, Yongkang Li, Yuhan Li, Bencheng Liao, Zeyu Zhang, Wenyu Liu, Hangxin Liu, Xinggang Wang
arXiv Machine Learning
Sep 22

Connectivity-Aware Exploration of Robotic Grasp Spaces

The paper investigates the multiscale connectivity structure of successful robotic grasps in SE(3) and finds that these sets exhibit heterogeneous yet reproducible connectivity across objects. It proposes a connectivity‑aware sampling strategy that prioritizes bridges, frontiers, boundary extensions, and geometric novelty, which recovers grasp connectivity more efficiently than random or farthest‑point sampling. Experiments also show that connectivity information can improve subsequent grasp discovery and transfer to unseen objects, indicating that the spatial organization of viable actions offers valuable guidance for exploration.

By Maksim A Kazanskii
arXiv Machine Learning
1d ago

Continual Learning for 6-DoF Grasp Synthesis via Experience and Demonstrations

The paper introduces a continual‑learning framework for single‑view 6‑DoF grasp synthesis with a parallel‑jaw gripper in cluttered scenes. Instead of fine‑tuning a large parametric model, the method updates grasp scores via memory in a learned embedding space and optionally incorporates user demonstrations to generate new candidate grasps. Experiments in simulation and real‑world trials (over 1500 grasps) show that the approach matches baseline performance before adaptation, improves online on unseen objects, and achieves over 90% success on challenging categories after just 50 online attempts.

By Giulio Schiavi, Andrei Cramariuc, Michael Pantic, Roland Siegwart
arXiv AI
Jun 3

Grasp-Then-Plan with Failure Attribution: A Closed Two-Stage Framework for Precise and Generalizable Robotic Manipulation

arXiv:2606. 03385v1 Announce Type: cross Abstract: In robotic manipulation, the tight coupling between grasping and motion planning often obscures the true source of failure, leading to inefficient trial-and-error.

By Jiahao Xu, Peiyuan Wang, Hanzhuo Zhang, Zihao Yu, Tianyu Fu, Hao Chen, Xuanhao Xiang, Jianbo Yu, Chenchen Fu, Wanyuan Wang