Hugging Face Trending Papers

RoboSimStudio: An Interactive Toolkit for Rapid Real2Sim of Robot Manipulation Tasks

RoboSimStudio (RSS) is an interactive toolkit designed to simplify the creation of realistic robot manipulation simulations. It allows users to explicitly choose and edit solvers, contact models, and physical parameters, enabling iterative refinement of simulations based on observed behavior. Experiments demonstrate human-guided real-to-sim approaches using visual evaluation, force-feedback, and agentic real-to-sim-to-real methods.

arXiv AI
Oct 15

RoboSimStudio: An Interactive Toolkit for Human and Agent Rapid Real2Sim of Robot Manipulation Tasks

arXiv:2610.18835v2 Announce Type: cross Abstract: It has been difficult to accurately model the physics of the interaction between a robot and the objects it manipulates, including contact mechanics,...

By Kaiyuan Chen, Shuangyu Xie, Uksang Yoo, Xinyue Zhu, Cael Magner, Alvin Zhu, Daehwa Kim, Eric Heiden, Erwin Coumans, Miles Macklin, Spencer Huang, Ken Goldberg
arXiv AI
Jul 2

Learning Dexterous Manipulation Using Contact Wrench Guidance From Human Demonstration

arXiv:2607. 00033v1 Announce Type: cross Abstract: Dexterous robot manipulation can benefit from the abundance of human demonstrations, but transferring such demonstrations to robot policies remains challenging.

By Xinghao Zhu, Zixi Liu, Shalin Jain, Chenran Li, Milad Noori, Huihua Zhao, John Welsh, Michael Andres Lin, Wei Liu, Tingwu Wang, Xingye Da, Zhengyi Luo, Vishal Kulkarni, Naema Bhatti, Yuke Zhu, Linxi Fan, Bowen Wen, Danfei Xu, Soha Pouya, Yan Chang
Hugging Face Trending Papers
Oct 27

ActiveAlign: Aligning Egocentric Manipulation via Active Perception

ActiveAlign is a framework that uses active perception to close the Real2Sim2Real gap in robot manipulation. It introduces two modules: ActiveAlign‑Waving, which performs hand‑eye calibration via active hand motions and differentiable rendering, and ActiveAlign‑Touching, which refines object alignment with tactile feedback for millimeter‑level precision. The approach enables strong real‑to‑simulation alignment, allowing simulation environments to be curated from uncalibrated datasets and enabling a real Unitree G1 robot to manipulate millimeter‑scale objects such as buttons and sliders.

arXiv AI
Sep 25

RAPID: Robot Agentic Programming from Demonstrations

RAPID is a system that automatically generates, verifies, and refines robot programs from a single visual human demonstration. It infers a testable task specification, action primitives, and an interactive environment, using an object-centric relational program representation to enable reuse beyond the demonstration. The approach was evaluated in simulation on eight contact-rich manipulation tasks and successfully deployed on a real Franka arm, showing strong generalization across object pose, shape, material, and environment.

By Yuyao Liu, Jiayuan Mao, David Hsu, Leslie Pack Kaelbling, Tom\'as Lozano-P\'erez
arXiv AI
Oct 28

ActiveAlign: Aligning Egocentric Manipulation via Active Perception

ActiveAlign is a framework that uses active perception to reduce the Real2Sim2Real gap in robot manipulation. It introduces two modules: ActiveAlign-Waving, which performs hand‑eye calibration through active hand motions and differentiable rendering, and ActiveAlign-Touching, which refines object alignment with tactile feedback to achieve millimeter‑level precision. The approach is demonstrated by curating simulation environments for uncalibrated datasets and enabling a Unitree G1 robot to manipulate millimeter‑scale objects such as buttons and sliders.

By Ri-Zhao Qiu, Bowen Wen, Yifeng Jiang, Chen Tessler, Eric Heiden, Xue Bin Peng, Xiaolong Wang, Stan Birchfield, Erwin Coumans