Hugging Face Trending Papers

I3L: Iterative Interactive Imitation Learning for Whole-Body Mobile Manipulation

arXiv Computer Vision
Sep 21

DexPIE: Stable Dexterous Policy Improvement from Real-World Experience

DexPIE is a post‑training framework that improves dexterous manipulation policies using real‑world experience. It introduces a dexterous‑hand‑adapted intervention system and multi‑stage DAgger‑style data collection to enhance exploration, aligns training and inference to reduce distribution shift, and conditions the policy on a continuous optimality indicator for fine‑grained data quality use. In three real‑world tasks, DexPIE boosts success rates by 37.3% over a demonstration‑based baseline, outperforming all other methods and showing stronger robustness.

By Ruizhe Liao, Wenrui Chen, Liangji Zeng, Haoran Lin, Fan Yang, Kailun Yang, Yaonan Wang
arXiv AI
Oct 16

Whole-Body Dexterity

Whole-Body Dexterity (WBD) is a framework that enables robots to use their entire body and appendages as contact surfaces for grasping and manipulating objects. The approach generates a dataset of feasible whole-body grasps, trains reinforcement‑learning experts on a repositioning objective, and distills them into a single policy that relies on proprioception and object geometry. The distilled policy achieves zero‑shot transfer to a real Unitree G1 robot, successfully completing complex tasks such as stowing a box under one arm and moving it from a shelf to a table, with a 90% success rate in real‑world trials.

By Conor Mc Gartoll, An Dang, Pranay Thangeda, Arjun Gupta, Carolina Higuera, Nima Fazeli, Mustafa Mukadam, Manikantan Nambi
arXiv AI
Oct 7

VOMMI: Collecting and Leveraging Portable Demonstrations for Mobile Manipulation

arXiv:2610.08220v1 Announce Type: cross Abstract: Portable mobile-manipulation demonstrations can help alleviate data scarcity for embodied intelligence, but obtaining reliable, low-cost, and robot-f...

By Yutian Zhang, Xingrui Xiong, Siyuan Ma, Yang Li, Jiawen Wen, Jiaqi Zhai, Liwen Yang, Ce Hao, Haozhen Chi, Yangkun Zhu, Yifan Zhu, Xiaowen Chu, Dong Wei, Qiaojun Yu, Dibo Hou
arXiv AI
Sep 18

HIL-UMI: Bringing Human-in-the-Loop Post-Training of Vision-Language-Action Models to Universal Manipulation Interface

HIL-UMI is a policy-guided Universal Manipulation Interface that enables robot‑free, human‑in‑the‑loop post‑training of vision‑language‑action models. By querying the current policy during handheld demonstrations and using an Energy Score to detect out‑of‑distribution states, it selectively collects new data and refines a progress‑based advantage estimator. The updated estimator then drives advantage‑conditioned behavioral cloning, improving performance on long‑horizon and precise manipulation tasks while reducing per‑frame collection time compared to HG‑DAgger.

By Zimu Han, Yiming Zeng, Jiyao Zhang, Zihao Zhao, Yuanfei Wang, Yixiang Jin, Shiqi Li, Shuangben Chen, Wei Huang, Ruodai Li, Hui Shen, Hao Dong
arXiv Machine Learning
Oct 15

Hierarchical Residual Policy Learning for Real-World Mobile Manipulation with Sparse Human Guidance

The paper introduces HiRe-MoMa, a hierarchical residual policy learning framework that fine‑tunes a frozen base policy for mobile manipulation. It uses a policy‑agnostic residual split into mobile‑base and manipulator‑arm heads to reduce gradient interference, and incorporates expert‑guided value alignment to improve sample efficiency with sparse human interventions. Experiments on the TIAGo++ platform show that HiRe‑MoMa boosts task performance after only about 30 minutes of online interaction, regardless of the underlying base policy.

By Zhefei Gong, Hefeifei Jiang, Zehao Wang, Jiachen Li
arXiv Machine Learning
4d ago

Has GPT-6-Astra Achieved Embodied Intelligence?

The paper evaluates GPT‑6‑Astra’s performance across 12 robotic benchmarks, showing it achieves unprecedented results when using in‑context learning from training‑set demonstrations. It highlights the benefits and costs of a dual‑system architecture (high‑level reasoning and low‑level control) and identifies practical gaps in real‑world deployment, such as expensive demonstration collection and physical constraints. The authors propose a new benchmark prototype that derives tasks from real‑world needs, omits in‑domain demos, and measures agents against a continuously running world clock.

By SenseNova, Joint Research Team, :, Zhongang Cai, Ziang Cao, Tailai Chen, Han Chong Chua, Linjun Dai, Hanming Deng, Hokin Deng, Haiwen Diao, Chenjing Ding, Weichen Fan, Xiao Fu, Zerui Gong, Chenyang Gu, Zexin He, Zhi Hou, Bo Li, Qinyue Li, Quanzhou Li, Xiaowan Li, Zhichao Liao, Dahua Lin, Zilong Lin, Bo Liu, Chunxiao Liu, Pengfei Liu, Tianqi Liu, Ziwei Liu, Chen Change Loy, Lewei Lu, Jiapeng Luo, Yuexiao Ma, Liang Pan, Xingang Pan, Oscar Qian, Ziyi Shang, Yuyao Shao, Dawei Su, Dacheng Tao, Qingyi Tao, Quan Wang, Ruisi Wang, Xiaogang Wang, Ziyi Wang, Beichen Wen, Donghao Wu, Jiaxu Wu, Silei Wu, Xiaoming Wu, Zhonghua Wu, Hongcan Xiao, Weiye Xu, Atsushi Yamashita, Lei Yang, Zhe Yang, Baiqiao Yin, Wanqi Yin, Hanfei Zhao, Tianbo Zhong, Long Zhuo, Jing Zuo