SoTa is a low‑cost, capacitive tactile skin that offers full‑hand coverage for both humans and robots, featuring a shared layout of 202 taxels across finger and palm regions. The multilayer design with fabric electrodes allows in‑house fabrication for under $10 in materials, and the sensor maintains over 97% of its response after 10,000 loading‑unloading cycles and 1,280 tight‑fist folds. Using SoTa, human‑robot co‑training improves in‑distribution success on three contact‑rich manipulation tasks, and adding human demonstrations more than doubles mean success across eight evaluation conditions, from 22.8% to 45.9%, including all out‑of‑distribution scenarios.
By Jingyun Yang, Baiyu Shi, Timothy Yu, Haitian Liu, Alberta Longhini, Weichen Wang, Rika Antonova, Zhenan Bao, Jeannette Bohg
The survey examines dexterous robotic hands in the context of foundation models, covering hardware, data, cross-embodiment transfer, learning, and evaluation from January 2024 to November 2026. It highlights that human data’s value hinges on alignment rather than volume, that shared policies still face embodiment constraints, and that task success alone does not guarantee physical correctness or readiness for deployment. The authors identify eleven open problems and suggest reporting standards to better measure full-stack progress.
By Ji Pei
arXiv:2609.24660v2 Announce Type: cross
Abstract: Human demonstrations offer a scalable way to collect manipulation data, but their contacts may be unstable or infeasible when transferred to a robot...
By Shengcheng Luo, Xiaoyang Cheng, Hong Ying, Xiaoying Zhou, Jiaming Jiang, Haoran Guo, Wanlin Li, Ziyuan Jiao, Chenxi Xiao
arXiv:2609.15726v1 Announce Type: cross
Abstract: Tactile sensing provides contact information that can be difficult to infer from vision alone, but tactile hardware for dexterous hands has not conve...
By Zhenjie Yang, Yideng Zhang, Dongjie Zhang, Chenyu Jiang, Xianshuai Liu, Yufeng Li, Zuhao Ge, Xingyu Jiao, Zheng Zhang, Kaiyu He, He Wang, Yuwen Zhong, Yi Deng, Muyun Jiang, Xianliang Huang, Haisheng Su, Donghang Zhang, Jian Zhang, Xue Yang, Hongyang Li, Zuxuan Wu, Yu-Gang Jiang, Xiaosong Jia, Junchi Yan
TACROSS is a low‑cost, scalable system that enables robots to learn from human touch by aligning tactile streams at the level of contact events rather than raw sensor values. It combines a $10.86 piezoresistive glove with 285 sensing points and a temporal Transformer that maps heterogeneous signals into a shared 256‑dimensional latent space. The approach uses robot demonstrations for action supervision while human demonstrations aid tactile representation learning, achieving a 3.5‑fold efficiency improvement and a 95.7% reduction in demonstration equipment cost across four manipulation tasks.
By Bo Chen, Huanzhang Hu, Junyang Ma, Bo Yue, Fangdi Yu, Haijier Chen, Xianxin Lai, Shuyu Pan, Zhen Yang, Xiaoquan Sun, Wenze Cui, Zhongliang Jiang, Shaopeng Liu, Jiayu Chen
Retargeting human object interaction demonstrations to physics based simulation requires reproducing not only body motion but also the object motion and contacts that make manipulation succeed. However, position only hand trajectories do not specify the contact forces needed to manipulate objects, and directly tracking them can overconstrain contact rich finger behavior.
The paper presents a method for force‑aware manipulation that relies solely on visual predictions of force from a compliant Fin Ray gripper. It trains a visual force estimator on calibration data to annotate demonstrations, then uses these annotated demonstrations to train an action–force proposal policy that generates candidate actions and their expected forces. At deployment, the robot selects the action whose predicted force best matches a target force from the demonstrations, enabling contact‑rich tasks such as berry picking, can grasping, in‑hand reorientation, and plug insertion without physical force or tactile sensors.
By Haonan Chen, Feiyang Wu, Yuxiang Ma, Mustafa Mete, Pengfei Ye, Junxuan Shen, Cheng Zhu, Aurora Ruggeri, Kelvin Cheung, Jiayuan Mao, Edward Adelson, Jiajun Wu, Robert D. Howe, Yilun Du
DexPort is a portable interface that lets operators collect high‑quality dexterous hand demonstrations without a full robot setup. By using the same hand hardware for both collection and deployment, it records joint targets and states while allowing operators to specify wrist motion and select from a small set of coordinated finger skills. The authors collected over 2,500 demonstrations across four real‑world tasks, showing significant performance gains when using recorded robot commands and in‑the‑wild data.
By Amber Xie, Jiawei Fu, Xiaofeng Guo, Carmelo Sferrazza, Guanya Shi, Haozhi Qi
arXiv:2609.34182v2 Announce Type: replace-cross
Abstract: Dexterous manipulation requires tactile feedback. However, robot tactile demonstrations are difficult to scale,because dexterous-hand teleope...
By Wenqiao Li, Qianyou Zhao, Jiawen Hao, Xuezhou Zhu, Tengyu Liu, Kaifeng Zhang, Chuan Wen, Siyuan Huang
arXiv:2610.10288v1 Announce Type: new
Abstract: Large-scale egocentric human interaction data is becoming an important source of physical supervision for embodied learning, yet video alone leaves the...
By Dayou Li, Hao Wang, Qianqian Yang, Zihao Zhu, Haoquan Fang, Ziyao Zeng, Yan Han, Zihan Wang, Yan Wang, Baoru Huang, Dilin Wang, Kenji Shimada, Yiyue Luo, Manling Li, Teresa Lv, Mustafa Mukadam, Rakesh Ranjan, Ruohan Zhang, Qi He, Changliu Liu, Xu Chen, Marco Pavone, Bangya Liu, Jiachen Li, Masayoshi Tomizuka, Zhiwen Fan
arXiv:2608.29601v2 Announce Type: replace-cross
Abstract: We present $N_0$-Foundation, a paradigm for tactile-enabled embodied manipulation, which integrates tactile sensing hardware, large-scale mul...
By NeoteAI Team, Fudan TEAI Team
arXiv:2608.29601v1 Announce Type: cross
Abstract: We present $\mathcal{N}_0$-Foundation, a paradigm for tactile-enabled embodied manipulation, which integrates tactile sensing hardware, large-scale m...
By NeoteAI Team, Fudan TEAI Team