arXiv Computer Vision
ME-Dex 1.0: Bringing Heterogeneous Tactile Sensing into World Action Modeling
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv Computer Vision
Sep 18
DexTouch-WM: Learning Action-Conditioned Tactile World Models from Human Touch for Dexterous Robot Manipulation
DexTouch-WM is an action‑conditioned world model that learns from scalable human touch to predict future RGB observations and bilateral tactile dynamics for dexterous robot manipulation. By using compatible piezoresistive arrays on both human and robot hands and retargeting human motion into the robot action space, the model can be supervised with human interaction data while keeping a fixed amount of real‑robot supervision. Experiments show that adding up to 100 hours of human interaction improves robot‑domain visual, geometric, and contact prediction, and the model can serve as a surrogate environment for policy evaluation and synthetic trajectory generation.
arXiv AI
Sep 30
Unified Visual-Tactile-Action Modeling from Human Demonstrations for Dexterous Manipulation
arXiv:2609.34182v2 Announce Type: replace-cross Abstract: Dexterous manipulation requires tactile feedback. However, robot tactile demonstrations are difficult to scale,because dexterous-hand teleope...
arXiv Machine Learning
Sep 22
$N_0$-Foundation: Towards the Age of Tactile Intelligence
arXiv:2608.29601v2 Announce Type: replace-cross Abstract: We present $N_0$-Foundation, a paradigm for tactile-enabled embodied manipulation, which integrates tactile sensing hardware, large-scale mul...
arXiv Machine Learning
Sep 1
$\mathcal{N}_0$-Foundation: Towards the Age of Tactile Intelligence
arXiv:2608.29601v1 Announce Type: cross Abstract: We present $\mathcal{N}_0$-Foundation, a paradigm for tactile-enabled embodied manipulation, which integrates tactile sensing hardware, large-scale m...
arXiv Computer Vision
Sep 22
DexTacWAM: A Visuo-Tactile World-Action Model for Dexterous Manipulation
arXiv:2609.24976v1 Announce Type: cross Abstract: Dexterous manipulation depends on contact dynamics that are often only partially observable from vision. Recent World-Action Models (WAMs) couple pre...
arXiv Machine Learning
Oct 9
TACROSS: An Efficient and Low-Cost Scalable Human Touch System Across Heterogeneous Tactile Sensors for Dexterous Robot Learning
TACROSS is a low‑cost, scalable system that enables robots to learn from human touch by aligning tactile streams at the level of contact events rather than raw sensor values. It combines a $10.86 piezoresistive glove with 285 sensing points and a temporal Transformer that maps heterogeneous signals into a shared 256‑dimensional latent space. The approach uses robot demonstrations for action supervision while human demonstrations aid tactile representation learning, achieving a 3.5‑fold efficiency improvement and a 95.7% reduction in demonstration equipment cost across four manipulation tasks.