DexTouch-WM is an action‑conditioned world model that learns from scalable human touch to predict future RGB observations and bilateral tactile dynamics for dexterous robot manipulation. By using compatible piezoresistive arrays on both human and robot hands and retargeting human motion into the robot action space, the model can be supervised with human interaction data while keeping a fixed amount of real‑robot supervision. Experiments show that adding up to 100 hours of human interaction improves robot‑domain visual, geometric, and contact prediction, and the model can serve as a surrogate environment for policy evaluation and synthetic trajectory generation.
arXiv:2609.34182v2 Announce Type: replace-cross Abstract: Dexterous manipulation requires tactile feedback. However, robot tactile demonstrations are difficult to scale,because dexterous-hand teleope...
arXiv:2609.21449v1 Announce Type: new Abstract: World Action Models bring the predictive capabilities of video models into robot action generation, providing a rich foundation for modeling future vis...
arXiv:2607. 09218v1 Announce Type: cross Abstract: Whole-arm manipulation involves direct contact with the environment while the robot completes a task by distributing contact across multiple links as contacts form, slide, and break.
arXiv:2610.10283v1 Announce Type: cross Abstract: Humans can grasp everyday objects with almost perfect success rates using fingertip tactile feedback, yet much of the robotic grasping literature emp...
arXiv:2607. 09218v2 Announce Type: replace-cross Abstract: Whole-arm manipulation involves direct contact with the environment while the robot completes a task by distributing contact across multiple links as contacts form, slide, and break.
TACROSS is a low‑cost, scalable system that enables robots to learn from human touch by aligning tactile streams at the level of contact events rather than raw sensor values. It combines a $10.86 piezoresistive glove with 285 sensing points and a temporal Transformer that maps heterogeneous signals into a shared 256‑dimensional latent space. The approach uses robot demonstrations for action supervision while human demonstrations aid tactile representation learning, achieving a 3.5‑fold efficiency improvement and a 95.7% reduction in demonstration equipment cost across four manipulation tasks.
arXiv:2609.24976v1 Announce Type: cross Abstract: Dexterous manipulation depends on contact dynamics that are often only partially observable from vision. Recent World-Action Models (WAMs) couple pre...
arXiv:2610.14372v1 Announce Type: cross Abstract: Dexterous robot hands can receive useful motion intent from teleoperation or learned policies, but successful execution also depends on contact decis...
arXiv:2606. 10614v1 Announce Type: cross Abstract: Robotic foundation models pre-trained on human demonstration videos have shown promise, but a significant embodiment gap remains when the resulting policies are deployed on real robots.
The paper introduces DSP: Dexterity from Supervised Play, a framework where a robot learns a play policy from brief human demonstrations via behavior cloning and then autonomously gathers extensive interaction data to train a world model. During inference, the play policy guides model‑predictive control by proposing action sequences evaluated by the learned model, and a self‑play distillation step produces a closed‑loop, goal‑conditioned policy. Experiments on underactuated pushing and in‑hand pose reorientation show DSP outperforms hindsight behavior cloning by 69.6% in success rate and matches reinforcement learning performance while using 490 times less data.
arXiv:2610.02840v1 Announce Type: cross Abstract: World action models jointly learn to forecast world dynamics and predict robot actions, such that the learned internal world dynamics guide accurate...
The paper introduces DSP: Dexterity from Supervised Play, a framework where a robot learns a play policy from minutes of human play via behavior cloning. The robot then autonomously uses this policy to gather hours of interaction data, training a world model that guides model‑predictive control during inference. The approach is validated on underactuated pushing and in‑hand pose reorientation tasks, outperforming hindsight behavior cloning by 69.6% in real‑world success rate and matching reinforcement learning performance with 490× less data.