RCT: A Robot-Collected Touch-Vision-Language Dataset for Tactile Generalization
arXiv:2606. 31694v1 Announce Type: cross Abstract: For robots manipulating open-world objects, tactile representations must generalize to unseen materials.
arXiv:2606. 31694v1 Announce Type: cross Abstract: For robots manipulating open-world objects, tactile representations must generalize to unseen materials.
BIDETA is a gradient‑free framework that adapts pretrained tactile models to new sensors using only a few labeled target contacts. It preserves pretrained representations while repairing sensor‑dependent feature neighborhoods through rapid support memory, support‑conditioned spectral graphs, and reliability‑gated recurrence. Experiments on multiple datasets show that BIDETA dramatically improves accuracy and speeds up adaptation compared to prior methods.
arXiv:2606. 31451v1 Announce Type: cross Abstract: Unified multimodal models (UMMs) have shown great promise in integrating understanding and generation across diverse modalities.
The paper introduces BIFTA, a Brain‑Inspired Few‑Shot Tactile Adaptation framework that enables a frozen encoder to adapt quickly to an unknown tactile sensor using only a small labeled support set. It preserves pretrained representations via dual‑view statistical memory, builds support‑conditioned spectral graphs to correct sensor‑dependent feature neighborhoods, and employs uncertainty‑gated recurrent propagation to reinforce reliable cross‑query evidence. Benchmarks on three tactile datasets demonstrate that BIFTA dramatically improves adaptation performance, achieving an 87.09% mean Sparsh accuracy on SITR with just 10% labeled data—an increase of 47.22 percentage points over the best prior method.
ControlTac is a two‑stage framework that generates realistic tactile images conditioned on a single reference image, contact force, and contact pose. By incorporating these physical priors, it produces realistic samples across different sensors and captures task‑relevant variations. Experiments in object insertion, imitation learning, and object weighting show that datasets augmented with ControlTac consistently improve performance in dynamic real‑world settings.
FlowTouch is a model that predicts tactile sensor outputs from visual data in a view‑invariant manner by leveraging an object’s local 3D mesh to encode rich information while abstracting scene‑dependent details. It integrates scene reconstruction with Flow Matching‑based image generation, enabling it to bridge the sim‑to‑real gap and generalize to new sensor instances. The predicted tactile images can be used for downstream tasks such as grasp stability prediction.
arXiv:2606. 11637v1 Announce Type: new Abstract: Touch is a key modality for embodied agents to understand the physical world.
arXiv:2609.24621v1 Announce Type: cross Abstract: Tactile sensing is increasingly being incorporated into learning-based robotic manipulation, yet many existing approaches rely on spatially distribut...
arXiv:2610.10288v1 Announce Type: new Abstract: Large-scale egocentric human interaction data is becoming an important source of physical supervision for embodied learning, yet video alone leaves the...
Touch-JEPA is a framework that learns tactile representations from hand‑object videos using limited tactile supervision. It first trains a self‑supervised model that predicts masked visual features at hand‑surface locations, capturing latent contact dynamics. The model is then jointly fine‑tuned on a small labeled subset, improving contact discrimination and tactile magnitude estimation on human‑hand benchmarks and transferring to robotic hands without robot tactile data.
TACROSS is a low‑cost, scalable system that enables robots to learn from human touch by aligning tactile streams at the level of contact events rather than raw sensor values. It combines a $10.86 piezoresistive glove with 285 sensing points and a temporal Transformer that maps heterogeneous signals into a shared 256‑dimensional latent space. The approach uses robot demonstrations for action supervision while human demonstrations aid tactile representation learning, achieving a 3.5‑fold efficiency improvement and a 95.7% reduction in demonstration equipment cost across four manipulation tasks.
arXiv:2608.15060v2 Announce Type: replace Abstract: Touch is fundamental to dexterous manipulation, yet most egocentric human data increasingly used for robot learning lacks tactile information. Dire...