arXiv AI

FWBC-VLA: Force-Aware Whole-Body Compensation for Contact-Rich Loco-Manipulation

FWBC‑VLA is a force‑aware framework that links vision‑language‑action (VLA) models with whole‑body compensation control for wheeled‑legged robots. It introduces HSR‑Force, a sensorless residual‑torque estimator that infers contact strength and encodes this information as tokens for the VLA action decoder, allowing the policy to detect contact onset, loading, and release. The system fine‑tunes a pretrained VLA backbone on a large WL&Arm dataset, combines proprioceptive, Jacobian‑derived force, and contact estimates to generate corrective actions, and demonstrates effectiveness in real‑world tasks such as whiteboard wiping and door opening.

arXiv AI
Aug 26

ForceFlow: Learning to Feel and Act via Contact-Driven Flow Matching

ForceFlow is a force-aware reactive framework that uses flow matching to improve contact-rich manipulation. It fuses force signals asymmetrically, treats force as a global regulator, and employs a joint prediction paradigm to couple force and motion. The approach splits tasks into a vision-dominant localization stage and a touch-dominant execution stage, using a Vision-to-Force handover to separate spatial generalization from contact regulation.

By Shuoheng Zhang, Yifu Yuan, Hongyao Tang, Yan Zheng, Qiaojun Yu, Pengyi Li, Guowei Huang, Helong Huang, Xingyue Quan, Jianye Hao
Hugging Face Trending Papers
Jun 3

VISTA: Vision-Grounded and Physics-Validated Adaptation of UMI data for VLA Training

Universal Manipulation Interface (UMI) enables scalable real-world robot data collection without hardware-specific teleoperation, yet leveraging UMI data to train large-scale Vision-Language-Action (VLA) models remains fundamentally challenging. We identify two critical mismatches: wrist-mounted fisheye views, with severe radial distortion and local gripper-centric perspectives, are out-of-distribution for pretrained VLMs; and human-collected trajectories frequently violate kinematic limits, incur collisions, or exceed controller bandwidth, teaching VLA policies physically infeasible actions.

arXiv Machine Learning
Oct 9

VioLA: Learning Generalist Humanoid Control Policies from Human Data

VioLA is a generalist humanoid control policy that predicts body and hand motion latents instead of joint commands, enabling a pretrained controller to execute these latents on a robot. By aligning human and robot motion in shared latent spaces, the policy can be trained on a large dataset of 140.6 million frames, 93.2% of which are human demonstrations. As a result, VioLA can follow locomotion and manipulation instructions on a real robot zero‑shot, achieving 100% locomotion success and 88.6% manipulation success without task‑specific fine‑tuning.

By Mert Albaba, Jens Bei{\ss}wenger, Anna Manasyan, Daniel Marta, Michael J. Black, Wieland Brendel, Andreas Krause, Georg Martius, Martin Riedmiller
arXiv AI
Jun 4

VISTA: Vision-Grounded and Physics-Validated Adaptation of UMI data for VLA Training

arXiv:2606. 04708v1 Announce Type: cross Abstract: Universal Manipulation Interface (UMI) enables scalable real-world robot data collection without hardware-specific teleoperation, yet leveraging UMI data to train large-scale Vision-Language-Action (VLA) models remains fundamentally challenging.

By Siyuan Yang, Linzheng Guo, Ouyang Lu, Zhaxizhuoma, Daoran Zhang, Xinmiao Wang, Ting Xiao, Fangzheng Yan, Zhijun Chen, Yan Ding, Chao Yu, Chenjia Bai, Xuelong Li
arXiv AI
Oct 15

HWAM: Humanoid World Action Model With Joint State--Action Generation

HWAM (Humanoid World Action Model) jointly generates reference actions and the robot’s post‑execution proprioceptive state, bridging the action–execution gap in hierarchical humanoid systems. It integrates three conditional paths—policy denoising, forward dynamics modeling, and inverse dynamics modeling—to connect policy references, realized motion, and visual outcomes. On the LimX OLI humanoid, HWAM outperforms baselines, achieving a 70.6% success rate on Candy Picking versus 43.3% for Fast‑WAM.

By Yan Yang, Jikun Rong, Minzhao Zhu, Zheyi Zhao, Qirui Hu, Zihan Lan, Weixin Mao, Yinhao Li, Zhen Fu, Hua Chen
arXiv Machine Learning
Jun 11

TacCoRL: Integrating Tactile Feedback into VLA via Simulation

arXiv:2606. 11743v1 Announce Type: cross Abstract: Vision-language-action (VLA) models provide strong visual, language, and action priors for robot manipulation, but visual observations alone often miss the local contact state required for contact-rich tasks.

By Siyu Ma, Yuqi Liang, Chang Yu, Yunuo Chen, Hao Su, Yixin Zhu, Yin Yang, Chenfanfu Jiang
arXiv AI
Jul 17

Never Too Late for Force: Accelerating VLA Post-Training with Reactive Force Injection

arXiv:2607. 14236v1 Announce Type: cross Abstract: Pretrained vision-language-action (VLA) policies provide strong language-conditioned manipulation knowledge, but they remain largely vision-driven and can struggle once manipulation enters contact states where the scene is occluded, depth is ambiguous, or small force errors push execution off the offline demonstration distribution.

By Yi Wang, Wendi Chen, Zimo Wen, Han Xue, Xueqi Li, Wenye Yu, Zhijie Chen, Hao Yang, Jun Lv, Chuan Wen, Cewu Lu