arXiv AI By Qiangong Zhou, Jiafeng Liang, Yimin Dong, Yang He, Hongxiang Li

TTT in VLA Models: Exploring Training with Human Demonstrations

Read the original on arXiv AI →

The paper investigates integrating Test‑Time Training (TTT) into InternVLA‑A1 and Pi0.5 to enable robots to generate actions conditioned on human demonstrations. By training on paired demonstration and robot trajectory data, the authors explore memory transfer, truncated backpropagation, and contrastive regularization across video, short‑video, and single‑frame cue tasks. Experiments show that, at the current scale, adding TTT and paired training does not consistently improve target selection from demonstrations, and even single‑frame cues still lead robots to prefer cups at fixed positions.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Jul 9

WAM-TTT: Steering World-Action Models by Watching Human Play at Test Time

arXiv:2607. 06988v1 Announce Type: cross Abstract: Steering robot foundation models (RFMs) toward new task variants or user-preferred behaviors remains challenging, often requiring additional robot demonstrations, task-specific fine-tuning, or long-context conditioning.

By Yusen Feng, Bingchen Han, Jiangran Lyu, Kai Liu, Yixin Zheng, Yuxuan Wan, Weiheng Liu, Sun Han, Ruiqin Li, Yulong Zhang, Fangfu Liu, Xuesong Shi, Libin Liu, Yizhou Wang, Zhizheng Zhang, He Wang
arXiv Machine Learning
Jun 3

SeeTraceAct: Visibility-Aware Latent Planning from Cross-Embodiment Demonstration Videos

arXiv:2606. 02745v1 Announce Type: cross Abstract: Vision-language-action models (VLAs) are promising general-purpose robot policies, but adapting them to new tasks typically requires costly task-specific teleoperation data.

By Jaehyeon Son, Junhyun Kim, Kyle Kam, Jeremiah Coholich, Seok Joon Kim, Jinhoo Kim, Chris Dongjoo Kim, Jaemin Cho, Dieter Fox, Zsolt Kira
arXiv AI
Sep 18

HIL-UMI: Bringing Human-in-the-Loop Post-Training of Vision-Language-Action Models to Universal Manipulation Interface

HIL-UMI is a policy-guided Universal Manipulation Interface that enables robot‑free, human‑in‑the‑loop post‑training of vision‑language‑action models. By querying the current policy during handheld demonstrations and using an Energy Score to detect out‑of‑distribution states, it selectively collects new data and refines a progress‑based advantage estimator. The updated estimator then drives advantage‑conditioned behavioral cloning, improving performance on long‑horizon and precise manipulation tasks while reducing per‑frame collection time compared to HG‑DAgger.

By Zimu Han, Yiming Zeng, Jiyao Zhang, Zihao Zhao, Yuanfei Wang, Yixiang Jin, Shiqi Li, Shuangben Chen, Wei Huang, Ruodai Li, Hui Shen, Hao Dong
arXiv AI
Oct 7

VOMMI: Collecting and Leveraging Portable Demonstrations for Mobile Manipulation

arXiv:2610.08220v1 Announce Type: cross Abstract: Portable mobile-manipulation demonstrations can help alleviate data scarcity for embodied intelligence, but obtaining reliable, low-cost, and robot-f...

By Yutian Zhang, Xingrui Xiong, Siyuan Ma, Yang Li, Jiawen Wen, Jiaqi Zhai, Liwen Yang, Ce Hao, Haozhen Chi, Yangkun Zhu, Yifan Zhu, Xiaowen Chu, Dong Wei, Qiaojun Yu, Dibo Hou