SALA introduces a semantically aligned latent action framework that bridges human and robot video data without requiring paired examples. By leveraging language descriptions to estimate semantic similarities, SALA guides human latent actions toward related robot latents while grounding the latent space with robot action reconstruction. This shared latent action space enables dual‑axis scaling: larger general human pre‑training reduces robot action prediction error, and task‑specific human post‑training boosts real‑world robot success.
By Jiachun Jin, Zetong Zhou, Haonan Wang, Xiao Yang, Jun Zhu, Zhijie Deng
arXiv:2606. 00054v1 Announce Type: cross Abstract: Recent progress in generalizable embodied control has been driven by large-scale pretraining of Vision-Language-Action (VLA) models.
By Zhiyuan Feng, Qixiu Li, Huizhi Liang, Rushuai Yang, Yichao Shen, Zhiying Du, Zhaowei Zhang, Yu Deng, Li Zhao, Hao Zhao, Zongqing Lu, Oier Mees, Marc Pollefeys, Jiaolong Yang, Baining Guo
LAPT-Scale introduces a latent action pre‑training framework that leverages large‑scale egocentric human videos to train embodied robotic policies. The method comprises LAPT‑Scale‑LAM, which learns continuous latent actions by modeling visual transitions in human videos, and LAPT‑Scale‑Policy, which aligns these latent actions with robot embodiment and fine‑tunes for specific tasks. Using 23.3K hours of video, the approach improves real‑robot success rates from 63.3% to 85.0% and generalizes to unseen visual conditions.
By Zhiyuan Xiang, Peidong Liu, Mingyang Li, Jiawei Li, Wenhow Li, Wenbo Ding, Xiang Deng
World models enable agents to perform forward rollout and planning without real-world interaction. However, their application in open-world embodied intelligence remains limited by the high cost of action annotations and the heterogeneity of action spaces across platforms.
Embodied foundation models are expected to benefit from data scaling like large language models, but face a much tighter data bottleneck. Teleoperated real-robot trajectories remain the dominant pretraining source due to their precise action supervision and embodiment alignment, yet their scalability is limited by high collection cost, acquisition difficulty, and low behavioral and environmental diversity.
The paper introduces NAVA-WAM, a method that learns action priors directly from observation-only videos to pretrain action policies for robots. It uses a two-stage training process: first, it pretrains on videos with future‑video flow‑matching supervision to learn action‑relevant priors, and second, it fine‑tunes with action‑labeled demonstrations for robot control. Experiments show that NAVA‑WAM outperforms previous methods in both in‑distribution and out‑of‑distribution scenarios, achieving strong action‑label efficiency and real‑robot generalization.
By Zhaochong An, Fei Zhang, Menglin Jia, Duncan Frost, Zijian Zhou, Yikai Wang, Xudong Wang, Aditya Patel, Belinda Zeng, Tao Xiang, Serge Belongie, Amir Bar, Sen He