Egocentric human data offer a path to scaling robot learning beyond costly robot demonstrations, yet the embodiment gap makes raw human trajectories a poor supervisory target for control. Our key insi...
EgoLAP is a VLA pre‑training framework that learns from both human and robot trajectories by expressing motion intent as temporally abstracted language actions linked to motion‑level reasoning grounded in scene geometry, physics, and object affordances. It jointly trains on a shared language‑based action chain‑of‑thought, enabling the transfer of human experience to robot control. In extensive real‑world and simulated experiments, EgoLAP achieves 80.1% mean real‑world task progress, a 2.3× improvement over alternative action representations, and outperforms composite reasoning formats.
arXiv:2606. 00054v1 Announce Type: cross Abstract: Recent progress in generalizable embodied control has been driven by large-scale pretraining of Vision-Language-Action (VLA) models.
PDRVLA is a Vision‑Language‑Action model that incorporates a lightweight Physical Dynamics Module to extract physical tokens from vision‑language features, enabling action generation without online video synthesis. The module predicts future RGB, depth, and optical‑flow features, guided by auxiliary supervision from a frozen pretrained video world model. Trained solely on publicly available data augmented with human‑to‑robot synthesis, subtask annotation, and embodied chain‑of‑thought (ECoT) annotation, PDRVLA achieves high success rates across four simulation benchmarks, with ablations demonstrating the benefits of world‑model supervision and various conditioning strategies.
arXiv:2607. 00836v1 Announce Type: cross Abstract: World models are increasingly used in embodied intelligence and generative simulation, yet their scope remains ambiguous across communities.
The survey "World-Action Models for Robot Learning and Control" reviews recent advances in coupling future world prediction with executable action generation for robots in open environments. It clarifies the scope of World-Action Models (WAMs) relative to conventional world models, model-based RL, and Vision‑Language‑Action policies, and organizes existing methods through a unified taxonomy covering representations, transition modeling, action interfaces, architectures, training pipelines, data modalities, and scaling strategies. The paper also surveys applications in manipulation, navigation, and autonomous driving, summarizes datasets, benchmarks, and metrics, and discusses key challenges such as action alignment, spatial consistency, long‑horizon memory, and efficient inference.
The paper introduces NAVA-WAM, a method that learns action priors directly from observation-only videos to pretrain action policies for robots. It uses a two-stage training process: first, it pretrains on videos with future‑video flow‑matching supervision to learn action‑relevant priors, and second, it fine‑tunes with action‑labeled demonstrations for robot control. Experiments show that NAVA‑WAM outperforms previous methods in both in‑distribution and out‑of‑distribution scenarios, achieving strong action‑label efficiency and real‑robot generalization.
arXiv:2606. 17046v1 Announce Type: cross Abstract: Generalist robot policies must follow user instructions while reasoning about how objects, cameras, and robot actions interact in the 3D physical world.
The paper proposes a new architecture for Vision‑Language‑Action (VLA) models that improves sample efficiency by training a predictive world model on the vision encoder’s embedding space. It argues that these embeddings are action‑relevant and can be used to predict future states, addressing the lack of an explicit world model in current VLAs. The trained model can also support short‑term planning by sampling actions that lead to desired goal images.
arXiv:2610.36925v1 Announce Type: new Abstract: Learning from experience is essential for building the next generation of agents that continually expand their capabilities. Pretrained vision-language...
World Action Planner is a robot planning system that uses an action-conditioned world model to search for and compose executable action plans. The agent performs a coarse-to-fine search: first a global action optimization over imagined rollouts to spot potential failures, then a local action search comparing neighboring candidates to pick the best action. In compositional long-horizon tasks, novel object layouts, and real‑robot planning without expert demonstrations, it consistently outperforms state‑of‑the‑art end‑to‑end generalist policies and VLM planners.
arXiv:2608. 06994v1 Announce Type: cross Abstract: World Action Models (WAMs) aim to construct a unified architecture capable of understanding world state evolution and guiding to generative motion planning.