arXiv Computer Vision
AffordanceWAM: Affordance-Aware Joint World-Action Modeling for Robot Manipulation
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv Machine Learning
Oct 9
Being-M0.7: A Latent World-Action Model for Humanoid Robots
Being‑M0.7 is a latent world‑action model that learns from a large mixed‑modality human dataset (over 10,000 hours of video‑only, motion‑only, and paired video‑motion data) to predict future latent visual states and motion. The model is pre‑trained on human data, adapted to robot viewpoints during mid‑training, and then combined with an action expert via gated cross‑attention during post‑training to produce executable whole‑body commands. In experiments, Being‑M0.7 outperforms baselines on the SIMPLE benchmark and matches the best baseline on real‑world Unitree G1 loco‑manipulation tasks.
arXiv Computer Vision
Oct 16
Perceive, Predict, and Plan: a Unified World Action Model for Egocentric Dexterous Manipulation
The paper introduces P³-WAM, a unified world action model for egocentric dexterous manipulation that integrates 3D perception, action-conditioned prediction, and goal-directed planning. It operates in three modes—Perceive, Predict, and Plan—using a mixture-of-transformers architecture that shares base weights and adapts to modality-specific inputs. Experiments demonstrate that unified training improves performance across all three capabilities, outperforming specialized baselines on 3D hand reconstruction and action-conditioned video prediction while producing more instruction‑adherent manipulation videos.
arXiv Computer Vision
Sep 23
MachEmbodied-U0: Unified Understanding and Generation Model for Embodied Intelligence
arXiv:2609.25627v1 Announce Type: cross Abstract: General-purpose robot control requires models to understand task intent, identify where to interact, capture how the scene evolves, and generate prec...
arXiv Computer Vision
Oct 27
EXE: Egocentric Cross-Embodiment Pretraining via Factorized Latent Actions for VLA Models
arXiv:2610.33685v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models are bottlenecked by the scarcity of robot data. Egocentric human manipulation videos offer an abundant, diverse,...
arXiv Computer Vision
Oct 28
PDRVLA: A Vision-Language-Action Model with Physical Dynamics Representations
PDRVLA is a Vision‑Language‑Action model that incorporates a lightweight Physical Dynamics Module to extract physical tokens from vision‑language features, enabling action generation without online video synthesis. The module predicts future RGB, depth, and optical‑flow features, guided by auxiliary supervision from a frozen pretrained video world model. Trained solely on publicly available data augmented with human‑to‑robot synthesis, subtask annotation, and embodied chain‑of‑thought (ECoT) annotation, PDRVLA achieves high success rates across four simulation benchmarks, with ablations demonstrating the benefits of world‑model supervision and various conditioning strategies.
arXiv AI
Oct 27
AffordSim: A Scalable Data Generator and Benchmark for Affordance-Aware Robotic Manipulation
AffordSim is a scalable data generator and benchmark that integrates open‑vocabulary 3D affordance prediction into simulation‑based trajectory generation for robotic manipulation. Given a natural‑language task description, it synthesizes task‑relevant scenes, queries affordances, grounds them on object surfaces, samples region‑conditioned grasps, and selects executable candidates with motion planning, while randomizing pose, texture, lighting, noise, and backgrounds for sim‑to‑real transfer. The benchmark includes 50 tasks, five robot embodiments, and over 500 objects, achieving 93% of the success rate of manual contact annotations on affordance‑critical tasks and 89% on hard composite tasks, with policies trained on AffordSim transferring zero‑shot to a real Franka FR3 with 24% average success.