arXiv Computer Vision
DUET-DINO: Simultaneous Cross-View World Modeling for Latent Planning in Robot Manipulation
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
Hugging Face Trending Papers
Sep 9
DUET-DINO: Simultaneous Cross-View World Modeling for Latent Planning in Robot Manipulation
Action-conditioned latent world models predict future visual representations, enabling zero-shot goal-conditioned robot planning and control. However, their predictions for fine-grained spatial and ro...
arXiv Computer Vision
Oct 5
PointWAM: 3D World Action Modeling for Dexterous Robotic Manipulation
arXiv:2610.02840v1 Announce Type: cross Abstract: World action models jointly learn to forecast world dynamics and predict robot actions, such that the learned internal world dynamics guide accurate...
arXiv Machine Learning
Oct 9
Being-M0.7: A Latent World-Action Model for Humanoid Robots
Being‑M0.7 is a latent world‑action model that learns from a large mixed‑modality human dataset (over 10,000 hours of video‑only, motion‑only, and paired video‑motion data) to predict future latent visual states and motion. The model is pre‑trained on human data, adapted to robot viewpoints during mid‑training, and then combined with an action expert via gated cross‑attention during post‑training to produce executable whole‑body commands. In experiments, Being‑M0.7 outperforms baselines on the SIMPLE benchmark and matches the best baseline on real‑world Unitree G1 loco‑manipulation tasks.
arXiv Computer Vision
Oct 12
ForeAct3D: Policy-Grounded Future World Modeling for VLA Policies
ForeAct3D is a framework that grounds future world modeling in Vision‑Language‑Action policies by decoding depth, semantic segmentation, and camera pose from policy representations into current and future 3D scene states. The future queries are conditioned on the policy‑generated action chunk, and a physical‑consistency closure enforces background staticity, instance‑level rigidity, and wrist‑camera pose alignment with end‑effector kinematics. This approach eliminates the need for future prediction at inference and achieves high success rates on LIBERO and CALVIN, outperforming the base policy across all suites.
arXiv Computer Vision
Oct 22
DepState-JEPA: Learning Depth-Grounded State Representation for Visual Perception and Manipulation
arXiv:2610.29246v1 Announce Type: cross Abstract: Predictive representations for robot manipulation should connect scene geometry with the state changes induced by actions. Our intuition is that unde...
arXiv AI
Aug 25
Inferring Action from Future Latent State for Robotic Manipulation
arXiv:2608.22067v1 Announce Type: cross Abstract: World-Action Models (WAMs) build robot control on video-generation backbones, which jointly predict dense future visual trajectories and robot action...