arXiv Machine Learning
MobileVISTA: Generative Data Augmentation for Pose Generalization in Mobile Manipulation
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv AI
1d ago
MOMASPLAT: Dynamic Novel-View Demonstration Augmentation for Mobile Manipulation
arXiv:2611.08372v1 Announce Type: cross Abstract: Visuomotor policies trained through imitation learning are highly sensitive to changes in camera viewpoint. This is particularly problematic for mobi...
arXiv Computer Vision
Oct 15
$\lambda_0$: Scaling Open-World Egocentric Human Data for Humanoid Loco-Manipulation
arXiv:2610.18950v1 Announce Type: cross Abstract: Humanoid loco-manipulation requires coordinated whole-body interaction with the physical world, yet collecting robot demonstrations at scale remains...
arXiv Machine Learning
Oct 9
Being-M0.7: A Latent World-Action Model for Humanoid Robots
Being‑M0.7 is a latent world‑action model that learns from a large mixed‑modality human dataset (over 10,000 hours of video‑only, motion‑only, and paired video‑motion data) to predict future latent visual states and motion. The model is pre‑trained on human data, adapted to robot viewpoints during mid‑training, and then combined with an action expert via gated cross‑attention during post‑training to produce executable whole‑body commands. In experiments, Being‑M0.7 outperforms baselines on the SIMPLE benchmark and matches the best baseline on real‑world Unitree G1 loco‑manipulation tasks.
arXiv AI
2d ago
RoboTryOn: Synthesizing Dexterous Robot Demonstrations from Human Videos via Virtual Try-On
arXiv:2611.05163v2 Announce Type: replace-cross Abstract: Robot foundation models have shown remarkable performance in robot control, yet adapting them to a new task still relies heavily on teleopera...
arXiv Machine Learning
Sep 23
MAVP: Map-Aware Visuomotor Policies for Mobile Manipulation
MAVP (Map-Aware Visuomotor Policies) is a framework that enhances mobile manipulation by predicting explicit base-pose targets and tracking them with localisation feedback. It reconstructs a static map from teleoperated demonstrations, expressing base trajectories in a shared map frame to provide consistent spatial supervision. During execution, the policy uses RGB observations, joint states, and the robot’s current map-frame base pose to jointly predict target base poses, arm actions, and gripper actions, while a low‑level controller corrects deviations using feedforward motion and pose error feedback. Pose‑noise augmentation during training further improves robustness, and MAVP outperforms unanchored velocity control across six real‑world tasks and three policy families.
arXiv AI
1d ago
Synthesizing Dexterous Robot Demonstrations from Human Videos via Virtual Try-On
The paper introduces RoboTryOn, a method that transforms human egocentric videos into synthetic demonstrations for robots by virtually swapping the human with a target robot while preserving task, objects, and background. It uses autoregressive keyframe translation guided by human hand skeletons and an inverse dynamics model to generate action labels for policy learning. Experiments on various humanoid robots show that policies trained on these synthetic videos achieve up to 60% success on new tasks, matching teleoperated demonstration performance at roughly one‑third the cost.