arXiv:2607. 27549v1 Announce Type: cross Abstract: Recent progress in large-scale imitation learning for robot manipulation has been driven by leveraging datasets across a wide range of robot embodiments.
Recent progress in large-scale imitation learning for robot manipulation has been driven by leveraging datasets across a wide range of robot embodiments. However, achieving significant cross-embodiment transfer is often still challenging.
The paper introduces RoboTryOn, a method that transforms human egocentric videos into synthetic demonstrations for robots by virtually swapping the human with a target robot while preserving task, objects, and background. It uses autoregressive keyframe translation guided by human hand skeletons and an inverse dynamics model to generate action labels for policy learning. Experiments on various humanoid robots show that policies trained on these synthetic videos achieve up to 60% success on new tasks, matching teleoperated demonstration performance at roughly one‑third the cost.
arXiv:2611.05163v2 Announce Type: replace-cross Abstract: Robot foundation models have shown remarkable performance in robot control, yet adapting them to a new task still relies heavily on teleopera...
arXiv:2507. 06219v2 Announce Type: replace-cross Abstract: Data scaling has driven remarkable success in foundation models for Natural Language Processing (NLP) and Computer Vision (CV), yet the principles of effective data scaling in robotic manipulation remain insufficiently understood.
The paper introduces Hierarchical Skill Retrieval (HSR), a framework that decomposes a target manipulation task into candidate skill sequences and evaluates each plan for semantic plausibility and skill reliability. HSR combines subtask-level language retrieval with behavior-feature reranking to select demonstrations that are both relevant and compatible with the target task, followed by a two-stage pretraining and finetuning pipeline for policy adaptation. Experiments on the LIBERO benchmark and real-world robot tasks show that HSR improves average success rates by 10.3% and 21.3% over the strongest baseline, demonstrating the effectiveness of structured skill-level retrieval for data-efficient Vision‑Language‑Action adaptation.
HIL-UMI is a policy-guided Universal Manipulation Interface that enables robot‑free, human‑in‑the‑loop post‑training of vision‑language‑action models. By querying the current policy during handheld demonstrations and using an Energy Score to detect out‑of‑distribution states, it selectively collects new data and refines a progress‑based advantage estimator. The updated estimator then drives advantage‑conditioned behavioral cloning, improving performance on long‑horizon and precise manipulation tasks while reducing per‑frame collection time compared to HG‑DAgger.
EgoJEPA is a three‑stage framework that learns embodiment‑agnostic representations from egocentric human videos, eliminating the need for hand‑crafted retargeting mappings. It first pre‑trains latent actions via visual prediction conditioned on hand‑motion differences, then models future visual dynamics and latent actions jointly, and finally adapts to specific robots with lightweight action adapters. Experiments on five manipulation tasks across three robot embodiments show a 74% average success rate versus 65% for a retargeting baseline, while cutting cross‑embodiment wall‑clock cost by 47.2%.
arXiv:2608.22301v1 Announce Type: cross Abstract: Humans imitate at the level of intent: given a demonstration, we infer its goal and carry it out with whatever tools, objects, and layouts are at han...
RoboGene is an agentic framework designed to generate diverse and informative manipulation tasks for single-arm, dual-arm, and mobile robots. It employs diversity-driven sampling, agentic self-reflection for task quality assessment, and human-verified feedback memory to validate and refine tasks. The framework produced 18,000 real-world trajectories and introduced new metrics for task feasibility and diversity, outperforming models like GPT‑4o and Gemini 2.5 Pro in training VLA models that achieve higher success rates and stronger generalization.
arXiv:2610.33685v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models are bottlenecked by the scarcity of robot data. Egocentric human manipulation videos offer an abundant, diverse,...
Open‑HumanScale presents the first fully open recipe for scaling egocentric human video pretraining to 50,000 hours, supported by the curated Open‑HumanScale‑50K corpus annotated with hand motion and natural language. Using this corpus, the authors develop HumanWAM‑Vanilla, a world–action model that achieves high success rates on RoboTwin 2.0 and RoboDojo after robot post‑training, and HumanWAM‑Goal, a visual‑goal‑conditioned model that further improves zero‑shot performance and demonstrates embodied in‑context learning on physical robots. The paper also releases the dataset, curation pipelines, pretrained checkpoints, and evaluation tools to enable reproducible scaling research in embodied AI.