arXiv Computer Vision October 12, 2026 By Hyeonwoo Kim, Jeonghwan Kim, Kyungwon Cho, Junyoung Lee, Hanbyul Joo

DeVI: Physics-based Dexterous Human-Object Interaction via Synthetic Video Imitation

Read the original on arXiv Computer Vision →

DeVI (Dexterous Video Imitation) is a framework that learns physics‑based character control for dexterous human‑object interaction by imitating text‑conditioned synthetic videos. It introduces hybrid imitation targets that combine reconstructed 3D human motion with tracked 2D object trajectories, avoiding explicit 3D object motion reconstruction. Visual HOI Alignment further refines the human reference to match both the generated video and the initial 3D object configuration, improving reconstruction quality and imitation success.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Machine Learning

Jun 10

Dexterous Point Policy: Learning Point-based Dexterous Hand Policies from Human Demonstrations

arXiv:2606. 10614v1 Announce Type: cross Abstract: Robotic foundation models pre-trained on human demonstration videos have shown promise, but a significant embodiment gap remains when the resulting policies are deployed on real robots.

By Beomjun Kim, Seong Hyeon Park, Seunghoon Sim, Seungjun Moon, Sanghyeok Lee, Jinwoo Shin

llms agents robotics fine-tuning benchmarks

arXiv AI

Aug 17

AdvDex: Learning Dexterous Manipulation from Human Demonstrations via Joint-Aligned Actions and Adversarial Learning

arXiv:2608. 14028v1 Announce Type: cross Abstract: Dexterous manipulation is a fundamental capability for embodied intelligence, but scaling it remains difficult because robot demonstrations are expensive to collect and action spaces vary across embodiments.

By Zhiyue Zhao, Jingyi Wu, Hairuo Liu, Mingyu Liu, Liyang Li, Hengdi Zhang, Tong He, Zhengxue Cheng

robotics multimodal safety

arXiv AI

Oct 7

SMART: Zero-Shot Sim-to-Real Articulated Object Manipulation via Large-Scale Synthetic Pretraining

SMART introduces a scalable system for zero‑shot sim‑to‑real articulated object manipulation by leveraging large‑scale synthetic pretraining. The core component, SMART‑Sim, is an articulation‑aware simulation platform that facilitates efficient task generation and demonstration collection. Using SMART‑Sim, the authors synthesize SMART‑Data, comprising over 1 million demonstrations across 44 task types, 5 robot setups, and 2,507 articulated objects, and demonstrate that a vision‑language‑action model pretrained on this data achieves competitive simulation performance and zero‑shot transfer to real‑world tasks.

By Jicong Ao, Shuhan Jiang, Yuling Zhong, Yanwen Liu, Yuhan Gao, Jiangyuan Zhao, Yang Zhang, Shiqiang Zhu, Chenjia Bai, Xuelong Li

agents robotics multimodal benchmarks

Hugging Face Trending Papers

Jul 29

ContactFlow: A video action conditioning that transfers across embodiments

World models offer a promising route toward robot planning by enabling agents to imagine and verify the consequences of actions before execution. However, current video-based world models often struggle to capture the physical constraints that govern manipulation, particularly contact.

llms agents robotics multimodal

arXiv Computer Vision

Sep 17

Track, Articulate, Act: Generating Articulation from Casual Human Videos

arXiv:2609.19119v1 Announce Type: new Abstract: Human videos contain rich causal evidence for robot manipulation: they reveal how hand motion induces object motion and produces task-relevant changes...

By Jiaming Zhang, Homanga Bharadhwaj

computer-vision robotics

arXiv Machine Learning

Jun 19

Pose6DAug: Physically Plausible Multi-view Object Swapping for Robot Data Augmentation

arXiv:2606. 20118v1 Announce Type: cross Abstract: Vision-language-action (VLA) policies have shown strong potential for general-purpose manipulation, yet they often fail on novel, out-of-distribution objects whose appearance or geometry deviates from the training distribution.

By Jonghoon Lee, Seong Hyeon Park, Byungwoo Jeon, Minha Lee, Jinwoo Shin

robotics fine-tuning multimodal benchmarks