PAMI: Part Anchored Motion for Text to Human-Object Interaction Generation
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
The Flow has not summarised this story yet — read it at arXiv Computer Vision.
arXiv:2609.32551v2 Announce Type: replace-cross Abstract: Text-conditioned human-object interaction (HOI) generation requires body motion, object trajectories & rotations, and hand articulation to re...
Text driven hand object interaction (HOI) generation is gaining attention for immersive applications and robotics, yet producing physically plausible interactions remains challenging. Even when individual motions appear natural, small contact errors can cause conspicuous artifacts such as floating and interpenetration.
The paper introduces Segment‑Snap, a method that jointly models movable parts, their motion, and the regions they operate on in 3D scenes. It uses learned predictors to identify part surfaces and handles, a geometric decoder to constrain motion with planar and upright priors, and a joint part‑and‑handle predictor to refine motion classes. Experiments on Articulate3D show that handle guidance boosts motion‑gated AP from 13.74% to 40.98%, while additional handle candidates and part‑based corrections further improve performance.
Synthesizing realistic full-body human interactions with articulated objects is a fundamental challenge for embodied AI and graphics, with applications in robotics training and virtual agents. Existing models remain limited: some focus on simple activities with static objects, while others restrict attention to hand-only manipulation.
arXiv:2610.00451v1 Announce Type: cross Abstract: Human motion, environmental contacts, and interaction forces are governed by common physical laws, yet existing approaches typically separate visual...
arXiv:2609.38615v1 Announce Type: cross Abstract: Egocentric videos of human manipulation provide valuable visual experience for embodied intelligence, yet collecting such data at scale is costly. Ex...