arXiv Computer Vision

FunArt: Decoding Functional Structure and Articulation from Generative 3D Latents

FunArt is a framework that builds articulation‑aware functional 3D scene graphs from a single static RGB‑D observation. It reconstructs object instances, converts their geometry into the O‑Voxel representation of TRELLIS.2, and uses a frozen sparse‑compression VAE as a structural prior. A lightweight query‑based decoder jointly segments movable parts and functional interactive elements while estimating motion type, axis, origin, and range, achieving state‑of‑the‑art results on the Articulate3D dataset.

arXiv Computer Vision
Sep 11

Artic-O: End-to-End Articulated Object Reconstruction via Latent Geometry Learning

Artic-O is an end‑to‑end, feed‑forward framework that reconstructs articulated objects from sparse images by learning latent geometry. It maps multi‑state observations into a pretrained latent geometry space, uses a frozen flow‑matching decoder for complete‑shape priors, and fuses visual tokens with geometry latents in an image‑grounded part‑reasoning module to segment active parts and predict articulation. Trained with a geometry‑to‑articulation curriculum and a decoupled two‑pass strategy, Artic‑O achieves high reconstruction quality and articulation accuracy while drastically reducing inference time from 9 minutes to about 0.3 seconds per object.

By Xuyang Wang, Zhenyu Li, Jian Ding, Habib Slim, Peter Wonka, Hongdong Li, Mohamed Elhoseiny
arXiv AI
Oct 15

Articulated 3D Scene Graphs for Open-World Mobile Manipulation

The paper introduces MoMa-SG, a framework that constructs semantic‑kinematic 3D scene graphs for articulated scenes using RGB‑D sequences. It segments interactions, tracks points robustly, estimates joint parameters in a single optimization, and associates objects with articulations to detect contained items. The authors also present the Arti4D‑Semantic dataset with 62 real‑world sequences and demonstrate the system’s effectiveness on a quadruped and a mobile manipulator.

By Martin B\"uchner, Adrian R\"ofer, Tim Engelbracht, Tim Welschehold, Zuria Bauer, Hermann Blum, Marc Pollefeys, Abhinav Valada
Hugging Face Trending Papers
Nov 5

ArtCrafter: Feed-Forward Generation of Articulated 3D Object with Analytic Joint Derivation

ArtCrafter is a feed‑forward generative model that creates articulated 3D objects from two images—one in the rest state and one in the open state. It uses a DiT‑based architecture with a $1+2N$ slot layout inspired by Slot Attention to jointly produce part‑level meshes for both states, while Triplet Attention and a repulsion loss enforce geometric consistency and prevent part penetration. The model analytically derives URDF joint parameters from the paired meshes, offering an interpretable alternative to learned regression, and outperforms existing methods in geometry quality and articulation precision on both in‑distribution and out‑of‑distribution datasets.

arXiv Computer Vision
Nov 6

ArtCrafter: Feed-Forward Generation of Articulated 3D Object with Analytic Joint Derivation

ArtCrafter is a feed‑forward generative model that creates articulated 3D objects from two images—one in the rest state and one in the open state—by producing part‑level meshes for both states in a single forward pass. It uses a DiT‑based architecture with a $1+2N$ slot layout inspired by Slot Attention, Triplet Attention for cross‑state consistency, and a repulsion loss to avoid part penetration. The model analytically derives URDF joint parameters from the rigid transformation between paired meshes, offering an interpretable alternative to learned joint regression, and outperforms existing methods in geometry quality and articulation precision on both in‑distribution and out‑of‑distribution datasets.

By Minh Canh Tu, Quang-Binh Nguyen, Khoi Nguyen
arXiv Computer Vision
Sep 24

Track2Art: Motion-Centric Articulated Object Model Recovery from 2D Point Trackers

Track2Art is a motion‑centric framework that recovers articulated object models from RGB‑D interaction videos by lifting 2D point tracks into 3D trajectories. It groups these trajectories into rigid‑part hypotheses and uses learned‑analytic reasoning to infer directed kinematic relations, joint types, and joint geometry. On the PartNet‑Mobility benchmark, it achieves 0.695 Point IoU and 0.410 end‑to‑end J@20 without requiring ground‑truth part counts or test‑time optimization.

By Xiaotong Li, Yixiong Jing, Junsheng Ding, Weihang Li, Benjamin Busam, Guangming Wang, Brian Sheil
arXiv Computer Vision
Oct 21

MolmoMotion: Forecasting Point Trajectories in 3D with Language Instruction

arXiv:2606.18558v2 Announce Type: replace Abstract: Motion forecasting is central to visual intelligence: agents must anticipate how objects will move in order to plan actions, reason about physical...

By Jianing Zhang, Chenhao Zheng, Yajun Yang, Max Argus, Rustin Soraki, Winson Han, Taira Anderson, Chun-Liang Li, Shuo Liu, Jiafei Duan, Zhongzheng Ren, Jieyu Zhang, Ranjay Krishna