arXiv Computer Vision By Dennis Rotondi, Abdelrhman Werby, Kai O. Arras

FunArt: Decoding Functional Structure and Articulation from Generative 3D Latents

Read the original on arXiv Computer Vision →

FunArt is a framework that builds articulation‑aware functional 3D scene graphs from a single static RGB‑D observation. It reconstructs object instances, converts their geometry into the O‑Voxel representation of TRELLIS.2, and uses a frozen sparse‑compression VAE as a structural prior. A lightweight query‑based decoder jointly segments movable parts and functional interactive elements while estimating motion type, axis, origin, and range, achieving state‑of‑the‑art results on the Articulate3D dataset.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
Sep 11

Artic-O: End-to-End Articulated Object Reconstruction via Latent Geometry Learning

Artic-O is an end‑to‑end, feed‑forward framework that reconstructs articulated objects from sparse images by learning latent geometry. It maps multi‑state observations into a pretrained latent geometry space, uses a frozen flow‑matching decoder for complete‑shape priors, and fuses visual tokens with geometry latents in an image‑grounded part‑reasoning module to segment active parts and predict articulation. Trained with a geometry‑to‑articulation curriculum and a decoupled two‑pass strategy, Artic‑O achieves high reconstruction quality and articulation accuracy while drastically reducing inference time from 9 minutes to about 0.3 seconds per object.

By Xuyang Wang, Zhenyu Li, Jian Ding, Habib Slim, Peter Wonka, Hongdong Li, Mohamed Elhoseiny
arXiv AI
Oct 15

Articulated 3D Scene Graphs for Open-World Mobile Manipulation

The paper introduces MoMa-SG, a framework that constructs semantic‑kinematic 3D scene graphs for articulated scenes using RGB‑D sequences. It segments interactions, tracks points robustly, estimates joint parameters in a single optimization, and associates objects with articulations to detect contained items. The authors also present the Arti4D‑Semantic dataset with 62 real‑world sequences and demonstrate the system’s effectiveness on a quadruped and a mobile manipulator.

By Martin B\"uchner, Adrian R\"ofer, Tim Engelbracht, Tim Welschehold, Zuria Bauer, Hermann Blum, Marc Pollefeys, Abhinav Valada
Hugging Face Trending Papers
Nov 5

ArtCrafter: Feed-Forward Generation of Articulated 3D Object with Analytic Joint Derivation

ArtCrafter is a feed‑forward generative model that creates articulated 3D objects from two images—one in the rest state and one in the open state. It uses a DiT‑based architecture with a $1+2N$ slot layout inspired by Slot Attention to jointly produce part‑level meshes for both states, while Triplet Attention and a repulsion loss enforce geometric consistency and prevent part penetration. The model analytically derives URDF joint parameters from the paired meshes, offering an interpretable alternative to learned regression, and outperforms existing methods in geometry quality and articulation precision on both in‑distribution and out‑of‑distribution datasets.