arXiv Computer Vision By Minh Canh Tu, Quang-Binh Nguyen, Khoi Nguyen

ArtCrafter: Feed-Forward Generation of Articulated 3D Object with Analytic Joint Derivation

Read the original on arXiv Computer Vision →

ArtCrafter is a feed‑forward generative model that creates articulated 3D objects from two images—one in the rest state and one in the open state—by producing part‑level meshes for both states in a single forward pass. It uses a DiT‑based architecture with a $1+2N$ slot layout inspired by Slot Attention, Triplet Attention for cross‑state consistency, and a repulsion loss to avoid part penetration. The model analytically derives URDF joint parameters from the rigid transformation between paired meshes, offering an interpretable alternative to learned joint regression, and outperforms existing methods in geometry quality and articulation precision on both in‑distribution and out‑of‑distribution datasets.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

Hugging Face Trending Papers
Nov 5

ArtCrafter: Feed-Forward Generation of Articulated 3D Object with Analytic Joint Derivation

ArtCrafter is a feed‑forward generative model that creates articulated 3D objects from two images—one in the rest state and one in the open state. It uses a DiT‑based architecture with a $1+2N$ slot layout inspired by Slot Attention to jointly produce part‑level meshes for both states, while Triplet Attention and a repulsion loss enforce geometric consistency and prevent part penetration. The model analytically derives URDF joint parameters from the paired meshes, offering an interpretable alternative to learned regression, and outperforms existing methods in geometry quality and articulation precision on both in‑distribution and out‑of‑distribution datasets.

arXiv Computer Vision
Sep 11

Artic-O: End-to-End Articulated Object Reconstruction via Latent Geometry Learning

Artic-O is an end‑to‑end, feed‑forward framework that reconstructs articulated objects from sparse images by learning latent geometry. It maps multi‑state observations into a pretrained latent geometry space, uses a frozen flow‑matching decoder for complete‑shape priors, and fuses visual tokens with geometry latents in an image‑grounded part‑reasoning module to segment active parts and predict articulation. Trained with a geometry‑to‑articulation curriculum and a decoupled two‑pass strategy, Artic‑O achieves high reconstruction quality and articulation accuracy while drastically reducing inference time from 9 minutes to about 0.3 seconds per object.

By Xuyang Wang, Zhenyu Li, Jian Ding, Habib Slim, Peter Wonka, Hongdong Li, Mohamed Elhoseiny
arXiv Computer Vision
Oct 23

MoRE: Motion-Regularized Encoding for Articulated 3D Generation

MoRE introduces a Motion-Regularized Encoding for generating articulated 3D objects from a single image. It encodes joint attributes as coordinate‑aligned joint lines with axis classification and Plücker moment coefficients, and couples attribute reconstruction to motion through a differentiable expectation over joint types and axis directions. Experiments on PartNet‑Mobility and ACD demonstrate improved part‑box agreement, articulated‑state geometry, visual similarity, and reduced joint prediction errors compared to prior methods.

By Guantian Zheng, Shan Jin
arXiv Computer Vision
Sep 18

FunArt: Decoding Functional Structure and Articulation from Generative 3D Latents

FunArt is a framework that builds articulation‑aware functional 3D scene graphs from a single static RGB‑D observation. It reconstructs object instances, converts their geometry into the O‑Voxel representation of TRELLIS.2, and uses a frozen sparse‑compression VAE as a structural prior. A lightweight query‑based decoder jointly segments movable parts and functional interactive elements while estimating motion type, axis, origin, and range, achieving state‑of‑the‑art results on the Articulate3D dataset.

By Dennis Rotondi, Abdelrhman Werby, Kai O. Arras
arXiv AI
Sep 18

FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observations

FAMOS is a feed‑forward model that predicts movable‑part segmentation and joint parameters from a sparse, unordered set of partial point clouds. It jointly reasons over multiple observations using a Multi‑state Articulation Transformer that alternates state‑wise and global attention, and introduces an observed articulation span objective to supervise motion ranges across inputs. A procedural data generator supplies self‑annotated assets for training, and experiments on PartNet‑Mobility, ACD, and ArtiCraft‑10K show consistent improvements over existing feed‑forward and optimization‑based baselines.

By Kevin Qu, Tao Sun, Massimiliano Viola, Liyuan Zhu, Zhizhuo Zhou, Sayan Deb Sarkar, Konrad Schindler, Iro Armeni
Hugging Face Trending Papers
Jul 2

PWM-ArtGen: Part World Model for Articulated Object Generation

The key challenge in articulated 3D object generation from a single image is accurately predicting the underlying kinematic structure. Existing methods either infer kinematic parameters directly from a static image that lacks dynamic part-level kinematic relationships, or estimate parameters from visual dynamics generated from a single image, which is prone to accumulated errors of two steps.