arXiv Computer Vision

Seeing Both the Forest and the Trees: Reusing Holistic 3D Priors for Part-Decomposed Generation

STRUCTPARTS is a new framework that reuses holistic 3D priors to generate part‑decomposed 3D assets. It introduces a dual‑frame coordinate interleaving mechanism, interpreting each shape latent under both part‑local and object‑global reference frames and processing them with a global‑local inter‑leaved transformer. Using a segmented mesh scaffold as structural input, the method achieves detailed intra‑part geometry and coherent inter‑part structure with lightweight finetuning, outperforming prior part‑decomposed models on PartObjaverse‑Tiny while enabling part‑mesh refinement and editing.

Hugging Face Trending Papers
Aug 13

SCULPT: Subtractive Composition for 3D Part Generation

Part-aware 3D generation aims to create digital assets that are coherent as complete objects while exposing structural parts for editing, material assignment, animation, and reuse. Existing methods impose this structure outside the native generation loop: segmentation-based methods partition an already generated shape, while additive methods synthesize parts from predefined layouts, boxes, or tokens and then reconcile them into a whole.

arXiv AI
Sep 16

KaiNinja: Extending Native 3D Generators to the Part Level

KaiNinja extends the native 3D generator TRELLIS.2 to produce part-level meshes by introducing a dual‑volume representation that overcomes the single‑sheet limitation of the O‑Voxel grid. It maintains TRELLIS.2’s speed and quality while eliminating the need for external segmentation, and is trained on diverse data including CAD models and assets created by an LLM‑driven agent. The method improves whole‑object fidelity and outperforms other part‑generation pipelines, reducing Chamfer distance by 40% and increasing strict part F‑score by 16%.

By Ruihan Yu, Lian Fu, Muyao Niu, Zheng-hui Huang, Yu-Ju Tsai, Sho Kuno, Fengbo Lan, Yonghao Yu, Erwin Wu, Ming-Hsuan Yang, Kaipeng Zhang, Zhixiang Wang
arXiv Computer Vision
Aug 26

SceneReGen: Generative Reconstruction of 3D Scenes from a Single Image

SceneReGen is a new framework for reconstructing 3D scenes from a single image by generating and assembling complete object meshes within a shared observation‑aligned scene frame. It uses selective pose factorization to encode each object’s observed orientation directly into the generated mesh, while estimating translation and scale from instance‑level and global scene cues. Evaluated on the 3D‑FUTURE dataset, SceneReGen outperforms existing methods on scene‑level metrics and shows strong performance on object‑level metrics, demonstrating its effectiveness in autonomous‑driving and embodied‑AI scenarios.

By Zefan Tian, Yuteng Ye, Yiheng Zhang, Yuhang Yang, Xueqiang Lv, Shizhou Zhang, Le Liu, Di Xu
arXiv Computer Vision
Sep 11

Artic-O: End-to-End Articulated Object Reconstruction via Latent Geometry Learning

Artic-O is an end‑to‑end, feed‑forward framework that reconstructs articulated objects from sparse images by learning latent geometry. It maps multi‑state observations into a pretrained latent geometry space, uses a frozen flow‑matching decoder for complete‑shape priors, and fuses visual tokens with geometry latents in an image‑grounded part‑reasoning module to segment active parts and predict articulation. Trained with a geometry‑to‑articulation curriculum and a decoupled two‑pass strategy, Artic‑O achieves high reconstruction quality and articulation accuracy while drastically reducing inference time from 9 minutes to about 0.3 seconds per object.

By Xuyang Wang, Zhenyu Li, Jian Ding, Habib Slim, Peter Wonka, Hongdong Li, Mohamed Elhoseiny
arXiv Computer Vision
6d ago

FlexPart: Text-Controlled Semantics-Aware 3D Part Segmentation at Flexible Granularity

FlexPart is a new framework that enables text‑controlled, semantics‑aware 3D mesh segmentation at any desired granularity. It introduces a holistic control prompt that combines part names with location and shape clauses, and uses a Vision‑Language Model pipeline to generate a large multi‑granularity dataset. The model produces a view‑independent part‑identity field in 3D space, and an inference‑time VLM planner can auto‑complete descriptive clauses from 2D renderings, allowing users to specify parts with ordinary words. FlexPart outperforms strong baselines by up to 22% in mIoU on its benchmark and improves selective segmentation by 35% over click‑driven methods.

By Yiqun Zhao, Jiachen Xu, Yihao Zhi, Yunfei Zhao, Zibo Zhao, Xintong Han, Chunchao Guo, Shenghua Gao