arXiv Computer Vision

A Unified Framework for Image-to-3D Part Generation via Variable Granularity

FlexPart is a unified image‑to‑3D part generation framework that allows variable‑granularity geometric conditions—ranging from sparse points to dense bounding boxes and masks—within a single model. It uses gated adaptive modulation to integrate heterogeneous inputs and an asymmetric geometric guidance mechanism to align representations across granularities, improving geometric consistency and inter‑task synergy. On the PartVerseXL dataset, FlexPart achieves a 16.6% reduction in Part CD compared to TripoSG + SAM3D and a 10.5% reduction compared to OmniPart while maintaining competitive whole‑mesh quality.

arXiv Computer Vision
6d ago

FlexPart: Text-Controlled Semantics-Aware 3D Part Segmentation at Flexible Granularity

FlexPart is a new framework that enables text‑controlled, semantics‑aware 3D mesh segmentation at any desired granularity. It introduces a holistic control prompt that combines part names with location and shape clauses, and uses a Vision‑Language Model pipeline to generate a large multi‑granularity dataset. The model produces a view‑independent part‑identity field in 3D space, and an inference‑time VLM planner can auto‑complete descriptive clauses from 2D renderings, allowing users to specify parts with ordinary words. FlexPart outperforms strong baselines by up to 22% in mIoU on its benchmark and improves selective segmentation by 35% over click‑driven methods.

By Yiqun Zhao, Jiachen Xu, Yihao Zhi, Yunfei Zhao, Zibo Zhao, Xintong Han, Chunchao Guo, Shenghua Gao
Hugging Face Trending Papers
Aug 13

SCULPT: Subtractive Composition for 3D Part Generation

Part-aware 3D generation aims to create digital assets that are coherent as complete objects while exposing structural parts for editing, material assignment, animation, and reuse. Existing methods impose this structure outside the native generation loop: segmentation-based methods partition an already generated shape, while additive methods synthesize parts from predefined layouts, boxes, or tokens and then reconcile them into a whole.

arXiv Computer Vision
Oct 16

Seeing Both the Forest and the Trees: Reusing Holistic 3D Priors for Part-Decomposed Generation

STRUCTPARTS is a new framework that reuses holistic 3D priors to generate part‑decomposed 3D assets. It introduces a dual‑frame coordinate interleaving mechanism, interpreting each shape latent under both part‑local and object‑global reference frames and processing them with a global‑local inter‑leaved transformer. Using a segmented mesh scaffold as structural input, the method achieves detailed intra‑part geometry and coherent inter‑part structure with lightweight finetuning, outperforming prior part‑decomposed models on PartObjaverse‑Tiny while enabling part‑mesh refinement and editing.

By Yiqun Zhao, Binbin Huang, Haobin Duan, Zibo Zhao, Shenghua Gao
arXiv AI
Sep 16

KaiNinja: Extending Native 3D Generators to the Part Level

KaiNinja extends the native 3D generator TRELLIS.2 to produce part-level meshes by introducing a dual‑volume representation that overcomes the single‑sheet limitation of the O‑Voxel grid. It maintains TRELLIS.2’s speed and quality while eliminating the need for external segmentation, and is trained on diverse data including CAD models and assets created by an LLM‑driven agent. The method improves whole‑object fidelity and outperforms other part‑generation pipelines, reducing Chamfer distance by 40% and increasing strict part F‑score by 16%.

By Ruihan Yu, Lian Fu, Muyao Niu, Zheng-hui Huang, Yu-Ju Tsai, Sho Kuno, Fengbo Lan, Yonghao Yu, Erwin Wu, Ming-Hsuan Yang, Kaipeng Zhang, Zhixiang Wang