arXiv Computer Vision By Qiwen Gu, Xin Zhou, Xiwu Chen, Zhongyang Zhu, Zhuo Zhang, Junqiao Zhao

A Unified Framework for Image-to-3D Part Generation via Variable Granularity

Read the original on arXiv Computer Vision →

FlexPart is a unified image‑to‑3D part generation framework that allows variable‑granularity geometric conditions—ranging from sparse points to dense bounding boxes and masks—within a single model. It uses gated adaptive modulation to integrate heterogeneous inputs and an asymmetric geometric guidance mechanism to align representations across granularities, improving geometric consistency and inter‑task synergy. On the PartVerseXL dataset, FlexPart achieves a 16.6% reduction in Part CD compared to TripoSG + SAM3D and a 10.5% reduction compared to OmniPart while maintaining competitive whole‑mesh quality.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
6d ago

FlexPart: Text-Controlled Semantics-Aware 3D Part Segmentation at Flexible Granularity

FlexPart is a new framework that enables text‑controlled, semantics‑aware 3D mesh segmentation at any desired granularity. It introduces a holistic control prompt that combines part names with location and shape clauses, and uses a Vision‑Language Model pipeline to generate a large multi‑granularity dataset. The model produces a view‑independent part‑identity field in 3D space, and an inference‑time VLM planner can auto‑complete descriptive clauses from 2D renderings, allowing users to specify parts with ordinary words. FlexPart outperforms strong baselines by up to 22% in mIoU on its benchmark and improves selective segmentation by 35% over click‑driven methods.

By Yiqun Zhao, Jiachen Xu, Yihao Zhi, Yunfei Zhao, Zibo Zhao, Xintong Han, Chunchao Guo, Shenghua Gao
Hugging Face Trending Papers
Aug 13

SCULPT: Subtractive Composition for 3D Part Generation

Part-aware 3D generation aims to create digital assets that are coherent as complete objects while exposing structural parts for editing, material assignment, animation, and reuse. Existing methods impose this structure outside the native generation loop: segmentation-based methods partition an already generated shape, while additive methods synthesize parts from predefined layouts, boxes, or tokens and then reconcile them into a whole.

arXiv Computer Vision
Oct 16

Seeing Both the Forest and the Trees: Reusing Holistic 3D Priors for Part-Decomposed Generation

STRUCTPARTS is a new framework that reuses holistic 3D priors to generate part‑decomposed 3D assets. It introduces a dual‑frame coordinate interleaving mechanism, interpreting each shape latent under both part‑local and object‑global reference frames and processing them with a global‑local inter‑leaved transformer. Using a segmented mesh scaffold as structural input, the method achieves detailed intra‑part geometry and coherent inter‑part structure with lightweight finetuning, outperforming prior part‑decomposed models on PartObjaverse‑Tiny while enabling part‑mesh refinement and editing.

By Yiqun Zhao, Binbin Huang, Haobin Duan, Zibo Zhao, Shenghua Gao