arXiv Computer Vision

FlexPart: Text-Controlled Semantics-Aware 3D Part Segmentation at Flexible Granularity

FlexPart is a new framework that enables text‑controlled, semantics‑aware 3D mesh segmentation at any desired granularity. It introduces a holistic control prompt that combines part names with location and shape clauses, and uses a Vision‑Language Model pipeline to generate a large multi‑granularity dataset. The model produces a view‑independent part‑identity field in 3D space, and an inference‑time VLM planner can auto‑complete descriptive clauses from 2D renderings, allowing users to specify parts with ordinary words. FlexPart outperforms strong baselines by up to 22% in mIoU on its benchmark and improves selective segmentation by 35% over click‑driven methods.

arXiv Computer Vision
Sep 14

UniPart: Towards Zero-shot Language-Grounded 3D Part Segmentation for Embodied Interaction

arXiv:2609.12898v1 Announce Type: new Abstract: Fine-grained robotic manipulation depends on understanding parts, not only whole objects. Existing 3D foundation models tend to be either generalized b...

By Xinqiang Yu, Zekun qi, Jiawei He, Wenyao Zhang, Xuchuan Chen, Guaocai Yao, Li Yi, Zhaoxiang Zhang, He Wang
arXiv Computer Vision
2d ago

A Unified Framework for Image-to-3D Part Generation via Variable Granularity

FlexPart is a unified image‑to‑3D part generation framework that allows variable‑granularity geometric conditions—ranging from sparse points to dense bounding boxes and masks—within a single model. It uses gated adaptive modulation to integrate heterogeneous inputs and an asymmetric geometric guidance mechanism to align representations across granularities, improving geometric consistency and inter‑task synergy. On the PartVerseXL dataset, FlexPart achieves a 16.6% reduction in Part CD compared to TripoSG + SAM3D and a 10.5% reduction compared to OmniPart while maintaining competitive whole‑mesh quality.

By Qiwen Gu, Xin Zhou, Xiwu Chen, Zhongyang Zhu, Zhuo Zhang, Junqiao Zhao
arXiv Machine Learning
Sep 2

CADKnitter: Compositional CAD Generation from Text and Geometry Guidance

CADKnitter is a compositional CAD generation framework that uses geometric-guiding cues to steer diffusion sampling, enabling the creation of complementary CAD parts that satisfy both geometric constraints of an existing model and semantic constraints from a text prompt. The authors introduce KnitCAD, a dataset of over 310,000 CAD models paired with textual prompts and assembly metadata to support training and evaluation. Experiments show that CADKnitter outperforms state‑of‑the‑art baselines by a clear margin.

By Tri Le, Khang Nguyen, Baoru Huang, Tung D. Ta, Anh Nguyen