UniPart: Towards Zero-shot Language-Grounded 3D Part Segmentation for Embodied Interaction
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
The Flow has not summarised this story yet — read it at arXiv Computer Vision.
FlexPart is a new framework that enables text‑controlled, semantics‑aware 3D mesh segmentation at any desired granularity. It introduces a holistic control prompt that combines part names with location and shape clauses, and uses a Vision‑Language Model pipeline to generate a large multi‑granularity dataset. The model produces a view‑independent part‑identity field in 3D space, and an inference‑time VLM planner can auto‑complete descriptive clauses from 2D renderings, allowing users to specify parts with ordinary words. FlexPart outperforms strong baselines by up to 22% in mIoU on its benchmark and improves selective segmentation by 35% over click‑driven methods.
arXiv:2609.25832v1 Announce Type: new Abstract: Part segmentation is a fundamental problem in computer graphics and 3D vision. Recent works have expanded 3D part segmentation beyond fixed taxonomies,...
FAMOS is a feed‑forward model that predicts movable‑part segmentation and joint parameters from a sparse, unordered set of partial point clouds. It jointly reasons over multiple observations using a Multi‑state Articulation Transformer that alternates state‑wise and global attention, and introduces an observed articulation span objective to supervise motion ranges across inputs. A procedural data generator supplies self‑annotated assets for training, and experiments on PartNet‑Mobility, ACD, and ArtiCraft‑10K show consistent improvements over existing feed‑forward and optimization‑based baselines.
OmniLatent is a unified latent modeling framework that jointly encodes geometry, deformation, appearance, and binary part IDs for 3D part decomposition. By learning a shared latent space, it enables a single-pass generation of part-aware 3D assets from a single input image, eliminating the need for separate segmentation stages. The framework also supports extensions such as a point-prompt adapter for full segmentation and an amodal part completion model that reconstructs missing parts while maintaining global consistency.
UniRAP is a unified model that infers part-level physical affordances and translates language instructions into actionable geometric representations. It treats the task as a conditional multimodal generation problem, integrating visual inputs, textual instructions, and optional prompts into a shared spatiotemporal representation via a unified interface token mechanism. The model employs a Unified Affordance Decoder to jointly perform object detection, part-level affordance segmentation, and 4‑DoF interaction pose estimation, and uses a curriculum-based transfer training strategy to improve data efficiency with limited textual annotations.
Vision-language perception has achieved impressive progress in aligning natural language with visual observations, yet grounding high-level semantics into part-level physical interaction remains chall...