3D-SceneQ: Empowering 3D LLM With Query-Guided Adaptive Pruning and Multi-Modal Feature Enhancement

3D-SceneQ is a new 3D large language model that tackles two key limitations of existing 3D scene understanding pipelines: the inclusion of irrelevant object tokens that add noise, and the exclusive use of point cloud data that lacks rich semantic cues. It introduces a Query‑Guided Adaptive Pruning (QGAP) module that selectively keeps task‑relevant objects based on user instructions, and a Multi‑modal Object‑level Feature Enhancement (MOFE) module that fuses 2D feature embeddings into the 3D representation to enrich semantic information. Experiments show that 3D‑SceneQ surpasses state‑of‑the‑art methods on several benchmarks, achieving significant gains in metrics such as CIDEr and EM@1.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

• llms
• rag
• efficiency
• multimodal
• benchmarks
• safety