SceneBench: A Hierarchical Benchmark for Vision-Language Understanding of 3D Scenes
Read the original on Hugging Face Trending Papers →The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
arXiv:2609.16233v1 Announce Type: cross Abstract: Vision-language models excel at 2D image understanding but remain limited in 3D spatial reasoning. Progress is hindered by limitations in current ben...
arXiv:2506.17545v2 Announce Type: replace Abstract: Large language models are increasingly being applied to 3D scene understanding. However, existing 3D-aware LLMs largely operate as black boxes: the...
MV-STRIDE is a Multi‑View hierarchical Spatial Reasoning dataset that models dependencies among perception, scene understanding, and contextual reasoning to support 3D spatial cognition. It introduces a QA generation pipeline that enforces cross‑view constraints, producing multi‑level reasoning tasks with chain‑of‑thought supervision. Experiments show that training on MV‑STRIDE yields state‑of‑the‑art performance on multi‑view spatial benchmarks, enabling MLLMs to reason robustly across diverse viewpoints.
3D-SceneQ is a new 3D large language model that tackles two key limitations of existing 3D scene understanding pipelines: the inclusion of irrelevant object tokens that add noise, and the exclusive use of point cloud data that lacks rich semantic cues. It introduces a Query‑Guided Adaptive Pruning (QGAP) module that selectively keeps task‑relevant objects based on user instructions, and a Multi‑modal Object‑level Feature Enhancement (MOFE) module that fuses 2D feature embeddings into the 3D representation to enrich semantic information. Experiments show that 3D‑SceneQ surpasses state‑of‑the‑art methods on several benchmarks, achieving significant gains in metrics such as CIDEr and EM@1.
Vision-language models (VLMs) achieve strong semantic understanding but remain unreliable in metric spatial reasoning, particularly when queries require comparing multiple instances of the same object category. We study this problem through the Closest-Instance Distance Query (CIDQ), where a model must identify the nearest visible candidate to a unique reference object and estimate their gravity-aligned floor-plane distance.
arXiv:2512.03284v2 Announce Type: replace Abstract: Spatial reasoning in large-scale 3D environments remains challenging for current vision--language models, which are typically constrained to room-s...