MonoLaDN introduces a language-guided denoising framework that transfers geometric reasoning from a frozen vision‑language model (VLM) into a monocular 3D object detector. During training, the VLM generates structured reasoning about occlusion, depth, dimension, and angle for each object, which is encoded into queries, perturbed with noise, and used to train the detector to reconstruct the clean reasoning. This process embeds the VLM’s geometric priors into the detector’s depth‑guided features, allowing the deployed model to remain purely vision‑based with no added latency or parameters, and achieves state‑of‑the‑art performance on KITTI 3D and nuScenes while generalizing well to new domains.
arXiv:2506.17545v2 Announce Type: replace Abstract: Large language models are increasingly being applied to 3D scene understanding. However, existing 3D-aware LLMs largely operate as black boxes: the...
arXiv:2608. 19973v1 Announce Type: cross Abstract: Recently, open-vocabulary 3D object detection (3D-OVD) has gained increasing attention for its ability to detect unseen objects in 3D scenes.
arXiv:2610.07958v1 Announce Type: new Abstract: Feed-forward 3D Gaussian Splatting (3DGS) reconstructs a scene in a single forward pass, replacing per-scene optimization with a network trained across...
arXiv:2607. 21595v1 Announce Type: cross Abstract: Despite rapid progress, most existing vision-language models (VLMs) built from 2D visual inputs often struggle when handling various 3D tasks that require fine-grained spatial understanding and reasoning.
OmniAct3D is a framework that adapts Vision Foundation Model (VFM) detectors trained on perspective images to equirectangular projection (ERP) panoramic images for 3D detection. It introduces the ERP-Ray Geometry Adapter (ERGA-Ray) to model spherical rays, the Visual-Action Reasoning Chain (VARC) to ground hypotheses in panoramic evidence, and the Appearance-Guided Heading Expert (AGHE) to recover high‑resolution heading cues. The method achieves a 2.96 NDS improvement on Spheriverse and a 24.87 mAP gain on PanoMMOcc, while preserving most of the baseline’s performance across configurations.
arXiv:2610.28018v1 Announce Type: new Abstract: Examining existing benchmarks for grounding in 3D VLMs reveals a pervasive "semantic leakage" in the evaluation and prompting protocols: a heavy relian...
arXiv:2606. 24353v1 Announce Type: cross Abstract: Bird's-eye view (BEV) perception fuses multi-camera images into a unified top-down representation for autonomous driving.
arXiv:2609.38177v1 Announce Type: cross Abstract: Reasoning about the 3D world from multi-view images remains a fundamental challenge for Multimodal Large Language Models (MLLMs). While modern MLLMs...
arXiv:2608.20788v1 Announce Type: new Abstract: Deep learning-based Multi-View Stereo (MVS) has advanced significantly but often generalizes poorly to unseen scenes, particularly in occluded areas or...
The paper introduces a tool‑augmented framework that enhances a small Vision‑Language Model (Qwen3.5‑4B) with geometric tools—3D object detection, metric depth estimation, and deterministic solvers for distance, size, and bearing—to improve metric spatial reasoning. By moving metric computation from the model’s weights into explicit solvers, the approach achieves significant gains on ReVSI‑Bench tasks, notably increasing absolute distance accuracy from 0.46 to 0.74 MRA and relative direction accuracy from 25.9% to 73.4%. The modular design allows swapping in different detectors, enabling a clear separation between perception and reasoning errors, and the model can autonomously sequence the tools to match a scripted pipeline on most tasks.
arXiv:2608.20720v1 Announce Type: new Abstract: Open-world 3D affordance grounding requires localizing functional object parts in 3D given free-form language queries. Existing methods typically assum...
arXiv:2610.19071v1 Announce Type: new Abstract: Monocular 3D object detection methods increasingly rely on depth-guided transformers, but they operate entirely in the perspective image plane where sp...