arXiv AI By Kiet Dang Vu, Cao Le Minh Khoa, Nguyen Viet Tri Pham, An Nguyen Gia, Tam Le Thuc Ho, Duc Dung Nguyen

MonoLaDN: Language-Guided DeNoising for Monocular 3D Object Detection

Read the original on arXiv AI →

MonoLaDN introduces a language-guided denoising framework that transfers geometric reasoning from a frozen vision‑language model (VLM) into a monocular 3D object detector. During training, the VLM generates structured reasoning about occlusion, depth, dimension, and angle for each object, which is encoded into queries, perturbed with noise, and used to train the detector to reconstruct the clean reasoning. This process embeds the VLM’s geometric priors into the detector’s depth‑guided features, allowing the deployed model to remain purely vision‑based with no added latency or parameters, and achieves state‑of‑the‑art performance on KITTI 3D and nuScenes while generalizing well to new domains.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Jul 24

3D-Aware VLMs with Implicit and Explicit Geometries

arXiv:2607. 21595v1 Announce Type: cross Abstract: Despite rapid progress, most existing vision-language models (VLMs) built from 2D visual inputs often struggle when handling various 3D tasks that require fine-grained spatial understanding and reasoning.

By Wenhao Li, Xueying Jiang, Quanhao Qian, Deli Zhao, Ran Xu, Shijian Lu, Gongjie Zhang
arXiv AI
Oct 5

OmniAct3D: Leveraging Foundation Geometry and Evidence-Grounded Reasoning for Panoramic 3D Detection

OmniAct3D is a framework that adapts Vision Foundation Model (VFM) detectors trained on perspective images to equirectangular projection (ERP) panoramic images for 3D detection. It introduces the ERP-Ray Geometry Adapter (ERGA-Ray) to model spherical rays, the Visual-Action Reasoning Chain (VARC) to ground hypotheses in panoramic evidence, and the Appearance-Guided Heading Expert (AGHE) to recover high‑resolution heading cues. The method achieves a 2.96 NDS improvement on Spheriverse and a 24.87 mAP gain on PanoMMOcc, while preserving most of the baseline’s performance across configurations.

By Runtong Wu, Fei Teng, Di Wen, Guoqiang Zhao, Kunyu Peng, Kailun Yang