arXiv Computer Vision

A Sparse Topometric Graph for Scalable Cross-Session Indoor Navigation

arXiv Computer Vision
Sep 18

SceneTeract: Probing and Improving Agent-Aware Activity Reasoning in 3D Indoor Scenes

SceneTeract is a verification interface that separates semantic action understanding from physical feasibility in indoor 3D scenes. It decomposes activities into atomic actions and performs explicit geometric checks to determine executability, providing diagnostic traces for failures. The system reveals widespread functional and accessibility issues in synthetic scenes, shows that existing VLMs over‑predict action feasibility, and improves VLM performance through post‑training with verifier feedback, with benefits that generalize to real‑world scenes.

By L\'eopold Maillard, Francis Engelmann, Tom Durand, Boxiao Pan, Yang You, Leonidas Guibas, Maks Ovsjanikov
arXiv Computer Vision
3d ago

Reading the Room: Scale-ambiguous Semantic Registration of Sparse VSLAM Maps to Floor Plans in Partially Built Environments

Reading the Room (RR) is a global‑local method that registers scale‑ambiguous, sparse semantic VSLAM maps to partially built floor plans. It introduces a single robust, differentiable, class‑balanced semantic‑geometric energy function that drives all pipeline stages, and offers two global initialization schemes—one using a single user‑provided correspondence and another using a cross‑modal matching network. Evaluated on 33 sequences from three construction sites, RR outperforms classical and learning‑based baselines, improving mean absolute trajectory error by 4.5× overall and 7.6× when an anchor is supplied.

By Bjorn Stragier, Emilia Szyma\'nska, J. Micah Prendergast, Lukas Rosenberger Schmid
arXiv Computer Vision
Oct 2

LangMap: A Human-Verified Benchmark for Hierarchical Open-Vocabulary Goal Navigation

LangMap introduces a human‑verified benchmark for language‑conditioned goal navigation (LGN) that spans four hierarchical semantic levels—scene, room, region, and instance—within real‑world indoor 3D scans. The dataset, built on HM3D, contains 18K tasks with concise and detailed descriptions for 414 object categories, and its contrastive annotation protocol ensures high‑quality, discriminative region and instance labels. Evaluation shows that LangMap’s descriptions improve text‑to‑view matching accuracy by 23 points over GOAT‑Bench and achieve a 92.5% unique‑and‑correct match rate in an independent human audit, while a proposed RGB‑only baseline, PlaNaVid, attains top‑tier success rates without depth or 3D scene representations.

By Bo Miao, Weijia Liu, Jun Luo, Lachlan Shinnick, Jian Liu, Thomas Hamilton-Smith, Yuhe Yang, Zijie Wu, Vanja Videnovic, Feras Dayoub, Anton van den Hengel