arXiv Computer Vision By Yijie Deng, Shuaihang Yuan, Congcong Wen, Hao Huang, Anthony Tzes

FastMap: Real-Time Semantic Map Completion via Bitwise Masked Modeling

Read the original on arXiv Computer Vision →

FastMap is a lightweight two‑stage framework that completes top‑down categorical semantic maps in real time. It first compresses map patches into compact bitwise tokens using a lookup‑free BitVAE, producing a 0.41 GB model that is 3.7× smaller than prior masked‑modeling baselines. A Masked AutoEncoder transformer then reconstructs missing tokens in a single forward pass (0.011 s per map), and an object‑aware masking strategy enables goal‑conditioned generation without extra inference cost. On the Gibson benchmark, FastMap attains 34.10 % mIoU and 45.84 % semantic Success Rate, more than doubling the previous best, and achieves an 83.8 % Success Rate on downstream ObjectNav, the highest among compared navigation methods.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
Oct 2

LangMap: A Human-Verified Benchmark for Hierarchical Open-Vocabulary Goal Navigation

LangMap introduces a human‑verified benchmark for language‑conditioned goal navigation (LGN) that spans four hierarchical semantic levels—scene, room, region, and instance—within real‑world indoor 3D scans. The dataset, built on HM3D, contains 18K tasks with concise and detailed descriptions for 414 object categories, and its contrastive annotation protocol ensures high‑quality, discriminative region and instance labels. Evaluation shows that LangMap’s descriptions improve text‑to‑view matching accuracy by 23 points over GOAT‑Bench and achieve a 92.5% unique‑and‑correct match rate in an independent human audit, while a proposed RGB‑only baseline, PlaNaVid, attains top‑tier success rates without depth or 3D scene representations.

By Bo Miao, Weijia Liu, Jun Luo, Lachlan Shinnick, Jian Liu, Thomas Hamilton-Smith, Yuhe Yang, Zijie Wu, Vanja Videnovic, Feras Dayoub, Anton van den Hengel
arXiv AI
Jul 9

GemNav: Discrete-Token Visual Robot Navigation using a Multimodal Large Language Model

arXiv:2607. 06882v1 Announce Type: cross Abstract: Visual navigation policies built on large pretrained models have so far followed a common recipe: a dedicated visual encoder, a bespoke action head, and training on thousands of hours of cross-embodiment datasets.

By Peter Bohm, Saimunur Rahman, Abdelwahed Khamis, Sagun Man Singh Shrestha, Chris McCool, Peyman Moghadam
arXiv Computer Vision
Sep 7

VoxelFix: Post-Hoc Semantic Correction of Completed 3D Voxel Maps

VoxelFix is a graph‑based post‑hoc semantic correction method that refines voxel labels in completed 3D voxel maps while preserving their geometry and occupancy. It learns to correct errors by exploiting local geometry and neighboring semantic information, using training pairs generated by corrupting annotated maps with class confusions from upstream perception pipelines. Experiments on OccuFly maps show consistent improvements of 4.23–5.00 percentage points in mIoU, especially for tree, roof, and wall classes, and the method generalizes to out‑of‑distribution aerial scenes.

By Sunesh Praveen Raja Sundarasami, Taehyoung Kim, Johannes Scherer, Toma\v{z} Coti\v{c}, Sivasubiramaniam Subbiah, Andreas Greiner, Paul Spannaus, Sebastian Houben
arXiv Computer Vision
Oct 21

VEOcc++: Learning Persistent Voxel Feature Maps for Embodied Online Semantic Occupancy Mapping and Offline Refinement

VEOcc++ is a voxel‑centric framework that unifies online incremental semantic occupancy mapping with offline global map refinement by maintaining a persistent sparse voxel feature map. During exploration the map expands and integrates local features with reliability‑guided updates, while a context‑aware decoder produces the current semantic occupancy map. After exploration, cached local features are consolidated and combined with the online representation for multi‑scale spatial refinement, achieving state‑of‑the‑art IoU and mIoU scores on EmbodiedOcc‑ScanNet and demonstrating zero‑shot transfer to unseen environments on a mobile robot.

By Ruoyu Wang, Jiahan Li, Yong Liu, Kexin Zhang