arXiv Computer Vision By Ruoyu Wang, Jiahan Li, Yong Liu, Kexin Zhang

VEOcc++: Learning Persistent Voxel Feature Maps for Embodied Online Semantic Occupancy Mapping and Offline Refinement

Read the original on arXiv Computer Vision →

VEOcc++ is a voxel‑centric framework that unifies online incremental semantic occupancy mapping with offline global map refinement by maintaining a persistent sparse voxel feature map. During exploration the map expands and integrates local features with reliability‑guided updates, while a context‑aware decoder produces the current semantic occupancy map. After exploration, cached local features are consolidated and combined with the online representation for multi‑scale spatial refinement, achieving state‑of‑the‑art IoU and mIoU scores on EmbodiedOcc‑ScanNet and demonstrating zero‑shot transfer to unseen environments on a mobile robot.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
Sep 7

VoxelFix: Post-Hoc Semantic Correction of Completed 3D Voxel Maps

VoxelFix is a graph‑based post‑hoc semantic correction method that refines voxel labels in completed 3D voxel maps while preserving their geometry and occupancy. It learns to correct errors by exploiting local geometry and neighboring semantic information, using training pairs generated by corrupting annotated maps with class confusions from upstream perception pipelines. Experiments on OccuFly maps show consistent improvements of 4.23–5.00 percentage points in mIoU, especially for tree, roof, and wall classes, and the method generalizes to out‑of‑distribution aerial scenes.

By Sunesh Praveen Raja Sundarasami, Taehyoung Kim, Johannes Scherer, Toma\v{z} Coti\v{c}, Sivasubiramaniam Subbiah, Andreas Greiner, Paul Spannaus, Sebastian Houben
arXiv Computer Vision
Aug 26

O3N: Omnidirectional Open-Vocabulary Occupancy Prediction for Embodied Intelligent Robotics

O3N is a novel framework that performs open‑vocabulary occupancy prediction from a single omnidirectional RGB image. It introduces a polar‑spiral voxel embedding (PsM) for continuous 360° spatial representation, an Occupancy Cost Aggregation (OCA) module that unifies geometric and semantic supervision, and a Natural Modality Alignment (NMA) pathway that aligns visual, voxel, and text features. Experiments show state‑of‑the‑art results on QuadOcc and Human360Occ benchmarks, with strong cross‑scene generalization and semantic scalability.

By Mengfei Duan, Hao Shi, Fei Teng, Guoqiang Zhao, Yuheng Zhang, Zhiyong Li, Kailun Yang
arXiv Computer Vision
Sep 16

Exploring 2D backbone effects for indoor semantic occupancy prediction

The paper investigates how different 2D image backbones affect indoor semantic occupancy prediction in RGB‑D pipelines. By keeping the projection, depth branch, and occupancy head constant and swapping only the image encoder, the authors find that stronger backbones such as DINOv2 and BLIP2 significantly raise mIoU scores compared to the default ResNet‑50. These results show that the choice of image backbone is a major determinant of 3D occupancy accuracy, outweighing many specialized 3D modules.

By Shizhang Fanga, Wanling Yea, Qi Zheng
arXiv Computer Vision
3d ago

Reading the Room: Scale-ambiguous Semantic Registration of Sparse VSLAM Maps to Floor Plans in Partially Built Environments

Reading the Room (RR) is a global‑local method that registers scale‑ambiguous, sparse semantic VSLAM maps to partially built floor plans. It introduces a single robust, differentiable, class‑balanced semantic‑geometric energy function that drives all pipeline stages, and offers two global initialization schemes—one using a single user‑provided correspondence and another using a cross‑modal matching network. Evaluated on 33 sequences from three construction sites, RR outperforms classical and learning‑based baselines, improving mean absolute trajectory error by 4.5× overall and 7.6× when an anchor is supplied.

By Bjorn Stragier, Emilia Szyma\'nska, J. Micah Prendergast, Lukas Rosenberger Schmid