VEOcc++ is a voxel‑centric framework that unifies online incremental semantic occupancy mapping with offline global map refinement by maintaining a persistent sparse voxel feature map. During exploration the map expands and integrates local features with reliability‑guided updates, while a context‑aware decoder produces the current semantic occupancy map. After exploration, cached local features are consolidated and combined with the online representation for multi‑scale spatial refinement, achieving state‑of‑the‑art IoU and mIoU scores on EmbodiedOcc‑ScanNet and demonstrating zero‑shot transfer to unseen environments on a mobile robot.
arXiv:2605.25059v4 Announce Type: replace Abstract: Crucial for autonomous exploration, online 3D occupancy prediction and mapping incrementally construct dense spatial representations on the fly. Em...
VoxelFix is a graph‑based post‑hoc semantic correction method that refines voxel labels in completed 3D voxel maps while preserving their geometry and occupancy. It learns to correct errors by exploiting local geometry and neighboring semantic information, using training pairs generated by corrupting annotated maps with class confusions from upstream perception pipelines. Experiments on OccuFly maps show consistent improvements of 4.23–5.00 percentage points in mIoU, especially for tree, roof, and wall classes, and the method generalizes to out‑of‑distribution aerial scenes.
O3N is a novel framework that performs open‑vocabulary occupancy prediction from a single omnidirectional RGB image. It introduces a polar‑spiral voxel embedding (PsM) for continuous 360° spatial representation, an Occupancy Cost Aggregation (OCA) module that unifies geometric and semantic supervision, and a Natural Modality Alignment (NMA) pathway that aligns visual, voxel, and text features. Experiments show state‑of‑the‑art results on QuadOcc and Human360Occ benchmarks, with strong cross‑scene generalization and semantic scalability.
The paper investigates how different 2D image backbones affect indoor semantic occupancy prediction in RGB‑D pipelines. By keeping the projection, depth branch, and occupancy head constant and swapping only the image encoder, the authors find that stronger backbones such as DINOv2 and BLIP2 significantly raise mIoU scores compared to the default ResNet‑50. These results show that the choice of image backbone is a major determinant of 3D occupancy accuracy, outweighing many specialized 3D modules.
Reading the Room (RR) is a global‑local method that registers scale‑ambiguous, sparse semantic VSLAM maps to partially built floor plans. It introduces a single robust, differentiable, class‑balanced semantic‑geometric energy function that drives all pipeline stages, and offers two global initialization schemes—one using a single user‑provided correspondence and another using a cross‑modal matching network. Evaluated on 33 sequences from three construction sites, RR outperforms classical and learning‑based baselines, improving mean absolute trajectory error by 4.5× overall and 7.6× when an anchor is supplied.
arXiv:2609.38864v1 Announce Type: new Abstract: Embodied tasks demand accurate, flexible, and semantically rich 3D scene representations. 3D semantic occupancy is well suited to this requirement, as...
Embodied tasks demand accurate, flexible, and semantically rich 3D scene representations. 3D semantic occupancy is well suited to this requirement, as it can model holistic 3D spaces by encoding geome...
VOIM (Voxel‑Grounded Online Instance Manager) is a training‑free system that builds open‑vocabulary 3D instance maps from RGB‑D or monocular RGB input by deferring label and instance decisions until sufficient soft evidence accumulates per voxel across views. Across four perception configurations on ScanNet++, VOIM outperforms the strongest online RGB‑D system, OVO‑SLAM, by 4.8–11.7 mIoU, and achieves 44.07 mIoU under a like‑for‑like protocol, winning all ten scenes. The method also runs unchanged on monocular RGB, matching baseline performance on Replica, and produces exportable occupancy grids that support free‑form instance queries.
The paper introduces SceneLM, a vision‑language model that maintains an open‑vocabulary 3D scene map using only a structured text list of objects as persistent memory. The model updates this textual map by adding, editing, and removing objects for each input image, learning the process through supervision tasks and an automatic annotation pipeline. Evaluations on language‑grounded retrieval and localization benchmarks show competitive performance with traditional mapping systems while producing a 6‑12× more compact representation, and the model can run online on an edge device such as a quadruped robot.
AOV-GS is an active 3D Gaussian mapping system that uses frozen foundation models (SAM and CLIP) to guide exploration toward semantically informative regions. During coarse exploration, it re‑ranks geometrically promising views based on CLIP mask‑embedding novelty from SAM instance segmentation, biasing the robot’s trajectory. The system fits a lightweight scene‑specific language field offline to the collected CLIP embeddings, enabling open‑vocabulary text‑query segmentation on novel views and improving language‑field mIoU by 1.3–1.8 percentage points over geometry‑only planning on Replica and Matterport3D.
arXiv:2608. 07079v1 Announce Type: cross Abstract: Object-goal navigation has made substantial progress in semantic perception and exploration, yet persistent memory for multi-object navigation and cross-floor navigation are still commonly addressed separately.
arXiv:2609.38620v1 Announce Type: new Abstract: Neural implicit representations have had a significant impact on scene reconstruction by enabling robots to build continuous, differentiable, and high-...