arXiv Machine Learning

Generative Semantic Scene Completion

The paper introduces Generative Semantic Scene Completion (GSSC), a framework that recasts outdoor LiDAR semantic scene completion as a discrete diffusion process. It comprises three components: (1) paired sparse‑dense scene synthesis (PS³) to generate synthetic training data, (2) semantic‑guided generative scene completion (SGSC) that generates scenes from noise conditioned on sparse scans, and (3) structured source discrete diffusion (S²D²) that refines existing completions in a single flow‑matching step. Using this approach, the authors achieve state‑of‑the‑art performance on the SemanticKITTI benchmark, reaching 38.8% mIoU in a single‑sweep, single‑sample setting and 39.2% with limited augmentation.

arXiv AI
2d ago

VOIM: Training-Free Open-Vocabulary 3D Instance Mapping for RGB-D and Monocular SLAM

VOIM (Voxel‑Grounded Online Instance Manager) is a training‑free system that builds open‑vocabulary 3D instance maps from RGB‑D or monocular RGB input by deferring label and instance decisions until sufficient soft evidence accumulates per voxel across views. Across four perception configurations on ScanNet++, VOIM outperforms the strongest online RGB‑D system, OVO‑SLAM, by 4.8–11.7 mIoU, and achieves 44.07 mIoU under a like‑for‑like protocol, winning all ten scenes. The method also runs unchanged on monocular RGB, matching baseline performance on Replica, and produces exportable occupancy grids that support free‑form instance queries.

By Sangmin Song, Sarath Kodagoda, Marc G. Carmichael, Karthick Thiyagarajan, Amal Gunatilake, Kelly Prentice, Jodi Martin
arXiv Computer Vision
Aug 26

AffineTok: Semantic Affine Consistency for Diffusion-Friendly Visual Tokenizer

arXiv:2608.23864v1 Announce Type: new Abstract: Visual tokenizers increasingly inject semantic supervision into latent spaces to make downstream diffusion easier. Yet how these semantics should be or...

By Junqiu Yu, Pandeng Li, Yikai Wang, Jiaxing Zhao, Yujie Wei, Kaixun Jiang, Quanhao Li, Hongtao Yu, Zhihang Liu, Zhaohe Liao, Junjie Zhou, Yun Zheng, Yu Liu, Yanwei Fu
arXiv Computer Vision
Aug 27

LaGen: Towards Autoregressive LiDAR Scene Generation

LaGen is an autoregressive framework that generates long‑horizon LiDAR scenes frame by frame, using a single‑frame input and bounding‑box conditions to produce high‑fidelity 4D scenes. It introduces a scene decoupling estimation module for better object‑level interaction and a noise modulation module to reduce error accumulation over time. Evaluations on the nuScenes dataset show that LaGen outperforms existing methods, especially on later frames.

By Sizhuo Zhou, Xiaosong Jia, Fanrui Zhang, Junjie Li, Juyong Zhang, Yukang Feng, Jianwen Sun, Songbur Wong, Junqi You, Junchi Yan