arXiv Computer Vision

Into the LidarVerse: A Real-Time Unified LiDAR World Model Across Tasks and Sensors

arXiv Computer Vision
Aug 27

LaGen: Towards Autoregressive LiDAR Scene Generation

LaGen is an autoregressive framework that generates long‑horizon LiDAR scenes frame by frame, using a single‑frame input and bounding‑box conditions to produce high‑fidelity 4D scenes. It introduces a scene decoupling estimation module for better object‑level interaction and a noise modulation module to reduce error accumulation over time. Evaluations on the nuScenes dataset show that LaGen outperforms existing methods, especially on later frames.

By Sizhuo Zhou, Xiaosong Jia, Fanrui Zhang, Junjie Li, Juyong Zhang, Yukang Feng, Jianwen Sun, Songbur Wong, Junqi You, Junchi Yan
arXiv Computer Vision
Sep 3

GEM: Generating LiDAR World Model via Deformable Mamba

GEM is a Generative LiDAR world model that uses a deformable Mamba architecture to better handle the disorder of LiDAR point clouds and distinguish dynamic objects from static structures. The model tokenizes LiDAR sweeps, unsupervisedly disentangles dynamic and static features, and applies a tri‑path deformable Mamba for selective scanning and adaptive gating fusion, improving spatial‑temporal understanding. Experiments show GEM outperforms existing methods across multiple benchmarks, and it can be paired with a planner and BEV controller for autonomous rollout and "what‑if" scenario generation.

By Yang Wu, Zhaojiang Liu, Qiang Meng, Youquan Liu, Renliang Weng, Jianjun Qian, Jian Yang, Jin Xie
arXiv AI
Jun 24

HilDA: Hierarchical Distillation with Diffusion for Advancing Self-Supervised LiDAR Pre-training

arXiv:2606. 20189v3 Announce Type: replace-cross Abstract: Leveraging Vision Foundation Models (VFMs) for camera-to-LiDAR knowledge distillation offers a promising solution to the scarcity of annotated data needed to represent the immense geometric and kinematic diversity of real-world autonomous driving (AD).

By Maciej Wozniak, Jesper Ericsson, Hariprasath Govindarajan, Truls Nyberg, Thomas Gustafsson, Patric Jensfelt, Olov Andersson
arXiv AI
Jun 19

HilDA: Hierarchical Distillation with Diffusion for Advancing Self-Supervised LiDAR Pre-trainin

arXiv:2606. 20189v1 Announce Type: cross Abstract: Leveraging Vision Foundation Models (VFMs) for camera-to-LiDAR knowledge distillation offers a promising solution to the scarcity of annotated data needed to represent the immense geometric and kinematic diversity of real-world autonomous driving (AD).

By Maciej Wozniak, Jesper Ericsson, Hariprasath Govindarajan, Truls Nyberg, Thomas Gustafsson, Patric Jensfelt, Olov Andersson
arXiv Computer Vision
Oct 5

LightLoc++: Sensor-Robust Representation Learning for Efficient Outdoor LiDAR Localization

LightLoc++ introduces a sensor‑robust framework for outdoor LiDAR localization that decouples a pretrained backbone from lightweight scene‑specific heads, enabling efficient new‑scene training. The authors present SULID, a synchronized urban multi‑LiDAR dataset featuring 32‑, 64‑, and 128‑beam sensors, which is used to pretrain a backbone via cross‑sensor consistency learning. Additional techniques such as sample classification guidance and redundant sample downsampling reduce regression ambiguity and computational load, achieving state‑of‑the‑art performance with minimal new‑scene training cost.

By Wen Li, Shangshu Yu, Dunqiang Liu, Shaoyang Chen, Qiming Xia, Sheng Ao, Siqi Shen, Chenglu Wen, Cheng Wang
arXiv Computer Vision
Sep 25

M3GD: Multi-Modal Multi-View Geometric Diffusion for Camera--LiDAR Novel View Synthesis

M3GD introduces a multimodal representation that fuses pre‑trained 2D image and 3D LiDAR foundation models for robotic novel view synthesis, avoiding the need for a separate cross‑modal translator. By projecting LiDAR onto the image latent grid and injecting the resulting geometry‑aware packets via a lightweight residual adapter, the method enhances both RGB and depth synthesis on the GrandTour dataset compared to an image‑only baseline. Ablation studies confirm that pixel‑aligned LiDAR content drives the performance gains, and real‑world deployment on a ground robot demonstrates a tunable quality–cost trade‑off.

By Yang Zhou, Jiuhong Xiao, Shizhao Ye, Long Quang, Carlos Nieto-Granda, Giuseppe Loianno