arXiv AI

Generation of Vectorized Maps Beyond Vehicle View

arXiv Computer Vision
Sep 4

FlexMap: Robust HD Map Construction under Flexible Camera Configurations

FlexMap is a vectorized high‑definition map construction framework that works with flexible camera configurations without needing calibrated rigs or explicit 2D‑to‑BEV transformations. It replaces geometric projection with a geometry foundation model that encodes cross‑view 3D structure, and uses a spatial‑temporal enhancement module and a camera‑aware decoder to separate spatial reasoning from temporal aggregation. Experiments on nuScenes and Argoverse 2 show that FlexMap outperforms pose‑dependent baselines and remains accurate even when camera views are missing or pose estimates are inaccurate.

By Run Wang, Chaoyi Zhou, Amir Salarpour, Xi Liu, Zhi-Qi Cheng, Feng Luo, Mert D. Pes\'e, Siyu Huang
Hugging Face Trending Papers
4d ago

A Unified Benchmark for Aerial-Enhanced Autonomous Driving: The KITScenes Aerial Dataset

The paper introduces KITScenes Aerial, an extension of the KITScenes Multimodal dataset that adds synchronized aerial imagery and high‑resolution neural representations to existing onboard sensor data, vehicle poses, and Lanelet2 map annotations. It evaluates mapping across all 53 KITScenes map classes, showing that aerial context significantly improves fine‑grained and extended‑range mapping, with higher‑resolution imagery boosting performance further, especially for challenging elements like traffic lights. The study also assesses cross‑view localization under geographically disjoint conditions, achieving a mean translation error of 5.13 m with a fine‑grained feature‑matching baseline.

arXiv AI
Sep 10

Closed-Loop Evaluation of Bird's-Eye-View Maps from Cross-View Transformers as Inputs to Behavior-Cloning Policies

The paper studies how Bird's‑Eye‑View (BEV) maps predicted by Cross‑View Transformers (CVT) can be used directly as inputs to a Behavior‑Cloning (BC) driving policy in the CARLA simulator. It introduces a six‑channel BEV representation and a Kernel Density Estimation (KDE) weighting scheme to focus learning on underrepresented maneuvers. Closed‑loop tests show that the KDE‑weighted model is the only predicted‑BEV agent to finish an episode without infractions, highlighting that global segmentation scores are poor proxies for driving performance and that prediction quality at critical geometries, especially the route channel, is key to reliable navigation.

By Felipe Carlos dos Santos, Eric Antonelo, Gustavo Claudio Karl Couto
arXiv Machine Learning
Jun 3

The Road Ahead in Autonomous Driving: The KITScenes Multimodal Dataset

arXiv:2606. 02956v1 Announce Type: cross Abstract: Existing autonomous driving datasets have enabled major progress, but fall short in sensor fidelity, map completeness, or geographic diversity.

By Richard Schwarzkopf, Fabian Immel, Alexander Blumberg, Jonas Merkert, Nils Rack, Kaiwen Wang, Fabian Konstantinidis, Julian Truetsch, Carlos Fernandez, Annika B\"atz, Kevin R\"osch, Marlon Steiner, Willi Poh, Yinzhe Shen, Royden Wagner, Felix Hauser, Dominik Strutz, Jaime Villa, Gleb Stepanov, Holger Caesar, \"Omer \c{S}ahin Ta\c{s}, Frank Bieder, Jan-Hendrik Pauls, Christoph Stiller
arXiv Computer Vision
Oct 2

MapLightning: Online Vectorized HD Map Construction with 1D Map Tokens

MapLightning introduces a new approach to online vectorized HD map construction that replaces dense bird’s‑eye‑view grids with a compact set of 1D learnable map tokens. Using a transformer‑based mapper that applies full self‑attention to combined image and map tokens, the method achieves efficient inference, lower memory usage, and improved global context without relying on camera projection parameters. Experiments on nuScenes and Argoverse 2 show state‑of‑the‑art accuracy, with a lightweight variant outperforming MapTRv2 by over 10 mAP and running 1.73× faster at 40+ FPS while using 53 % less memory.

By Shen Zheng, Anurag Ghosh, Mani Ramanagopal, Srinivasa Narasimhan
arXiv AI
Jun 16

MapDream: Task-Driven Map Learning for Vision-Language Navigation

arXiv:2602. 00222v3 Announce Type: replace-cross Abstract: Vision-Language Navigation (VLN) requires agents to follow natural language instructions in partially observed 3D environments, motivating map representations that aggregate spatial context beyond local perception.

By Guoxin Lian, Shuo Wang, Yucheng Wang, Yongcai Wang, Maiyue Chen, Kaihui Wang, Bo Zhang, Zhizhong Su, Deying Li, Zhaoxin Fan
arXiv Computer Vision
Sep 23

Leveraging Vision-Based Point Cloud Map Priors for Camera-Based 3D Object Detection and Online Vectorized HD Mapping

The paper presents a framework that builds a static point cloud prior map from past camera traversals, augmenting each point with DINOv3 semantic features. During runtime, a local prior patch is retrieved, encoded with a sparse voxel backbone, and fused with lifted multi‑view camera features in bird’s‑eye view. This fused representation is then used by sparse transformer heads to predict 3D objects and vectorized map elements, achieving improved performance on Argoverse 2 without requiring LiDAR for prior‑map construction or online inference.

By Markus K\"appeler, Rohit Mohan, Abhinav Valada
arXiv AI
Oct 19

DriveWorld3D Evidence Constrained 3D World Modeling and Generative Simulation for Real-World Autonomous Driving

DriveWorld3D is a framework that integrates temporal video learning, multi‑sensor measurement constraints, and offline generative simulation to build a unified 3D world model for autonomous driving. Its online component tracks road surfaces, volumetric occupancy, dynamic entities, and road relations while explicitly managing physical occupancy, observability, and evidence provenance. The offline component reconstructs scenes with neural radiance fields or 3D Gaussian Splatting and expands rare conditions using generative models, but limits generated content from being used as geometric ground truth.

By Wei Wang (Robostreet research team Cambridge, MA, USA), Yiru Veronika Wang (Robostreet research team Cambridge, MA, USA), Yihan Wang (Robostreet research team Cambridge, MA, USA), Zihao Li (Robostreet research team Cambridge, MA, USA), Xiaohui Liang (Robostreet research team Cambridge, MA, USA)