arXiv AI

Situation Awareness for Intelligent Data Distribution in Connected Vehicles

The paper proposes a method for identifying the current traffic situation of a vehicle using Bird's‑Eye‑View images. It combines object detection with semantic segmentation and a situation identification neural network built on the Cam2BEV projective transformation. The approach was validated in the CARLA simulator and on Cityscapes and nuScenes datasets, demonstrating that it can prioritize relevant sensor data for efficient distribution in connected vehicles.

arXiv AI
Jun 16

OmniTraffic: A Controllable Generation Pipeline and Benchmark for Spatio-Temporal Traffic Reasoning

arXiv:2606. 15749v1 Announce Type: cross Abstract: Traffic scene understanding requires models to reason beyond object recognition, including lane topology, multi-view geometry, temporal evolution, and signal-phase semantics.

By Maonan Wang, Zhengyan Huang, Kemou Jiang, Yuhang Fu, Jiayue Zhu, Yuxin Cai, Xingchen Zou, Qiaosheng Zhang, Yi Yu, Ding Wang, Xi Chen, Ben M. Chen, Yuxuan Liang, Zhiyong Cui, Man On Pun, Yirong Chen
arXiv Machine Learning
Jul 28

SimBEV2X: A Large-Scale Dataset and Data Generation Tool for Multi-Task Vehicle-to-Everything Cooperative Perception

arXiv:2607. 23910v1 Announce Type: cross Abstract: Cooperative perception through vehicle-to-everything (V2X) communication can overcome the inherent physical limitations of individual autonomous vehicles, such as occlusions and limited sensor range.

By Goodarz Mehr, Sepideh Gohari, Montasir Abbas, Azim Eskandarian
arXiv Machine Learning
Sep 3

Enhancing Road Safety Through Multi-Camera Image Segmentation with Post-Encroachment Time Analysis

The paper introduces a multi‑camera computer vision system that computes Post‑Encroachment Time (PET) in real time to assess intersection safety. Using four synchronized cameras and YOLOv11 segmentation on NVIDIA Jetson AGX Xavier devices, vehicle detections are mapped to a unified bird’s‑eye view and processed with a pixel‑level PET algorithm to generate high‑resolution heatmaps. The system records PET data in an SQL database and demonstrates real‑time throughput (2.68 FPS) with 800 × 800 heatmaps, validating a scalable, decentralized approach for high‑resolution intersection safety evaluation.

By Shounak Ray Chaudhuri, Arash Jahangiri, Christopher Paolini
arXiv AI
Jul 10

AUTOPILOT VQA: Benchmarking Vision-Language Models for Incident-Centric Dashcam Understanding

arXiv:2607. 08745v1 Announce Type: new Abstract: Recent advances in Vision-Language Models, Large Language Models, and Multimodal Large Language Models have improved autonomous driving tasks such as scene understanding, decision making, trajectory prediction, and visual question answering.

By Siddharth Damodharan, Radhika Gupta, Ali Alshami, Ryan Rabinowitz, Jugal Kalita
arXiv AI
Jun 10

TaCarla: A comprehensive benchmarking dataset for end-to-end autonomous driving

arXiv:2602. 23499v4 Announce Type: replace-cross Abstract: Collecting a high-quality dataset is a critical task that demands meticulous attention to detail, as overlooking certain aspects can render the entire dataset unusable.

By Tugrul Gorgulu, Atakan Dag, M. Esat Kalfaoglu, Halil Ibrahim Kuru, Baris Can Cam, Halil Ibrahim Ozturk, Ozsel Kilinc
arXiv Machine Learning
Sep 1

AdaptAV: Continuous Adaption of Vision Models for Autonomous Vehicles Using Cloud-based Oracle

The paper introduces AdaptAV, a system that continuously adapts vision models for autonomous vehicles by retraining them on the cloud using data uploaded from the vehicles. It leverages powerful cloud compute resources and a highly accurate oracle model to guide the retraining process, producing a new model that is then transmitted back to the vehicle. This approach aims to improve inference accuracy over time while maintaining the fast inference speeds required for on‑vehicle deployment.

By Yuheng Zhu, Dhruva Ungrupulithaya, Boluo Ge, Man-Ki Yoon
arXiv AI
6d ago

VLALight: Lightweight Vision-Language-Action Models for Emergency-Aware Traffic Signal Control

VLALight is a lightweight end‑to‑end vision‑language‑action framework designed for traffic signal control. It fuses multiple camera views and textual instructions to directly predict signal actions, avoiding intermediate image‑to‑text conversions. The model, with only 0.5 B parameters, achieves superior emergency vehicle service, cutting pooled waiting time by 21.1% compared to cascaded methods while running in real time on local hardware.

By Kemou Jiang, Maonan Wang, Xingchen Zou, Jiayue Zhu, Yuhang Fu, Sicheng Wang, Xi Chen, Yirong Chen, Zhiyong Cui