arXiv:2601. 17216v3 Announce Type: replace-cross Abstract: Intelligent Transportation Systems (ITS) demand real-time collision prediction to ensure road safety and reduce accident severity.
arXiv:2503.13938v3 Announce Type: replace-cross Abstract: Comprehensive traffic scene understanding is a foundational capability for Intelligent Transportation Systems (ITS) underpinning applications...
VLALight is a lightweight end‑to‑end vision‑language‑action framework designed for traffic signal control. It fuses multiple camera views and textual instructions to directly predict signal actions, avoiding intermediate image‑to‑text conversions. The model, with only 0.5 B parameters, achieves superior emergency vehicle service, cutting pooled waiting time by 21.1% compared to cascaded methods while running in real time on local hardware.
The paper proposes a method for identifying the current traffic situation of a vehicle using Bird's‑Eye‑View images. It combines object detection with semantic segmentation and a situation identification neural network built on the Cam2BEV projective transformation. The approach was validated in the CARLA simulator and on Cityscapes and nuScenes datasets, demonstrating that it can prioritize relevant sensor data for efficient distribution in connected vehicles.
arXiv:2606. 15749v1 Announce Type: cross Abstract: Traffic scene understanding requires models to reason beyond object recognition, including lane topology, multi-view geometry, temporal evolution, and signal-phase semantics.
HERMES is a holistic end‑to‑end multimodal driving framework that incorporates long‑tail semantic knowledge into trajectory planning for autonomous vehicles. It uses a foundation‑model‑assisted annotation pipeline to build Long‑Tail Scene Context and Long‑Tail Planning Context, capturing hazard‑centric scene information, maneuver intent, and risk‑aware guidance. A Tri‑Modal Driving Module then fuses multi‑view visual observations, historical ego‑motion, and long‑tail semantic instructions to generate intent‑ and risk‑aware trajectories, achieving consistent performance gains on a large‑scale real‑world long‑tail driving benchmark.
arXiv:2609.36934v1 Announce Type: new Abstract: Traffic signal control (TSC) is essential for improving urban mobility and reducing congestion. Although roadside cameras are widely deployed at signal...
Traffic-VL introduces a vision‑language model that directly maps synchronized multi‑view images and natural‑language phase descriptions to traffic signal decisions, bypassing intermediate structured states. It is trained using SynTra‑V, a photorealistic simulation that generates surveillance imagery from physics‑based traffic models, and employs offline reinforcement learning to adapt its vision encoder before freezing it for online control. Experiments demonstrate that Traffic‑VL matches the performance of structured‑state controllers while outperforming image‑based and general‑purpose vision‑language models, and it generalizes robustly to unseen topologies, degraded sensing, real footage, and real‑world deployment across multiple intersections.
arXiv:2607. 08745v1 Announce Type: new Abstract: Recent advances in Vision-Language Models, Large Language Models, and Multimodal Large Language Models have improved autonomous driving tasks such as scene understanding, decision making, trajectory prediction, and visual question answering.
The paper introduces a plug‑and‑play method that injects traffic‑element signals—such as traffic lights and road signs—into end‑to‑end autonomous driving models with minimal architectural changes. By augmenting several public datasets with comprehensive traffic‑element annotations, the authors evaluate this integration across diverse driving paradigms, consistently improving performance on nuScenes, NAVSIM‑v1, NAVSIM‑v2, and Bench2Drive. The approach achieves a new state‑of‑the‑art result on the challenging NAVSIM‑v2 benchmark, demonstrating the broad utility of traffic‑element awareness.
The paper introduces SemISAC, a unified framework that integrates semantic communication and semantic sensing into a single dual‑function waveform. It employs a joint semantic encoder to extract task‑specific information for both communication and sensing, and uses an adaptive pilot configuration to balance channel estimation and sensing needs. In vehicular scenarios, SemISAC achieves segmentation accuracy comparable to dedicated semantic communication systems while outperforming conventional and semantic baselines in target recognition and range estimation.
The paper presents a decoupled framework for sim-to-real traffic scene understanding, separating semantic fact extraction from caption generation. It uses a frozen V-JEPA encoder for predictive scene representations and a lightweight Llama-based predictor for VQA, followed by a training-free structured refinement that leverages statistical priors, inter-question relationships, and temporal consistency. The refined facts are then fed to Qwen3-VL-8B to produce pedestrian and vehicle descriptions, achieving top performance on the 2026 AI City Challenge Track 2 benchmark with 87.09% VQA accuracy and an overall S2 score of 60.0853.