arXiv Computer Vision
Vision-Language-Action Autonomous Driving Agent with Language-based Memory
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv Machine Learning
Sep 24
Less Language, More Latents: Annotation-Efficient VLAs for Driving
The paper introduces Latent Action Driving Annotations (LADA), a three‑stage pipeline that converts large amounts of unlabelled observation‑trajectory data into a language‑conditioned driving model. First, a latent action model with a vector‑quantised bottleneck learns a compact codebook of vehicle intents. Then, a small set of language‑annotated examples trains a vision‑language translator to map observations and instructions into this codebook, and finally a VLA is trained on observation‑latent‑action pairs across the full corpus. Using less than 5% of language annotations, LADA attains a Driving Score of 87.98 and a Success Rate of 70.46% on Bench2Drive, matching or surpassing fully supervised baselines.
arXiv AI
Jun 2
From Segments to Scenes: Temporal Understanding in Autonomous Driving via Vision-Language Model
arXiv:2512. 05277v3 Announce Type: replace-cross Abstract: Vision-Language Models (VLMs) are increasingly deployed as the perception and reasoning backbone of autonomous agents acting in the wild, with autonomous driving (AD) being one of the most safety-critical instances.
arXiv Machine Learning
Jun 15
RT-VLA: Real-Time Vision-Language-Action Models via Knowledge Distillation
arXiv:2606. 14010v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models have shown strong potential for end-to-end autonomous driving by jointly modeling visual perception, language reasoning, explainability and action prediction.
arXiv AI
Jun 4
From Segments to Scenes: Temporal Understanding for Agentic Autonomous Driving via Vision-Language Models
arXiv:2512. 05277v4 Announce Type: replace-cross Abstract: Vision-Language Models (VLMs) are increasingly deployed as the perception and reasoning backbone of autonomous agents acting in the wild, with autonomous driving (AD) being one of the most safety-critical instances.
arXiv Computer Vision
Sep 17
FIVE-VLA: Fast and EffectIVE Autonomous Driving with Recurrent Action Memory
arXiv:2609.18623v1 Announce Type: new Abstract: State-of-the-art vision-language-action models (VLA) for autonomous driving face critical limitations: excessive parameter counts, inefficient high-res...
arXiv AI
Aug 25
Geo-VLA: Geometry-Aware Vision-Language-Action Planning via Internalization of Map Semantics
arXiv:2608.21440v1 Announce Type: cross Abstract: Vision-language-action (VLA) models have advanced end-to-end autonomous driving by leveraging foundation models for semantic reasoning and long-tail...