arXiv AI
Jun 6

Drive-KD: Multi-Teacher Distillation for VLMs in Autonomous Driving

arXiv:2601. 21288v2 Announce Type: replace Abstract: Autonomous driving is an important and safety-critical task, and recent advances in LLMs/VLMs have opened new possibilities for reasoning and planning in this domain.

By Weitong Lian, Zecong Tang, Haoran Li, Tianjian Gao, Yifei Wang, Zixu Wang, Lingyi Meng, Tengju Ru, Zhejun Cui, Yichen Zhu, Hangshuo Cao, Qi Kang, Tianxing Chen, Kaixuan Wang, Yu Zhang
arXiv AI
Oct 15

Cross-Stage Coherence in Hierarchical Driving VQA: A Consistency Protocol and Parameter-Efficient Gated Context Routing

The paper studies cross‑stage context passing in Graph Visual Question Answering for autonomous driving, focusing on the Perception, Prediction, and Planning stages. Two complementary approaches are evaluated on DriveLM‑nuScenes: an explicit prompt‑based conditioning strategy using a domain‑adapted 4B VLM that reduces NLI contradiction by up to 42.6%, and an implicit gated context projector that, with only ~0.5% of parameters updated, cuts planning‑stage NLI contradiction by 34% and boosts cross‑stage entailment by 50%. The explicit method offers a strong zero‑training baseline for surface consistency, while the implicit method delivers significant semantic gains, highlighting the potential of domain adaptation for further improvement.

By Gautam Kumar Jain, Carsten Markgraf, Julian St\"ahler
arXiv AI
Jun 17

DriveJudge: Rethinking Autonomous Driving Evaluation with Vision-Language Models

arXiv:2606. 17362v1 Announce Type: cross Abstract: Autonomous driving has shifted towards end-to-end policy learning, where reliable, interpretable policy evaluation is a fundamental challenge as driving quality is highly context-dependent.

By Xinglong Sun, Kevin Xie, Jenny Schmalfuss, Despoina Paschalidou, Xiuming Zhang, Sanja Fidler, Kashyap Chitta, Jose M. Alvarez