arXiv Computer Vision

Explicit Geometric Chain-of-Thought for Vision-Language-Action in Autonomous Driving

arXiv AI
Sep 24

AnchorReasoning: A Visual Grounding and Causal Reasoning Dataset in Long-Tail Autonomous Driving Scenarios

arXiv:2609. 28366v1 Announce Type: cross Abstract: Vision-language models (VLMs) offer a promising approach to long-tail autonomous driving, but existing driving datasets provide limited supervision for connecting decision-critical visual evidence with reasoning and planning.

By Zhipeng Bao, Wenjie Zhao, Tianle Zhu, Haohua Que, Chence Yang, Geng Yuan, Qianwen Li
arXiv AI
Aug 5

Deferred Exposure of Future Trajectories for Verifiable Reasoning in Autonomous Driving VLMs

arXiv:2608. 01755v2 Announce Type: replace Abstract: Recent Vision-Language-Action (VLA) models for autonomous driving (AD) increasingly utilize chain-of-thought (CoT) supervision to enhance the reasoning capabilities of their Vision-Language Model (VLM) components, yet existing annotation pipelines commonly expose the teacher model to the logged ground-truth (GT) future trajectory.

By Zixuan Huang, Yang Zhou, Kaixuan Wang, Guli Zhang, Hongyan Xie, Yakun Zhu, Hao Geng, Xiaozhi Chen, Yikun Ban, Deqing Wang
arXiv AI
Jun 17

Reinforcing Dual-Path Reasoning in Spatial Vision Language Models

arXiv:2606. 17539v1 Announce Type: cross Abstract: Spatial VLMs have made substantial progress in geometric perception, yet complex spatial reasoning requiring multi-step inference over depth, distance, and scene relations remains challenging.

By Yatai Ji, An-Chieh Cheng, Yang Fu, Yukang Chen, Han Zhang, Zhaojing Yang, Wei Huang, Ka Chun Cheung, Song Han, Vidya Nariyambut Murali, Pavlo Molchanov, Jan Kautz, Simon See, Hongxu Yin, Ping Luo, Sifei Liu
Hugging Face Trending Papers
Sep 8

3DWay: Generalizing Robot Manipulation via 3D Consistent Waypoints

The paper introduces 3DWay, a method that predicts 3D consistent waypoints for robot manipulation using multi‑view images. By first generating 2D waypoints that are consistent across views and then triangulating them, the approach provides explicit 3D motion specifications while leveraging pretrained vision‑language models. Experiments demonstrate that 3DWay improves 3D spatial grounding and vision‑language reasoning, enhancing the generalization of robot manipulation policies.

arXiv Computer Vision
3d ago

VGGTWorld-VLA: Intent-Conditioned 3D World Evolution for Autonomous Driving

VGGTWorld-VLA extends the VGGT-World model by adding intention-conditioned control to 3D world evolution for autonomous driving. It introduces an action–semantic conditioning mechanism that injects driving semantics and ego‑motion into the future‑token stream, allowing different future geometry predictions for the same observed scene under alternative actions. A geometry–language–action bridge further integrates historical geometry, VLA semantic features, and maneuver/trajectory representations to jointly condition future geometry prediction, achieving competitive performance on NAVSIM and demonstrating the benefits of semantic and action conditioning.

By Zhaoyang Liu, Kun Jiang, Ziying Song, Diange Yang