arXiv Computation and Language
Oct 28

Structured Maps for Landmark-Based Route Instructions with LLMs

The paper introduces a structured text representation using SVG to encode map geometry for landmark-based route instruction generation. It shows that large language models can use this representation to select landmarks at turns and near destinations, performing as well or better than image-based inputs. Fine‑tuning smaller local LLMs further improves accuracy, demonstrating the efficiency of structured text for spatial reasoning in navigation.

By Mifu Matsumoto, Yuki Nakanishi, Tomoya Hashiguchi, Hiroaki Ohshima
arXiv Computer Vision
Oct 1

KilometerVision: A New Frontier for Large-Scale Spatial Intelligence in VLMs

arXiv:2609.39588v1 Announce Type: new Abstract: We push the frontier of large-scale spatial intelligence in Vision-Language Models (VLMs) and introduce the first benchmark that probes geographical la...

By Aravindh Mahendran, Michael King, Matthew Koichi Grimes, Antoine Yang, Tyler Zhu, Joseph Heyward, Tengda Han, Shiry Ginosar, Chen Sun, Dima Damen, Simon Osindero, Noah Snavely, Simon Lynen, Jo\~ao Carreira, Viorica P\u{a}tr\u{a}ucean