arXiv Computer Vision
Traj-VLN: Learning Pixel-Space Interaction via Autoregressive Trajectory Generation
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv Machine Learning
Aug 4
SpatioLM: Towards General Physical Spatial Intelligence in Vision-Language Models
arXiv:2608. 01899v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) perform well on commonsense reasoning tasks but struggle with visual spatial reasoning.
arXiv AI
Jun 30
Pondering the Way: Spatial-perceiving World Action Model for Embodied Navigation
arXiv:2606. 29908v1 Announce Type: cross Abstract: Existing world model-based planners for visual navigation typically follow a verification-centric paradigm, decoupling goal intent from trajectory synthesis.
arXiv AI
Jul 14
ABot-N1: Toward a General Visual Language Navigation Foundation Model
arXiv:2607. 10383v1 Announce Type: cross Abstract: Visual Language Navigation foundation models aim to unify deep reasoning for grounded spatial decisions with broad versatility for diverse embodied tasks.
arXiv AI
Jul 21
Spatiotemporal Knowledge Graphs as Persistent Scene Memory for Embodied Question Answering
arXiv:2510. 01483v3 Announce Type: replace-cross Abstract: Vision-language models (VLMs) demonstrate strong image-level scene understanding, but reasoning over long egocentric video remains costly: because VLMs maintain no persistent memory or explicit spatial representation, all sampled frames must be re-processed for every new query.
arXiv AI
Aug 18
VTInstructor: Visual Trajectory Prompting for Navigation Instruction Generation in Continuous Environments
arXiv:2608. 15284v1 Announce Type: cross Abstract: Navigation instruction generation from ego-centric RGB video in continuous environments is an important yet challenging task for human-robot interaction and scalable dataset construction.
arXiv AI
Jul 7
SpatialThinker: Reinforcing Scene Graph-Grounded Spatial Reasoning via Dense Rewards
arXiv:2511. 07403v2 Announce Type: replace-cross Abstract: Multimodal large language models (MLLMs) have achieved remarkable progress in vision-language tasks, but continue to struggle with spatial reasoning.