arXiv AI By Vasiliki Kondyli, Jakob Suchan, Mehul Bhatt

A Human-Factors Guided Cognitive Model of Visuospatial Complexity in Embodied Active Vision

Read the original on arXiv AI →

The paper introduces a new framework for analyzing multimodal data—visual, auditory, and spatial—by focusing on the complexity of embodied perception and interaction in dynamic, naturalistic settings. It expands upon prior visual complexity work to categorize diverse attributes (quantitative, structural, dynamic, auditory, interactional) that together describe multimodal complexity. The authors illustrate how this model can characterize visuospatial complexity in everyday driving and suggest its use for creating and evaluating benchmark datasets that prioritize cognitive human factors.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
3d ago

Humanity's Sixth Sense: Benchmarking Intuitive Visual Reasoning in Multimodal Models

The paper introduces Humanity's Sixth Sense (HSS), a benchmark designed to evaluate intuitive visual reasoning in multimodal large language models. HSS covers a wide range of image and video inputs, organizes them under a structured taxonomy, and pairs each with human‑written prompts that probe implicit temporal, spatial, social, and abstract cues that humans can infer at a glance. Current state‑of‑the‑art models, including GPT‑6‑astra, achieve far lower accuracy than humans (53.6 % vs. 93.1 %), highlighting a significant gap in intuitive visual understanding.

By Xingang Guo, Jing Gu, Brian Jang, Renxiong Wang, Utkarsh Tyagi, Daniel Quigley, Steven Li, David Yan, Daniel Yue Zhang, Darvin Yi, Forrest Huang, HiJae Kim, Tianyi Zhang, Jared Lichtarge, Jihua Huang, Le Xue, Manan Tomar, Qiuyi Richard Zhang, Ruofei Yu, Seth Neel, Yaning Hu, Marcella Valentine, Xinzhe Jiang, Daniel Evans, Chenguang Wang, Dustin Tran, Tong Zhao, Yinfei Yang, Yunzhong He
arXiv AI
Aug 10

Probing Visual Concepts in Lightweight Vision-Language Models for Automated Driving

arXiv:2603. 06054v2 Announce Type: replace-cross Abstract: The use of Vision-Language Models (VLMs) in automated driving applications is becoming increasingly common, with the aim of leveraging their reasoning and generalisation capabilities to handle long-tail scenarios.

By Nikos Theodoridis, Reenu Mohandas, Ganesh Sistu, Anthony Scanlan, Ciar\'an Eising, Tim Brophy
arXiv Computer Vision
Sep 30

Speed in the Blind Spot: An Interpretability Analysis of Dynamic Perception in VLMs for Autonomous Driving

Vision‑Language Models (VLMs) used in autonomous driving are evaluated on their ability to understand velocity through three tasks: surrounding‑agent speed, current ego speed, and short‑horizon future ego‑speed. Experiments on nuScenes show that while current ego speed can be accessed internally, verbal outputs are poor and surrounding‑agent speed is weakly encoded; temporal cues and frame order are largely ignored. Specialized driving models (Alpamayo‑1.5) improve latent speed representations but still leave gaps between internal knowledge and verbal readout, indicating that good planning outputs do not guarantee reliable dynamic state recovery.

By Katharina Winter, Stefan Englmeier, Fabian B. Flohr