arXiv:2608.22232v1 Announce Type: new
Abstract: Real-world situation appearances can deviate from their underlying physical states, challenging the reliability of multimodal large language models (ML...
By Zhiming Yang, Zhuoxi Xiong, Donglin Zhou, Wenjun Wei, Shiyao Cui, Jinqiao Shi
Hob‑VL is a benchmark for visually grounded Boolean reasoning that tests models on two tasks: determining whether a Boolean rule holds in an image and identifying the unique object that satisfies a Boolean description. It contains 6,000 balanced Yes/No questions built from ten visual statements across 1,000 generated scenes and 46 labeled photographs, plus 1,000 object‑identification questions on the same photographs. The questions are designed to challenge reasoning with misleading local cues, nested logical operations, and both symbolic and natural‑language presentations, revealing significant gaps in current model performance.
By Yuzhou Wang, Emile Anand, Ijay Narang
arXiv:2608.23518v1 Announce Type: new
Abstract: Vision-Language Models (VLMs) achieve strong performance in visual reasoning tasks, but it remains unclear whether they understand visual relations, or...
By Adhithya Laxman Ravi Shankar Geetha, Aulia Kharis Rakhmasari, Haleema Ramzan, Xander Yap
arXiv:2603. 23867v2 Announce Type: replace-cross Abstract: Vision-Language Models (VLMs) have been applied to a wide range of reasoning tasks, yet it remains unclear whether they can reason robustly under distribution shifts.
By Weixin Chen, Antonio Vergari, Han Zhao
arXiv:2603. 16728v2 Announce Type: replace Abstract: Vision-language models (VLMs) are increasingly deployed in high-stakes settings where reliable uncertainty quantification (UQ) is as important as predictive accuracy.
By Robert Welch, Emir Konuk, Kevin Smith
arXiv:2508. 10956v3 Announce Type: replace-cross Abstract: Inspired by human categorization, visual reasoning about object properties, such as physical attributes and functions, involves identifying and recognizing low-level details and higher-level abstractions.
By Abhishek Kolari, Mohammadhossein Khojasteh, Yifan Jiang, Floris den Hengst, Filip Ilievski