arXiv AI By Liangjie Zhao, Jiaqing Lyu, Kexin Tang, Zecheng Fang, Rong Yin, Yulan Hu, Da Li, Jianing Li

Can LVLMs Uncover the Truth Behind Visual Illusions? An Analysis of Perceptual and Reasoning Capabilities

Read the original on arXiv AI →

The paper introduces Illusion-Reasoning, a benchmark that uses real-world visual illusion images paired with annotated question-answer pairs to evaluate Large Vision Language Models (LVLMs). It argues that current evaluations focus too narrowly on perception or specific domains, and that a joint assessment of perception and reasoning in open-world settings is lacking. Using this benchmark, the authors demonstrate that many LVLMs’ reasoning abilities are less advanced than previously claimed, offering new insights and directions for optimization.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Oct 2

Hob-VL: A Benchmark for Visually Grounded Boolean Reasoning

Hob‑VL is a benchmark for visually grounded Boolean reasoning that tests models on two tasks: determining whether a Boolean rule holds in an image and identifying the unique object that satisfies a Boolean description. It contains 6,000 balanced Yes/No questions built from ten visual statements across 1,000 generated scenes and 46 labeled photographs, plus 1,000 object‑identification questions on the same photographs. The questions are designed to challenge reasoning with misleading local cues, nested logical operations, and both symbolic and natural‑language presentations, revealing significant gaps in current model performance.

By Yuzhou Wang, Emile Anand, Ijay Narang
arXiv Computer Vision
Aug 25

Investigating Relational Reasoning in VLMs

arXiv:2608.23518v1 Announce Type: new Abstract: Vision-Language Models (VLMs) achieve strong performance in visual reasoning tasks, but it remains unclear whether they understand visual relations, or...

By Adhithya Laxman Ravi Shankar Geetha, Aulia Kharis Rakhmasari, Haleema Ramzan, Xander Yap