arXiv Machine Learning July 9, 2026 By Xingzhou Pang, Yifan Hou, Junling Wang, Mrinmaya Sachan

Unveiling the Visual Counting Bottleneck in Vision-Language Models

Read the original on arXiv Machine Learning →

arXiv:2605. 30170v2 Announce Type: replace-cross Abstract: While Large Vision-Language Models (VLMs) excel at interpolation, they suffer catastrophic failures in systematic generalization, most notably in visual counting.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Computer Vision

4d ago

Why MLLMs Struggle to Count: Overcoming Individuation and Aggregation Bottlenecks with ConvStack

arXiv:2609.37096v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) consistently struggle with fine-grained visual counting, yet the underlying causes remain poorly understood. I...

By Liwei Che, Yihao Quan, Sen Fang, Hongyi Wang, Ranjay Krishna, Ruixiang Tang, Vladimir Pavlovic

llms fine-tuning multimodal benchmarks

arXiv AI

Aug 7

HoloCount: A Holistic Visual Counting Benchmark for MLLMs

arXiv:2607. 06420v1 Announce Type: cross Abstract: Visual counting is a fundamental pillar of multimodal intelligence, requiring a seamless integration of fine-grained grounding and spatial reasoning.

By Jinhong Deng, Limeng Qiao, Guanglu Wan

llms multimodal benchmarks safety

arXiv Machine Learning

Jul 13

The Count Is There, but Misaligned: Understanding and Correcting Counting Failures in VLMs

arXiv:2607. 09544v1 Announce Type: cross Abstract: Despite strong performance on many multimodal tasks, vision-language models (VLMs) still struggle with basic object counting.

By Ahmed Oumar El-Shangiti, Abzal Nurgazy, Hilal AlQuabeh, Nikolai Rozanov, Kentaro Inui

llms multimodal

arXiv AI

Jun 9

The Last Visible Pixel: Probing Fine-Scale Perception in Vision-Language Models

arXiv:2606. 07861v1 Announce Type: cross Abstract: Recent vision-language models (VLMs) excel at multimodal understanding and reasoning, yet their fine-grained visual perception remains underexplored.

By Lujun Li, Lama Sleem, Niccolo Gentile, Yangjie Xu, Yewei Song, Wenbo Wu, Radu State

llms multimodal benchmarks

arXiv AI

Aug 18

NumerosityVLM: A Cognitively Inspired Benchmark for Interpreting Numerosity Representations in Vision-Language Models

arXiv:2608. 15425v1 Announce Type: cross Abstract: Vision-language models (VLMs) achieve strong performance on high-level multimodal tasks, yet numerosity perception, a cognitive ability that emerges in human infants before language acquisition, remains poorly understood in current models, as existing counting benchmarks entangle numerosity with correlated visual factors.

By Yiming Fu, Fangjun Li, Xiujin Liu, Ruidong Ma, Hang Yu, Zhichen Lu, Kanwei He, Alessandro Di Nuovo, Angelo Cangelosi, Zhegong Shangguan

llms multimodal benchmarks

arXiv AI

Sep 16

Same Answer, Different Representations: Hidden instability in VLMs

arXiv:2602.06652v2 Announce Type: replace Abstract: The robustness of Vision Language Models (VLMs) is commonly assessed through output-level invariance, implicitly assuming that stable predictions r...

By Farooq Ahmad Wani, Alessandro Suglia, Rohit Saxena, Aryo Pradipta Gema, Wai-Chung Kwan, Fazl Barez, Maria Sofia Bucarelli, Fabrizio Silvestri, Pasquale Minervini

llms rag multimodal benchmarks safety

One email a morning, machine-written

Related stories

Why MLLMs Struggle to Count: Overcoming Individuation and Aggregation Bottlenecks with ConvStack

HoloCount: A Holistic Visual Counting Benchmark for MLLMs

The Count Is There, but Misaligned: Understanding and Correcting Counting Failures in VLMs

The Last Visible Pixel: Probing Fine-Scale Perception in Vision-Language Models

NumerosityVLM: A Cognitively Inspired Benchmark for Interpreting Numerosity Representations in Vision-Language Models

Same Answer, Different Representations: Hidden instability in VLMs