arXiv AI September 30, 2026 By Yicong Li, Junjie Wang, Leander Lauenburg, Ella Hugie, Alexandra Irger, Wanhua Li, Donglai Wei, Hanspeter Pfister

Benchmarking Vision-Language Models on Synapse Detection and Proofreading in Connectomics

Read the original on arXiv AI →

The paper benchmarks vision‑language models (VLMs) on two key tasks in connectomics: synapse detection (presence and polarity) and proofreading (split and merge errors). It evaluates 21 models (19 open, 2 closed) under zero‑shot, few‑shot, and LoRA fine‑tuning, comparing them to specialist models on datasets built from public resources. While most VLMs perform at chance in zero‑shot settings, LoRA fine‑tuning with a few thousand labels brings open models to specialist performance, and adapted VLMs outperform specialists on unseen species for merge‑error detection.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI

Aug 18

OODBench: Out-of-Distribution Benchmark for Large Vision-Language Models

arXiv:2602. 18094v2 Announce Type: replace-cross Abstract: Existing Visual-Language Models (VLMs) have achieved significant progress by being trained on massive-scale datasets, typically under the assumption that data are independent and identically distributed (IID).

By Ling Lin, Yang Bai, Heng Su, Congcong Zhu, Yaoxing Wang, Yang Zhou, Huazhu Fu, Jingrun Chen

llms agents robotics multimodal benchmarks safety

arXiv Computer Vision

1d ago

Visual Evidence Under Cross-Examination: Evaluating and Controlling Decision-Level Evidence Use in Vision-Language Models

arXiv:2610.09550v1 Announce Type: new Abstract: Vision-language models increasingly reason through crops, regions, and tool-produced observations. Yet an observation can influence the answer without...

By Huiyao Zhang, Jin Bai, Zilong Su, Rui Guo, Chaofan Qin, Jinze Lv, Wenhui Yu, Hongfei Wang, Ye Li

llms multimodal benchmarks

arXiv Machine Learning

Jun 30

DataComp-VLM: Improved Open Datasets for Vision-Language Models

arXiv:2606. 28551v1 Announce Type: cross Abstract: Building performant Vision-Language Models (VLMs) requires carefully curating large-scale training datasets, yet the community lacks systematic benchmarks for evaluating such curation strategies.

By Matteo Farina, Vishaal Udandarao, Thao Nguyen, Selim Kuzucu, Maximilian B\"other, Andreas Hochlehnert, Adhiraj Ghosh, Marianna Nezhurina, Karsten Roth, Joschka Struber, Yuhui Zhang, Sebastian Dziadzio, Elaine Sui, Soumya Jahagirdar, Dhruba Ghosh, Hasan Hammoud, Thomas De Min, Simone Caldarella, Jehanzeb Mirza, Sedrick Keh, Mehdi Cherti, Hilde Kuehne, Bernt Schiele, Serena Yeung-Levy, Muhammad Ferjad Naeem, Federico Tombari, Ana Klimovic, Elisa Ricci, Matthias Bethge, Sewoong Oh, Ameya Prabhu, Alessio Tonioni, Jenia Jitsev, Massimiliano Mancini, Ludwig Schmidt, Nikhil Parthasarathy

llms multimodal benchmarks

arXiv AI

Oct 1

VisionFoundry: Teaching VLMs Visual Perception with Synthetic Images

arXiv:2604.09531v2 Announce Type: replace-cross Abstract: Vision-language models (VLMs) still struggle with visual perception tasks such as spatial understanding and viewpoint recognition, largely be...

By Guanyu Zhou, Yida Yin, Wenhao Chai, Shengbang Tong, Xingyu Fu, Zhuang Liu

llms diffusion reinforcement-learning fine-tuning multimodal benchmarks

Hugging Face Trending Papers

Aug 17

Diagnosing Dense Same-Class Attribute Misbinding in Large Vision-Language Models

Large vision-language models can recognize the objects and attributes in a crowded scene yet assign an attribute to the wrong same-class instance. Generic visual-question-answering accuracy marks the...

llms multimodal benchmarks safety

arXiv AI

Sep 12

Can Edge-Deployable Vision-Language Models Identify Species?

arXiv:2609. 11916v1 Announce Type: new Abstract: Camera traps often run in the field on edge hardware with limited or no connectivity, making small, locally-deployable vision-language models (VLMs) -- not frontier-scale ones -- the practically relevant class to evaluate for species identification.

By William Zhou, Mayukha Siripuram, Xiao Yan, Ziqi Liu, Yi Ding

llms multimodal

One email a morning, machine-written

Related stories

OODBench: Out-of-Distribution Benchmark for Large Vision-Language Models

Visual Evidence Under Cross-Examination: Evaluating and Controlling Decision-Level Evidence Use in Vision-Language Models

DataComp-VLM: Improved Open Datasets for Vision-Language Models

VisionFoundry: Teaching VLMs Visual Perception with Synthetic Images

Diagnosing Dense Same-Class Attribute Misbinding in Large Vision-Language Models

Can Edge-Deployable Vision-Language Models Identify Species?