arXiv Computer Vision October 23, 2026 By Ilan Theodoro, Jord\~ao Bragantini, Lo\"ic A. Royer

CellTrack-Bench: Microscopic Cell Tracking Benchmark for Vision-Language Models

Read the original on arXiv Computer Vision →

CellTrack-Bench is a new benchmark designed to evaluate Vision‑Language Models (VLMs) on microscopic cell tracking tasks. It compiles 1,537 problems from 15 standard cell‑tracking datasets across four imaging modalities, totaling 9,041 cell‑linking decisions, and includes a hard subset that highlights shared failures among specialized trackers. The benchmark was used to assess 9 closed‑source and 13 open‑weight VLMs, compare them to specialized trackers, and analyze their failure modes, with all code and data available on GitHub.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv AI

Jun 8

MMBU: A Massive Multi-modal Biomedical Understanding Benchmark to Probe the Perception Capabilities of Vision-Language Models

arXiv:2606. 06696v1 Announce Type: cross Abstract: Vision and language models (VLMs) hold immense promise to transform biomedical imaging workflows, from detecting lesions in chest X-rays to profiling cellular features in microscopy.

By Ryan D'Cunha, Alejandro Lozano, Xiaoxiao Sun, Daniel Vela Jarquin, Min Woo Sun, Josiah Aklilu, James Burgess, Yuhui Zhang, Ryan Nayebi, Paola Avila, Robayo, Jin Ye, Ming Hu, Zhongying Deng, Junjun He, Xin Chen, Yue Yao, Robert Tibshirani, Jeffrey J. Nirschl, Serena Yeung-Levy

llms computer-vision multimodal benchmarks

arXiv AI

Jul 28

scMIR: a vision-language foundation model for single-cell light microscopy image representation

arXiv:2607. 22712v1 Announce Type: cross Abstract: Single-cell light microscopy images have become an important data source for characterizing cell phenotypes, but their complexity and heterogeneity pose challenges to high-throughput automated analysis.

By Yifan Shang (Department of Biomedical Engineering, The Chinese University of Hong Kong, Hong Kong, China, College of Computer Science and Electronic Engineering, Hunan University, Changsha, China), Jiahui Tan (College of Computer Science and Electronic Engineering, Hunan University, Changsha, China), Xiangxiang Zeng (College of Computer Science and Electronic Engineering, Hunan University, Changsha, China), Renjie Zhou (Department of Biomedical Engineering, The Chinese University of Hong Kong, Hong Kong, China)

fine-tuning efficiency multimodal benchmarks safety

arXiv Computer Vision

Sep 10

VANTAGE-Bench: Evaluating the Infrastructure AI Gap in Vision-Language Models

arXiv:2609.09396v1 Announce Type: new Abstract: As Vision-Language Models (VLMs) advance toward physical deployment, the focus has remained on action-oriented Embodied AI evaluated on subject-centric...

By Zaid Pervaiz Bhat, Nimra Nayyar, Arihant Jain, Lap Fung Chan, John Suchanek, Yu Wang, Varun Praveen, Tomasz Kornuta, Vidya Nariyambut Murali

llms nlp robotics multimodal benchmarks safety

arXiv Machine Learning

Jun 30

DataComp-VLM: Improved Open Datasets for Vision-Language Models

arXiv:2606. 28551v1 Announce Type: cross Abstract: Building performant Vision-Language Models (VLMs) requires carefully curating large-scale training datasets, yet the community lacks systematic benchmarks for evaluating such curation strategies.

By Matteo Farina, Vishaal Udandarao, Thao Nguyen, Selim Kuzucu, Maximilian B\"other, Andreas Hochlehnert, Adhiraj Ghosh, Marianna Nezhurina, Karsten Roth, Joschka Struber, Yuhui Zhang, Sebastian Dziadzio, Elaine Sui, Soumya Jahagirdar, Dhruba Ghosh, Hasan Hammoud, Thomas De Min, Simone Caldarella, Jehanzeb Mirza, Sedrick Keh, Mehdi Cherti, Hilde Kuehne, Bernt Schiele, Serena Yeung-Levy, Muhammad Ferjad Naeem, Federico Tombari, Ana Klimovic, Elisa Ricci, Matthias Bethge, Sewoong Oh, Ameya Prabhu, Alessio Tonioni, Jenia Jitsev, Massimiliano Mancini, Ludwig Schmidt, Nikhil Parthasarathy

llms multimodal benchmarks

arXiv AI

Oct 26

Benchmarking Vision-Language Models on Synapse and Neuron Proofreading in Connectomics

arXiv:2609.36492v2 Announce Type: replace-cross Abstract: We benchmarked vision-language models (VLMs) on the decisions annotators take when inspecting electron microscopy images in connectomics: syn...

By Yicong Li, Junjie Wang, Leander Lauenburg, Ella Hugie, Alexandra Irger, Wanhua Li, Donglai Wei, Hanspeter Pfister

llms fine-tuning multimodal benchmarks

arXiv AI

Sep 30

Benchmarking Vision-Language Models on Synapse Detection and Proofreading in Connectomics

The paper benchmarks vision‑language models (VLMs) on two key tasks in connectomics: synapse detection (presence and polarity) and proofreading (split and merge errors). It evaluates 21 models (19 open, 2 closed) under zero‑shot, few‑shot, and LoRA fine‑tuning, comparing them to specialist models on datasets built from public resources. While most VLMs perform at chance in zero‑shot settings, LoRA fine‑tuning with a few thousand labels brings open models to specialist performance, and adapted VLMs outperform specialists on unseen species for merge‑error detection.

By Yicong Li, Junjie Wang, Leander Lauenburg, Ella Hugie, Alexandra Irger, Wanhua Li, Donglai Wei, Hanspeter Pfister

llms fine-tuning multimodal benchmarks

One email a morning, machine-written

Related stories

MMBU: A Massive Multi-modal Biomedical Understanding Benchmark to Probe the Perception Capabilities of Vision-Language Models

scMIR: a vision-language foundation model for single-cell light microscopy image representation

VANTAGE-Bench: Evaluating the Infrastructure AI Gap in Vision-Language Models

DataComp-VLM: Improved Open Datasets for Vision-Language Models

Benchmarking Vision-Language Models on Synapse and Neuron Proofreading in Connectomics

Benchmarking Vision-Language Models on Synapse Detection and Proofreading in Connectomics