arXiv Computer Vision

Label-free cell counting and viability prediction with brightfield imaging and deep learning

arXiv AI
Jul 28

scMIR: a vision-language foundation model for single-cell light microscopy image representation

arXiv:2607. 22712v1 Announce Type: cross Abstract: Single-cell light microscopy images have become an important data source for characterizing cell phenotypes, but their complexity and heterogeneity pose challenges to high-throughput automated analysis.

By Yifan Shang (Department of Biomedical Engineering, The Chinese University of Hong Kong, Hong Kong, China, College of Computer Science and Electronic Engineering, Hunan University, Changsha, China), Jiahui Tan (College of Computer Science and Electronic Engineering, Hunan University, Changsha, China), Xiangxiang Zeng (College of Computer Science and Electronic Engineering, Hunan University, Changsha, China), Renjie Zhou (Department of Biomedical Engineering, The Chinese University of Hong Kong, Hong Kong, China)
arXiv Computer Vision
Oct 12

Detection of extremely rare dead cells in fluorescence microscopy images

The study evaluates multiple computational methods for detecting dead cells in fluorescence microscopy images, comparing heuristic thresholding, classification with numerical and image features, and anomaly detection techniques. Using a dataset of 258 images and 65,527 cells, the best performance was achieved by deep learning image classifiers (ResNet-18) and traditional numerical classifiers (XGBoost), outperforming manual heuristics and anomaly detection. The results highlight the difficulty of reliably identifying apoptotic cells despite advanced machine learning approaches.

By Prateek Verma, Benjamin Butter, Jian Zhang, Xintao Wu
arXiv AI
Jun 3

CP-Agent: Context-Aware Multimodal Reasoning for Cellular Morphological Profiling under Chemical Perturbations

arXiv:2606. 03435v1 Announce Type: new Abstract: Cell Painting combines multiplexed fluorescent staining, high-content imaging, and quantitative analysis to generate high-dimensional phenotypic readouts to support diverse downstream tasks such as mechanism-of-action (MoA) inference, toxicity prediction, and construction of drug-disease atlases.

By Yuxin Zhang, Yiyao Li, Ping Shu Ho, Simon See, Zhenqin Wu, Kevin Tsia
arXiv AI
Jul 2

MalariAI: A Label-Resilient Decoupled Framework for Universal Cell Segmentation and Explainable Stage Classification in Dense Malaria Blood Smears

arXiv:2607. 00385v1 Announce Type: cross Abstract: Automated malaria diagnosis from blood smear microscopy is a critical challenge in global health AI; in resource-limited settings, the scarcity of expert microscopists remains the primary bottleneck to timely and accurate diagnosis.

By Kaysarul Anas Apurba, Md Hasibul Hasan, Mohammed Ali, Tanzilur Rahman
arXiv Computer Vision
Oct 23

CellTrack-Bench: Microscopic Cell Tracking Benchmark for Vision-Language Models

CellTrack-Bench is a new benchmark designed to evaluate Vision‑Language Models (VLMs) on microscopic cell tracking tasks. It compiles 1,537 problems from 15 standard cell‑tracking datasets across four imaging modalities, totaling 9,041 cell‑linking decisions, and includes a hard subset that highlights shared failures among specialized trackers. The benchmark was used to assess 9 closed‑source and 13 open‑weight VLMs, compare them to specialized trackers, and analyze their failure modes, with all code and data available on GitHub.

By Ilan Theodoro, Jord\~ao Bragantini, Lo\"ic A. Royer
arXiv AI
Sep 25

A Multimodal 3D Foundation Model for Light Sheet Fluorescence Microscopy Enables Few-Shot Segmentation, Classification, and Deblurring

The paper presents a 3D foundation model for light sheet fluorescence microscopy (LSM) that is pretrained on a large curated set of 3D images from various organisms, stains, and imaging protocols. By jointly optimizing for masked reconstruction and image‑text alignment, the model learns transferable volumetric representations that dramatically reduce the need for annotated data. The pretrained backbone enables efficient few‑shot adaptation to downstream tasks such as segmentation, classification, and deblurring, consistently outperforming baselines according to standard metrics and expert evaluation.

By Adina Scheinfeld, Haotan Zhang, Shang Mu, Rudolf L. M. van Herten, Lucas Stoffl, Ali Erturk, Zhuhao Wu, Johannes C. Paetzold