arXiv Machine Learning

Unsupervised Learning of Cell Instances with Generative Routing Pyramids

arXiv:2608. 16810v1 Announce Type: cross Abstract: Identifying and representing object instances such as cells or nuclei is a common task in microscopy image analysis.

arXiv AI
Jul 7

HASSL: Hierarchy-Aware Self-Supervised Learning Framework for Single Cell Microscopy

arXiv:2607. 04353v1 Announce Type: cross Abstract: Hierarchical structure is common in image data, where fine-grained clusters often merge into larger, coarser semantic groups.

By Julius Riel, Vishwa Mohan Singh, Sai Anirudh Aryasomayajula, Anuun Chinbat, Hannes Leonhard, Moritz Ladenburger, Frederik Alexander, Vishisht Choudhary, Fabio Laredo, Giacomo Masserdotti, Thorben Prein, Carsten Marr, Amirhossein Kardoost
arXiv AI
Sep 15

End-to-End Cell Detection via Instance-aware Graph Modeling

The paper introduces an end‑to‑end framework for detecting and classifying cells in pathology images by jointly modeling visual features and instance‑level interactions. It employs a dynamic graph construction module that builds cell graphs from learnable queries and an instance‑aware graph network that filters and reorganizes features, integrating appearance and relational evidence. Experiments on multiple staining protocols show the method surpasses existing approaches in both detection and classification accuracy.

By Ruochen Liu, Yalin Zheng, Jingxin Liu, Jianfeng Zhang, Shoujun Huang, Dexing Kong, Haofeng Li, Wei Lou
arXiv AI
Jul 28

scMIR: a vision-language foundation model for single-cell light microscopy image representation

arXiv:2607. 22712v1 Announce Type: cross Abstract: Single-cell light microscopy images have become an important data source for characterizing cell phenotypes, but their complexity and heterogeneity pose challenges to high-throughput automated analysis.

By Yifan Shang (Department of Biomedical Engineering, The Chinese University of Hong Kong, Hong Kong, China, College of Computer Science and Electronic Engineering, Hunan University, Changsha, China), Jiahui Tan (College of Computer Science and Electronic Engineering, Hunan University, Changsha, China), Xiangxiang Zeng (College of Computer Science and Electronic Engineering, Hunan University, Changsha, China), Renjie Zhou (Department of Biomedical Engineering, The Chinese University of Hong Kong, Hong Kong, China)
arXiv AI
Sep 1

QCell: Recombining and Aligning Cell Queries for Overlapping Instance Segmentation

QCell is a query‑based model designed to improve overlapping cell instance segmentation in microscopy images. It introduces an instance recombination module that decomposes and recombines query representations in latent space, allowing the model to reason about entire cell structures even when they overlap. Additionally, a contrastive query alignment objective is used to learn distinctive instance features and separate overlapping cell queries. The authors also present a new Organoid dataset benchmark and demonstrate that QCell surpasses state‑of‑the‑art methods, achieving +2.2 AP and +2.7 AJI on the ISBI2014 benchmark.

By Yaroslav Prytula, Anton Popov, Dmytro Fishman
arXiv AI
Sep 25

A Multimodal 3D Foundation Model for Light Sheet Fluorescence Microscopy Enables Few-Shot Segmentation, Classification, and Deblurring

The paper presents a 3D foundation model for light sheet fluorescence microscopy (LSM) that is pretrained on a large curated set of 3D images from various organisms, stains, and imaging protocols. By jointly optimizing for masked reconstruction and image‑text alignment, the model learns transferable volumetric representations that dramatically reduce the need for annotated data. The pretrained backbone enables efficient few‑shot adaptation to downstream tasks such as segmentation, classification, and deblurring, consistently outperforming baselines according to standard metrics and expert evaluation.

By Adina Scheinfeld, Haotan Zhang, Shang Mu, Rudolf L. M. van Herten, Lucas Stoffl, Ali Erturk, Zhuhao Wu, Johannes C. Paetzold