arXiv Computer Vision

Learning to Track Cells from Sparse Annotations in 3D Time-Lapse Microscopy

arXiv Machine Learning
Oct 21

PACE: Geometry-Aware Bridge Transport for Single-Cell Trajectory Inference

PACE is a trajectory inference framework that reconstructs continuous transport dynamics from destructive single‑cell time‑course snapshots. It uses a state‑ and time‑dependent anisotropic Riemannian metric to guide transport along tangent directions, alternates between refining cross‑time couplings and fitting neural bridges, and distills the learned dynamics into a global velocity field. Across multiple datasets, PACE outperforms existing methods, reducing key distance metrics by an average of 23.7% and improving RNA‑velocity alignment by 15.4%.

By Chenglei Yu, Chuanrui Wang, Bangyan Liao, Tailin Wu
arXiv Machine Learning
Oct 5

Generalizable single-cell perturbation response prediction using energy-guided flow matching

The paper introduces scEGFlow, an energy‑guided flow matching framework that predicts how single cells respond to perturbations by modeling continuous transitions from control to perturbed states. It uses conditional flow matching and condition‑specific energy gradients to dynamically adjust predictions without retraining, achieving superior performance on imaging and transcriptomic benchmarks, even for unseen perturbations or limited data. The method preserves cellular manifold geometry, heterogeneity, and accurately recapitulates gene‑expression regulatory patterns.

By Jianan Wei, Jiajun Hong, Guikun Chen, Ning Yang, Lifeng Fan, Wenguan Wang
arXiv AI
Sep 25

A Multimodal 3D Foundation Model for Light Sheet Fluorescence Microscopy Enables Few-Shot Segmentation, Classification, and Deblurring

The paper presents a 3D foundation model for light sheet fluorescence microscopy (LSM) that is pretrained on a large curated set of 3D images from various organisms, stains, and imaging protocols. By jointly optimizing for masked reconstruction and image‑text alignment, the model learns transferable volumetric representations that dramatically reduce the need for annotated data. The pretrained backbone enables efficient few‑shot adaptation to downstream tasks such as segmentation, classification, and deblurring, consistently outperforming baselines according to standard metrics and expert evaluation.

By Adina Scheinfeld, Haotan Zhang, Shang Mu, Rudolf L. M. van Herten, Lucas Stoffl, Ali Erturk, Zhuhao Wu, Johannes C. Paetzold
arXiv Computer Vision
Oct 23

CellTrack-Bench: Microscopic Cell Tracking Benchmark for Vision-Language Models

CellTrack-Bench is a new benchmark designed to evaluate Vision‑Language Models (VLMs) on microscopic cell tracking tasks. It compiles 1,537 problems from 15 standard cell‑tracking datasets across four imaging modalities, totaling 9,041 cell‑linking decisions, and includes a hard subset that highlights shared failures among specialized trackers. The benchmark was used to assess 9 closed‑source and 13 open‑weight VLMs, compare them to specialized trackers, and analyze their failure modes, with all code and data available on GitHub.

By Ilan Theodoro, Jord\~ao Bragantini, Lo\"ic A. Royer
arXiv Computer Vision
Oct 26

IFC-SSL-Bench: Benchmarking Self-Supervised Learning for Annotation-Efficient Multispectral Imaging Flow Cytometry

arXiv:2610.31848v1 Announce Type: new Abstract: Imaging Flow Cytometry (IFC) generates large multispectral datasets, yet the need for expert annotations bottlenecks the development of supervised deep...

By Angelo Jovin Yamachui Sitcheu, Roxana-Teodora Fetescu, Thomas Lautenschlager, Nils Friederich, Linus Schilpp, Stephan Allgeier, Luca Deininger, Daniel H\"ubschmann, Ralf Mikut
arXiv Computer Vision
Sep 7

DART: Depth-as-Target Pretraining for Surgical Vision Foundation Models

DART is a new RGB‑D pretraining method for surgical vision foundation models that incorporates pseudo‑labeled depth maps as a pixel‑space reconstruction target during training. By adding a depth reconstruction head to DINOv2’s masked iBOT framework, DART improves representation quality without affecting downstream RGB‑only fine‑tuning or inference. Across eight surgical benchmarks—including segmentation, depth estimation, and image‑level recognition—DART outperforms both natural‑image and in‑domain baselines, demonstrating that geometric pseudo‑labels can strengthen foundation model pretraining without extra labels or inference cost.

By John J. Han, Adam Schmidt, Muhammad Abdullah Jamal, Jie Ying Wu, Omid Mohareri