arXiv Computer Vision By Mohammad Vali Sanian, Arshia Hemmat, Amirhossein Vahidi, Jonas Maaskola, Jimmy Tsz Hang Lee, Martin Prete, Stanislaw Makarchuk, Yeliz Demirci, Nana-Jane Chipampe, Muzlifah Haniffa, Omer Bayraktar, Lassi Paavolainen, Mohammad Lotfollahi

3D-Guided Scalable Flow Matching for Generating Volumetric Tissue Spatial Transcriptomics from Serial Histology

Read the original on arXiv Computer Vision →

The paper introduces HoloTea, a 3D‑aware flow‑matching framework that imputes spot‑level gene expression on unprofiled histology sections using H&E images and neighboring profiled sections. By incorporating cross‑section context via a lightweight ControlNet and a zero‑inflated negative binomial prior, HoloTea preserves anatomical continuity along the z‑axis and scales efficiently with a global attention block. Experiments on three spatial transcriptomics datasets show that HoloTea outperforms both 2D and existing 3D baselines in expression accuracy and generalization.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv AI
1d ago

More Genes, Faster Inference: Efficient Large-Panel Spatial Transcriptomics Prediction from Histology

GeneFlow is a new framework that predicts large-panel spatial gene expression directly from histology images. It combines flow‑matching generative modeling with structured multimodal fusion, encoding both tissue morphology and cross‑gene interactions via histology and gene tokenizers. The method achieves state‑of‑the‑art performance on multiple spatial transcriptomics benchmarks, delivering up to 56.8% improvement in 1,000‑gene prediction while drastically reducing computational cost.

By Songming Zhang, Yuxiao Luo, Shifu Luo, Siran Chen, Shuquan Su, Jinyan Li
arXiv AI
Sep 25

A Multimodal 3D Foundation Model for Light Sheet Fluorescence Microscopy Enables Few-Shot Segmentation, Classification, and Deblurring

The paper presents a 3D foundation model for light sheet fluorescence microscopy (LSM) that is pretrained on a large curated set of 3D images from various organisms, stains, and imaging protocols. By jointly optimizing for masked reconstruction and image‑text alignment, the model learns transferable volumetric representations that dramatically reduce the need for annotated data. The pretrained backbone enables efficient few‑shot adaptation to downstream tasks such as segmentation, classification, and deblurring, consistently outperforming baselines according to standard metrics and expert evaluation.

By Adina Scheinfeld, Haotan Zhang, Shang Mu, Rudolf L. M. van Herten, Lucas Stoffl, Ali Erturk, Zhuhao Wu, Johannes C. Paetzold
arXiv Machine Learning
Oct 28

Biology-Guided Context-Aware Residual Propagation for Spatial Gene Expression Prediction from Histology

The paper introduces BCARP, a Biology‑Guided Context‑Aware Residual Propagation framework that predicts spatial gene expression from H&E‑stained histology images. Rather than directly decoding expression from visual features, BCARP treats histology embeddings as morphological priors and iteratively refines spot representations in a transcriptomics‑oriented latent space, integrating nuclei‑guided local context and prototype‑guided global propagation. Evaluations on three spatial transcriptomics datasets and ten HEST‑1k cohorts show that BCARP outperforms existing baselines in mean correlation‑based metrics, demonstrating the effectiveness of biology‑guided local‑global residual propagation for histology‑to‑transcriptomics prediction.

By Vu Van An, Long D. Nguyen, Ho Viet Duc Luong, Binh P. Nguyen
arXiv Machine Learning
Sep 22

Correlation-Guided Flow Matching with Annealed Masking for Spatial Transcriptomics Generation

CorrFlow is a new generative framework for predicting spatial transcriptomics from histology images. It explicitly models gene-gene interactions using an annealed masked flow matching strategy and a gene graph‑regularized optimization that incorporates prior knowledge from STRING and data‑driven co‑expression from WGCNA. Across 12 datasets, CorrFlow outperforms existing methods in average PCC and HPCC, producing more biologically coherent ST predictions.

By Yupei Zhang, Hao Chen, Li Pan, Chao Li, Xiaohan Xing