arXiv Computer Vision

3D-Guided Scalable Flow Matching for Generating Volumetric Tissue Spatial Transcriptomics from Serial Histology

The paper introduces HoloTea, a 3D‑aware flow‑matching framework that imputes spot‑level gene expression on unprofiled histology sections using H&E images and neighboring profiled sections. By incorporating cross‑section context via a lightweight ControlNet and a zero‑inflated negative binomial prior, HoloTea preserves anatomical continuity along the z‑axis and scales efficiently with a global attention block. Experiments on three spatial transcriptomics datasets show that HoloTea outperforms both 2D and existing 3D baselines in expression accuracy and generalization.

arXiv AI
1d ago

More Genes, Faster Inference: Efficient Large-Panel Spatial Transcriptomics Prediction from Histology

GeneFlow is a new framework that predicts large-panel spatial gene expression directly from histology images. It combines flow‑matching generative modeling with structured multimodal fusion, encoding both tissue morphology and cross‑gene interactions via histology and gene tokenizers. The method achieves state‑of‑the‑art performance on multiple spatial transcriptomics benchmarks, delivering up to 56.8% improvement in 1,000‑gene prediction while drastically reducing computational cost.

By Songming Zhang, Yuxiao Luo, Shifu Luo, Siran Chen, Shuquan Su, Jinyan Li
arXiv AI
Sep 25

A Multimodal 3D Foundation Model for Light Sheet Fluorescence Microscopy Enables Few-Shot Segmentation, Classification, and Deblurring

The paper presents a 3D foundation model for light sheet fluorescence microscopy (LSM) that is pretrained on a large curated set of 3D images from various organisms, stains, and imaging protocols. By jointly optimizing for masked reconstruction and image‑text alignment, the model learns transferable volumetric representations that dramatically reduce the need for annotated data. The pretrained backbone enables efficient few‑shot adaptation to downstream tasks such as segmentation, classification, and deblurring, consistently outperforming baselines according to standard metrics and expert evaluation.

By Adina Scheinfeld, Haotan Zhang, Shang Mu, Rudolf L. M. van Herten, Lucas Stoffl, Ali Erturk, Zhuhao Wu, Johannes C. Paetzold
arXiv Machine Learning
Oct 28

Biology-Guided Context-Aware Residual Propagation for Spatial Gene Expression Prediction from Histology

The paper introduces BCARP, a Biology‑Guided Context‑Aware Residual Propagation framework that predicts spatial gene expression from H&E‑stained histology images. Rather than directly decoding expression from visual features, BCARP treats histology embeddings as morphological priors and iteratively refines spot representations in a transcriptomics‑oriented latent space, integrating nuclei‑guided local context and prototype‑guided global propagation. Evaluations on three spatial transcriptomics datasets and ten HEST‑1k cohorts show that BCARP outperforms existing baselines in mean correlation‑based metrics, demonstrating the effectiveness of biology‑guided local‑global residual propagation for histology‑to‑transcriptomics prediction.

By Vu Van An, Long D. Nguyen, Ho Viet Duc Luong, Binh P. Nguyen
arXiv Machine Learning
Sep 22

Correlation-Guided Flow Matching with Annealed Masking for Spatial Transcriptomics Generation

CorrFlow is a new generative framework for predicting spatial transcriptomics from histology images. It explicitly models gene-gene interactions using an annealed masked flow matching strategy and a gene graph‑regularized optimization that incorporates prior knowledge from STRING and data‑driven co‑expression from WGCNA. Across 12 datasets, CorrFlow outperforms existing methods in average PCC and HPCC, producing more biologically coherent ST predictions.

By Yupei Zhang, Hao Chen, Li Pan, Chao Li, Xiaohan Xing
arXiv Machine Learning
Jun 5

HEIST: A Graph Foundation Model for Spatial Transcriptomics and Proteomics Data

arXiv:2506. 11152v4 Announce Type: replace-cross Abstract: Single-cell transcriptomics and proteomics have become a great source for data-driven insights into biology, enabling the use of advanced deep learning methods to understand cellular heterogeneity and gene expression at the single-cell level.

By Hiren Madhu, Jo\~ao Felipe Rocha, Tinglin Huang, Siddharth Viswanath, Smita Krishnaswamy, Rex Ying
arXiv Machine Learning
Jun 3

Spatial Transcriptomics-Guided Alignment Enhances Molecular Profiling in Pathology Foundation Model

arXiv:2606. 03644v1 Announce Type: new Abstract: Comprehensive molecular profiling is essential for modern precision oncology but remains hindered by prohibitive costs, specimen exhaustion, and protracted turnaround times.

By Fengtao Zhou, Yingxue Xu, Zhengyu Zhang, Yihui Wang, Zhengrui Guo, Ling Liang, Jiabo Ma, Cheng Jin, Ziyi Liu, Huajun Zhou, Hongyi Wang, Du Cai, Chenglong Zhao, Xi Wang, Can Yang, Yu Wang, Wenbin Li, Feng Gao, Zhe Wang, Zhenhui Li, Xiuming Zhang, Li Liang, Hao Chen
arXiv Machine Learning
Sep 25

SpaFactor: Lightweight Spatial Context-Aware Gene Program Modeling for Histology-to-Transcriptomics Inference

SpaFactor is a lightweight framework that predicts spatial gene expression from hematoxylin and eosin images by fusing central spot visuals with multiscale neighborhood context. It uses a residual MLP to map tissue microenvironment to low‑dimensional latent gene programs, which are decoded into coordinated multi‑gene predictions. Across five public cohorts, SpaFactor outperforms existing methods, especially for spatially variable genes, and better recovers biologically organized spatial patterns.

By Shiting Ruan, Xitong Ling, Qiming He, Ziyou Yan, Huaitian Yuan, Tian Guan, Ying Xiao, Xu Guan, Yonghong He