arXiv Computer Vision

Predicting Single-Cell Spatial Gene Expression from H&E using Pathology Foundation Models

The paper presents a method for predicting single‑cell spatial gene expression from hematoxylin and eosin (H&E) images by adapting pathology foundation models with domain‑informed, task‑specific strategies. Using paired H&E and Xenium 5K data, the approach improves mean gene‑wise Pearson correlation by 2.67× over a zero‑shot baseline and achieves state‑of‑the‑art performance, with an AUROC of 0.800 across the full gene panel. The study shows that predictive performance varies across biological contexts, achieving the highest correlation for spatially variable genes (r = 0.643), and demonstrates that H&E‑derived representations can recover biologically meaningful spatial expression patterns despite sparse single‑cell measurements.

arXiv Machine Learning
Oct 28

Biology-Guided Context-Aware Residual Propagation for Spatial Gene Expression Prediction from Histology

The paper introduces BCARP, a Biology‑Guided Context‑Aware Residual Propagation framework that predicts spatial gene expression from H&E‑stained histology images. Rather than directly decoding expression from visual features, BCARP treats histology embeddings as morphological priors and iteratively refines spot representations in a transcriptomics‑oriented latent space, integrating nuclei‑guided local context and prototype‑guided global propagation. Evaluations on three spatial transcriptomics datasets and ten HEST‑1k cohorts show that BCARP outperforms existing baselines in mean correlation‑based metrics, demonstrating the effectiveness of biology‑guided local‑global residual propagation for histology‑to‑transcriptomics prediction.

By Vu Van An, Long D. Nguyen, Ho Viet Duc Luong, Binh P. Nguyen
arXiv AI
Jun 2

GC-MoE: Genomics-Guided Cell-Type-Specific Mixture of Experts for Histology-Based Single-Cell Spatial Transcriptomics

arXiv:2606. 02424v1 Announce Type: cross Abstract: Histology-based single-cell spatial transcriptomics (ST) estimation aims to predict gene expression for individual cells from histopathological images and cell locations, reducing the need for costly single-cell ST measurements.

By Kaito Shiku, Ahtisham Fazeel Abbasi, Ryoma Bise, Yuichiro Iwashita, Kazuya Nishimura, Andreas Dengel, Muhammad Nabeel Asim
arXiv Machine Learning
Sep 25

SpaFactor: Lightweight Spatial Context-Aware Gene Program Modeling for Histology-to-Transcriptomics Inference

SpaFactor is a lightweight framework that predicts spatial gene expression from hematoxylin and eosin images by fusing central spot visuals with multiscale neighborhood context. It uses a residual MLP to map tissue microenvironment to low‑dimensional latent gene programs, which are decoded into coordinated multi‑gene predictions. Across five public cohorts, SpaFactor outperforms existing methods, especially for spatially variable genes, and better recovers biologically organized spatial patterns.

By Shiting Ruan, Xitong Ling, Qiming He, Ziyou Yan, Huaitian Yuan, Tian Guan, Ying Xiao, Xu Guan, Yonghong He
arXiv Machine Learning
Nov 2

From WSIs to Bulk, Spatial and Single-Cell Transcriptomics via Multi-Scale Graph Neural Networks

The paper presents a Multi‑Scale Graph Neural Network that predicts bulk, spatial, and single‑cell gene expression directly from whole‑slide histopathology images. It uses a Pathology Foundation Model to extract morphological features and builds spatial graphs at patch and cell levels, training on TCGA, Visium, and Xenium data from lung, kidney, and breast tissues. The model achieves accurate slide‑level predictions, moderate patch‑level accuracy (especially on Xenium), and moderate single‑cell correlation, and its outputs are shown to be useful for survival analysis, spatial hazard mapping, and tumor classification.

By Miguel Andrade, Jos\'e Almeida, Carlos Santiago, Catarina Barata
arXiv Machine Learning
Jun 3

Spatial Transcriptomics-Guided Alignment Enhances Molecular Profiling in Pathology Foundation Model

arXiv:2606. 03644v1 Announce Type: new Abstract: Comprehensive molecular profiling is essential for modern precision oncology but remains hindered by prohibitive costs, specimen exhaustion, and protracted turnaround times.

By Fengtao Zhou, Yingxue Xu, Zhengyu Zhang, Yihui Wang, Zhengrui Guo, Ling Liang, Jiabo Ma, Cheng Jin, Ziyi Liu, Huajun Zhou, Hongyi Wang, Du Cai, Chenglong Zhao, Xi Wang, Can Yang, Yu Wang, Wenbin Li, Feng Gao, Zhe Wang, Zhenhui Li, Xiuming Zhang, Li Liang, Hao Chen
Hugging Face Trending Papers
Oct 13

MIST: Multi-Scale Spatial Context for Gene Expression Prediction from Histology

MIST is a Multi‑context Spatial Transformer that predicts spatial gene expression from H&E images by adding two context pathways to a standard Transformer: a coordinate‑invariant local pathway that attends to spatial k‑nearest‑neighbor spots, and a slide pathway that broadcasts a whole‑slide summary to every spot. In intra‑cohort evaluation across six human organ cohorts, MIST improves mean Pearson correlation by 9.7%–11.6% over the strongest baseline for 10‑, 50‑, and 100‑gene panels, and achieves lower MSE and MAE. It also outperforms baselines in leave‑one‑organ‑out transfer, domain recovery, and reproduces spatial expression patterns of cancer‑marker genes.

arXiv AI
1d ago

More Genes, Faster Inference: Efficient Large-Panel Spatial Transcriptomics Prediction from Histology

GeneFlow is a new framework that predicts large-panel spatial gene expression directly from histology images. It combines flow‑matching generative modeling with structured multimodal fusion, encoding both tissue morphology and cross‑gene interactions via histology and gene tokenizers. The method achieves state‑of‑the‑art performance on multiple spatial transcriptomics benchmarks, delivering up to 56.8% improvement in 1,000‑gene prediction while drastically reducing computational cost.

By Songming Zhang, Yuxiao Luo, Shifu Luo, Siran Chen, Shuquan Su, Jinyan Li
arXiv Machine Learning
Jun 5

HEIST: A Graph Foundation Model for Spatial Transcriptomics and Proteomics Data

arXiv:2506. 11152v4 Announce Type: replace-cross Abstract: Single-cell transcriptomics and proteomics have become a great source for data-driven insights into biology, enabling the use of advanced deep learning methods to understand cellular heterogeneity and gene expression at the single-cell level.

By Hiren Madhu, Jo\~ao Felipe Rocha, Tinglin Huang, Siddharth Viswanath, Smita Krishnaswamy, Rex Ying