arXiv Computer Vision

Towards Scalable Context-Aware Single-Cell Spatial Transcriptomics Prediction from Histology Images

arXiv AI
Jun 2

GC-MoE: Genomics-Guided Cell-Type-Specific Mixture of Experts for Histology-Based Single-Cell Spatial Transcriptomics

arXiv:2606. 02424v1 Announce Type: cross Abstract: Histology-based single-cell spatial transcriptomics (ST) estimation aims to predict gene expression for individual cells from histopathological images and cell locations, reducing the need for costly single-cell ST measurements.

By Kaito Shiku, Ahtisham Fazeel Abbasi, Ryoma Bise, Yuichiro Iwashita, Kazuya Nishimura, Andreas Dengel, Muhammad Nabeel Asim
arXiv Machine Learning
Oct 28

Biology-Guided Context-Aware Residual Propagation for Spatial Gene Expression Prediction from Histology

The paper introduces BCARP, a Biology‑Guided Context‑Aware Residual Propagation framework that predicts spatial gene expression from H&E‑stained histology images. Rather than directly decoding expression from visual features, BCARP treats histology embeddings as morphological priors and iteratively refines spot representations in a transcriptomics‑oriented latent space, integrating nuclei‑guided local context and prototype‑guided global propagation. Evaluations on three spatial transcriptomics datasets and ten HEST‑1k cohorts show that BCARP outperforms existing baselines in mean correlation‑based metrics, demonstrating the effectiveness of biology‑guided local‑global residual propagation for histology‑to‑transcriptomics prediction.

By Vu Van An, Long D. Nguyen, Ho Viet Duc Luong, Binh P. Nguyen
arXiv Computer Vision
6d ago

Predicting Single-Cell Spatial Gene Expression from H&E using Pathology Foundation Models

The paper presents a method for predicting single‑cell spatial gene expression from hematoxylin and eosin (H&E) images by adapting pathology foundation models with domain‑informed, task‑specific strategies. Using paired H&E and Xenium 5K data, the approach improves mean gene‑wise Pearson correlation by 2.67× over a zero‑shot baseline and achieves state‑of‑the‑art performance, with an AUROC of 0.800 across the full gene panel. The study shows that predictive performance varies across biological contexts, achieving the highest correlation for spatially variable genes (r = 0.643), and demonstrates that H&E‑derived representations can recover biologically meaningful spatial expression patterns despite sparse single‑cell measurements.

By Ashley P. Tsang, Evan Liu, Conrad Foo, Bob Chen, Hassaan Maan, Donny Chan, Elisa Penna, Veronica Ibarra Lopez, Hector Corrada Bravo, Aicha BenTaieb, Lisa M. McGinnis, Runmin Wei, Kenneth T. Gao
Hugging Face Trending Papers
Oct 13

MIST: Multi-Scale Spatial Context for Gene Expression Prediction from Histology

MIST is a Multi‑context Spatial Transformer that predicts spatial gene expression from H&E images by adding two context pathways to a standard Transformer: a coordinate‑invariant local pathway that attends to spatial k‑nearest‑neighbor spots, and a slide pathway that broadcasts a whole‑slide summary to every spot. In intra‑cohort evaluation across six human organ cohorts, MIST improves mean Pearson correlation by 9.7%–11.6% over the strongest baseline for 10‑, 50‑, and 100‑gene panels, and achieves lower MSE and MAE. It also outperforms baselines in leave‑one‑organ‑out transfer, domain recovery, and reproduces spatial expression patterns of cancer‑marker genes.

arXiv AI
1d ago

More Genes, Faster Inference: Efficient Large-Panel Spatial Transcriptomics Prediction from Histology

GeneFlow is a new framework that predicts large-panel spatial gene expression directly from histology images. It combines flow‑matching generative modeling with structured multimodal fusion, encoding both tissue morphology and cross‑gene interactions via histology and gene tokenizers. The method achieves state‑of‑the‑art performance on multiple spatial transcriptomics benchmarks, delivering up to 56.8% improvement in 1,000‑gene prediction while drastically reducing computational cost.

By Songming Zhang, Yuxiao Luo, Shifu Luo, Siran Chen, Shuquan Su, Jinyan Li
arXiv Machine Learning
Sep 25

SpaFactor: Lightweight Spatial Context-Aware Gene Program Modeling for Histology-to-Transcriptomics Inference

SpaFactor is a lightweight framework that predicts spatial gene expression from hematoxylin and eosin images by fusing central spot visuals with multiscale neighborhood context. It uses a residual MLP to map tissue microenvironment to low‑dimensional latent gene programs, which are decoded into coordinated multi‑gene predictions. Across five public cohorts, SpaFactor outperforms existing methods, especially for spatially variable genes, and better recovers biologically organized spatial patterns.

By Shiting Ruan, Xitong Ling, Qiming He, Ziyou Yan, Huaitian Yuan, Tian Guan, Ying Xiao, Xu Guan, Yonghong He
arXiv AI
Jun 30

Data-Efficient Multimodal Alignment for Histopathology-based Molecular Prediction

arXiv:2606. 29949v1 Announce Type: cross Abstract: H&E-stained whole-slide images offer cohort-scale availability and rich spatial context but lack molecular specificity, whereas bulk RNA-seq provides transcriptome-wide resolution at high cost with limited archival availability.

By Dominik Winter, Dominik Vonficht, Lo\"ic Le Bescond, Christian Gebbe, Marco Rosati, Richard J. Chen, Markus Schick, Ross Stewart, Nicolas Brieu
arXiv AI
Oct 1

CellMSA: Context Modeling for Single-Cell Representation Learning

CellMSA introduces a novel single‑cell representation learning framework that leverages a multiple‑sequence‑alignment‑inspired context model. For each target cell, it retrieves relevant cells across batches and related cell types, summarizing cross‑cell patterns into a context‑dependent gene‑pair representation that is fed into a pair‑aware encoder. Pretraining on a massive human single‑cell corpus (≈109 million cells) and subsequent benchmarks demonstrate consistent performance gains over existing methods.

By Suyuan Zhao, Minghao Liu, Yizhen Luo, Zaiqing Nie
arXiv Machine Learning
Jun 3

Spatial Transcriptomics-Guided Alignment Enhances Molecular Profiling in Pathology Foundation Model

arXiv:2606. 03644v1 Announce Type: new Abstract: Comprehensive molecular profiling is essential for modern precision oncology but remains hindered by prohibitive costs, specimen exhaustion, and protracted turnaround times.

By Fengtao Zhou, Yingxue Xu, Zhengyu Zhang, Yihui Wang, Zhengrui Guo, Ling Liang, Jiabo Ma, Cheng Jin, Ziyi Liu, Huajun Zhou, Hongyi Wang, Du Cai, Chenglong Zhao, Xi Wang, Can Yang, Yu Wang, Wenbin Li, Feng Gao, Zhe Wang, Zhenhui Li, Xiuming Zhang, Li Liang, Hao Chen
arXiv Machine Learning
Jun 5

HEIST: A Graph Foundation Model for Spatial Transcriptomics and Proteomics Data

arXiv:2506. 11152v4 Announce Type: replace-cross Abstract: Single-cell transcriptomics and proteomics have become a great source for data-driven insights into biology, enabling the use of advanced deep learning methods to understand cellular heterogeneity and gene expression at the single-cell level.

By Hiren Madhu, Jo\~ao Felipe Rocha, Tinglin Huang, Siddharth Viswanath, Smita Krishnaswamy, Rex Ying