arXiv Computer Vision

Hyperbolic Contrastive Learning with Entailment for Spatial Transcriptomics

arXiv Machine Learning
Sep 25

SpaFactor: Lightweight Spatial Context-Aware Gene Program Modeling for Histology-to-Transcriptomics Inference

SpaFactor is a lightweight framework that predicts spatial gene expression from hematoxylin and eosin images by fusing central spot visuals with multiscale neighborhood context. It uses a residual MLP to map tissue microenvironment to low‑dimensional latent gene programs, which are decoded into coordinated multi‑gene predictions. Across five public cohorts, SpaFactor outperforms existing methods, especially for spatially variable genes, and better recovers biologically organized spatial patterns.

By Shiting Ruan, Xitong Ling, Qiming He, Ziyou Yan, Huaitian Yuan, Tian Guan, Ying Xiao, Xu Guan, Yonghong He
arXiv Machine Learning
Oct 28

Biology-Guided Context-Aware Residual Propagation for Spatial Gene Expression Prediction from Histology

The paper introduces BCARP, a Biology‑Guided Context‑Aware Residual Propagation framework that predicts spatial gene expression from H&E‑stained histology images. Rather than directly decoding expression from visual features, BCARP treats histology embeddings as morphological priors and iteratively refines spot representations in a transcriptomics‑oriented latent space, integrating nuclei‑guided local context and prototype‑guided global propagation. Evaluations on three spatial transcriptomics datasets and ten HEST‑1k cohorts show that BCARP outperforms existing baselines in mean correlation‑based metrics, demonstrating the effectiveness of biology‑guided local‑global residual propagation for histology‑to‑transcriptomics prediction.

By Vu Van An, Long D. Nguyen, Ho Viet Duc Luong, Binh P. Nguyen
arXiv AI
Oct 1

GATE-ST: Gene-Aware Text-image Encoder for Spatial Transcriptomics

GATE-ST is a gene-aware text-image encoder that enhances spatial transcriptomics predictions by integrating gene descriptions into image-based models. The method encodes gene summaries with a text encoder and fuses these embeddings with image features via cross‑attention, aligning them with morphological cues. Benchmarks show GATE‑ST outperforms random gene embeddings and other image‑text fusion architectures, indicating its potential to improve accuracy while reducing time and cost in spatial gene expression analysis.

By Lucas Ni, Jian Luo, Wentao Huang, Chao Chen
arXiv AI
1d ago

More Genes, Faster Inference: Efficient Large-Panel Spatial Transcriptomics Prediction from Histology

GeneFlow is a new framework that predicts large-panel spatial gene expression directly from histology images. It combines flow‑matching generative modeling with structured multimodal fusion, encoding both tissue morphology and cross‑gene interactions via histology and gene tokenizers. The method achieves state‑of‑the‑art performance on multiple spatial transcriptomics benchmarks, delivering up to 56.8% improvement in 1,000‑gene prediction while drastically reducing computational cost.

By Songming Zhang, Yuxiao Luo, Shifu Luo, Siran Chen, Shuquan Su, Jinyan Li
arXiv Machine Learning
Jun 3

Spatial Transcriptomics-Guided Alignment Enhances Molecular Profiling in Pathology Foundation Model

arXiv:2606. 03644v1 Announce Type: new Abstract: Comprehensive molecular profiling is essential for modern precision oncology but remains hindered by prohibitive costs, specimen exhaustion, and protracted turnaround times.

By Fengtao Zhou, Yingxue Xu, Zhengyu Zhang, Yihui Wang, Zhengrui Guo, Ling Liang, Jiabo Ma, Cheng Jin, Ziyi Liu, Huajun Zhou, Hongyi Wang, Du Cai, Chenglong Zhao, Xi Wang, Can Yang, Yu Wang, Wenbin Li, Feng Gao, Zhe Wang, Zhenhui Li, Xiuming Zhang, Li Liang, Hao Chen