arXiv AI

Understanding Gene Expression-to-Image Learning: Spatial Structure and Information Fidelity

Hugging Face Trending Papers
Oct 13

Understanding Gene Expression-to-Image Learning: Spatial Structure and Information Fidelity

The paper investigates how arranging single‑cell RNA sequencing data into images (Gene Expression‑to‑Image, GE2I) affects learning with convolutional neural networks. By keeping the network and training procedure constant, the authors uncover a trade‑off between spatial smoothness and gene‑level fidelity: structured mappings yield smooth, low‑frequency patterns that accelerate early optimization, while assigning multiple genes to the same pixel can obscure expression differences and hurt predictive performance. They show that one‑to‑one gene‑to‑pixel assignments improve predictions across various visual backbones, and that the benefits of pretraining and augmentation depend on both the backbone and the mapping strategy, offering practical guidance for pixel allocation and transfer learning in gene expression analysis.

arXiv AI
Oct 1

GATE-ST: Gene-Aware Text-image Encoder for Spatial Transcriptomics

GATE-ST is a gene-aware text-image encoder that enhances spatial transcriptomics predictions by integrating gene descriptions into image-based models. The method encodes gene summaries with a text encoder and fuses these embeddings with image features via cross‑attention, aligning them with morphological cues. Benchmarks show GATE‑ST outperforms random gene embeddings and other image‑text fusion architectures, indicating its potential to improve accuracy while reducing time and cost in spatial gene expression analysis.

By Lucas Ni, Jian Luo, Wentao Huang, Chao Chen
arXiv Machine Learning
Oct 28

Biology-Guided Context-Aware Residual Propagation for Spatial Gene Expression Prediction from Histology

The paper introduces BCARP, a Biology‑Guided Context‑Aware Residual Propagation framework that predicts spatial gene expression from H&E‑stained histology images. Rather than directly decoding expression from visual features, BCARP treats histology embeddings as morphological priors and iteratively refines spot representations in a transcriptomics‑oriented latent space, integrating nuclei‑guided local context and prototype‑guided global propagation. Evaluations on three spatial transcriptomics datasets and ten HEST‑1k cohorts show that BCARP outperforms existing baselines in mean correlation‑based metrics, demonstrating the effectiveness of biology‑guided local‑global residual propagation for histology‑to‑transcriptomics prediction.

By Vu Van An, Long D. Nguyen, Ho Viet Duc Luong, Binh P. Nguyen
arXiv Machine Learning
Sep 22

Correlation-Guided Flow Matching with Annealed Masking for Spatial Transcriptomics Generation

CorrFlow is a new generative framework for predicting spatial transcriptomics from histology images. It explicitly models gene-gene interactions using an annealed masked flow matching strategy and a gene graph‑regularized optimization that incorporates prior knowledge from STRING and data‑driven co‑expression from WGCNA. Across 12 datasets, CorrFlow outperforms existing methods in average PCC and HPCC, producing more biologically coherent ST predictions.

By Yupei Zhang, Hao Chen, Li Pan, Chao Li, Xiaohan Xing