arXiv:2610.28266v1 Announce Type: cross
Abstract: VGL-stGen is a multimodal large language model adapted from a pretrained medical vision-language model using paired lung H&E and spatial transcriptom...
By Haenara Shin, Dongjoo Lee, Sungwoo Bae, Kwon Joong Na, Daeseung Lee, Hongyoon Choi
arXiv:2608. 14710v1 Announce Type: cross Abstract: Predicting spatial gene expression from hematoxylin and eosin (H\&E)-stained images offers a cost-effective alternative to spatial transcriptomics (ST).
By Ruochen Liu, Wei Lou
arXiv:2610.26988v1 Announce Type: new
Abstract: Histopathology is central to cancer diagnosis, but morphology in Hematoxylin and Eosin (HE)-stained images does not directly reveal the molecular state...
By Lanfeng Zhong, Xiangyu Sun, Guixuan Xu, Rongzhao Zhang, Jie Xu, Shaoting Zhang, Guotai Wang
Recent advances in pathology foundation models have enabled accurate prediction of spatial transcriptomics (ST) from routine H&E images. However, existing explainability methods for vision transformer...
arXiv:2609.36429v1 Announce Type: new
Abstract: Predicting gene expression from H&E-stained histology images offers a scalable alternative to costly spatial transcriptomics, yet most existing methods...
By Zijun Gao, Chunbin Gu, Jinxi Xiang, Xiangde Luo, Pheng-Ann Heng
arXiv:2608. 14355v1 Announce Type: new Abstract: Spatial transcriptomics (ST) enables the simultaneous profiling of gene expression and tissue morphology, creating an opportunity to learn multimodal representations capturing shared morpho-transcriptomic structure.
By Julian Ostermaier, Swann Ruyter, Reuben Dorent, Daniel Racoceanu
The paper introduces BCARP, a Biology‑Guided Context‑Aware Residual Propagation framework that predicts spatial gene expression from H&E‑stained histology images. Rather than directly decoding expression from visual features, BCARP treats histology embeddings as morphological priors and iteratively refines spot representations in a transcriptomics‑oriented latent space, integrating nuclei‑guided local context and prototype‑guided global propagation. Evaluations on three spatial transcriptomics datasets and ten HEST‑1k cohorts show that BCARP outperforms existing baselines in mean correlation‑based metrics, demonstrating the effectiveness of biology‑guided local‑global residual propagation for histology‑to‑transcriptomics prediction.
By Vu Van An, Long D. Nguyen, Ho Viet Duc Luong, Binh P. Nguyen
arXiv:2507. 04704v3 Announce Type: replace-cross Abstract: Understanding how cellular morphology, gene expression, and spatial context jointly shape tissue function is a central challenge in biology.
By Zhenglun Kong, Mufan Qiu, John Boesen, Xiang Lin, Sukwon Yun, Tianlong Chen, Manolis Kellis, Marinka Zitnik
Histopathology is central to cancer diagnosis, but morphology in Hematoxylin and Eosin (HE)-stained images does not directly reveal the molecular states that characterize disease heterogeneity and inf...
MIST is a multimodal survival prediction framework that fuses whole-slide images and genomic profiles by representing genomic features as tokens that query histology context tokens derived from a foundation model. The architecture enriches molecular information with histology context before survival prediction, avoiding late-stage merging of separately encoded modalities. Training incorporates discrete-time survival prediction, genomic feature masking, WSI dropout, and contrastive alignment, and demonstrates improved external C-index across colon, renal, lung, and glioblastoma cohorts compared to standard fusion baselines.
By Muhammet Sami Yavuz, Sabri Mustafa Kahya, Richard R. Chen, Jana Lipkova, Benedikt Wiestler
arXiv:2608. 14924v1 Announce Type: cross Abstract: Spatial transcriptomics (ST) links tissue morphology with molecular programs, motivating multimodal pretraining methods that align histology images with gene expression.
By Azim Dehghani Amirabad, Junchao Zhu, Pushpak Pati, Walid Abdelmoula, Tommaso Mansi, Rui Liao
Predicting spatial gene expression from H&E images offers a scalable complement to experimental spatial transcriptomics. However, despite progress in spatial context modeling, how to construct subsequ...