MIST is a Multi‑context Spatial Transformer that predicts spatial gene expression from H&E images by adding two context pathways to a standard Transformer: a coordinate‑invariant local pathway that attends to spatial k‑nearest‑neighbor spots, and a slide pathway that broadcasts a whole‑slide summary to every spot. In intra‑cohort evaluation across six human organ cohorts, MIST improves mean Pearson correlation by 9.7%–11.6% over the strongest baseline for 10‑, 50‑, and 100‑gene panels, and achieves lower MSE and MAE. It also outperforms baselines in leave‑one‑organ‑out transfer, domain recovery, and reproduces spatial expression patterns of cancer‑marker genes.
arXiv:2609.36429v1 Announce Type: new Abstract: Predicting gene expression from H&E-stained histology images offers a scalable alternative to costly spatial transcriptomics, yet most existing methods...
arXiv:2608. 14924v1 Announce Type: cross Abstract: Spatial transcriptomics (ST) links tissue morphology with molecular programs, motivating multimodal pretraining methods that align histology images with gene expression.
Recent advances in pathology foundation models have enabled accurate prediction of spatial transcriptomics (ST) from routine H&E images. However, existing explainability methods for vision transformer...
arXiv:2606. 03644v1 Announce Type: new Abstract: Comprehensive molecular profiling is essential for modern precision oncology but remains hindered by prohibitive costs, specimen exhaustion, and protracted turnaround times.
arXiv:2607. 09166v1 Announce Type: new Abstract: Spatial transcriptomics enables profiling of spatial gene expression but is limited by high cost and low throughput, motivating prediction from H&E histopathology images.
SpaFactor is a lightweight framework that predicts spatial gene expression from hematoxylin and eosin images by fusing central spot visuals with multiscale neighborhood context. It uses a residual MLP to map tissue microenvironment to low‑dimensional latent gene programs, which are decoded into coordinated multi‑gene predictions. Across five public cohorts, SpaFactor outperforms existing methods, especially for spatially variable genes, and better recovers biologically organized spatial patterns.
arXiv:2606.28676v2 Announce Type: replace-cross Abstract: Predicting distant metastasis from the digital H & E slides of the primary tumor is a critical yet challenging task in computational patholog...
arXiv:2608.08374v3 Announce Type: replace Abstract: Transformer models are increasingly used for whole-slide image analysis in computational pathology. Yet, WSIs differ fundamentally from natural ima...
arXiv:2506. 11152v4 Announce Type: replace-cross Abstract: Single-cell transcriptomics and proteomics have become a great source for data-driven insights into biology, enabling the use of advanced deep learning methods to understand cellular heterogeneity and gene expression at the single-cell level.
arXiv:2606. 29949v1 Announce Type: cross Abstract: H&E-stained whole-slide images offer cohort-scale availability and rich spatial context but lack molecular specificity, whereas bulk RNA-seq provides transcriptome-wide resolution at high cost with limited archival availability.
arXiv:2606. 02424v1 Announce Type: cross Abstract: Histology-based single-cell spatial transcriptomics (ST) estimation aims to predict gene expression for individual cells from histopathological images and cell locations, reducing the need for costly single-cell ST measurements.
MIST is a multimodal survival prediction framework that fuses whole-slide images and genomic profiles by representing genomic features as tokens that query histology context tokens derived from a foundation model. The architecture enriches molecular information with histology context before survival prediction, avoiding late-stage merging of separately encoded modalities. Training incorporates discrete-time survival prediction, genomic feature masking, WSI dropout, and contrastive alignment, and demonstrates improved external C-index across colon, renal, lung, and glioblastoma cohorts compared to standard fusion baselines.