arXiv:2605.07938v2 Announce Type: replace
Abstract: Single-cell representation learning (SCRL) from gene expression data offers a way to uncover the complex regulatory logic underlying cellular funct...
By Sachini Weerasekara, Natasha Darras, Sagar Kamarthi, Colles Price, Jacqueline Isaacs
arXiv:2606. 09558v1 Announce Type: cross Abstract: Motivation: Transformer-based models are increasingly applied to large-scale single-cell transcriptomics, showing strong performance through self-supervised learning on millions of cells.
By Mikele Milia, Louis Fabrice Tshimanga, Henning Mueller, Manfredo Atzori, Barbara Di Camillo
CellMSA introduces a novel single‑cell representation learning framework that leverages a multiple‑sequence‑alignment‑inspired context model. For each target cell, it retrieves relevant cells across batches and related cell types, summarizing cross‑cell patterns into a context‑dependent gene‑pair representation that is fed into a pair‑aware encoder. Pretraining on a massive human single‑cell corpus (≈109 million cells) and subsequent benchmarks demonstrate consistent performance gains over existing methods.
By Suyuan Zhao, Minghao Liu, Yizhen Luo, Zaiqing Nie
arXiv:2606. 00685v1 Announce Type: new Abstract: Gene regulatory networks (GRNs) capture transcription factor-target interactions and are central to understanding cell-state regulation and disease.
By Tianyang Xu, Tianci Liu, Niraj Rayamajhi, Ryan Patrick, Kranthi Varala, Ying Li, Jing Gao
MUSS is a sequence‑based multi‑scale model that jointly represents DNA sequence, chromatin accessibility, and gene expression for single‑cell gene regulation. It uses a frozen pre‑trained sequence encoder to generate peak‑ and gene‑level representations, which are integrated via peak‑peak self‑attention and distance‑biased peak‑gene interactions, and trained with peak‑masked language modeling on paired scATAC‑seq and scRNA‑seq data. MUSS outperforms existing sequence‑based and single‑cell omics baselines on tasks such as gene expression prediction, enhancer‑gene linking, motif‑guided regulatory prioritization, and zero‑shot cell clustering, and can predict expression for unseen genes and peaks.
By Kangjie Zheng, Amirhossein Vahidi, Liying Jin, Joseph Clarke, Vijaya Baskar MS, Connor Rogerson, Mengji Zhang, Muzlifah Haniffa, Anshul Kundaje, Mo Lotfollahi
arXiv:2608. 00985v1 Announce Type: new Abstract: The rapid growth of single-cell transcriptomic data has enabled the development of foundation models pretrained primarily by reconstructing masked expression values.
By Jiaqi Xiong, Yuntao hu, Yu Zheng, Yifei Shi, Xinyue Guo, Jiaxin Qi
arXiv:2607. 08803v1 Announce Type: cross Abstract: The push toward large language models for biology (BioLM) has created a need for training corpora that can endow models with a genuine understanding of biology.
By Hyunjin Seo, Hyeon Hwang, Gyubok Lee, Jay Shin, Jimin Park, Taesoo Kim, Sanghoon Lee, Hongjoon Ahn, Sungjun Han, Sangwon Jung
The paper introduces TxFM, a self‑supervised masked autoencoder designed for RNA‑seq gene expression data. By carefully selecting architecture components and curating a public training corpus (DiverseRNA‑1.4M), TxFM achieves high‑fidelity gene representations that outperform larger foundation models trained on atlas‑scale datasets. The study demonstrates that inductive self‑supervised learning can be effective for transcriptomics when model design and data curation are optimized.
By Kian Kenyon-Dean, Alina Selega, Ihab Bendidi, Jordan M. Sorokin, Luca Bertinetto, David Errington, Hayley Donnella, Oren Kraus
arXiv:2610.08694v1 Announce Type: new
Abstract: Gene expression is widely measured in biomedicine, yet clinical outcome prediction remains challenging due to high dimensionality, strong feature corre...
By Michael Bohl, Alexander Theus, David Wissel, Valentina Boeva
arXiv:2609.36429v1 Announce Type: new
Abstract: Predicting gene expression from H&E-stained histology images offers a scalable alternative to costly spatial transcriptomics, yet most existing methods...
By Zijun Gao, Chunbin Gu, Jinxi Xiang, Xiangde Luo, Pheng-Ann Heng
arXiv:2608. 02961v1 Announce Type: cross Abstract: We study a self-supervised generation task for single-cell gene expression vectors: given a set of vectors from a cell type, we aim to generate additional gene expression vectors of that cell type.
By Aleksandr Sharipov, Yusif Mukhtarov, Igor Molybog
arXiv:2606. 07676v1 Announce Type: cross Abstract: Spatial transcriptomics (ST) is a powerful tool for exploring biological properties dependent on structure, proximity, and interaction in tissue.
By Joseph Boyd, Matthew Lyon, Martino Mansoldo, Christian Hurry, Finnian Firth