arXiv AI
MUSS: A Multi-scale and Sequence-based Model for Single-cell Gene Regulation
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Machine Learning
Jun 9
Integrating gene regulatory priors into Transformer attention with scTransformer for interpretable scRNA-seq analysis
arXiv:2606. 09558v1 Announce Type: cross Abstract: Motivation: Transformer-based models are increasingly applied to large-scale single-cell transcriptomics, showing strong performance through self-supervised learning on millions of cells.
arXiv Machine Learning
Jun 2
Prior-Guided Multi-Omic Transformers for Single-Cell Gene Regulatory Network Inference
arXiv:2606. 00685v1 Announce Type: new Abstract: Gene regulatory networks (GRNs) capture transcription factor-target interactions and are central to understanding cell-state regulation and disease.
arXiv Machine Learning
Oct 2
Prototype Guided Post-pretraining for Single-Cell Representation Learning
arXiv:2605.07938v2 Announce Type: replace Abstract: Single-cell representation learning (SCRL) from gene expression data offers a way to uncover the complex regulatory logic underlying cellular funct...
arXiv AI
Oct 1
CellMSA: Context Modeling for Single-Cell Representation Learning
CellMSA introduces a novel single‑cell representation learning framework that leverages a multiple‑sequence‑alignment‑inspired context model. For each target cell, it retrieves relevant cells across batches and related cell types, summarizing cross‑cell patterns into a context‑dependent gene‑pair representation that is fed into a pair‑aware encoder. Pretraining on a massive human single‑cell corpus (≈109 million cells) and subsequent benchmarks demonstrate consistent performance gains over existing methods.
arXiv AI
Sep 15
Towards a knowledge-enhanced single-cell foundation model
The paper introduces scKITE, a single-cell foundation model that incorporates biological knowledge—cell-level text annotations and gene-level regulatory information—into a shared Transformer encoder via lightweight auxiliary decoders used only during pretraining. This approach provides a new scaling dimension beyond merely increasing data size, enabling the model to achieve superior performance on diverse downstream tasks with only 179,067 pretraining samples, less than 0.5% of the data used by previous strong scFMs. The study demonstrates that knowledge-enhanced pretraining can yield significant gains while reducing computational cost.
arXiv Machine Learning
Aug 4
Beyond Gene Reconstruction: Learning Cell Representations through Complementary Transcriptomic Views
arXiv:2608. 00985v1 Announce Type: new Abstract: The rapid growth of single-cell transcriptomic data has enabled the development of foundation models pretrained primarily by reconstructing masked expression values.