arXiv Machine Learning

RIBOSPAN: A Long-Context RNA Foundation Model for Versatile RNA Modeling

arXiv Machine Learning

1d ago

RiboUnmix: Learning Shared Translational Dynamics from Biased and Noisy Ribo-seq Measurements

arXiv:2609.39644v2 Announce Type: new Abstract: Ribosome profiling (Ribo-seq) measures ribosome distributions along mRNAs, but observed occupancy profiles also contain experiment-specific distortions...

By Gabriele Martino, Denis Skibinski, Ivo L. Hofacker, Sebastian Tschiatschek

benchmarks

arXiv Machine Learning

Aug 6

RiboSphere: Learning Unified and Efficient Representations of RNA Structures

arXiv:2603. 19636v2 Announce Type: replace Abstract: Accurate RNA structure modeling remains difficult because RNA backbones are highly flexible, non-canonical interactions are prevalent, and experimentally determined 3D structures are comparatively scarce.

By Zhou Zhang, Hanqun Cao, Cheng Tan, Fang Wu, Pheng Ann Heng, Tianfan Fu

llms diffusion efficiency benchmarks

arXiv AI

Sep 1

mRNA Design and Optimization with Deep Knowledge-Infused Approach

arXiv:2505.23862v2 Announce Type: replace-cross Abstract: The mRNA optimization is essential for mRNA vaccines, therapies, and industrial protein production. Based on current explorations, an ideal o...

By Zheng Gong, Ziyi Jiang, Weihao Gao, Yuanyuan Wang, Zhining Cai, Deng Zhuo, Lan Ma

llms efficiency benchmarks safety

arXiv AI

2d ago

CellMSA: Context Modeling for Single-Cell Representation Learning

CellMSA introduces a novel single‑cell representation learning framework that leverages a multiple‑sequence‑alignment‑inspired context model. For each target cell, it retrieves relevant cells across batches and related cell types, summarizing cross‑cell patterns into a context‑dependent gene‑pair representation that is fed into a pair‑aware encoder. Pretraining on a massive human single‑cell corpus (≈109 million cells) and subsequent benchmarks demonstrate consistent performance gains over existing methods.

By Suyuan Zhao, Minghao Liu, Yizhen Luo, Zaiqing Nie

efficiency benchmarks safety

arXiv Machine Learning

Jun 26

Training-Free Generation of Protein Sequences from Small Family Alignments via Stochastic Attention

arXiv:2603. 14717v2 Announce Type: replace Abstract: Generating novel protein sequences that respect a family's statistical constraints typically requires training deep generative models on thousands to millions of examples.

By Jeffrey D. Varner

llms safety

arXiv Machine Learning

3d ago

RNA Design via Conditioned Flow Matching and Finite-Policy Reinforcement Learning

arXiv:2609.36885v1 Announce Type: cross Abstract: RNA design aims to identify sequences that fold into specified secondary structures. Existing methods formulate the task as target-specific search or...

By Zefeng Lin, Xianyong Fang, Tianfan Fu, Xiaohua Xu

diffusion reinforcement-learning benchmarks

arXiv Machine Learning

Jun 4

Towards A Generative Protein Evolution Machine with DPLM-Evo

arXiv:2605. 00182v3 Announce Type: replace Abstract: Proteins are shaped by gradual evolution under biophysical and functional constraints.

By Xinyou Wang, Liang Hong, Jiasheng Ye, Zaixiang Zheng, Yu Li, Shujian Huang, Quanquan Gu

llms diffusion benchmarks safety

arXiv Machine Learning

Jun 18

Contextualizing Biological Language Models across Modalities via Logit-Space Contrastive Alignment

arXiv:2606. 18703v1 Announce Type: new Abstract: Pretrained biological language models expose per-token probability distributions through masked-token prediction, providing the likelihood interface central to sequence design, variant scoring, and mechanistic interpretation.

By Yanjun Shao, Yundi Chen, Yashvi Patel, Aurelien Pelissier, Mar\'ia Rodr\'iguez Mart\'inez

llms rag nlp multimodal benchmarks safety

arXiv AI

Jun 12

scLLM-DSC: LLM-Knowledge Enhanced Cross-Modal Deep Structural Clustering for Single-Cell RNA Sequencing

arXiv:2606. 13007v1 Announce Type: cross Abstract: Clustering is fundamental to scRNA-seq analysis, serving as a cornerstone for identifying cell populations and resolving tissue heterogeneity.

By Ping Xu, Pengjiang Li, Tian Du, Zaitian Wang, Jiawei Gu, Ziyue Qiao, Pengfei Wang, Yuanchun Zhou

llms rag diffusion multimodal benchmarks safety

arXiv AI

Jun 12

HD-Prot: A Protein Language Model for Joint Sequence-Structure Modeling with Continuous Structure Tokens

arXiv:2512. 15133v3 Announce Type: replace-cross Abstract: Proteins inherently possess a consistent sequence-structure duality.

By Yi Zhou, Haohao Qu, Yunqing Liu, Shanru Lin, Le Song, Wenqi Fan

llms diffusion fine-tuning efficiency multimodal benchmarks

arXiv AI

Sep 3

Subcellularly Resolved Single-Cell Embedding Learning with Transcriptomic data, Protein Structure and Localization Information

The paper introduces a multimodal framework that learns subcellularly resolved cell embeddings by integrating RNA expression profiles, protein sequence representations, and protein structural information using a cross‑attention architecture. This approach models interactions within distinct subcellular compartments, producing fine‑grained embeddings that capture both molecular expression patterns and functional protein properties. It is presented as the first method to jointly incorporate transcriptomic data, sequence, and structural knowledge for subcellularly resolved cell representation.

By Zhen Zhou, Jiachen Li, Yuan Liu, Xiaoyong Pan, Hong-Bin Shen

rag multimodal

arXiv AI

Jun 9

Single-Cell Cross-Modal Transfer by Adversarial Fine-Tuning of Foundation Models

arXiv:2606. 07676v1 Announce Type: cross Abstract: Spatial transcriptomics (ST) is a powerful tool for exploring biological properties dependent on structure, proximity, and interaction in tissue.

By Joseph Boyd, Matthew Lyon, Martino Mansoldo, Christian Hurry, Finnian Firth

fine-tuning multimodal safety

Related stories