arXiv Machine Learning

Scaling RNA Foundation Models through Iterative Refinement

Eco‑RNA is an 80‑million‑parameter RNA foundation model that introduces adjustable inference depth via learned iterative refinement. The shared, input‑conditioned Transformer core repeatedly refines sequence representations, with the number of iterations chosen after training to control effective depth. On the RNAGym fitness benchmark, increasing iterations from one to four improves Spearman correlation from 0.242 to 0.286, and at four iterations Eco‑RNA outperforms the 40‑billion‑parameter Evo 2 model across all aggregate fitness metrics, while also excelling in non‑coding RNA classification, secondary‑structure prediction, and chemical probing profile prediction.

arXiv Machine Learning
Oct 5

RNADyn: A Benchmark for Generating and Understanding RNA Dynamics

RNADynBench is a new standardized benchmark for RNA molecular dynamics, comprising 2,585 high‑quality 100‑nanosecond all‑atom trajectories with carefully controlled data splits. RNADynNet is a unified model that simultaneously generates RNA trajectories and extracts dynamics fingerprints from a single conformer, leveraging coordinate denoising, alignment, and physical grounding. The model achieves strong agreement with MD data, achieving RMSF correlations of 0.875 and 0.766 on test sets, including a high‑flexibility challenge set.

By Yiming Huang, Lennart Bastian, Hanqun Cao, Luis Vollmers, Tolga Birdal
arXiv Machine Learning
Oct 12

MORAD: Reinforcement Learning with Multi-Objective Rewards for RNA Inverse Design

MORAD is an online reinforcement learning framework that trains a single shared policy for backbone‑conditioned RNA diffusion models, enabling structure‑conditioned RNA inverse design across diverse target backbones. It integrates backbone‑conditioned group sampling, group‑relative reward normalization, and a forward‑process diffusion objective, jointly optimizing six measurements—including tertiary geometry, base pairing, ensemble behavior, and sequence composition—by mapping each to a bounded desirability score and combining them with a weighted geometric mean. Compared to a tertiary‑structure‑only reward, MORAD improves 10 of 11 evaluation metrics, achieving significant gains in GDT‑TS, pairing MCC, and normalized ensemble defect, and surpasses existing methods such as RiboDiffusion, gRNAde, and RDesign on tertiary structural accuracy, secondary‑structure pairing, and thermodynamic quality.

By Jixin Tang, Ji Guo, Jun Zhao
arXiv AI
Oct 9

La-Ribo: RNA Co-Design via Geometry-Latent Flow Matching

La‑Ribo is a generative framework that jointly designs RNA nucleotide sequences and their three‑dimensional structures using geometry‑latent flow matching. It preserves a sparse phosphate‑sugar‑base scaffold while encoding nucleotide identity and local conformation in residue‑wise latent variables, which a shared flow network generates before an RNA‑specific decoder reconstructs all heavy atoms. The authors also built a large, quality‑controlled corpus of 168,561 RNA structures—combining experimental data with predictions from three folding models—to expand supervision, and demonstrate that La‑Ribo outperforms baselines in designability and co‑designability across sampling budgets and refolding models, while also enabling scaffold‑conditioned inverse folding without extra training.

By Runze Ma, Will Hua, Shuangjia Zheng
arXiv Machine Learning
Aug 27

Gated Recurrent Transformers: Expressive Depth through Recurrent Modulation

The paper introduces Gated Recurrent Transformers, a depth‑sharing architecture that brackets a single shared core with fixed prelude and coda blocks and uses a lightweight projection and element‑wise update gate to modulate recurrent updates. This design allows functional specialization across recurrences while reducing memory footprint. Experiments show that, under equal FLOPs or parameter budgets, the recurrent model matches or surpasses deeper GPT‑2 Small baselines, achieving similar or better accuracy with fewer parameters and lower peak decoding memory.

By Amr Hegazy, Amr Alanwar, Mostafa Elhoushi