arXiv Machine Learning By Chenhao Zeng, Zhibin Pu, Shufei Ge

HyCoSeq: Contextual Hyperbolic Representation Learning for Genomic Sequences

Read the original on arXiv Machine Learning →

HyCoSeq is a new framework for learning genomic representations in hyperbolic space. It combines weighted Lorentzian residual aggregation with multi‑curvature Lorentz encoding, enabling full Lorentz representations to contribute directly to local aggregation. A bidirectional LSTM further captures contextual relationships across the sequence, extending local hyperbolic convolutions to sequence‑level representations. Experiments show HyCoSeq surpasses existing hyperbolic baselines and competes with much larger pretrained DNA language models without large‑scale pretraining.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Aug 12

JEPA-DNA: Grounding Genomic Foundation Models through Joint-Embedding Predictive Architectures

arXiv:2602. 17162v3 Announce Type: replace Abstract: Genomic Foundation Models (GFMs) typically rely on Masked Language Modeling (MLM) or Next-Token Prediction (NTP) to learn the "Laws of Nature".

By Ariel Larey, Elay Dahan, Amit Bleiweiss, Raizy Kellerman, Guy Leib, Omri Nayshool, Dan Ofer, Tal Zinger, Dan Dominissini, Gideon Rechavi, Nicole Bussola, Simon Lee, Shane O'Connell, Dung Hoang, Marissa Wirth, Alexander W. Charney, Nati Daniel, Yoli Shavit