arXiv AI By Hiren Madhu, Ngoc Bui, Ali Maatouk, Leandros Tassiulas, Smita Krishnaswamy, Menglin Yang, Sukanta Ganguly, Kiran Srinivasan, Rex Ying

HypRAG: Hyperbolic Dense Retrieval for Retrieval Augmented Generation

Read the original on arXiv AI →

arXiv:2602. 07739v2 Announce Type: replace-cross Abstract: Embedding geometry plays a fundamental role in retrieval quality, yet dense retrievers for retrieval-augmented generation (RAG) remain largely confined to Euclidean space.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
Sep 16

HyCoSeq: Contextual Hyperbolic Representation Learning for Genomic Sequences

HyCoSeq is a new framework for learning genomic representations in hyperbolic space. It combines weighted Lorentzian residual aggregation with multi‑curvature Lorentz encoding, enabling full Lorentz representations to contribute directly to local aggregation. A bidirectional LSTM further captures contextual relationships across the sequence, extending local hyperbolic convolutions to sequence‑level representations. Experiments show HyCoSeq surpasses existing hyperbolic baselines and competes with much larger pretrained DNA language models without large‑scale pretraining.

By Chenhao Zeng, Zhibin Pu, Shufei Ge
arXiv AI
Sep 25

Hyperbolic Multimodal Continual Learning: A Closest-Admissible Solution

The paper introduces Hyperbolic Multimodal Continual Learning (HMCL), a method that preserves the Lorentz geometry of hyperbolic multimodal models during sequential updates. By restricting all modalities to a shared hyperbolic isometry, HMCL formulates a joint closest‑admissible (CA) correction—along with a minimal‑rotation (MR) variant—to adjust AdamW updates while maintaining task performance. Experiments on a 16‑task classification‑retrieval stream with three hyperbolic backbones show that HMCL-CA achieves the highest overall score, reduces geometric drift by up to 95.5 %, and improves semantic hierarchy preservation on ImageNet‑WordNet. whyItMatters":"The study demonstrates that explicitly maintaining hyperbolic geometry during continual learning yields superior performance and reduced representation drift compared to existing baselines."

By Jiahong Liu, Ming Shen, Xiaohao Liu, Rex Ying, Menglin Yang, Tat-Seng Chua, Irwin King