Retrieval-augmented generation

Retrieval pipelines, vector search, chunking and reranking: how models are grounded in a corpus instead of their weights.

6,124 stories · RSS feed

arXiv Computation and Language
4d ago

FRAGMENT: Factorized Graph Representations for Document Generation and Editing via Entity-Aware Transformations

FRAGMENT is a two‑stage generative framework that models documents as typed relational graphs, factorizing the joint distribution into structure and content components. The first stage, the Architect, uses a causally masked Transformer to autoregressively generate graph topology and spatial relations, while the second stage, the Builder, employs a GATv2-based graph attention network to add bounding boxes, text, and visual style attributes. The framework provides explicit likelihood models for anomaly scoring and supports prompt‑conditioned, entity‑aware editing via cross‑attention.

By Ayoub El Bouchtili, Guilhaume Leroy-Meline
arXiv Machine Learning
4d ago

Rethinking Generalization in Knowledge Graph Embedding: An Empirical Study and Sparse Peak Regularization

arXiv:2505.23442v2 Announce Type: replace Abstract: Knowledge graphs (KGs) provide structured representations of entities and relations, and underpin data management and Web applications such as sear...

By Linyu Li, Zhi Jin, Yuanpeng He, Dongming Jin, Haoran Duan, Zhengwei Tao, Xuan Zhang, Jiandong Li, Huanyao Zhang, Gadeng Luosang, Nyima Tashi
arXiv Machine Learning
4d ago

STRABLE: Benchmarking Tabular Machine Learning with Strings

arXiv:2605.12292v2 Announce Type: replace Abstract: Benchmarking tabular learning has revealed the benefit of dedicated architectures, pushing the state of the art. But real-world tables often contai...

By Gioia Blayer, Myung Jun Kim, F\'elix Lefebvre, Lennart Purucker, Alan Arazi, Eilam Shapira, Roi Reichart, Frank Hutter, Marine Le Morvan, David Holzm\"uller, Ga\"el Varoquaux
arXiv Computation and Language
4d ago

FLINT: Fixed-budget Late Interaction

arXiv:2610.27273v1 Announce Type: cross Abstract: Multi-vector retrieval models such as ColBERT often outperform single-vector models of comparable scale by matching queries and documents at the toke...

By Himank Handa, Negar Arabzadeh, Matei Zaharia
arXiv Computer Vision
4d ago

Towards Consistent Geospatial Representations: Aligning One Encoder to Many Foundation Models

The paper introduces Pangaea-Latents, an extension of the Pangaea benchmark that provides frozen embeddings from five geospatial foundation models (GFMs) across eleven datasets, showing that these embeddings are neither redundant nor disjoint. It then proposes GeoMixture, a framework that aligns a Vision Transformer (ViT) to multiple GFMs per dataset using a multi-representation alignment (mREPA) objective, resulting in an encoder that achieves the best average rank across nine Pangaea datasets while maintaining cross-task consistency.

By Arthur Ouaknine, David Rolnick