Retrieval-augmented generation

Retrieval pipelines, vector search, chunking and reranking: how models are grounded in a corpus instead of their weights.

6,375 stories · RSS feed

arXiv AI
Sep 10

Memory in Deep Time-Series Models

arXiv:2609.06006v1 Announce Type: cross Abstract: Deep learning for time series has progressed through successive architectural paradigms, from recurrent networks and transformers to structured state...

By Minh Hoang Nguyen, Huu Hiep Nguyen, Manh Nguyen, Van Dai Do, Dung Nguyen, Hung Le
arXiv Computation and Language
Sep 10

From Retrieval to Weights: Parametric Individualization of Small Language Models with Individual Text Corpora

The paper explores how individual text corpora (ITCs) can be integrated into small language models (SLMs) using DoRA fine‑tuning. By training a DoRA adapter for each of 150 participants, the authors show that the adapter can encode a participant’s own ITC into the model’s weights, improving fit to that participant’s held‑out text. However, while the adapter improves log‑loss on a generalized knowledge test, it does not enhance accuracy under a bias‑corrected PMI readout, and adding retrieval does not provide further benefit.

By Christoph Wigbels, Ali Abusaleh, Markus T. Jansen, Alexander Mehler, Markus J. Hofmann