Retrieval-augmented generation

Retrieval pipelines, vector search, chunking and reranking: how models are grounded in a corpus instead of their weights.

3,469 stories · RSS feed

arXiv Machine Learning

Jun 3

Explainable Forecasting of Scientific Breakthroughs from Concept Network Dynamics

arXiv:2606. 03864v1 Announce Type: cross Abstract: We introduce an explainable machine-learning approach that forecasts the structural precursors of scientific breakthroughs -- the emergence and intensification of links between research concepts -- by modelling how OpenAlex concept networks evolve over time.

By Thomas Maillart, Thibaut Chataing, Ntorina Antoni, David Dosu, Paul Bagourd, Julian Jang-Jaccard, Alain Mermoud

rag

arXiv AI

Jun 3

From Control Boundary to Insurance Claim: Reconstructing AI-Mediated Losses Through the CER Framework

arXiv:2606. 03777v1 Announce Type: new Abstract: AI losses that arise through an insured organization's generative or agentic AI system require state reconstruction, not merely event reconstruction, because the relevant state changes as the system reasons, retrieves, calls tools, and acts.

By Alex Leung, Rex Zhang, Kentaroh Toyoda, SiewMei Loh

rag agents

arXiv Machine Learning

Jun 3

The Efficiency vs. Accuracy Trade-off: Optimizing RAG-Enhanced LLM Recommender Systems Using Multi-Head Early Exit

arXiv:2501. 02173v2 Announce Type: replace-cross Abstract: The deployment of Large Language Models (LLMs) in recommender systems for predicting Click-Through Rates (CTR) necessitates a delicate balance between computational efficiency and predictive accuracy.

By Huixue Zhou, Hengrui Gu, Xi Liu, Kaixiong Zhou, Mingfu Liang, Yongkang Xiao, Srinivas Govindan, Piyush Chawla, Jiyan Yang, Xiangfei Meng, Huayu Li, Buyun Zhang, Liang Luo, Wen-Yen Chen, Yiping Han, Bo Long, Rui Zhang, Tianlong Chen

llms rag

arXiv Machine Learning

Jun 3

Visual Instruction Tuning Aligns Modalities through Abstraction

arXiv:2606. 03871v1 Announce Type: cross Abstract: Visual instruction tuning effectively adapts a pre-trained Large Language Model (LLM) to process image information alongside text.

By Luis Palacios, Lorenzo Basile, Diego Doimo, Alberto Cazzaniga

llms rag fine-tuning multimodal benchmarks safety

arXiv Machine Learning

Jun 3

The Impact of Temporal Granularity on Socio-Demographic Inference from Household Load Profiles

arXiv:2606. 03358v1 Announce Type: new Abstract: Smart meter data can reveal sensitive socio-demographic characteristics of households, raising privacy concerns.

By Dejan Radovanovic, Maximilian Schirl, Andreas Unterweger, G\"unther Eibl

rag safety

arXiv Machine Learning

Jun 3

Multi-Segment Attention: Enabling Efficient KV-Cache Management for Faster Large Language Model Serving

arXiv:2606. 02964v1 Announce Type: cross Abstract: Large Language Model (LLM) inference relies on key-value (KV) caches to avoid redundant attention computation.

By Chunan Shi, Yilei Chen, Yilin Chen, Xupeng Miao, Bin Cui

llms rag agents efficiency

arXiv AI

Jun 3

Cost-Aware Query Routing in RAG: Empirical Analysis of Retrieval Depth Tradeoffs

arXiv:2606. 02581v1 Announce Type: cross Abstract: Retrieval-augmented generation (RAG) faces a fundamental three-way tension: deeper retrieval improves factual grounding but inflates token costs and end-to-end latency.

By Sanjay Mishra

llms rag benchmarks safety

arXiv AI

Jun 3

vLLM Semantic Router: Signal Driven Decision Routing for Mixture-of-Modality Models

arXiv:2603. 04444v3 Announce Type: replace-cross Abstract: As large language models (LLMs) diversify across modalities, capabilities, and cost profiles, the problem of intelligent request routing -- selecting the right model for each query at inference time -- has become a critical systems challenge.

By Xunzhuo Liu (Steve), Huamin Chen (Steve), Samzong Lu (Steve), Yossi Ovadia (Steve), Guohong Wen (Steve), Hao Wu (Steve), Zhengda Tan (Steve), Jintao Zhang (Steve), Senan Zedan (Steve), Yehudit Kerido (Steve), Liav Weiss (Steve), Haichen Zhang (Steve), Bishen Yu (Steve), Asaad Balum (Steve), Noa Limoy (Steve), Abdallah Samara (Steve), Baofa Fan (Steve), Brent Salisbury (Steve), Ryan Cook (Steve), Zhijie Wang (Steve), Qiping Pan (Steve), Rehan Khan (Steve), Avishek Goswami (Steve), Houston H. Zhang (Steve), Shuyi Wang (Steve), Ziang Tang (Steve), Fang Han (Steve), Zohaib Hassan (Steve), Jianqiao Zheng (Steve), Avinash Changrani (Steve), Xue (Steve), Liu, Bowei He

llms rag agents safety

arXiv AI

Jun 3

RGMem: Renormalization Group-inspired Memory Evolution for Language Agents

arXiv:2510. 16392v3 Announce Type: replace Abstract: Personalized and continuous interactions are critical for LLM-based conversational agents, yet finite context windows and static parametric memory hinder the modeling of long-term, cross-session user states.

By Ao Tian, Yunfeng Lu, Xinxin Fan, Changhao Wang, Lanzhi Zhou, Yeyao Zhang, Yanfang Liu

llms rag agents nlp benchmarks

arXiv AI

Jun 3

Generalizing Graph Foundation Models via Hyperbolic Retrieval-Augmented Generation

arXiv:2606. 03307v1 Announce Type: cross Abstract: Graph foundation models (GFMs) emerged as a dominant paradigm in graph representation learning by leveraging large-scale pre-training for cross-domain inference.

By Yifan Jin, Qirui Ji, Bin Qin, Jiangmeng Li, Lixiang Liu, Fuchun Sun, Changwen Zheng

rag benchmarks

arXiv Machine Learning

Jun 3

Zero-Shot 3D Question Answering via Hierarchical View-to-Token Transportation

arXiv:2606. 03100v1 Announce Type: cross Abstract: Recently, zero-shot 3D scene understanding via 2D Vision-Language Models (VLMs) has gained increasing research interest due to their promising spatial reasoning capabilities.

By Dongsheng Wang, Dawei Su, Hui Huang

llms rag nlp multimodal benchmarks

arXiv Machine Learning

Jun 3

Reconstructing Content with Collaborative Attention for Universal Multimodal Representation Learning

arXiv:2603. 01471v3 Announce Type: replace-cross Abstract: Multimodal embedding models, rooted in multimodal large language models (MLLMs), have yielded significant performance improvements across diverse tasks such as retrieval and classification.

By Jiahan Chen, Da Li, Hengran Zhang, Yinqiong Cai, Lixin Su, Jiafeng Guo, Daiting Shi, Dawei Yin, Keping Bi

llms rag multimodal

arXiv AI

Jun 3

QuITE: Query-Based Irregular Time Series Embedding

arXiv:2605. 28166v3 Announce Type: replace-cross Abstract: Irregular Multivariate Time Series (IMTS) are common in practice, yet their irregular sampling complicates effective modeling.

By Junghoon Lim

rag benchmarks

arXiv AI

Jun 3

$\mathbb{R}^{2k}$ is Theoretically Large Enough for Embedding-based Top-$k$ Retrieval

arXiv:2601. 20844v3 Announce Type: replace-cross Abstract: This paper studies the Minimal Embeddable Dimension (MED): the least dimension in which there exists a configuration of $m$ object vectors so that every subset of size at most $k$ is exactly retrieved by score comparison.

By Zihao Wang, Hang Yin, Lihui Liu, Hanghang Tong, Yangqiu Song, Ginny Wong, Simon See

llms rag

arXiv AI

Jun 3

Align-KD: Distilling Cross-Modal Alignment Knowledge for Mobile Vision-Language Model Enhancement

arXiv:2412. 01282v2 Announce Type: replace-cross Abstract: Vision-Language Models (VLMs) bring powerful understanding and reasoning capabilities to multimodal tasks.

By Qianhan Feng, Wenshuo Li, Tong Lin, Xinghao Chen

llms rag efficiency multimodal benchmarks safety

arXiv AI

Jun 3

GFFMERGE: Efficient Merging of Graph Neural Force Fields and Beyond

arXiv:2606. 03232v1 Announce Type: cross Abstract: Graph Neural Networks (GNNs) have revolutionized Neural Force Fields for atomistic simulations, achieving near-quantum accuracy at reduced cost, yet adapting these models to new chemical systems requires expensive retraining of foundation models.

By Parth Verma, Parv P. Singh, Vipul Garg, Ishita Thakre, N. M. Anoop Krishnan, Sayan Ranu

rag fine-tuning benchmarks safety

arXiv AI

Jun 3

Do Neural Retrievers Prefer Certain Documents? Evidence of Learned Relevance Priors

arXiv:2606. 02814v1 Announce Type: cross Abstract: Neural retrievers are trained to estimate query-document relevance from annotated query-document pairs.

By Francisco Valentini, Edgar Altszyler, Martin Fajcik

llms rag benchmarks safety

arXiv AI

Jun 3

Learning the Neighborhood: Contrast-Free Multimodal Self-Supervised Molecular Graph Pretraining

arXiv:2509. 22468v2 Announce Type: replace-cross Abstract: High-quality molecular representations are essential for property prediction and molecular design, yet large labeled datasets remain scarce.

By Boshra Ariguib, Mathias Niepert, Andrei Manolache

llms rag diffusion fine-tuning multimodal benchmarks

arXiv AI

Jun 3

UR$^2$: Unify RAG and Reasoning through Reinforcement Learning

arXiv:2508. 06165v5 Announce Type: replace-cross Abstract: Large Language Models (LLMs) have shown strong capabilities through two complementary paradigms: Retrieval-Augmented Generation (RAG) for knowledge grounding and Reinforcement Learning from Verifiable Rewards (RLVR) for complex reasoning.

By Weitao Li, Boran Xiang, Xiaolong Wang, Zhinan Gou, Weizhi Ma, Yang Liu

llms rag reinforcement-learning benchmarks

arXiv AI

Jun 3

Inference Cost Attacks for Retrieval-Augmented Large Language Models

arXiv:2606. 02643v1 Announce Type: cross Abstract: Retrieval-Augmented Generation (RAG)-enhanced LLM systems, while powerful, introduce substantial inference costs due to the inclusion of an extra multi-stage pipeline that dynamically retrieves and synthesizes information from external knowledge sources.

By Chengliang Liu, Liangbo Ning, Yujuan Ding, Wenqi Fan

llms rag agents reinforcement-learning robotics safety

Get the daily briefing