Retrieval-augmented generation

Retrieval pipelines, vector search, chunking and reranking: how models are grounded in a corpus instead of their weights.

6,121 stories · RSS feed

Towards Data Science
2d ago

Does Agentic RAG Actually Retrieve Better Evidence? I Tested It on 298 Questions

The article reports on an experiment where an AI agent was allowed to search for evidence whenever it chose. The agent discovered some papers that a standard search missed, but also lost some that the plain search had found, and overall the gains were insufficient to be trusted. The post examines whether agentic Retrieval-Augmented Generation (RAG) truly retrieves better evidence across 298 questions.

By Abdullahi Dattijo
arXiv Computation and Language
2d ago

Same Answer, Different Reasons: Trace-Level Divergence in Multilingual Large Language Models

The paper introduces a trace-level divergence framework for evaluating multilingual large language models, breaking down agreement into structural similarity, order consistency, and holistic similarity. Experiments across three reasoning benchmarks, seven languages, and six leading LLMs show that conventional holistic similarity metrics overstate agreement, with up to 67.3% of top-scoring examples lacking structural alignment. Human judgments align more closely with structural similarity, highlighting language-specific divergence and the need for trace-level evaluation in multilingual deployments.

By Rui Sun, Peizhao Mei, Xiewei Cheng, Kaizhuo Chen, Taoran Li, Zhiyuan Yu, Varun Chandrasekaran