Hugging Face Trending Papers

Configuring RAG Systems: What Breaks, Where Originates, and How to Fix

The paper investigates configuration problems in Retrieval-Augmented Generation (RAG) systems, which combine large language models with components like vector or graph databases. An empirical study of 654 real-world issues from 10 RAG systems categorizes symptoms, root causes, stages, and fix patterns, revealing that symptoms often appear early or late in the pipeline while root causes may lie elsewhere. The authors also offer nine actionable insights for practitioners to test, localize, and resolve configuration issues in RAG systems.

arXiv AI
Jun 30

XRAG: eXamining the Core -- Benchmarking Foundational Components in Advanced Retrieval-Augmented Generation

arXiv:2412. 15529v4 Announce Type: replace-cross Abstract: Retrieval-augmented generation (RAG) synergizes the retrieval of pertinent data with the generative capabilities of Large Language Models (LLMs), ensuring that the generated output is not only contextually relevant but also accurate and current.

By Qili Zhang, Qianren Mao, Yangyifei Luo, Yashuo Luo, Hanwen Hao, Zhilong Cao, Weifeng Jiang, Zhijun Chen, Junnan Liu, Feng Yan, Xiaolong Wang, Jinlong Zhang, Zhenting Huang, Zhixing Tan, Jie Sun, Bo Li, Jianxin Li, Philip S. Yu
arXiv AI
3d ago

Characterising and Analysing Retrieval-Augmented Generation Techniques

The paper introduces a conceptual framework to classify and evaluate Retrieval-Augmented Generation (RAG) techniques, addressing the challenge of selecting suitable methods for specific tasks. It identifies main dimensions and sub-dimensions based on a qualitative analysis of existing literature. The framework can act as a pre-empirical filter, helping researchers and practitioners choose the most fitting RAG candidates before costly benchmarking.

By Emmanuel Igbekele, Olawande Daramola
arXiv AI
Aug 18

Think Inside the Chunk: RegulaRAG for Regulation-Compliant Scenario Generation using LLMs: A Case Study of UN Regulation No. 152

arXiv:2608. 16394v1 Announce Type: new Abstract: Generating regulation-compliant test scenarios is essential for validating safety-critical automotive systems, yet Large Language Models (LLMs) struggle to ground outputs in long, hierarchical standards.

By Vahid Zolfaghari, Nenad Petrovic, Andr\'E Schamschurko, Alois Knoll
arXiv AI
Sep 7

Better Understanding, Better Fixes? A Study of Hallucination in LLM-based Automated Program Repair

The paper investigates hallucination in large language model–based automated program repair (APR). It defines hallucination as producing patches or intermediate artifacts that are not grounded in available repair evidence, and analyzes it across final patches and intermediate tasks such as triggering test case identification, line coverage prediction, and additional test case generation. Experiments on 832 Defects4J bugs show that only 21.0%–55.9% of patches pass the developer test suite, with 72.7% of sampled repairs exhibiting hallucinations, often due to incorrect causal localization or repair strategies.

By Xuemeng Cai, Jiakun Liu, Linhan Yang, Wei Ma, Lingxiao Jiang