arXiv AI By Jia-Rui Lin, Yun-Hong Cai, Xiang-Rui Ni, Peng Pan

Intelligent Identification and Repair of Design Defects in BIM via Domain-Specific Large Language Models

Read the original on arXiv AI →

The Flow has not summarised this story yet — read it at arXiv AI.

arXiv AI
Sep 7

Better Understanding, Better Fixes? A Study of Hallucination in LLM-based Automated Program Repair

The paper investigates hallucination in large language model–based automated program repair (APR). It defines hallucination as producing patches or intermediate artifacts that are not grounded in available repair evidence, and analyzes it across final patches and intermediate tasks such as triggering test case identification, line coverage prediction, and additional test case generation. Experiments on 832 Defects4J bugs show that only 21.0%–55.9% of patches pass the developer test suite, with 72.7% of sampled repairs exhibiting hallucinations, often due to incorrect causal localization or repair strategies.

By Xuemeng Cai, Jiakun Liu, Linhan Yang, Wei Ma, Lingxiao Jiang
Hugging Face Trending Papers
Oct 13

Configuring RAG Systems: What Breaks, Where Originates, and How to Fix

The paper investigates configuration problems in Retrieval-Augmented Generation (RAG) systems, which combine large language models with components like vector or graph databases. An empirical study of 654 real-world issues from 10 RAG systems categorizes symptoms, root causes, stages, and fix patterns, revealing that symptoms often appear early or late in the pipeline while root causes may lie elsewhere. The authors also offer nine actionable insights for practitioners to test, localize, and resolve configuration issues in RAG systems.