arXiv AI
On the Role of Citations in Preference Data
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Jun 30
How Do LLMs Cite? A Mechanistic Interpretation of Attribution in Retrieval-Augmented Generation
arXiv:2606. 28358v1 Announce Type: cross Abstract: Retrieval-Augmented Generation (RAG) aims to enhance the trustworthiness of Large Language Models (LLMs) by grounding their outputs in external documents, often using inline citations for verifiability.
arXiv Computation and Language
Sep 2
Citing Less Critically: LLMs Reshape the Rhetoric and Reach of Scientific Citation
arXiv:2609.01432v1 Announce Type: cross Abstract: Scientific citations carry rhetorical intent. Scholars may cite prior work positively (supporting), negatively (contrasting), or neutrally (mentionin...
Hugging Face Trending Papers
Jun 11
Authority, Truth, and Citation Bias: A Large-Scale Multi-Domain Benchmark for Studying Epistemic Susceptibility in Large Language Models
Large language models are increasingly deployed in citation-augmented settings, yet the effect of citation presence on model behavior independent of factual content remains poorly understood. We introduce AuthorityBench, a 220,564-prompt multi-domain benchmark that isolates how citation-based authority signals influence epistemic behavior in LLMs.
arXiv AI
Sep 17
Abstention vs. Hallucination: Benchmarking LLM Source Attribution for Scientific Citations
The paper introduces REASONS, a benchmark comprising 12,723 sentence-level citation instances across 12 arXiv subject categories, to evaluate scientific citation attribution by large language models. It proposes a dual-metric framework—Abstention Rate (AR) and Hallucination Rate (HR)—to assess the trade-off between reliability and responsiveness. Experiments on proprietary and open-source LLMs under various prompting and retrieval settings show that advanced Retrieval-Augmented Generation (RAG) reduces hallucinations but may increase abstention, while retrieval-augmented variants often maintain near-zero abstention. Human evaluation reveals a high ratio of factual hallucinations to acceptable paraphrases, underscoring the need for systems that can appropriately abstain under uncertainty.
arXiv AI
Sep 10
Attribution in Scientific Literature: New Benchmark and Methods
The paper introduces REASONS, a benchmark of 12,723 sentence-level citation instances across 12 arXiv subject categories, to evaluate scientific citation attribution under different evidence conditions. It proposes a dual-metric framework—Abstention Rate (AR) and Hallucination Rate (HR)—to balance reliability and responsiveness. Experiments with proprietary and open-source LLMs across various prompting and retrieval settings show that advanced Retrieval-Augmented Generation (RAG) reduces hallucinations but increases abstention, while adversarial metadata can push hallucination rates above 85%. Human evaluation confirms a high ratio of factual hallucinations to acceptable paraphrases, underscoring the need for systems that can appropriately abstain under uncertainty.
arXiv Computation and Language
Sep 18
Are Finer Citations Always Better? Rethinking Granularity for Attributed Generation
The paper investigates how the granularity of citations—sentence, paragraph, or document level—affects the performance of large language models in attributed generation tasks. Across models ranging from 8B to 120B parameters, enforcing fine‑grained, sentence‑level citations consistently reduces performance, with median losses of 40% and up to 338% on specific tasks, while overall answer correctness remains largely unchanged. The study finds that attribution quality peaks at intermediate, paragraph‑level granularity, suggesting that overly fine citations break semantic dependencies and overly coarse ones add noise, and that the optimal granularity depends on model scale and the amount of evidence required. whyItMatters":"The findings reveal that the conventional preference for fine‑grained citations can actually harm model performance, indicating that attribution standards should be tailored to the model’s semantic scope rather than fixed by convention."