arXiv AI
SPARK: Adaptive Parametric Knowledge Participation for Faithful Retrieval-Augmented Generation
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Jun 24
Representation Interventions Enable Lifelong Knowledge Memory Control in LLMs
arXiv:2511. 20892v4 Announce Type: replace Abstract: Large language models (LLMs) often produce incorrect or outdated content after being employed.
arXiv AI
Jul 10
ParamMute: Suppressing Knowledge-Critical FFNs for Faithful Retrieval-Augmented Generation
arXiv:2502. 15543v4 Announce Type: replace-cross Abstract: Large language models (LLMs) integrated with retrieval-augmented generation (RAG) have improved factuality by grounding outputs in external evidence.
arXiv AI
Jun 16
Retrievable Gradients: Continual Post-Training Without Cumulative Weight Drift
arXiv:2606. 15734v1 Announce Type: cross Abstract: Continual post-training enables models to absorb emerging knowledge after deployment, but repeatedly updating shared parameters can accumulate weight drift, potentially causing catastrophic forgetting and degrading general capabilities.
arXiv AI
Aug 20
From Storage to Access: Verifiable Activation of Parametric Knowledge in LLMs via Explicit Priming and Implicit Reasoning
The paper introduces VAKE, a two‑stage reinforcement‑learning framework that activates latent factual knowledge in large language models. In the Priming stage, the model explicitly inserts bridging triples into an insufficient subgraph, guided by rewards from a frozen model’s answers. The Reasoning stage then trains the model to answer from the original input, demonstrating that the elicitation capability transfers to implicit reasoning and consistently outperforms baselines across multiple benchmarks and model sizes.
arXiv Machine Learning
Sep 29
Parameters vs. Context: TRACE Fine-Tuning for Robust Retrieval-Augmented Generation
The paper introduces TRACE, a fine‑tuning framework for Retrieval‑Augmented Generation (RAG) that addresses conflicts between retrieved knowledge and a model’s internal knowledge. TRACE uses multi‑agent debate traces to identify correct and incorrect candidates and answer‑shift patterns, providing fine‑grained supervision for reliable knowledge‑source selection. It also incorporates an answer‑completeness regularization mechanism to prevent empty, overly short, or prematurely terminated responses, thereby improving robustness against misleading retrieved content and enhancing answer quality.
arXiv AI
Jun 29
SHIFT: Gate-Modulated Activation Steering for Knowledge Conflict Mitigation in Retrieval-Augmented Generation
arXiv:2606. 27786v1 Announce Type: cross Abstract: Retrieval-augmented generation (RAG) enhances LLMs by incorporating external knowledge to support response generation.