The paper introduces Causal-Counterfactual RAG, a new framework that augments Retrieval-Augmented Generation with explicit causal graphs and counterfactual reasoning. By incorporating cause‑effect relationships into retrieval and evaluating both direct causal evidence and counterfactual scenarios, the approach aims to produce more robust, accurate, and interpretable answers. This method seeks to maintain contextual coherence, reduce hallucinations, and improve reasoning fidelity compared to traditional RAG systems.
arXiv:2607. 10562v1 Announce Type: new Abstract: Evaluating the multi-hop reasoning capabilities of large language models remains a significant challenge.
arXiv:2610.01936v2 Announce Type: replace Abstract: Large Language Models (LLMs) have demonstrated remarkable fluency and versatility across natural language tasks but remain fundamentally limited by...
arXiv:2602. 20094v2 Announce Type: replace Abstract: As large language models (LLMs) witness increasing deployment in complex, high-stakes decision-making scenarios, it becomes imperative to ground their reasoning in causality rather than spurious correlations.
arXiv:2503. 10677v3 Announce Type: replace-cross Abstract: Retrieval-Augmented Generation (RAG) has gained significant attention in recent years for its potential to enhance natural language understanding and generation by combining large-scale retrieval systems with generative models.
arXiv:2607. 15281v1 Announce Type: new Abstract: Causal and intervention-based question answering is fundamental to advancing large language models (LLMs) toward reasoning beyond surface-level correlations and understanding underlying causal mechanisms.
arXiv:2404.06349v3 Announce Type: replace Abstract: The ability to understand causality significantly impacts the competence of large language models (LLMs) in output explanation and counterfactual r...
The paper introduces Retrieval-Augmented Decoding (RAD), a decoding-time method that improves the truthfulness of large language models without retraining. RAD uses a small reference set of up to ten annotated examples to build a grounding space of context embeddings and next-token logits, which it retrieves and aggregates during inference to shape the model’s output. Experiments on four open-ended generation benchmarks and four different LLMs show that RAD consistently outperforms strong baselines and generalizes well across tasks.
arXiv:2508. 21010v3 Announce Type: replace-cross Abstract: Existing Causal-Why Video Question Answering (VideoQA) models often struggle with higher-order reasoning, relying on opaque, monolithic pipelines that entangle video understanding, causal inference, and answer generation.
The paper introduces TRACE, a fine‑tuning framework for Retrieval‑Augmented Generation (RAG) that addresses conflicts between retrieved knowledge and a model’s internal knowledge. TRACE uses multi‑agent debate traces to identify correct and incorrect candidates and answer‑shift patterns, providing fine‑grained supervision for reliable knowledge‑source selection. It also incorporates an answer‑completeness regularization mechanism to prevent empty, overly short, or prematurely terminated responses, thereby improving robustness against misleading retrieved content and enhancing answer quality.
arXiv:2605. 12213v2 Announce Type: replace Abstract: LLM-based conversational AI agents struggle to maintain coherent behavior over long horizons due to limited context.
arXiv:2603. 00026v2 Announce Type: replace-cross Abstract: Memory management is essential for LLM agents in long-term interactions.
The paper introduces LAnR (Latent Abstraction for Retrieval-Augmented Generation), a unified framework where a single large language model jointly encodes, retrieves, and generates within its latent space. Instead of generating natural language queries, LAnR produces dense retrieval vectors from a designated [PRED] token and matches them against encoded document representations from the same model. An adaptive MLP control head decides when sufficient evidence has been retrieved, eliminating the need for a separate retriever and explicit token-level stopping reasoning. Experiments on six QA benchmarks show that LAnR outperforms existing RAG methods while improving inference efficiency by reducing retrieval calls and tightening model integration.