arXiv Computation and Language September 4, 2026 By Harshad Khadilkar, Abhay Gupta

Causal-Counterfactual RAG: The Integration of Causal-Counterfactual Reasoning into RAG

Read the original on arXiv Computation and Language →

The paper introduces Causal-Counterfactual RAG, a new framework that augments Retrieval-Augmented Generation with explicit causal graphs and counterfactual reasoning. By incorporating cause‑effect relationships into retrieval and evaluating both direct causal evidence and counterfactual scenarios, the approach aims to produce more robust, accurate, and interpretable answers. This method seeks to maintain contextual coherence, reduce hallucinations, and improve reasoning fidelity compared to traditional RAG systems.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv AI

Jul 14

CRiT-QA: Evaluating Multi-hop Reasoning with Counterfactual Chains and Distractor Traps

arXiv:2607. 10562v1 Announce Type: new Abstract: Evaluating the multi-hop reasoning capabilities of large language models remains a significant challenge.

By JungMin Yun, JuneHyoung Kwon, YoungBin Kim

llms nlp

arXiv AI

Jun 29

CausalFlip: A Benchmark for LLM Causal Judgment Beyond Semantic Matching

arXiv:2602. 20094v2 Announce Type: replace Abstract: As large language models (LLMs) witness increasing deployment in complex, high-stakes decision-making scenarios, it becomes imperative to ground their reasoning in causality rather than spurious correlations.

By Yuzhe Wang, Yaochen Zhu, Jundong Li

llms benchmarks

arXiv AI

Jul 21

A Survey on Knowledge-Oriented Retrieval-Augmented Generation

arXiv:2503. 10677v3 Announce Type: replace-cross Abstract: Retrieval-Augmented Generation (RAG) has gained significant attention in recent years for its potential to enhance natural language understanding and generation by combining large-scale retrieval systems with generative models.

By Mingyue Cheng, Yucong Luo, Jie Ouyang, Qi Liu, Huijie Liu, Li Li, Shuo Yu, Bohou Zhang, Jiawei Cao, Jie Ma, Daoyu Wang, Enhong Chen

rag nlp multimodal benchmarks safety

arXiv AI

Jul 20

Causal-Audit: Explicit and Auditable Graph-based Reasoning via Target-Aware Causal Chain Construction

arXiv:2607. 15281v1 Announce Type: new Abstract: Causal and intervention-based question answering is fundamental to advancing large language models (LLMs) toward reasoning beyond surface-level correlations and understanding underlying causal mechanisms.

By Su Lan, Xuefei Yin, Yanming Zhu, Alan Wee-Chung Liew

llms nlp benchmarks

arXiv Machine Learning

Sep 10

CausalBN-Bench: A Comprehensive Benchmark for Causal Learning Capability of LLMs

arXiv:2404.06349v3 Announce Type: replace Abstract: The ability to understand causality significantly impacts the competence of large language models (LLMs) in output explanation and counterfactual r...

By Yu Zhou, Xingyu Wu, Jibin Wu, Liang Feng, Kay Chen Tan

llms benchmarks

arXiv Machine Learning

Sep 10

Retrieval-augmented Decoding for Improving Truthfulness in Open-ended Generation

The paper introduces Retrieval-Augmented Decoding (RAD), a decoding-time method that improves the truthfulness of large language models without retraining. RAD uses a small reference set of up to ten annotated examples to build a grounding space of context embeddings and next-token logits, which it retrieves and aggregates during inference to shape the model’s output. Experiments on four open-ended generation benchmarks and four different LLMs show that RAD consistently outperforms strong baselines and generalizes well across tasks.

By Manh Nguyen, Sunil Gupta, Hung Le

llms rag reinforcement-learning fine-tuning benchmarks

One email a morning, machine-written

Related stories

CRiT-QA: Evaluating Multi-hop Reasoning with Counterfactual Chains and Distractor Traps

CausalFlip: A Benchmark for LLM Causal Judgment Beyond Semantic Matching

A Survey on Knowledge-Oriented Retrieval-Augmented Generation

Causal-Audit: Explicit and Auditable Graph-based Reasoning via Target-Aware Causal Chain Construction

CausalBN-Bench: A Comprehensive Benchmark for Causal Learning Capability of LLMs

Retrieval-augmented Decoding for Improving Truthfulness in Open-ended Generation