arXiv AI

Topic-Level Fairness in Retrieval-Augmented Generation

The paper investigates topic-level fairness in retrieval‑augmented generation (RAG) systems, noting that aggregate metrics can mask disparities across individual topics. It proposes adapting a reranker per topic using a Bradley‑Terry objective guided by preference pairs derived from the generator’s own output, which reduces mean absolute per‑topic disparity by 51% on RoMQA and 40% on TREC Fair Ranking while preserving accuracy. Existing baselines, even when modified to treat topics separately, fail to achieve comparable reductions.

arXiv Computation and Language
Oct 9

Fair-GPTQ: Bias-Aware Quantization for Large Language Models

Fair-GPTQ is a quantization method for large language models that incorporates explicit group‑fairness constraints into the quantization objective. By guiding the rounding operation, it reduces bias in generated text, particularly for occupational stereotypes and discriminatory language across gender, race, and religion. The approach maintains at least 90 % of baseline accuracy on zero‑shot benchmarks while preserving the memory and speed benefits of 4‑bit quantization.

By Irina Proskurina, Guillaume Metzler, Julien Velcin
arXiv Computation and Language
Aug 25

WARP: Wasserstein-Aligned RAG for Population Opinions

arXiv:2608.22859v1 Announce Type: cross Abstract: RAG systems are increasingly used to summarize what large collections of documents say. A user asks "What do people think about X?" and receives an a...

By Aman Singh Thakur, Aditya Agrawal, Alwarappan Nakkiran, Alex Karlsson
arXiv AI
Aug 13

CAR: Query-Guided Confidence-Aware Reranking for Retrieval-Augmented Generation

arXiv:2605. 04495v2 Announce Type: replace-cross Abstract: Retrieval-augmented generation (RAG) relies on evidence ranking to determine what information is exposed to the generator, yet existing retrieval and reranking methods primarily estimate query--document relevance.

By Zhipeng Song, Yizhi Zhou, Xiangyu Kong, Jiulong Jiao, Xuezhou Ye, Chunqi Gao, Xueqing Shi, Yu Wang, Yuhang Zhou, Heng Qi
arXiv Computation and Language
Sep 30

Pair Difficulty Matters: Rethinking Pairwise LLM-as-a-Judge Evaluation and Consistency

Large Language Model judges are commonly used to rank texts via pairwise comparison, with reliability traditionally measured by position bias, transitivity, and pairwise agreement. This paper argues that these proxies are misleading because they are dominated by close‑rank‑gap pairs, which contribute little to the overall ranking, while far‑gap pairs carry the true ranking signal. Experiments on simulations and human‑rated corpora show weak correlation between the proxies and actual ranking accuracy, suggesting judges should be evaluated using rank‑gap‑conditional metrics against human rankings.

By Bruno Brocai, Maria Becker
arXiv Machine Learning
Oct 2

FairRARI: A Plug and Play Framework for Fairness-Aware PageRank

FairRARI is a new in‑processing convex optimization framework that computes PageRank vectors while satisfying various group‑fairness constraints based on vertex attributes. By formulating PageRank as a variational problem, FairRARI solves a strongly convex problem that guarantees a target fairness level and retains the same asymptotic time complexity as standard PageRank. Experiments on real datasets show that FairRARI outperforms existing methods in utility while achieving the desired fairness across multiple vertex groups.

By Emmanouil Kariotakis, Aritra Konar