arXiv Computation and Language By Ruiyi Yan, Zhuoyuan Mao, Yugo Murawaki, Yiwen Guo

Re$^3$Rank: Listwise Reranking with Reasoning-Conditioned Retrieval Heads

Read the original on arXiv Computation and Language →

Re$^3$Rank is a listwise reranker that uses reasoning-conditioned retrieval heads (RRHeads). It generates a reasoning trace for each candidate, then scores candidates by using the trace tokens as attention queries for selected RRHeads, producing continuous relevance scores. A straight‑through estimator allows joint training of the generator and scorer, and on nine benchmarks the 4B model outperforms 11 baseline rerankers by an average of 3.11 NDCG@10 points, while the 0.6B model beats rerankers with up to 32B parameters.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv Computation and Language
Sep 18

Think Thrice Before Reranking: Multi-perspective Evidence and Reasoning Integration for Text Reranking

MERIT‑Rank is a reranking framework that integrates multiple reasoning trajectories to enhance text ranking robustness. It introduces a Multi‑Trajectory Reasoning Space (MTRS) to evaluate query‑document relevance from diverse perspectives and a joint reranker that consolidates these paths into a single ranking decision. The Progressive Rank Policy Optimization (PRPO) training scheme stabilizes reasoning trajectories and progressively improves ranking quality, yielding superior performance on both reasoning‑intensive and traditional retrieval benchmarks, with a 4B model outperforming larger 7B and 32B rerankers on BRIGHT.

By Lijun Liu, Zhengzong Chen, Wenyan Li, Yuanyuan Zhao, Fei Huang
Hugging Face Trending Papers
Sep 17

Think Thrice Before Reranking: Multi-perspective Evidence and Reasoning Integration for Text Reranking

MERIT‑Rank introduces a multi‑trajectory reasoning framework for text reranking, combining complementary reasoning paths to enhance robustness against errors. It defines a Multi‑Trajectory Reasoning Space (MTRS) and a joint reranker that merges these perspectives into a single ranking decision. The Progressive Rank Policy Optimization (PRPO) training scheme stabilizes reasoning trajectories and progressively improves ranking quality, yielding superior performance on both reasoning‑intensive and traditional retrieval benchmarks, with a 4B model outperforming larger rerankers on BRIGHT.

arXiv AI
Aug 13

CAR: Query-Guided Confidence-Aware Reranking for Retrieval-Augmented Generation

arXiv:2605. 04495v2 Announce Type: replace-cross Abstract: Retrieval-augmented generation (RAG) relies on evidence ranking to determine what information is exposed to the generator, yet existing retrieval and reranking methods primarily estimate query--document relevance.

By Zhipeng Song, Yizhi Zhou, Xiangyu Kong, Jiulong Jiao, Xuezhou Ye, Chunqi Gao, Xueqing Shi, Yu Wang, Yuhang Zhou, Heng Qi
Hugging Face Trending Papers
6d ago

Glance: The Generator Is Its Own Reranker

Glance is a retrieval‑augmented generation approach that eliminates the need for separate reranker models by adding a lightweight decision adapter and pointer head to a single 9B backbone. It scores candidate passages directly from a shared prefill, requiring only about 0.1 GiB of extra memory per decision skill. In fine‑tuning on MS MARCO, Glance outperforms the bge‑reranker‑v2‑m3 on SciFact and NFCorpus, and improves answer F1 on HotpotQA by 0.045, while scaling to 200 candidates it surpasses cross‑encoder reranking by 0.058 nDCG@10.