arXiv Computation and Language By Xiaoyang Chen, Jie Liu, Haijin Liang, Haibo Shi, Jin Ma, Ben He, Yingfei Sun, Dezhi Ye

Beyond Polarization: The Generative Constraint of Chain-of-Thought in Pointwise Reranking

Read the original on arXiv Computation and Language →

In pointwise document reranking, Chain-of-Thought models consistently underperform direct scoring models, a gap that persists across models up to 32B parameters. The authors conducted stress tests—reinforcement learning, fine‑grained supervision, and architectural decoupling—to address classification, score polarization, and calibration issues, which improved absolute scores but did not close the relative ranking gap. Their results indicate that routing continuous relevance semantics through discrete text imposes a stable bottleneck in ranking resolution that current standard methods cannot easily overcome.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv AI
Jun 10

RankLLM: Weighted Ranking of LLMs by Quantifying Question Difficulty

arXiv:2602. 12424v2 Announce Type: replace-cross Abstract: Benchmarks establish a standardized evaluation framework to systematically assess the performance of large language models (LLMs), facilitating objective comparisons and driving advancements in the field.

By Ziqian Zhang, Xingjian Hu, Yue Huang, Kai Zhang, Ruoxi Chen, Yixin Liu, Qingsong Wen, Kaidi Xu, Xiangliang Zhang, Neil Zhenqiang Gong, Lichao Sun
arXiv Computation and Language
6d ago

Re$^3$Rank: Listwise Reranking with Reasoning-Conditioned Retrieval Heads

Re$^3$Rank is a listwise reranker that uses reasoning-conditioned retrieval heads (RRHeads). It generates a reasoning trace for each candidate, then scores candidates by using the trace tokens as attention queries for selected RRHeads, producing continuous relevance scores. A straight‑through estimator allows joint training of the generator and scorer, and on nine benchmarks the 4B model outperforms 11 baseline rerankers by an average of 3.11 NDCG@10 points, while the 0.6B model beats rerankers with up to 32B parameters.

By Ruiyi Yan, Zhuoyuan Mao, Yugo Murawaki, Yiwen Guo