arXiv Machine Learning June 15, 2026 By Teng Chen, Sheng Xu, Feixiang Guo, Xiaoyu Wang, Qingqing Gu, Hongyan Li, Luo Ji

Efficient Rationale-based Retrieval: On-policy Distillation from Generative Rerankers based on JEPA

Read the original on arXiv Machine Learning →

arXiv:2604. 23336v3 Announce Type: replace-cross Abstract: Unlike traditional fact-based retrieval, rationale-based retrieval typically necessitates cross-encoding of query-document pairs using large language models, incurring substantial computational costs.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

Hugging Face Trending Papers

Jun 22

KaLM-Reranker-V1: Fast but Not Late Interaction for Compressed Document Reranking

As retrieval systems scale, high-quality reranking becomes increasingly important. However, most existing rerankers, whether encoder-based or decoder-based, jointly encode the query and passage, tightly coupling their computation and limiting deployment efficiency as well as flexibility.

rag benchmarks

arXiv AI

1d ago

What the Reranker Sees: Multi-Aspect Page Annotation for Long-Document Multimodal Question Answering

arXiv:2608. 14841v1 Announce Type: new Abstract: Long-document visual question answering (VQA) over documents of tens to hundreds of pages mixing text, tables, charts, and figures typically follows retrieve-then-read pipelines.

By Guanchen Wu, Jiayuan Ding, Subhabrata Mukherjee, Carl Yang

llms nlp multimodal

arXiv AI

Jul 3

Optimizing RAG Rerankers with LLM Feedback via Reinforcement Learning

arXiv:2604. 02091v2 Announce Type: replace-cross Abstract: Rerankers play a pivotal role in refining retrieval results for Retrieval-Augmented Generation.

By Yuhang Wu, Xiangqing Shen, Fanfan Wang, Cangqi Zhou, Zhen Wu, Xinyu Dai, Rui Xia

llms rag reinforcement-learning benchmarks

arXiv Machine Learning

Jul 15

Transforming LLMs into Efficient Cross-Encoders via Knowledge Distillation for RAG Reranking

arXiv:2607. 11933v1 Announce Type: cross Abstract: Cross-encoders achieve high reranking accuracy in Retrieval-Augmented Generation (RAG) pipelines but impose quadratic inference costs that limit real-time deployment.

By Shreeya Dasa Lakshminath, Shubhan S

llms rag fine-tuning efficiency benchmarks

arXiv AI

Aug 11

TreeHop: Efficient Embedding-Level Query Rewriter

arXiv:2504. 20114v3 Announce Type: replace-cross Abstract: Retrieval-augmented generation (RAG) systems face significant challenges in multi-hop question answering (MHQA), where complex queries require synthesizing information across multiple document chunks.

By Zhonghao Li, Kunpeng Zhang, Jinghuai Ou, Shuliang Liu, Xuming Hu

llms rag nlp

arXiv AI

6d ago

CAR: Query-Guided Confidence-Aware Reranking for Retrieval-Augmented Generation

arXiv:2605. 04495v2 Announce Type: replace-cross Abstract: Retrieval-augmented generation (RAG) relies on evidence ranking to determine what information is exposed to the generator, yet existing retrieval and reranking methods primarily estimate query--document relevance.

By Zhipeng Song, Yizhi Zhou, Xiangyu Kong, Jiulong Jiao, Xuezhou Ye, Chunqi Gao, Xueqing Shi, Yu Wang, Yuhang Zhou, Heng Qi

llms rag

Related stories

KaLM-Reranker-V1: Fast but Not Late Interaction for Compressed Document Reranking

What the Reranker Sees: Multi-Aspect Page Annotation for Long-Document Multimodal Question Answering

Optimizing RAG Rerankers with LLM Feedback via Reinforcement Learning

Transforming LLMs into Efficient Cross-Encoders via Knowledge Distillation for RAG Reranking

TreeHop: Efficient Embedding-Level Query Rewriter

CAR: Query-Guided Confidence-Aware Reranking for Retrieval-Augmented Generation