Hugging Face Trending Papers June 22, 2026

KaLM-Reranker-V1: Fast but Not Late Interaction for Compressed Document Reranking

Read the original on Hugging Face Trending Papers →

As retrieval systems scale, high-quality reranking becomes increasingly important. However, most existing rerankers, whether encoder-based or decoder-based, jointly encode the query and passage, tightly coupling their computation and limiting deployment efficiency as well as flexibility.

Summary generated by The Flow from the publisher's feed. The full article lives at Hugging Face Trending Papers.

arXiv Machine Learning

Jun 15

Efficient Rationale-based Retrieval: On-policy Distillation from Generative Rerankers based on JEPA

arXiv:2604. 23336v3 Announce Type: replace-cross Abstract: Unlike traditional fact-based retrieval, rationale-based retrieval typically necessitates cross-encoding of query-document pairs using large language models, incurring substantial computational costs.

By Teng Chen, Sheng Xu, Feixiang Guo, Xiaoyu Wang, Qingqing Gu, Hongyan Li, Luo Ji

llms rag robotics efficiency benchmarks

arXiv Machine Learning

Jul 15

Transforming LLMs into Efficient Cross-Encoders via Knowledge Distillation for RAG Reranking

arXiv:2607. 11933v1 Announce Type: cross Abstract: Cross-encoders achieve high reranking accuracy in Retrieval-Augmented Generation (RAG) pipelines but impose quadratic inference costs that limit real-time deployment.

By Shreeya Dasa Lakshminath, Shubhan S

llms rag fine-tuning efficiency benchmarks

arXiv Machine Learning

Jun 4

Training-Free Lexical-Dense Fusion for Conversational-Memory Retrieval

arXiv:2606. 04194v1 Announce Type: new Abstract: Retrieving the few past turns that answer a new query across long multi-session histories is the retrieval bottleneck behind long-term conversational memory (LoCoMo, LongMemEval).

By Christian Lysenst{\o}en

rag benchmarks safety

arXiv AI

Jun 30

Beyond the Reranker: Do RAG Retrieval Enhancements Help Once a Strong Reranker Is Present?

arXiv:2606. 28367v1 Announce Type: cross Abstract: Retrieval-augmented generation (RAG) is routinely extended with methods meant to improve retrieval: query expansion, hierarchical and cross-document summarization, graph-based expansion, per-query routing, rank fusion, and corrective re-retrieval.

By Sadanand Singh, Allam Reddy, Manan Chopra

rag nlp benchmarks

arXiv Machine Learning

Jul 31

Recall Before You Rank: Similarity-Guided Top-$K$ Reuse for Efficient Long-Context Attention

arXiv:2607. 27692v1 Announce Type: cross Abstract: Top-$K$ sparse attention reduces the cost of Softmax and value aggregation by attending to only a small subset of key--value (KV) entries.

By Wenshuai Yao, Wenyong Zhou, Hanyong Shao, Yizhe Chen, Zhiyuan Ning, Yuannuo Feng, Ru Huang, Kechao Tang

efficiency

arXiv AI

1d ago

What the Reranker Sees: Multi-Aspect Page Annotation for Long-Document Multimodal Question Answering

arXiv:2608. 14841v1 Announce Type: new Abstract: Long-document visual question answering (VQA) over documents of tens to hundreds of pages mixing text, tables, charts, and figures typically follows retrieve-then-read pipelines.

By Guanchen Wu, Jiayuan Ding, Subhabrata Mukherjee, Carl Yang

llms nlp multimodal

Related stories

Efficient Rationale-based Retrieval: On-policy Distillation from Generative Rerankers based on JEPA

Transforming LLMs into Efficient Cross-Encoders via Knowledge Distillation for RAG Reranking

Training-Free Lexical-Dense Fusion for Conversational-Memory Retrieval

Beyond the Reranker: Do RAG Retrieval Enhancements Help Once a Strong Reranker Is Present?

Recall Before You Rank: Similarity-Guided Top-$K$ Reuse for Efficient Long-Context Attention

What the Reranker Sees: Multi-Aspect Page Annotation for Long-Document Multimodal Question Answering