arXiv AI
Learning from What You Retrieve: Online RL Fine-Tuning for Semantic Retrieval
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Machine Learning
Jun 2
Semantic Retrieval for Product Search in E-Commerce
arXiv:2606. 01504v1 Announce Type: cross Abstract: Semantic retrieval in e-commerce must handle short, noisy, and colloquial queries over large product catalogs with fine-grained attribute distinctions.
arXiv AI
Jul 3
Optimizing RAG Rerankers with LLM Feedback via Reinforcement Learning
arXiv:2604. 02091v2 Announce Type: replace-cross Abstract: Rerankers play a pivotal role in refining retrieval results for Retrieval-Augmented Generation.
arXiv AI
1d ago
NE-R1: Enhancing Named Entity Recognition Model via Reinforcement Learning
NE‑R1 is a framework that improves Named Entity Recognition by using a retrieval‑on‑demand mechanism and a two‑stage training process that includes instruction tuning and reinforcement learning with chain‑of‑thought. It balances the use of internal model parameters and external knowledge through a multi‑dimensional reward that considers accuracy and retrieval benefit. The approach achieves state‑of‑the‑art results, improving in‑domain F1 by 2.52% and zero‑shot cross‑domain F1 by 1.18%.
arXiv AI
Aug 19
DEPT: Document Embedding Preservation Tuning for Unified Query Expansion and Retrieval
The paper introduces DEPT, a method that trains a single decoder-only large language model to both expand queries and encode documents for retrieval. By preserving document embeddings close to their initial cached values while allowing gradients to flow through the generator, DEPT stabilizes retrieval targets and enables efficient index reuse and online hard‑negative mining. Experiments on the BEIR benchmark with Qwen3‑4B‑Instruct‑2507 and LLaMA‑3.2‑3B‑Instruct show that DEPT outperforms training‑free, independently trained, and staged unified baselines, with ablations confirming the benefits of preservation, whitening, end‑to‑end expansion training, and online negatives.
arXiv Machine Learning
Jun 30
Diagnosing and Mitigating Retrieval Bottlenecks in LLM-Based Cold-Start Recommendation
arXiv:2606. 29947v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly used as rerankers in recommender systems, with the expectation that semantic understanding will help in cold-start and long-tail regimes.
arXiv AI
Aug 25
Unleashing the Power of LLMs in Dense Retrieval with Query Likelihood Modeling
The paper introduces LLM-QL, a dense retrieval model that harnesses large language models (LLMs) by maximizing query likelihood (QL) as an auxiliary task. It incorporates an Attention Block to limit predictive token attention to document tokens before the ending token and a Document Corruption component that masks parts of the document during prediction. Experiments on MS MARCO and BEIR datasets show that LLM-QL outperforms other LLM-based retrievers, and detailed analyses confirm the effectiveness of its components.