arXiv AI By Yerang Kim, Jiyoon Myung, Joohyung Han

E-SENS: Exclusion-Sensitive Penalization for Negative-Constraint Retrieval

Read the original on arXiv AI →

E‑SENS is a training‑free reranking technique designed to improve negative‑constraint retrieval in retrieval‑augmented language models. It works by extracting a compact ‘trap query’ that represents the excluded concept and subtracting the similarity of this trap query from the original retrieval score, thereby reducing the influence of documents that mention the excluded concept. Experiments on the ExcluIR benchmark demonstrate that E‑SENS achieves a clear recall‑violation trade‑off across four embedding models and effectively reduces trap retrieval while preserving recall.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
Jun 15

Efficient Rationale-based Retrieval: On-policy Distillation from Generative Rerankers based on JEPA

arXiv:2604. 23336v3 Announce Type: replace-cross Abstract: Unlike traditional fact-based retrieval, rationale-based retrieval typically necessitates cross-encoding of query-document pairs using large language models, incurring substantial computational costs.

By Teng Chen, Sheng Xu, Feixiang Guo, Xiaoyu Wang, Qingqing Gu, Hongyan Li, Luo Ji
arXiv AI
Aug 19

DEPT: Document Embedding Preservation Tuning for Unified Query Expansion and Retrieval

The paper introduces DEPT, a method that trains a single decoder-only large language model to both expand queries and encode documents for retrieval. By preserving document embeddings close to their initial cached values while allowing gradients to flow through the generator, DEPT stabilizes retrieval targets and enables efficient index reuse and online hard‑negative mining. Experiments on the BEIR benchmark with Qwen3‑4B‑Instruct‑2507 and LLaMA‑3.2‑3B‑Instruct show that DEPT outperforms training‑free, independently trained, and staged unified baselines, with ablations confirming the benefits of preservation, whitening, end‑to‑end expansion training, and online negatives.

By Jingyuan Wang, Richong Zhang, Zhijie Nie, Mingxin Li, Yanzhao Zhang
arXiv Machine Learning
Jul 28

Similarity Is Not Logic: Factored Inference for Dual-Encoder Vision-Language Models

arXiv:2607. 23052v1 Announce Type: cross Abstract: Dual-encoder vision-language models (VLMs) expose a similarity interface that enables zero-shot retrieval but fails compositional constraints: queries like "umbrella and no person" retrieve images containing both, even when concept detection is reliable.

By Sultan Alshehri, Zhantao Yang, Han Zhang, Marios Savvides