arXiv:2607. 23507v1 Announce Type: cross Abstract: Choosing the right text embedding model is one of the most consequential -- and most frequently under-examined -- decisions in building a retrieval or search system, yet the model that tops a leaderboard is rarely the best choice for a given deployment.
By Madhav S Baidya
arXiv:2606.22807v3 Announce Type: replace
Abstract: As retrieval systems scale, effective and efficient reranking becomes increasingly important. However, most existing encoder- and decoder-based rer...
By Xinping Zhao, Jiaxin Xu, Ziqi Dai, Xin Zhang, Huiyao Chen, Shouzheng Huang, Xianhao Xiong, Danyu Tang, Xinshuo Hu, Guohong Fu, Meishan Zhang, Baotian Hu
arXiv:2607. 03515v1 Announce Type: cross Abstract: In many machine learning applications, the most relevant items for a query should be efficiently retrieved.
By Kirill Shevkunov, Andrey Ploskonosov, Liudmila Prokhorenkova
Lychee‑Reranker is a fast, not‑late‑interaction reranker that decouples query and passage computation while preserving expressive relevance modeling. It uses an encoder–decoder architecture: passages are pre‑encoded with Matryoshka embedding pooling, and the decoder jointly processes system/user instructions and query intent, with cross‑attention capturing fine‑grained relevance. The design yields four benefits—offline passage encoding for efficiency, cross‑attention expressiveness, compact Matryoshka pooling, and adjustable test‑time compute—and is available in Nano, Small, and Large sizes (0.27B, 1B, and 4B activated parameters).
By Xinping Zhao, Jiaxin Xu, Ziqi Dai, Xin Zhang, Huiyao Chen, Shouzheng Huang, Xianhao Xiong, Danyu Tang, Xinshuo Hu, Guohong Fu, Meishan Zhang, Baotian Hu
As retrieval systems scale, high-quality reranking becomes increasingly important. However, most existing rerankers, whether encoder-based or decoder-based, jointly encode the query and passage, tightly coupling their computation and limiting deployment efficiency as well as flexibility.
arXiv:2606. 01070v1 Announce Type: cross Abstract: Dense retrievers excel at first-stage candidate generation but lack effective reranking in zero-resource settings.
By Shiyan Liu, Yichen Li