Retrieval-augmented generation

Retrieval pipelines, vector search, chunking and reranking: how models are grounded in a corpus instead of their weights.

6,126 stories · RSS feed

arXiv Statistics ML
Oct 1

A Unified Dual Method for Matching Problems

arXiv:2609.39339v1 Announce Type: cross Abstract: Matching problems are ubiquitous in data science as they enable the alignment of structured objects and distributions. While existing solvers are oft...

By Guillaume Houry (HeKA | U1346), Ferdinand Genans (SU, LPSM), Jean Feydy (HeKA | U1346), Fran\c{c}ois-Xavier Vialard (LIGM)
arXiv Statistics ML
Oct 1

Learning to Plan from Random Exploration

arXiv:2609.38383v1 Announce Type: cross Abstract: Random exploration reveals how an environment can be traversed before a goal is specified. Can this experience support long-range planning without po...

By Deqian Kong, Guangyan Sun, Sheng Cheng, Sirui Xie, Bo Pang, Jianwen Xie, Tony Geng, Caiwen Ding, Ying Nian Wu
arXiv AI
Oct 1

Right Answers, Costly Models: The Efficiency Gap in LLM-based Optimization Modeling

The paper introduces OptTips, a knowledge base of 50 expert optimization modeling techniques, and OptDachshund, a multi‑agent framework that generates mathematical models and solver code from natural‑language problem descriptions. Using these tools, the authors create the EfficientOpt benchmark, comprising 561 expert‑reviewed tasks with paired reference implementations, to evaluate large language models (LLMs) on both correctness and computational efficiency. Their experiments with 11 LLMs show a consistent efficiency gap: even when LLMs produce correct solutions, the resulting programs often take longer to solve than expert‑crafted counterparts, highlighting the need to assess both accuracy and runtime performance in LLM‑based optimization modeling.

By Zhong Li, Xin Huang, Jinhui Wan, Xiangyi Wang, Shenkai Zhang, Ruiqi Chen, Wenyu Liu, Zaiwen Wen, Ziyan Luo
arXiv Computer Vision
Oct 1

Mutual Equilibrium: Multimodal Representation Learning through Reciprocal Feedback

The paper introduces MEQ, a mutual feedback architecture that iteratively refines two multimodal inputs into coupled embeddings, each embedding incorporating information from the other. By continuously exchanging information between the modalities, the model converges to a fixed point that improves representation quality. Experiments on classification and visual grounding tasks show that MEQ achieves competitive or superior performance compared to concatenation-based baselines, and qualitatively enhances visual grounding when paired with complementary modalities.

By Ho-min Park, Byungkon Kang
arXiv Computation and Language
Oct 1

Doc2LoRA Provides Decodable Representations of Scientific Ideas

Doc2LoRA introduces a method to represent scientific papers as LoRA adapters generated by a hypernetwork, enabling each point in the resulting vector space—whether a real paper or a mixture—to be interpreted by a large language model (LLM). The approach allows both search and generation: it achieves competitive search performance with models like SPECTER2 and EmbeddingGemma, while also enabling the LLM to label subfields and generate abstracts that smoothly transition between papers. The invertible transform ensures every point maps back to an LLM, making the embeddings usable for both querying and creative idea generation.

By Chand Sahil Mansuri, Joel Zachariah, Sadamori Kojaku
arXiv Statistics ML
Oct 1

Optimal VC Dimension of Contrastive Learning with Margin

arXiv:2609.38834v1 Announce Type: cross Abstract: Contrastive learning is a successful paradigm for learning $d$-dimensional geometric representations from a collection of ``anchor--positive--negativ...

By Dionysis Arvanitakis, Vaggos Chatziafratis, Yiyuan Luo, Konstantin Makarychev
arXiv Computation and Language
Oct 1

Exploring Heterogeneous Model Merging Approach for Complex Knowledge Transfer

The paper investigates transferring specialized task-oriented behavior to a general language model without training or distillation. It applies two training‑free heterogeneous merging techniques—Intersection‑Merge (IM) and Activate‑Prune‑Merge (APM)—to project a specialist donor into the recipient’s parameter space and interpolate backbone weights. Experiments across embedding, reranking, reward modeling, and MoE code‑specialist tasks show that both methods improve the general model, demonstrating that simple parameter‑level merging can transfer capabilities across diverse specialist roles.

By Jiahe Fan, Si Chen, Yinghao Hou, Wenbo Xia, Ke Xu, Hong Xie, Enhong Chen
arXiv Computer Vision
Oct 1

SOLAR: SVD-Optimized Lifelong Attention for Recommendation

arXiv:2603.02561v2 Announce Type: replace-cross Abstract: Attention mechanism remains the defining operator in Transformers since it provides expressive global credit assignment, yet its quadratic co...

By Chenghao Zhang, Chao Feng, Yuanhao Pu, Xunyong Yang, Wenhui Yu, Xiang Li, Chunjie Chen, Kaiqiao Zhan
arXiv AI
Oct 1

Automatic estimation of verbal fluency index in people with Motor Neuron Disease using ASR alignment and pause modelling

The study introduces an automated system for estimating the Verbal Fluency Index (VFI) in individuals with Motor Neuron Disease (MND) by combining ASR (WhisperX) and VAD (Silero) with precise timestamping. Using a unique MND dataset, the approach outperformed traditional acoustic and self‑supervised embedding methods, achieving high predictive accuracy (R² up to 0.9 for P‑words and 0.8 for S‑words). Clinically inspired features were consistently superior, demonstrating the feasibility of automated VFI estimation for monitoring cognitive impairment in MND.

By Bahman Mirheidari, Leslie Ing, Daniel Blackburn, Sharon Abrahams, Christopher McDermott, Heidi Christensen
arXiv Computation and Language
Oct 1

Bongard: Training Machine Intuition

arXiv:2609.39111v1 Announce Type: new Abstract: Human intelligence relies heavily on learned intuition: recognising patterns and judging situations without explicitly unfolding every intermediate ste...

By Li Ding, Haidi Jin, Chen Ji