Retrieval-augmented generation

Retrieval pipelines, vector search, chunking and reranking: how models are grounded in a corpus instead of their weights.

6,126 stories · RSS feed

arXiv Computer Vision
Oct 7

RPA: Residual Patch-Token Adapter for Image Retrieval from EEG and MEG

The paper introduces the Residual Patch Adapter (RPA), a lightweight module that aligns EEG and MEG signals with all patch tokens from an intermediate layer of a Vision Transformer, rather than a single global embedding. Ablation studies show that retaining the full set of patch tokens is crucial for effective alignment, while the CLS token adds little value. Using RPA, the authors achieve state‑of‑the‑art Top‑1 accuracies on THINGS‑EEG2 and THINGS‑MEG datasets, and demonstrate that the approach generalizes to other brain encoders and can be swapped with various neural network backbones.

By Yuhui Jin, Yonghao Song, Bingchuan Liu
arXiv Statistics ML
Oct 7

Spectral Recovery of Point Clouds from Noisy Geometric Graphs

The paper investigates how to recover low‑dimensional latent geometry from a random geometric graph built from noisy, high‑dimensional data. It analyzes a spectral embedding algorithm on the Signal+Noise Graph Model, where vertices are perturbed points and edges are added when their inner product exceeds a threshold. In the regime where both the number of points and ambient dimension grow, the authors prove that, under a spectral gap condition, the leading eigenvectors and eigenvalues of the adjacency matrix can approximately recover the original point cloud up to an orthogonal transformation, and demonstrate the method on nested spheres and high‑dimensional sinusoid curves.

By Tatiana Brailovskaya, Nicholas A. Cook, Sofia Poinelli
arXiv AI
Oct 7

RA-MoWE: Workflow-Affinity Embeddings for Query Clustering and Agentic Workflow Generation

RA-MoWE introduces workflow‑affinity embeddings to cluster queries and guide the creation of reusable expert workflows for large language models. Each embedding captures how well a set of reference workflows solves a query, revealing common reasoning strategies. The framework uses cluster embeddings to initialize and refine specialized workflows, and an encoder predicts embeddings from query text, enabling efficient expert selection without executing reference workflows.

By Qi Cheng, Shengyu Chen, Wei Cheng, Yiqun Xie, Haoyu Wang, Haifeng Chen, Xiaowei Jia
arXiv AI
Oct 7

WorkflowOps: Learning Agent Collaboration Priors for Multi-Agent Workflow Orchestration

WorkflowOps is a multi‑agent workflow orchestration framework that learns collaboration priors from historical workflows. It uses a transition probability matrix to guide DAG construction, a sufficiency‑driven loop to create new agents on demand via an LLM, and a layered semantic matching strategy to reduce LLM calls. Experiments show that WorkflowOps improves end‑to‑end pass rates, especially on structured, decomposable tasks.

By Qi Cheng, Shengyu Chen, Wei Cheng, Zhengzhang Chen, Xiaowei Jia, Haoyu Wang, Haifeng Chen
arXiv AI
Oct 7

Jailbreaking Open-Weight LLMs via Random Embedding Perturbations

arXiv:2610.07125v1 Announce Type: cross Abstract: While open-weight models have enjoyed steady progress in capabilities and wide adoption across multiple domains, their safety remains an important co...

By Abhinav Sudhakar Dubey (University of California Santa Cruz), Scott Sirri (University of California Santa Cruz), Vaggos Chatziafratis (University of California Santa Cruz), C. Seshadhri (University of California Santa Cruz)
arXiv AI
Oct 7

TICDA: Tabular In-Context Data Attribution

arXiv:2610.07996v1 Announce Type: cross Abstract: Tabular foundation models (TFMs) achieve strong predictive performance by conditioning on labeled demonstrations provided in context, without any par...

By Yacine Benihaddadene, Milan Bhan, Eliot Dugelay, Mohammed Jawhar, Benjamin Wong, Nicolas Chesneau, Duong Nguyen
arXiv AI
Oct 7

Aligning LLMs with Biomedical Knowledge using Balanced Fine-Tuning

arXiv:2511.21075v4 Announce Type: replace-cross Abstract: Engineering LLMs to accelerate life sciences research requires a robust alignment with biomedical knowledge. We observe that biomedical text...

By Zhenchao Tang, Fang Wang, Haohuai He, Jiale Zhou, Tianxu Lv, Jun Zhu, Shouzhi Chen, Minghao Yang, Yu Wang, Jiayang Wu, Yidong Song, Yaokun Li, Jiehui Huang, Jun Zhou, Bing He, Jianhua Yao