Retrieval-augmented generation

Retrieval pipelines, vector search, chunking and reranking: how models are grounded in a corpus instead of their weights.

6,299 stories · RSS feed

arXiv Computer Vision
Sep 23

MatchFusion: Explicit-Implicit Instance Matching for Spatio-Temporal Multimodal Autonomous Driving

MatchFusion is a learnable module that performs explicit-implicit instance matching for spatio‑temporal multimodal autonomous driving. It initializes pairwise affinities with geometric similarity and category consistency, then refines associations using instance embeddings to guide a residual aggregation operator for adaptive information exchange. Experiments on nuScenes show that MatchFusion improves perception accuracy, reduces FLOPs by 55.3% and GPU memory usage by 39.3%, and adds only 3.7% of total perception latency.

By Xiaoyu Li, Jiajia Fu, Long Shi, Tianyu Du, Ruihang Li, Xian Wu, Lijun Zhao, Yingtao Zhang, Lining Sun, Ruifeng Li
arXiv Computer Vision
Sep 23

COVER: Codec-Robust Video Watermarking with Generative Video Priors

COVER is a new video watermarking method that targets codec compression as its primary design goal. It embeds the watermark payload in the latent space of a frozen generative video autoencoder and recovers it by re‑encoding the received video into the same latent space. Using a differentiable codec surrogate bank, COVER achieves high bit accuracy across multiple codecs while keeping marked videos visually close to the originals.

By Yuxin Cao, Hao Yang, Ziqi Ding, Jie Hao, Wei Song
arXiv AI
Sep 23

Recidivism Prediction, Peer Effect Estimation, and Prediction-Powered Inference with LLM Text Measures

The paper introduces a framework for estimating peer effects using multivariate behavioral measures extracted from written text via a large language model (LLM). It demonstrates that LLM embeddings enhance out‑of‑sample recidivism prediction by up to 30% compared to pre‑entry covariates alone, and presents a novel instrumental variable estimator that is √N‑consistent for sparse networks with multidimensional latent homophily. By combining limited human annotations with LLM zero‑shot vectors, the authors develop a prediction‑powered peer inference method that yields de‑biased estimates and reveals significant peer effects in behavioral profiles.

By Shanjukta Nath, Jiwon Hong, Jae Ho Chang, Keith Warren, Subhadeep Paul
arXiv Computation and Language
Sep 23

BELXTR: Biomedical Entity Linking via Contextualized Token Retrieval

BELXTR is a new biomedical entity linking model that uses a multi‑vector (late interaction) architecture to preserve token‑level matching information, unlike traditional embedding‑based approaches that compress mentions into a single vector. By extending the XTR model with a task‑specific training objective and active query expansion, BELXTR achieves state‑of‑the‑art performance on half of ten evaluated corpora, with an average 5‑percentage‑point gain in recall@1. The model shows especially strong results on cross‑species gene disambiguation, outperforming an LLM‑powered retrieve‑and‑rerank pipeline and approaching a specialized rule‑based system.

By Samuele Garda, Ulf Leser
arXiv Computer Vision
Sep 23

What Drives Hierarchy-Aware Image Retrieval? Taxonomy Alignment, Objective Choice, and Geometry

The paper investigates why hierarchical image retrieval improves when using frozen DINOv2 features. It compares Euclidean and hyperbolic embeddings trained with taxonomy-distance regression or a taxonomy-aware supervised contrastive objective, finding that the choice of loss function (objective family) contributes more to hierarchy-aware performance than the geometry of the embedding space. Semantic alignment of the taxonomy also plays a significant role, while stronger negative curvature does not explain the gains.

By Ling Shi (Southeast University)
arXiv Computer Vision
Sep 23

Annual Earth-observation embeddings encode wildfire disturbance and support simplified burned area mapping

Annual Earth‑observation embeddings, specifically Tessera, can encode wildfire disturbance signals well enough to map burned areas without needing curated fire‑specific imagery or dense time‑series analysis. In tests, linear models using a single Tessera embedding matched or outperformed paired pre‑ and post‑fire HLS imagery and post‑fire imagery alone, achieving high F1 scores for burn‑scar delineation and regional mapping. The approach successfully mapped all same‑year fires in benchmark scenes, recovered 97% of California burned area without California training data, transferred to European fires with high accuracy, and even estimated ignition timing within a 13‑day error margin. "whyItMatters":"The study demonstrates that pre‑trained annual embeddings can simplify and scale burned‑area mapping, reducing reliance on dense time‑series data and enabling more efficient wildfire monitoring."

By Jovana Knezevic, Clement Atzberger, Zhengpeng Feng, Adam F. A. Pellegrini, Srinivasan Keshav, David Coomes
arXiv Machine Learning
Sep 23

Federating Quantum and Classical Computing: A Privacy-Preserving Hybrid Approach

arXiv:2609.25082v1 Announce Type: new Abstract: Quantum machine learning (QML) is increasingly recognized as one of the most promising near-term applications of quantum computing, viewed as a next-fr...

By Carlos Cano, Daniel M. Jimenez-Gutierrez, Diego Sal, Georgios Kellaris, Joaquin del Rio, Oleksii Sliusarenko, Xabi Uribe-Etxebarria
arXiv Machine Learning
Sep 23

Discovering Data Manifold Geometry through Geometric Properties

arXiv:2602.02611v2 Announce Type: replace Abstract: A prevailing paradigm in modern representation learning is the map-first approach, in which a representation map is learned from reconstruction, em...

By David Vigouroux (ANITI, IMT Atlantique - DSD, LaTIM), Lucas Drumetz (IMT Atlantique - MEE, Lab-STICC\_OSE, ODYSSEY), Ronan Fablet (IMT Atlantique - MEE, Lab-STICC\_OSE, ODYSSEY), Fran\c{c}ois Rousseau (IMT Atlantique - DSD, LaTIM)
arXiv Machine Learning
Sep 23

Financially Guided Deep Portfolio Optimization

arXiv:2605.28853v2 Announce Type: replace-cross Abstract: Portfolio optimization in real-world financial markets is notoriously difficult due to non-stationarity, noisy data, and high transaction cos...

By Rahul Fernandes, Travis Desell