Retrieval-augmented generation

Retrieval pipelines, vector search, chunking and reranking: how models are grounded in a corpus instead of their weights.

6,124 stories · RSS feed

arXiv Computer Vision
3d ago

Latent space configuration for neural network finetuning, fast ranking, and embedding dimensionality reduction

The paper introduces Latent Space Configuration (LSC) for fine‑tuning neural networks, enabling the creation of structured latent spaces that accelerate top‑K retrieval with O(1) candidate search. Using ArcFace‑pretrained IResNet50 models, the authors demonstrate up to three‑fold GPU speed‑ups and 40% CPU speed‑ups over exhaustive search, while also showing that reducing latent space dimensionality further speeds up queries and can improve rank‑N metrics.

By Nikita Gabdullin, Anton Raskovalov
arXiv Machine Learning
3d ago

Structured Temporal Causality for Interpretable Multivariate Time Series Anomaly Detection

Structured Temporal Causality for Interpretable Multivariate Time Series Anomaly Detection introduces OracleAD, an unsupervised framework that encodes each variable’s past into a causal embedding to jointly predict the present and reconstruct the input window. The embeddings are projected via self‑attention into a shared latent space, capturing dynamic spatial relationships that are aligned to a Stable Latent Structure (SLS) representing normal-state relationships. Anomalies are detected through a dual scoring mechanism based on prediction error and deviation from the SLS, allowing fine‑grained diagnosis and root‑cause identification at the variable level.

By Dongchan Cho, Jiho Han, Keumyeong Kang, Minsang Kim, Honggyu Ryu, Namsoon Jung
arXiv AI
4d ago

Beyond the Prompt: Recovering Hidden Concepts in Text-to-Image Models

The paper introduces EmbGA, an embedding‑space genetic algorithm designed to uncover hidden concepts in text‑to‑image models that are not explicitly mentioned in prompts. Unlike existing prompt optimizers, EmbGA operates directly in token embedding space, using crossover and mutation to generate valid token sequences that align with unseen visual concepts. Experiments on two benchmarks show that EmbGA outperforms six other optimizers in alignment and token grounding, especially with larger exploration budgets, while also being faster than language‑model‑guided search.

By Zhengfeng Zheng, Minghong Fang
arXiv Machine Learning
4d ago

LocaLeJEPA: Maximum Entropy Representations under Geometric Priors

LocaLeJEPA extends Joint-Embedding Predictive Architectures (JEPA) by introducing a manifold-theoretic reformulation that aligns representation learning with non‑Euclidean geometric priors. It incorporates a locally Euclidean distribution‑matching regularizer, LocaLeReg, to stabilize training and scale to large models. Experiments on ImageNet‑1K show that LocaLeJEPA outperforms the original LeJEPA across both hyperbolic and Euclidean backbones, improving linear and k‑NN classification as well as downstream tasks.

By Kartik Tandon, Alessio Borgi, Pavel Snopov, In\'es Garc\'ia-Redondo, Davide D'Ascenzo, Sebastiano Cultrera di Montesano, Fabrizio Silvestri, Pietro Li\`o, Francesca Dominici, Randall Balestriero, Claudio Battiloro
arXiv Computation and Language
4d ago

When Is 0.1% Enough? Analyzing the Combined Effects of Dimensionality Reduction and Quantization on Text Embedding Compression

The paper investigates how dimensionality reduction and quantization together affect text embedding compression across four task families in the Massive Text Embedding Benchmark using five pretrained models. It finds that combining these techniques can preserve near-original performance while drastically reducing storage, with some classification models retaining at least 99% of their score using less than 0.1% of the original storage. The optimal trade‑off between dimensionality and bit‑width varies by task, with retrieval tasks being more sensitive to compression.

By Riku Kisako, Hayato Tsukagoshi, Ryohei Sasano
arXiv Computer Vision
4d ago

Only Train Once: Uncertainty-Aware One-Class Learning for Face Authenticity Detection

The paper introduces FADNet, a face authenticity detector that treats forgery detection as a one‑class classification problem, training only on authentic faces. It uses Evidential Deep Learning to measure uncertainty and a pseudo‑forgery generator to sharpen decision boundaries. Experiments on DF40 and ASFD show FADNet surpasses state‑of‑the‑art methods with 96.63% accuracy and 98.83% precision.

By Qingchao Jiang, Zhenxuan Hou, Zhiying Zhu, Zhenxing Qian, Xinpeng Zhang, Zaiwang Gu
arXiv Computer Vision
4d ago

DriveVLA-M0: Failure-Aware Memory Augmentation for Autonomous Driving

DriveVLA-M0 introduces a failure-aware latent memory system for Vision‑Language‑Action models in autonomous driving. It stores past failure cases with scene representations and expert trajectories, and uses a retrieval model to decouple static road structure from dynamic agent interactions. During inference, retrieved cases are injected via a lightweight LoRA‑based test‑time training mechanism, yielding significant performance gains on NAVSIM benchmarks with minimal latency overhead.

By Zebin Xing, Yupeng Zheng, Qiang Chen, Linbo Wang, Yichen Zhang, Pengxuan Yang, Junli Wang, Deheng Qian, Xiaoqing Ye, Junyu Han, Yifeng Pan, Qichao Zhang, Dongbin Zhao
arXiv Computer Vision
4d ago

CondenseVLA: Learnable History Condensation for Efficient Multi-Frame VLA

CondenseVLA introduces a learnable history‑condensation module that distills short‑term visual context into a fixed set of slot tokens via learnable queries and cross‑attention, reducing redundancy and improving action decoding. The approach achieves notable gains on several robot manipulation benchmarks, raising Simpler‑WidowX success from 58.7% to 69.8%, reaching 97.2% on LIBERO, 52.8% on real‑world tasks, and 21.6% on memory‑dependent RMBench tasks.

By Feiyang Hong, Yujie Wei, Bo Zhao, Xiu Su, Hongxun Yao, Shuo Yang