Retrieval-augmented generation

Retrieval pipelines, vector search, chunking and reranking: how models are grounded in a corpus instead of their weights.

6,183 stories · RSS feed

arXiv AI
Oct 2

Geometry-Aware Adaptation for Pretrained Models

arXiv:2307.12226v3 Announce Type: replace-cross Abstract: Machine learning models -- including prominent zero-shot models -- are often trained on datasets whose labels are only a small proportion of...

By Nicholas Roberts, Xintong Li, Dyah Adila, Sonia Cromp, Tzu-Heng Huang, Jitian Zhao, Frederic Sala
arXiv AI
Oct 2

Reshape and Recur: Improving SSMs with Input Reshaping and Depth Recurrence

The paper proposes two extensions to State Space Models (SSMs) to reduce memory usage and improve performance. First, it introduces depth recurrence, allowing a looped SSM with fewer parameters to match the performance of a larger, non-recurrent model. Second, it advocates using a fixed time granularity across tasks by reshaping input sequences, which enhances how information is presented to the model. Both techniques consistently benefit four representative SSM architectures (LRU, S5, LinOSS, LrcSSM).

By M\'onika Farsang, Ramin Hasani, Daniela Rus, Radu Grosu
arXiv AI
Oct 1

Spatio-Temporal Partial Sensing Forecast for Long-term Traffic

The paper introduces the Spatio-temporal Long-term Partial sensing Forecast model (SLPF) for predicting long-term traffic when sensors are only available at some locations. It tackles challenges such as unknown data distribution at unsensed sites, complex spatio-temporal correlations, and noise by employing a rank-based embedding, a spatial transfer matrix, and a multi-step training process. Experiments on real-world datasets show that SLPF outperforms existing methods.

By Zibo Liu, Zhe Jiang, Zelin Xu, Tingsong Xiao, Zhengkun Xiao, Yupu zhang, Haibo Wang, Shigang Chen
arXiv AI
Oct 1

Diffusion-Augmented Markov Decision Processes for Maximum Entropy Reinforcement Learning

The paper introduces Diffusion-Augmented Markov Decision Processes (DA‑MDPs), a framework that extends Maximum Entropy Reinforcement Learning to diffusion-based policies. DA‑MDPs treat each reverse‑diffusion step as an RL decision, deriving a tractable reverse‑KL bound that decomposes across denoising transitions and yields diffusion‑augmented soft rewards, value functions, and policy objectives. The authors implement this framework with PPO, REPPO, and a maximum‑entropy WPO variant, showing improved continuous‑control performance, higher success rates on manipulation tasks, and memory‑efficient training with action chunking.

By Sebastian Sanokowski, Kaustubh Patil, Majid Khadiv
arXiv Computer Vision
Oct 1

SheafStain: Sheaf-Theoretic Schr\"odinger Bridge for Spatially and Biologically Coherent Virtual Staining

SheafStain introduces a sheaf-theoretic Schr"odinger Bridge framework to improve virtual staining of gigapixel whole-slide images. By treating Vision Foundation Model features as sheaf-like sections, it integrates class and patch tokens to enforce spatial and biological coherence, mitigating patch-boundary artifacts. The method is evaluated on HER2, ER, PR, and Ki‑67 stains, outperforming six prior approaches on stitched 1024 × 1024 outputs.

By Hyeongyeol Lim, Hongjun Yoon, Eunjin Jang, Daeky Jeong, Won June Cho, Hwamin Lee
arXiv AI
Oct 1

LogiC-Diff: Embedding Security Properties Into AI-Enabled Cyber-Physical Systems

The paper introduces LogiC-Diff, a logic-conditioned bi-stage diffusion framework that embeds Signal Temporal Logic (STL) specifications into AI-enabled cyber‑physical system (CPS) forecasting models. By using STL as a conditioning signal, the method repairs inputs and refines outputs to jointly mitigate adversarial perturbations and enforce desired temporal behaviors. Experiments on two real‑world CPS datasets show that LogiC-Diff consistently improves robustness and specification compliance across various sensor faults and cyber attacks, outperforming reconstruction‑based defenses.

By Ziyan An, John Stankovic, Meiyi Ma
arXiv AI
Oct 1

GATE-ST: Gene-Aware Text-image Encoder for Spatial Transcriptomics

GATE-ST is a gene-aware text-image encoder that enhances spatial transcriptomics predictions by integrating gene descriptions into image-based models. The method encodes gene summaries with a text encoder and fuses these embeddings with image features via cross‑attention, aligning them with morphological cues. Benchmarks show GATE‑ST outperforms random gene embeddings and other image‑text fusion architectures, indicating its potential to improve accuracy while reducing time and cost in spatial gene expression analysis.

By Lucas Ni, Jian Luo, Wentao Huang, Chao Chen