Retrieval-augmented generation

Retrieval pipelines, vector search, chunking and reranking: how models are grounded in a corpus instead of their weights.

6,299 stories · RSS feed

arXiv AI
Sep 16

AntennaFlow: A Generative Flow Model for Offset Correction in Phaseless Antenna Testing

AntennaFlow is a three‑stage generative flow model that jointly addresses costly phase acquisition and offset‑mounting violations in near‑field to far‑field antenna testing. It learns an offset‑invariant embedding of amplitude fields, transports offset amplitudes to a center‑aligned field, and applies a simplified extrapolation technique valid only for centered fields. Experiments demonstrate fast, phaseless, offset‑vector‑free NF–FF reconstruction from sparse amplitude‑only measurements, outperforming existing baselines while preserving physical consistency.

By Yongzhi Li, Chongting Shen, Menglin Chen, Xun Jiang, Zhengpeng Wang
arXiv Machine Learning
Sep 16

LLM Inference in a Flash!

The paper "LLM Inference in a Flash!" proposes an integer‑only quantization scheme and a dictionary‑based KV cache compression technique to enable large language model inference on compute‑in‑flash (CIF) devices. By eliminating floating‑point operations and reducing KV cache traffic through sparse dictionary coding, the authors achieve minimal accuracy loss while cutting dynamic KV cache traffic by 15× on Llama‑3.1‑8B and Qwen‑2.5‑7B models.

By Sebastian Zhao, Minseo Kim, Coleman Hooper, Luca Manolache, Michael W. Mahoney, Yakun Sophia Shao, Kurt Keutzer, Amir Gholami
arXiv AI
Sep 16

CLIP Embeddings for AI-Generated Image Detection: A Few-Shot Study with Lightweight Classifier

The paper explores whether CLIP embeddings can detect AI-generated images by using a frozen CLIP model to extract visual embeddings and training lightweight classifiers on top. On the CIFAKE benchmark, the approach achieves 95% accuracy without language reasoning, and 85% accuracy after few-shot adaptation with 20% of the data. Certain image types, such as wide-angle photographs and oil paintings, remain challenging, highlighting unexplored difficulties in AI-generated image classification.

By Ziyang Ou
arXiv Computer Vision
Sep 16

Accelerated Decoding of Centroid Positional Encoding for Instance Segmentation

arXiv:2609.16874v1 Announce Type: new Abstract: Beyond model inference, the decoding stage, which converts raw network outputs into task-level representations, constitutes a significant portion of th...

By Carmelo Scribano, Filippo Muzzini, Nedyalko Prisadnikov, Mohammad Mahdi, Yuqian Fu, Giorgia Franchini, Danda Pani Paudel, Marko Bertogna, Luc Van Gool
arXiv Machine Learning
Sep 16

Crash Narrative-Guided Countermeasure Recommendation Using Large Language Models: A Retrieval-Augmented Generation Framework for Intersection Safety

arXiv:2609.15997v1 Announce Type: cross Abstract: Improving safety at intersections requires identifying crash mechanisms and recommending appropriate countermeasures. However, this process tradition...

By Abu Saif Md Nasim Uddin, Mohamed Abdel-Aty, Zubayer Islam, Parvez Anowar, Chenzhu Wang
arXiv AI
Sep 16

Multimodal Cultural Heritage Architectural Style Classification for Residential Buildings in the UAE Based on CLIP Embeddings and SVM

The paper presents a multimodal machine learning framework that classifies Emirati residential architectural styles by combining visual features from images and textual descriptions using OpenAI's CLIP model. The unified 512‑dimensional embeddings are reduced with UMAP, clustered with K‑Means, and then used to train an SVM classifier, achieving a 98% accuracy across eight style clusters. This approach outperforms previous studies and demonstrates the value of integrating visual and textual data for cultural heritage analysis.

By Ahmed Ammar Kubba, Manar Abu Talib, Iman Ibrahim, Qassim Nasir
arXiv AI
Sep 16

RAG-CT: Mitigating Privacy Risks on Retrieval-Augmented Generation Systems via Scanning Prompt Distribution

RAG-CT is a defense mechanism designed to protect Retrieval-Augmented Generation (RAG) systems from leaking personally identifiable information (PII). It works by detecting malicious queries through analysis of entropy and margin distributions, applying a score-based detection method. Experiments across four attack strategies and four baseline defenses on two datasets show that RAG-CT significantly reduces PII leakage while outperforming existing defenses, all without altering the underlying LLM or retriever.

By Xingyu Lyu, Jiayimei Wang, Jianfeng He, Ning Wang, Yidan Hu, Yimin Chen
arXiv AI
Sep 16

Same Answer, Different Representations: Hidden instability in VLMs

arXiv:2602.06652v2 Announce Type: replace Abstract: The robustness of Vision Language Models (VLMs) is commonly assessed through output-level invariance, implicitly assuming that stable predictions r...

By Farooq Ahmad Wani, Alessandro Suglia, Rohit Saxena, Aryo Pradipta Gema, Wai-Chung Kwan, Fazl Barez, Maria Sofia Bucarelli, Fabrizio Silvestri, Pasquale Minervini
arXiv Computer Vision
Sep 16

InfoTaxa: Information-Calibrated Label-Free Clustering for Fine-Grained Visual Taxonomy

InfoTaxa presents an information‑calibrated, label‑free clustering approach for fine‑grained visual taxonomy, using frozen pretrained visual embeddings and DNA as an audit signal. On the BIOSCAN‑5M dataset, the method achieves 0.79 AMI at family and 0.67 at genus, outperforming prior image baselines and matching oracle‑K and graph‑based methods. The study shows that while clustering efficiency recovers most image‑available information at higher taxonomic ranks, species‑level performance remains limited by both clustering and representation, with DNA adding significant predictive value.

By David Ahmedt-Aristizabal, Mohammad Ali Armin, Lars Petersson
arXiv Computation and Language
Sep 16

NepKANUN: A RAG-Based Nepali Legal Assistant

The paper introduces NepKANUN, an AI-powered legal assistant designed specifically for Nepali legal texts. Built on a fine‑tuned large language model and integrated into a Retrieval‑Augmented Generation (RAG) framework, it delivers precise answers to natural language legal queries. Evaluated with BERTScore, the system achieved strong F1 scores of 0.82, 0.77, and 0.71 across simple, moderate, and complex question categories, and expert reviews confirm its usability.

By Bhabuk Thapa, Prasiddha Koirala, Ranjit Raut, Sunil Regmi, Bal Krishna Bal
arXiv Computation and Language
Sep 16

Where Post-Training Quantization Breaks Text Embedders: A Measured Map Across Four Embedder Families

arXiv:2609. 16391v1 Announce Type: cross Abstract: Weight-only post-training quantization is the cheapest way to shrink a retrieval embedder, and the received advice for applying it -- protect the embedding table, allocate bits by module sensitivity, prefer a ranking-aware objective over weight reconstruction -- was carried into LLM quantization largely intact.

By Hyojung Han
arXiv Computer Vision
Sep 16

Multi-modal Knowledge Preserving Adapter for Embedding Backward Compatibility

The paper introduces the Multi-modal Knowledge Preserving Adapter (MKP-Adapter), an adapter-only approach that enables backward compatible training for multi-modal large language models without updating the backbone. It employs a multi-level preservation loss to maintain embedding geometry and a focal re-weighting strategy to focus on difficult samples. Experiments show strong backward compatibility across image, text, visual document, and video retrieval tasks with minimal latency overhead.

By Jaeseok Byun, Gukyeong Kwon, Han-Kai Hsu, Meher Gitika Karumuri, Zhikang Zhang, Hao Yang, Davide Modolo