arXiv AI
3d ago

Latent Abstraction for Retrieval-Augmented Generation

The paper introduces LAnR (Latent Abstraction for Retrieval-Augmented Generation), a unified framework where a single large language model jointly encodes, retrieves, and generates within its latent space. Instead of generating natural language queries, LAnR produces dense retrieval vectors from a designated [PRED] token and matches them against encoded document representations from the same model. An adaptive MLP control head decides when sufficient evidence has been retrieved, eliminating the need for a separate retriever and explicit token-level stopping reasoning. Experiments on six QA benchmarks show that LAnR outperforms existing RAG methods while improving inference efficiency by reducing retrieval calls and tightening model integration.

By Ha Lan N. T, Minh-Anh Nguyen, Dung D. Le
arXiv Machine Learning
Sep 21

Beyond WER: Entity and Disfluency Recall in Accented Conversational ASR

The paper introduces a three‑stage pipeline to improve accented conversational ASR for speakers from India, Indonesia, and Latin America. It uses heuristic SQL filters to curate entity‑rich training data, regional LoRA adapters fine‑tuned on Qwen2.5‑Omni‑3B to generate both verbatim and corrected transcripts, and a six‑category error taxonomy validated by an LLM judge. The approach raises entity recall to 80‑85% and filler recall to 76‑86%, while keeping WER low (6‑10%) and outperforming Whisper and a commercial ASR on entity recall.

By Fiza Husain, Ankit Pandey, Yash Singh
arXiv AI
Jun 30

XRAG: eXamining the Core -- Benchmarking Foundational Components in Advanced Retrieval-Augmented Generation

arXiv:2412. 15529v4 Announce Type: replace-cross Abstract: Retrieval-augmented generation (RAG) synergizes the retrieval of pertinent data with the generative capabilities of Large Language Models (LLMs), ensuring that the generated output is not only contextually relevant but also accurate and current.

By Qili Zhang, Qianren Mao, Yangyifei Luo, Yashuo Luo, Hanwen Hao, Zhilong Cao, Weifeng Jiang, Zhijun Chen, Junnan Liu, Feng Yan, Xiaolong Wang, Jinlong Zhang, Zhenting Huang, Zhixing Tan, Jie Sun, Bo Li, Jianxin Li, Philip S. Yu