arXiv AI
Iterative Multimodal Retrieval-Augmented Generation for Medical Question Answering
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Oct 16
Loud and Clear: Making Visual Evidence Count in Multimodal Document RAG
The paper introduces Loud and Clear (LoC), a method that enhances multimodal document retrieval-augmented generation by fully utilizing visual token capacity and refining retrieved pages to highlight evidence. LoC combines higher-resolution pages with OCR of query-relevant regions, achieving significant accuracy gains over eight prior methods on multiple benchmarks. The study demonstrates that the way retrieved pages are presented to the generator is a critical bottleneck beyond retrieval itself.
arXiv AI
Oct 12
Locate, Judge, Read: Role-Specialized Tool Agents over a Knowledge-Point Index for Open-Domain Multimodal Document QA
KnowForge is a modular pipeline for open‑domain multimodal document question answering that separates retrieval, judging, and reading into distinct agents. It uses a hybrid‑retrieval knowledge‑point index, a Locator agent for searching, a Bridge Judge to enforce a second hop, a Deep Reader that handles text, images, and tables, and a synthesizer with format checking. On the M3DocVQA benchmark it achieves an F1 of 47.5, outperforming prior systems by 11 points, and shows strong gains on MultiHop‑RAG and MMLongBench‑Doc as well.
arXiv AI
Sep 2
MIDR: Enrichment-Augmented Indexing for Multimodal Document Retrieval
MIDR (Multimodal Indexing for Document Retrieval) is a training‑free framework that enriches document indexes by converting rendered pages into verified textual fields with a multimodal LLM, then indexing those fields with BM25F and optionally fusing with dense retrieval. By shifting multimodal reasoning to index time, MIDR enables text‑centric serving while retaining multimodal evidence, achieving a 23.0% relative gain over BM25 on ViDoRe V3 and outperforming ColQwen2.5 on several domains with significantly smaller index memory and lower query latency.
arXiv AI
Jul 29
Multimodal Hybrid Retrieval-Augmented Generation for Scientific Document Understanding using Open-Source SLMs
arXiv:2607. 24799v1 Announce Type: cross Abstract: Large Language Models tend to hallucinate when answering domain-specific ques tions from scientific documents without prior fine-tuning.
arXiv AI
Oct 15
VL-DocIR: A Benchmark for Vision-Based Long Document Information Retrieval
arXiv:2610.17057v1 Announce Type: new Abstract: Vision-based document retrieval has improved rapidly, but current evaluation settings still emphasize short documents and single relevant pages. This l...
arXiv Computation and Language
Oct 16
MeddeX: A Retrieval-Augmented LLaMA-3 System with Gemini Vision for Evidence-Backed Medical Report Analysis
MeddeX is a medical report analyzer that fuses a QLoRA‑fine‑tuned LLaMA‑3 (8B) model with Retrieval‑Augmented Generation and a Gemini Vision layer to produce concise, evidence‑backed summaries of medical documents. It processes text‑native PDFs, scanned PDFs, and radiological images via a hybrid extraction pipeline featuring a garbage‑text detection mechanism for corrupted or UTF‑16‑encoded files. The system adds report‑scoped retrieval, an automated longitudinal comparison engine, and a self‑healing backfill pipeline, and is backed by a FastAPI backend, Supabase vector store, and Next.js frontend. Evaluation shows significant gains over the base LLaMA‑3‑Med42‑8B model across ROUGE, BLEU, and BERTScore metrics, underscoring the value of domain‑specific fine‑tuning.