Hugging Face Trending Papers

How Ground Truth Shapes Retrieval Scores: Evidence-Aware Evaluation of a Retrieval-Augmented Generation System for Breast Lesions

Read the original on Hugging Face Trending Papers →

The study presents an evidence‑aware evaluation protocol for a retrieval‑augmented generation system focused on breast lesion management literature. Using an 18‑document corpus and 18 queries, the authors compared dense embeddings, BM25, and cross‑encoder reranking across various chunk sizes and overlaps, finding that a hybrid retriever with 384‑token chunks and 20% overlap achieved top‑three evidence retrieval for 17 of 18 queries and high recall and precision metrics. Ground‑truth curation expanded evidence spans and accepted chunk targets, demonstrating that annotation coverage significantly affects retrieval performance.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at Hugging Face Trending Papers.

arXiv Computation and Language
Oct 23

How Ground Truth Shapes Retrieval Scores: Evidence-Aware Evaluation of a Retrieval-Augmented Generation System for Breast Lesions

The study introduces an evidence-aware evaluation protocol for a retrieval‑augmented generation system focused on breast lesion management literature. Using an 18‑document corpus and 18 queries, the authors compared dense embeddings, BM25, and cross‑encoder reranking across various chunk sizes and overlaps, finding that a hybrid retriever with 384‑token chunks and 20% overlap achieved top‑three retrieval success for 17 of 18 queries and high recall and precision metrics. Expanding ground‑truth relevance annotations increased recognized evidence spans and accepted chunk targets, though retrieval rankings remained unchanged, underscoring the sensitivity of evaluation to annotation coverage.

By Miguel Mochizuki Silva, Samuel Ismael, Mateus C. Dias, Tha\'is Gaud\^encio, Yuri Malheiros, Barufaldi
Hugging Face Trending Papers
Jul 30

CXR-Retrieve: Compositional Text-to-Image Retrieval in Chest Radiography

Large chest radiography archives are difficult to search because most studies are paired only with free-text reports rather than structured clinical annotations. Vision-language models offer a natural interface for text-to-image retrieval, but current biomedical models are primarily optimized for report-to-image matching rather than for satisfying short clinical search queries.

arXiv AI
Jul 20

Ruling Out to Rule In: Contrastive Hypothesis Retrieval for Medical Question Answering

arXiv:2604. 04593v2 Announce Type: replace-cross Abstract: Retrieval-augmented generation (RAG) grounds large language models in external medical knowledge, yet standard retrievers frequently surface hard negatives that are semantically close to the query but describe clinically distinct conditions.

By Byeolhee Kim, Min-Kyung Kim, Young-Hak Kim, Tae-Joon Jeon
arXiv Computation and Language
Aug 28

Assessing the Downstream Utility of Evidence-Aware Retrieval in RAG

The paper investigates whether incorporating an evidence-support signal into retrieval evaluation for retrieval‑augmented generation (RAG) improves downstream decision‑making. Across multiple benchmarks and a TREC RAG 2025 setting, the evidence signal alters retriever rankings but its benefits vary: it does not consistently enhance retriever training, its usefulness for system selection depends on generator instructions, and it does not reliably predict answer quality on unseen topics. Human filtering of evidence‑rich passages preserves useful content, yet evaluators disagree on whether this improves final answers, indicating that evidence‑aware evaluation alone does not guarantee better downstream outcomes.

By Utshab Kumar Ghosh, Debayan Mukhopadhyay, Shubham Chatterjee