arXiv AI
Horizon Scans can be accelerated using novel information retrieval and artificial intelligence tools
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Aug 24
ASTAR: Automated induction of STAndardized radiology Reporting templates from large-scale clinical free-text corpora
ASTAR is an LLM-based framework that automatically generates standardized radiology reporting templates from large-scale clinical free-text corpora, eliminating the manual, expert-driven template construction process. In experiments on 4,215 fetal brain MRI reports from multiple centers, ASTAR‑induced templates outperformed two expert‑curated templates in template coverage, information fidelity, diagnostic fidelity, and expert‑rated usability. The approach reduces template development time from weeks of committee deliberation to hours of automated processing.
arXiv Computation and Language
Oct 9
Clinician use of language models diverges from how the models are evaluated
Large language model assistants are being deployed to clinicians, but their readiness is judged mainly by benchmark scores that are based on examination questions or curated cases. This study analyzed 127,833 queries from 6,342 healthcare professionals across 35 specialties, finding that most requests were for documentation, administration, and knowledge retrieval, with a significant portion of queries unanswerable. When compared to 58 public benchmarks, the median benchmark lacked documentation requests and only shared 31% of the real task mix, indicating that current benchmarks poorly reflect actual clinical use.
arXiv AI
Sep 1
Standardizing Longitudinal Radiology Report Evaluation via Large Language Model Annotation
arXiv:2601.16753v2 Announce Type: replace-cross Abstract: Longitudinal information in radiology reports refers to the sequential tracking of findings across multiple examinations over time, which is...
arXiv Computation and Language
Oct 16
MeddeX: A Retrieval-Augmented LLaMA-3 System with Gemini Vision for Evidence-Backed Medical Report Analysis
MeddeX is a medical report analyzer that fuses a QLoRA‑fine‑tuned LLaMA‑3 (8B) model with Retrieval‑Augmented Generation and a Gemini Vision layer to produce concise, evidence‑backed summaries of medical documents. It processes text‑native PDFs, scanned PDFs, and radiological images via a hybrid extraction pipeline featuring a garbage‑text detection mechanism for corrupted or UTF‑16‑encoded files. The system adds report‑scoped retrieval, an automated longitudinal comparison engine, and a self‑healing backfill pipeline, and is backed by a FastAPI backend, Supabase vector store, and Next.js frontend. Evaluation shows significant gains over the base LLaMA‑3‑Med42‑8B model across ROUGE, BLEU, and BERTScore metrics, underscoring the value of domain‑specific fine‑tuning.
arXiv Computation and Language
Sep 22
Custom Named Entity Recognition and Topic Classification for Global Health Publications
This thesis explores how to select and adapt NLP models for global health literature when annotated data and computational resources are scarce. It compares skip‑gram word2vec models trained on increasingly large specialized corpora with BioWordVec for semantic tag discovery, finding that larger coverage does not always yield more useful domain associations. The study also evaluates convolutional spaCy models versus a RoBERTa transformer for named entity recognition, noting a trade‑off between higher F1 scores and longer inference time, and investigates MiniLM few‑shot versus BART‑MNLI zero‑shot classification for multi‑label topic classification, highlighting practical constraints of inference cost. "whyItMatters":"The work provides empirical guidance on balancing model accuracy and resource demands for building knowledge systems in low‑resource global health settings."
arXiv AI
Jul 9
Health System Scale Semantic Search Across Unstructured Clinical Notes
arXiv:2604. 25605v2 Announce Type: replace-cross Abstract: Introduction: Semantic search, which retrieves documents based on conceptual similarity rather than keywords, offers advantages for retrieval of clinical information.