arXiv AI August 6, 2026 By Anran Li, Lingfei Qian, Mengmeng Du, Yu Yin, Yan Hu, Zihao Sun, Yihang Fu, Hyunjae Kim, Erica Stutz, Xuguang Ai, Qianqian Xie, Rui Zhu, Jimin Huang, Yifan Yang, Siru Liu, Yih-Chung Tham, Lucila Ohno-Machado, Hyunghoon Cho, Zhiyong Lu, Hua Xu, Qingyu Chen

Memorization in Large Language Models in Medicine: Prevalence, Characteristics, and Implications

Read the original on arXiv AI →

arXiv:2509. 08604v5 Announce Type: replace-cross Abstract: Large Language Models (LLMs) have demonstrated significant potential in medicine, with many studies adapting them through continued pre-training or fine-tuning on medical data to enhance domain-specific accuracy and safety.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning

Sep 22

Didactic knowledge or Clinical Cases? How Data Types Shape Medical Large Language Models

arXiv:2609.22161v1 Announce Type: cross Abstract: Medical large language models are commonly trained on mixtures of didactic data (e.g., textbooks) and clinical data (e.g., patient records), yet how...

By Yuzheng Fan, Haochun Wang, Sendong Zhao, Xiao Han, Ming Ma, Bing Qin

llms

arXiv AI

Jun 2

On the Limits of LLM Adaptability: Impact of Model-Internalized Priors on Annotation Task Performance

arXiv:2606. 00467v1 Announce Type: cross Abstract: Large Language Models (LLMs) are increasingly used for zero-shot annotation and LLM-as-a-judge tasks, yet their reliability hinges on how model-internalized priors interact with user-provided instructions.

By Etienne Casanova, Rafal Kocielnik, R. Michael Alvarez

llms rag safety

arXiv Machine Learning

Sep 16

Memorisation bias in medical AI

arXiv:2609.17223v1 Announce Type: new Abstract: Medical AI models hold immense potential to improve patient outcomes, but they are also known to unintentionally memorise individual records from their...

By Moritz A. Knolle, Martin J. Menten, Laurin Lux, M\'elanie Roschewitz, Emma A. M. Stanley, Georgios Kaissis, Daniel Rueckert, Ben Glocker

safety

arXiv AI

Jun 8

When Large Language Models Fail in Healthcare: Evaluating Sensitivity to Prompt Variations

arXiv:2606. 07237v1 Announce Type: cross Abstract: Large Language Models (LLMs) are increasingly used in healthcare for tasks such as clinical question answering, diagnosis support, and report summarization.

By Mahdi Alkaeed

llms nlp benchmarks safety

arXiv Computation and Language

3d ago

MedKIT: Evaluating Knowledge Integration and Generalization in Large Language Models

arXiv:2609.38543v1 Announce Type: new Abstract: Constantly evolving real-world knowledge necessitates models to be updated continuously. Especially in medicine, as clinical evidence changes over time...

By Lukas Thede, Yash Kumar Atri, David Chen, Danielle Bitterman, Matthias Bethge, Tom Hartvigsen, Zeynep Akata

llms benchmarks safety

arXiv AI

Jun 8

REMEDI: A Benchmark for Retention and Unlearning Evaluation in Multi-label Clinical Disease Inference

arXiv:2606. 07141v1 Announce Type: cross Abstract: Language models trained for clinical disease inference are trained on patient data, which may include sensitive and private information, and data owners may request the removal of their data from a trained model due to privacy or copyright concerns.

By Anurag Sharma, Sai Teja Chunchu, Prasenjit Mitra, Sandipan Sikdar, Koustav Rudra

llms benchmarks safety

One email a morning, machine-written

Related stories

Didactic knowledge or Clinical Cases? How Data Types Shape Medical Large Language Models

On the Limits of LLM Adaptability: Impact of Model-Internalized Priors on Annotation Task Performance

Memorisation bias in medical AI

When Large Language Models Fail in Healthcare: Evaluating Sensitivity to Prompt Variations

MedKIT: Evaluating Knowledge Integration and Generalization in Large Language Models

REMEDI: A Benchmark for Retention and Unlearning Evaluation in Multi-label Clinical Disease Inference