arXiv AI
DL$^3$M: A Vision-to-Language Framework for Expert-Level Medical Reasoning through Deep Learning and Large Language Models
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Computation and Language
4d ago
PathKGen: Pathology Knowledge Assisted MLLM for Explainable Histopathology
arXiv:2610.33691v1 Announce Type: cross Abstract: Whole Slide Image (WSI) analysis serves as the fundamental method for the clinical diagnosis of cancer in digital histopathology. Recent advances in...
arXiv AI
Oct 19
Frozen Models, Evolving Expertise: Model-Agnostic Learning from Deployment Experience for Multimodal Medical AI
The paper introduces a model‑agnostic framework that lets frozen large language models (LLMs) and vision‑language models (VLMs) learn from deployment experience without retraining. It does so by adding three external expertise components—a Skill for guiding reasoning and tool use, a Knowledge Memory for storing reliable facts, and a Multimodal Knowledge Base for visual examples—and by using a validation strategy that updates only when new cases improve performance without harming past performance. Experiments on six benchmarks with both open‑weight and closed‑source models show up to a 34.2% performance gain on medical tasks, generalization to unseen cases, and transferability to other models and non‑medical domains.
arXiv AI
Sep 17
A visual large language foundational model for medical image recognition using clinician-contributed online resources
The paper introduces ThoughtMed-1M, a large-scale medical visual question answering dataset built from de‑identified images and clinician‑generated commentaries, designed to capture structured clinical reasoning and image‑text alignment. Using this dataset, the authors train FOLTMed, a foundational large language model that achieves state‑of‑the‑art performance on 42 medical VQA benchmarks, with a macro accuracy of 85.4% and improved factuality and similarity metrics over existing models.
arXiv AI
Sep 10
A visual large language foundational model for medical image recognition using clinician-oriented social media
arXiv:2609.06914v1 Announce Type: new Abstract: Large language models (LLMs) have demonstrated strong capabilities across diverse domains, showing considerable potential in medicine. However, their a...
arXiv AI
Sep 21
LiteMedCoT-VL: Parameter-Efficient Adaptation for Medical Visual Question Answering
LiteMedCoT-VL is a parameter‑efficient pipeline that transfers chain‑of‑thought reasoning from a 235B teacher model to a 2B student model using LoRA fine‑tuning on explanation‑enriched data. The approach enables a compact vision‑language model to perform medical visual question answering without relying on image captions, achieving 64.9% accuracy on the PMC‑VQA benchmark—an 11‑point improvement over the zero‑shot Qwen3‑VL‑4B baseline. Visual grounding analysis confirms that the model bases its predictions on image content rather than textual priors.
arXiv Machine Learning
Jun 17
Beyond Visual Cues: CoT-Enhanced Reasoning for Semi-supervised Medical Image Segmentation
arXiv:2606. 17958v1 Announce Type: cross Abstract: Semi-supervised medical image segmentation has emerged as a dominant research problem in medical image analysis, mitigating annotation scarcity by leveraging consistency regularization on unlabeled data.