The paper introduces a multi-agent peer‑reviewed reasoning approach for medical question answering, where several large language models independently generate chain‑of‑thought explanations and then evaluate each other’s reasoning for factual correctness and logical soundness. The highest‑rated reasoning chain is used to produce the final answer. Experiments with five state‑of‑the‑art LLMs on three benchmark datasets show that this method consistently outperforms single‑model chain‑of‑thought reasoning and majority voting ensembles, achieving an average accuracy of 0.820 versus 0.777 for the best single model.
arXiv:2606. 15419v1 Announce Type: cross Abstract: Objective: To enhance the accuracy, interpretability, and robustness of large language models (LLMs) in medical question answering (MedQA).
arXiv:2607. 06452v1 Announce Type: cross Abstract: Biomedical question answering requires not only accurate extraction of information from scientific literature but also reliable integration of evidence across multiple documents.
The paper introduces an adaptive memory and reflection (AMR) multi‑agent system for medical question answering. Each agent has dedicated memory and uses reflection‑based feedback to retrieve relevant prior cases, improving reasoning. The system routes questions through solo, collaborative, or escalated workflows and includes consensus and ethical overseer modules, achieving strong performance on MedQA and MedMCQA datasets.
The paper reviews how Large Language Models (LLMs) are being adapted for medical reasoning, moving beyond single-step answers to systems that can systematically, transparently, and verifiably reason. It introduces a taxonomy of enhancement techniques, split into training-time methods such as supervised fine‑tuning and reinforcement learning, and test-time methods like prompt engineering and multi‑agent systems. The review examines their application across text, image, and code modalities in key clinical areas—diagnosis, education, and treatment planning—and tracks the shift in evaluation benchmarks from simple accuracy to more nuanced assessments of reasoning quality and visual interpretability.
arXiv:2610.08327v1 Announce Type: new Abstract: Large language models (LLMs) have shown promise in medical question answering and clinical reasoning, yet their improvement remains constrained by stat...
arXiv:2509. 02594v3 Announce Type: replace-cross Abstract: Evaluating large language models (LLMs) on their ability to generate high-quality, accurate, situationally aware answers to clinical questions requires going beyond conventional benchmarks to assess how these systems behave in complex, high-stakes clinical scenarios.
arXiv:2603. 03292v3 Announce Type: replace-cross Abstract: Large Language Models (LLMs) exhibit high reasoning capacity in medical question-answering, but their tendency to produce hallucinations and outdated knowledge poses critical risks in healthcare fields.
arXiv:2503. 07459v3 Announce Type: replace-cross Abstract: Complex medical reasoning requires integrating heterogeneous clinical evidence across multiple inference steps.
arXiv:2609.24480v1 Announce Type: cross Abstract: Deploying Large Language Models (LLMs) in healthcare requires robust performance across two complementary dimensions - diagnostic reasoning: the conv...
The paper introduces LLM‑PeerReview, an unsupervised ensemble method that selects the best response from multiple LLM-generated candidates by scoring each answer with several LLMs, aggregating those scores via averaging or a graphical model, and choosing the highest-scoring response. The approach is peer‑review inspired, transparent, and interpretable, and it outperforms the Smoothie‑Global model by 6.9%–7.3% across factual recall QA, math reasoning, and instruction‑following tasks. The authors also provide a curated benchmark suite of 12 ensemble methods evaluated on four datasets and three task families to aid reproducibility.
The paper introduces PrecepTron, a 32‑billion‑parameter language model fine‑tuned with low‑rank adaptation to evaluate clinical reasoning in large language models (LLMs) at a physician level. It also releases GRAND‑ROUNDS, a benchmark of 9,217 scored responses from 160 clinicians across seven studies. Using PrecepTron, the authors replicate key findings from major medical AI studies and explore new questions about LLM diagnostic accuracy, demonstrating that fine‑tuned models can provide consistent, scalable physician‑level scoring.
arXiv:2507. 02983v3 Announce Type: replace-cross Abstract: Large Language Models (LLMs) hold significant promise for transforming digital health by enabling automated medical question answering.