arXiv Machine Learning By Alexander Romanus, Mehul Shetty, Connor Jordan

Quantifying Symptom Causality in Clinical Decision Making: An Exploration Using CausaLM

Read the original on arXiv Machine Learning →

The paper investigates the causal impact of the symptom "chest pain" on medical diagnosis predictions, moving beyond traditional correlation-based methods. Using the CausaLM framework, the authors generate counterfactual text representations that effectively remove the symptom, allowing for a principled estimation of its causal effect on disease predictions. They apply Textual Representation-based Average Treatment Effect (TReATE) to quantify how the presence or absence of chest pain shapes diagnostic outcomes, and compare these results to correlation-based baselines such as CONEXP, providing deeper insight into the decision-making behavior of clinical NLP models.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Sep 2

Medical Causal Hypothesis Verification with Large Language Models

The paper "Medical Causal Hypothesis Verification with Large Language Models" reports a small-scale study evaluating eight LLMs on 17 medical causal hypotheses. The authors introduce an evaluation framework and annotate 1,067 evidence points across six criteria, using nine metrics to assess performance. Results show that while LLMs have strong recall, they frequently fail to provide valid scientific articles, evidence, or reject unsupported hypotheses, revealing a critical limitation for their use in healthcare.

By Safiyyah Ahmed, Abrar Ansari, Md Aminul Islam, Elena Zheleva