arXiv AI

From Visual Attribution to Clinical Reasoning: Explainable Parkinson's Disease Screening from Hand-Drawn Patterns

Hugging Face Trending Papers
Jun 25

TraMP-LLaMA: Generative Interpretability with Decoupled Instruction Tuning for Facial Expression Quality Assessment

Existing facial expression quality assessment (FEQA) methods typically produce only a severity score, without explicitly communicating the observable facial motion evidence that supports the prediction. This limits interpretability and makes it difficult to inspect the basis of model outputs in Parkinson's disease assessment.

arXiv Computer Vision
Sep 10

Freezing of Gait Prediction Under Spatial Occlusion: An IMU-Supervised Cross-Modal Distillation Approach

The paper introduces a cross‑modal distillation framework that combines the accuracy of inertial measurement unit (IMU) data with the practicality of video‑based gait analysis to detect freezing of gait (FOG) in Parkinson’s patients. By extracting invariant latent topologies from a pre‑trained kinematic oracle, the method supervises a visual architecture and fuses skeletal graph nodes with continuous spatial pixels to handle severe spatial occlusion during continuous 360° turns. Experiments on a public multimodal dataset show that this approach reduces tracking entropy and achieves precise FOG predictions without requiring wearable sensors.

By Chandan Biswas, Aryan Singh, Anabik Pal
arXiv Machine Learning
Jul 2

Explainability in mulimodal deep transformation models for stroke outcome prediction

arXiv:2504. 06299v2 Announce Type: replace-cross Abstract: Multimodal prediction models based on imaging and clinical data are increasingly used for clinical decision support, yet their interpretability remains limited.

By Lisa Herzog, Jonas Br\"andli, Maurice Schneeberger, Loran Avci, Nordin Dari, Martin H\"ansel, Hakim Baazaoui, Pascal B\"uhler, Susanne Wegener, Beate Sick
arXiv Machine Learning
Sep 7

SMILE: Self-Explainable Multimodal Information Bottleneck for Medical Diagnosis

The paper introduces SMILE, a self‑explainable multimodal information bottleneck framework for medical diagnosis. It jointly optimizes predictive accuracy and modality‑specific explainability by selecting the most informative elements within each data modality. Experiments on diverse medical datasets show strong diagnostic performance, including a 9.1‑percentage‑point accuracy gain on the iCTCF dataset, and provide transparent, modality‑aware explanations that enhance both explainability and generalization.

By Yuqing Yang, Alexander Schmatz, Zhaozhao Ma, Changkyu Choi, Robert Jenssen, Shujian Yu
arXiv AI
3d ago

UniAR: A Unified Framework for Autism Recognition Enhanced by Multi-View Prompt Learning

UniAR is a unified framework that improves autism spectrum disorder (ASD) recognition by using multi-granularity prompt learning and a large multimodal model to generate diagnostic descriptions at word, phrase, and sentence levels. It aligns these semantic representations with visual evidence through a Mixture-of-Experts-based Multi-Scale Alignment Module, enabling robust ASD detection across heterogeneous data types. Experiments on four brain MRI and facial expression benchmarks show that UniAR outperforms state‑of‑the‑art methods, achieving 75.9% accuracy on MRI and 91.6% on facial benchmarks, with gains of 1.5 and 1.2 percentage points respectively.

By Lei Xin, Zeheng Wang, Jiayin Zhu, Shihong Huang, Fanhu Zeng, Changjiang Jiang, Dengbo He, Yutao Yue, Zhenglun Kong
arXiv Machine Learning
Jun 8

Explaining Unsupervised Disease Staging in Huntington's Disease: Insights into Model Representations and Clusters

arXiv:2606. 07135v1 Announce Type: new Abstract: Huntington's disease (HD) is a progressive neurodegenerative disorder that affects motor, cognitive, and behavioral functions, where accurate characterization of disease progression remains essential to improve patient outcome and quality of life.

By Lubna Mahmoud Abu Zohair, Hind Zantout