The paper explores remaining useful life (RUL) estimation using multimodal large language models (MLLMs) that are grounded through time‑series retrieval. It proposes a framework that retrieves historically similar degradation segments, combines them with the test trajectory into a visual comparison artifact, and processes this via a structured multimodal prompt. Experiments on the FD001 partition of the C‑MAPSS benchmark show that retrieval consistently improves RUL prediction, with greater benefits for larger MLLMs, while also revealing current limitations in practical prognostics and health management (PHM) settings.
By Valeriu Dimidov, Rapha\"el Frank
arXiv:2610.17856v2 Announce Type: cross
Abstract: Time-series analysis is increasingly studied in multimodal settings, yet most benchmarks pair temporal signals with text or with visualizations deriv...
By Ziyang Zhang, Shenyi Li, Yilin Wang, Ziyun Cui, Bowen Zhou, Wen Wu, Chao Zhang
MMTClinic is a new benchmark that tests large language models on complex reasoning and question‑answering tasks involving clinical time‑series data. It combines text, medical images, and multivariate physiological signals to create 30,000 QA pairs—including 15,000 multiple‑choice and 15,000 open‑ended questions—in five languages (English, Hindi, Bengali, Marathi, and Tamil). The benchmark covers mortality prediction, heart‑rate forecasting, and SOFA score estimation, and evaluates 13 state‑of‑the‑art LLMs across zero‑shot, few‑shot, and chain‑of‑thought settings, revealing significant performance gaps across tasks, languages, and modalities.
By Sourav Malakar, Harshit Nigam, Akash Ghosh, Sriparna Saha, Amlan Chakrabarti, Saptarsi Goswami, Priti Singh
PRISM (Population‑Retrieved Inference for Structured Multimodal Prognosis) is a multimodal language model that integrates structured measurements, physiological waveforms, longitudinal history, and population context for clinical prognosis. It uses per‑feature numerical tokenization, recency‑weighted aggregation of ECGs, and a dual‑modality population memory bank, retrieving mean‑pooled embeddings of similar encounters without including individual records in the prompt. On the 1,443‑task MDS‑ED benchmark, PRISM achieves high AUROCs across diagnosis, deterioration, ICU admission, and mortality, outperforming baselines and demonstrating the value of structured multimodal integration and supervised external adaptation.
By Hamza Shafiq, Jialu Tang, Ting Dang, Jun Hu, Aaqib Saeed
arXiv:2607. 14510v1 Announce Type: new Abstract: Industrial time series serve as the foundation for Prognostics and Health Management (PHM) to ensure the reliability and safety of industrial equipment such as aero-engines.
By Haiteng Wang, Jingheng Yan, Xiaokang Wang, Lei Ren
arXiv:2507. 19634v4 Announce Type: replace-cross Abstract: Recent advances in large language models have laid the foundation for multimodal LLMs (MLLMs), which unify text, speech, and vision within a single framework.
By Sara Papi, Maike Z\"ufle, Marco Gaido, Beatrice Savoldi, Danni Liu, Ioannis Douros, Luisa Bentivogli, Jan Niehues