← Back to all news
arXiv AI By Valeriu Dimidov, Rapha\"el Frank

Time-Series Retrieval for Grounding Multimodal Language Models in Remaining Useful Life Prediction

Read the original on arXiv AI →

The paper explores remaining useful life (RUL) estimation using multimodal large language models (MLLMs) that are grounded through time‑series retrieval. It proposes a framework that retrieves historically similar degradation segments, combines them with the test trajectory into a visual comparison artifact, and processes this via a structured multimodal prompt. Experiments on the FD001 partition of the C‑MAPSS benchmark show that retrieval consistently improves RUL prediction, with greater benefits for larger MLLMs, while also revealing current limitations in practical prognostics and health management (PHM) settings.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Related stories

arXiv AI
Sep 7

MMTClinic: Multimodal, Multilingual Time Series Question Answering and Reasoning Benchmark for Clinical Domain

MMTClinic is a new benchmark that tests large language models on complex reasoning and question‑answering tasks involving clinical time‑series data. It combines text, medical images, and multivariate physiological signals to create 30,000 QA pairs—including 15,000 multiple‑choice and 15,000 open‑ended questions—in five languages (English, Hindi, Bengali, Marathi, and Tamil). The benchmark covers mortality prediction, heart‑rate forecasting, and SOFA score estimation, and evaluates 13 state‑of‑the‑art LLMs across zero‑shot, few‑shot, and chain‑of‑thought settings, revealing significant performance gaps across tasks, languages, and modalities.

By Sourav Malakar, Harshit Nigam, Akash Ghosh, Sriparna Saha, Amlan Chakrabarti, Saptarsi Goswami, Priti Singh
llmsnlpmultimodalbenchmarks
More like this →
arXiv AI
Oct 12

Retrieval-Augmented Multimodal Language Model with Heterogeneous Evidence Integration for Clinical Prognosis

PRISM (Population‑Retrieved Inference for Structured Multimodal Prognosis) is a multimodal language model that integrates structured measurements, physiological waveforms, longitudinal history, and population context for clinical prognosis. It uses per‑feature numerical tokenization, recency‑weighted aggregation of ECGs, and a dual‑modality population memory bank, retrieving mean‑pooled embeddings of similar encounters without including individual records in the prompt. On the 1,443‑task MDS‑ED benchmark, PRISM achieves high AUROCs across diagnosis, deterioration, ICU admission, and mortality, outperforming baselines and demonstrating the value of structured multimodal integration and supervised external adaptation.

By Hamza Shafiq, Jialu Tang, Ting Dang, Jun Hu, Aaqib Saeed
llmsragnlpfine-tuningmultimodalbenchmarks
More like this →