arXiv Machine Learning

Time Series Foundation Models for Process Model Forecasting

arXiv Machine Learning
Jul 28

Foundation Models and Fine-Tuning: Toward a New Generation of Models for Time Series Forecasting

arXiv:2607. 23146v1 Announce Type: new Abstract: Inspired by recent breakthroughs in large language models for natural language processing, foundation models have emerged as a promising paradigm for zero-shot time series forecasting, enabling accurate predictions on datasets never seen during pre-training.

By Morad Laglil, Bertrand Pracca, Emilie Devijver, Eric Gaussier
arXiv Machine Learning
Jul 31

Revisiting Predictive Process Monitoring in the Age of Foundation Models: A Comparative Study of Sequence, Tabular, and LLM Approaches

arXiv:2607. 27797v1 Announce Type: new Abstract: Predictive process monitoring (PPM) leverages event logs to forecast the future of running process instances, for instance, predicting the next activity, the remaining time until case completion, or the time to the next event.

By Lennart Fertig, Lukas Kirchdorfer, Tobias Sesterhenn
arXiv Machine Learning
Aug 31

D-TAIA: Domain-Aware LLM Adaptation for Multi-Task Predictive Process Monitoring

D-TAIA is a framework that adapts large language models for multi‑task predictive process monitoring, jointly predicting the next activity and remaining time of ongoing cases. It uses domain‑aware triplet loss pre‑training, FAISS‑based nearest‑neighbor retrieval for time estimation, and a TAIA inference strategy to preserve sequential reasoning while fine‑tuning a 10 M‑parameter backbone. Across four real‑world event logs, D‑TAIA achieves state‑of‑the‑art or competitive results compared to a fine‑tuned LLM and a recurrent neural network baseline, with ablation studies showing the effectiveness of NLP and computer‑vision techniques for this domain.

By Sjoerd van Straten, Christine Jacob, Marwan Hassani
arXiv AI
Jul 23

Post-Training in Time Series Foundation Models: A Unifying Framework

arXiv:2607. 20002v1 Announce Type: cross Abstract: Time series foundation models (TSFMs) have emerged as general-purpose models for time series analysis, but pretraining alone is often insufficient for reliable downstream deployment.

By Shifeng Xie, Ambroise Odonnat, Zehao Xiao, Lei Zan, Malik Tiomoko, Lujia Pan, Themis Palpanas, Boris N. Oreshkin, Chenghao Liu, Keli Zhang
arXiv AI
Sep 16

LLMs as Master Forgers: Generating Synthetic Time Series Data for Manufacturing

The paper introduces a framework that uses Large Language Models (LLMs) to generate synthetic time‑series data for manufacturing processes. By fine‑tuning pre‑trained LLMs on manufacturing instructions and applying Retrieval Augmented Generation (RAG), the method enhances data diversity and realism. Evaluation against traditional models such as ARIMA and LSTMs shows that the LLM‑driven approach produces higher‑quality synthetic data, better capturing temporal dependencies and improving downstream anomaly detection performance.

By Mantek Singh, Jeshwanth Challagundla, Prateek Karnal, Gagan Ganapathy, Vineet Shah, Ridam Arora