arXiv AI

Large Models for Time Series and Spatio-Temporal Data: A Survey and Outlook

arXiv:2310. 10196v3 Announce Type: replace-cross Abstract: Temporal data, including time series and spatio-temporal data, are pervasive in real-world applications.

arXiv Machine Learning
Sep 3

A Unified Particle Filter LSTM for Data-Driven Process Simulation

The paper introduces a Unified Particle Filter LSTM (Unified PF‑LSTM) for data‑driven process simulation, which maintains a weighted set of recurrent‑state hypotheses to better capture latent process conditions from incomplete event logs. By summarizing this particle belief with a weighted mean and moment‑generating‑function features, the model predicts next‑activity probabilities and conditional sojourn‑time quantiles. Experiments on three real‑world emergency department datasets show that the framework consistently outperforms existing data‑driven baselines in reproducing routing, duration, and system‑level behavior, especially when process dynamics are only partially reflected in the logs.

By Parvin Malekzadeh, Opher Baron, Dmitry Krass
arXiv AI
Aug 25

A Modular Multitask Reasoning Framework Integrating Spatio-temporal Models and LLMs

The paper introduces STReason, a modular multitask reasoning framework that combines large language models with spatio‑temporal models to handle complex natural language queries without task‑specific fine‑tuning. STReason decomposes queries into interpretable programs, executes them to produce numerical results and detailed, computation‑grounded explanations, thereby reducing hallucinations. The authors evaluate the system on a new benchmark and show it outperforms advanced LLM baselines, with human studies confirming its credibility and practical utility.

By Kethmi Hirushini Hettige, Jiahao Ji, Cheng Long, Shili Xiang, Gao Cong, Jingyuan Wang
arXiv AI
Aug 18

Adapting LLMs to Time Series Forecasting via Temporal Heterogeneity Modeling and Representation Alignment

arXiv:2508. 07195v2 Announce Type: replace-cross Abstract: Recent advances have demonstrated that Large Language Models (LLMs) can be effectively adapted for time series forecasting, revealing strong potential beyond natural language tasks.

By Yanru Sun, Emadeldeen Eldele, Zongxia Xie, Yucheng Wang, Wenzhe Niu, Qinghua Hu, Chee Keong Kwoh, Min Wu
arXiv Machine Learning
Aug 12

ChronoSSM: Training for Temporally Aware Representations in Autoregressive State Space Models

arXiv:2608. 10120v1 Announce Type: new Abstract: Modern sequence models, from Transformers to State Space Models, have enabled powerful generative modeling across diverse domains, yet they are typically trained to predict what happens while treating when it happens as a secondary concern.

By Adrien Schoen, Nachiketa Ratnakar Patil, Arjun Bhagoji, Francesco Bronzino