Predicting the Unpredictable: LLM-powered Long-term Chaotic Time Series Forecasting under Short-term Observations
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
The Flow has not summarised this story yet — read it at arXiv Machine Learning.
arXiv:2505. 23863v3 Announce Type: replace-cross Abstract: Understanding chaotic dynamics is a fundamental problem across scientific disciplines, including climate science, neuroscience, and fluid dynamics, yet direct experimentation and intervention in such systems are often infeasible.
The paper introduces a data‑adaptive nonlinear vector autoregression (NVAR) model that replaces fixed polynomial or random feature maps with a shallow, trainable multilayer perceptron (MLP). By jointly training the MLP and a linear readout via gradient‑based optimization, the model learns data‑driven nonlinearities while maintaining a simple readout structure, improving scalability in high‑dimensional settings. Experiments on several chaotic systems, both noise‑free and synthetically noisy, show that this adaptive NVAR outperforms standard NVAR, a leaky echo state network (ESN), and a hybrid ESN in predictive accuracy, demonstrating robust forecasting under noisy conditions.
arXiv:2607. 00197v1 Announce Type: new Abstract: Long-horizon multivariate time series forecasting (LTSF) remains challenging due to non-stationarity, regime shifts, and error accumulation.
arXiv:2508. 07195v2 Announce Type: replace-cross Abstract: Recent advances have demonstrated that Large Language Models (LLMs) can be effectively adapted for time series forecasting, revealing strong potential beyond natural language tasks.
NeST is a framework that adapts large language models (LLMs) for continuous time‑series forecasting by creating neighborhood‑aware text prototypes and aligning them with temporal representations through a nearest‑neighbor contrastive objective. It retrieves the most relevant prototypes and uses them to conditionally modulate time‑series features, enabling more effective integration of textual and temporal information. Experiments show that NeST outperforms state‑of‑the‑art methods on eight benchmarks, reduces MSE by 1.2% for long‑term forecasting, improves zero‑shot forecasting by 4.9%, and boosts R² by 3.3% on a real‑world photovoltaic power forecasting task.
WorldTS is a new forecasting framework that models latent dynamics conditioned on multimodal covariates to improve time‑series prediction. It uses a two‑stage training process: first learning latent state dynamics from historical data and covariates, then training a decoder to map predicted latent states back to future observations. Experiments on 21 real‑world datasets demonstrate the effectiveness of this approach.