arXiv Machine Learning

Quantile-Guided Diffusion for Probabilistic Time-Series Forecasting

arXiv Machine Learning
Oct 8

DiTS: Multimodal Diffusion Transformers Are Time Series Forecasters

DiTS introduces a Multimodal Diffusion Transformer designed for time‑series forecasting that incorporates heterogeneous exogenous covariates. The model treats endogenous targets and exogenous covariates as separate modalities, jointly conditioning future generation on target history and available covariates. By employing flow matching and Time‑aligned Modulation, DiTS achieves strong deterministic and probabilistic forecasting performance across diverse covariate‑aware tasks.

By Haoran Zhang, Haixuan Liu, Yong Liu, Yunzhong Qiu, Yuxuan Wang, Jianmin Wang, Mingsheng Long
arXiv Machine Learning
Sep 29

Aurora-X: Built for Extreme Time Series Forecasting

Aurora‑X is a billion‑parameter time‑series foundation model designed for extreme forecasting tasks. It employs a progressive curriculum that starts with channel‑independent pretraining, then adds cross‑variable dependencies, variable context and horizon lengths, and optional future covariates during mid‑training. A variable‑resolution post‑training stage allows adjustable temporal spans per token at inference, while a pattern‑guided mixture‑of‑experts expands capacity through sparse activation and expert specialization. An implicit quantile network head predicts arbitrary quantiles, enhancing probabilistic forecasting flexibility. Experiments on GIFT‑Eval, TIME, FEV‑Bench, TFB, and DAG‑Bench show state‑of‑the‑art performance against both pretrained TSFMs and task‑specific supervised models.

By Xingjian Wu, Chenjuan Guo, Xiangfei Qiu, Zhigang Hu, Hanyin Cheng, Peng Chen, Yang Shu, Jilin Hu, Bin Yang
arXiv Machine Learning
Sep 22

Monotone-Constrained Diffusion Models for Long-Horizon Production Forecasting

The paper introduces Physics‑SIMS‑TS, a conditional diffusion model designed for long‑horizon oil and gas production forecasting. It enforces monotone decline through negative guidance, decline‑curve constraints, and isotonic projection during sampling, and incorporates spatial training augmentation and an ensembled stochastic sampler to produce calibrated predictive distributions. Evaluated on over 35,000 wells across three jurisdictions, Physics‑SIMS‑TS achieves the highest accuracy among diffusion forecasters and matches transformer ensembles, with only a 0.5% increase in mean squared error for monotonicity.

By Temesgen Mikael Abraha, Yves Lucet
arXiv Machine Learning
Sep 15

FlowTSFM: Turning Encoder Depth into Quantile Transport

arXiv:2609.13640v1 Announce Type: new Abstract: Encoder-based time series foundation models (TSFMs) typically rely on deep stacks of independently parameterized Transformer layers, where only the fin...

By Bahaeddine Abdessalem, Shifeng Xie, Zehao Xiao, Youssef Attia El Hili, Ambroise Odonnat, Jianfeng Zhang, Lujia Pan, Keli Zhang, Malik Tiomoko
arXiv Machine Learning
Oct 2

Proper Scoring Rule-based Diffusion for Probabilistic Weather Forecasting

The paper introduces a new diffusion-based approach for probabilistic weather forecasting that incorporates auxiliary conditional denoising tasks. By predicting future states from both clean and corrupted contexts, the model reduces ambiguity and learns conditional distributions across noise levels using a proper scoring rule. Experiments demonstrate improved one‑step forecasting, especially at longer horizons, and better calibration in high‑dimensional global weather scenarios.

By Joonhyeong Park, Giung Nam, Hyungi Lee, Kyunghyun Cho, Byoungwoo Park, Juho Lee