arXiv Machine Learning

DiTS: Multimodal Diffusion Transformers Are Time Series Forecasters

DiTS introduces a Multimodal Diffusion Transformer designed for time‑series forecasting that incorporates heterogeneous exogenous covariates. The model treats endogenous targets and exogenous covariates as separate modalities, jointly conditioning future generation on target history and available covariates. By employing flow matching and Time‑aligned Modulation, DiTS achieves strong deterministic and probabilistic forecasting performance across diverse covariate‑aware tasks.

arXiv Machine Learning
Aug 19

TiMi: Empower Time Series Transformers with Multimodal Mixture of Experts

The paper introduces TiMi, a framework that enhances time series transformers with a Multimodal Mixture-of-Experts (MMoE) module to incorporate multimodal data, especially textual information, into forecasting. TiMi leverages large language models to generate future inferences that guide predictions, eliminating the need for explicit representation alignment. Experiments show TiMi achieves state‑of‑the‑art performance on sixteen real‑world multimodal forecasting benchmarks, outperforming advanced baselines while maintaining adaptability and interpretability.

By Jiafeng Lin, Yuxuan Wang, Huakun Luo, Jianmin Wang, Zhongyi Pei
arXiv Machine Learning
Sep 3

DynG-Diff: A State-Aware Dynamic Guidance Diffusion Framework for Probabilistic Time Series Forecasting

DynG-Diff is a new diffusion-based framework for probabilistic multivariate time‑series forecasting that addresses the challenge of information heterogeneity across variables. It uses a two‑stage training strategy with an unconditional diffusion backbone and introduces a lightweight state‑aware policy network that dynamically adjusts guidance strength based on real‑time variable reliability. The dynamic guidance is mathematically framed as local precision, allowing the model to focus on high‑confidence variables and suppress anomalous noise, leading to competitive performance and robustness on real‑world benchmarks.

By Zhente Zhang, Zhengwei Ni, Wei Fan
arXiv Machine Learning
Oct 2

Proper Scoring Rule-based Diffusion for Probabilistic Weather Forecasting

The paper introduces a new diffusion-based approach for probabilistic weather forecasting that incorporates auxiliary conditional denoising tasks. By predicting future states from both clean and corrupted contexts, the model reduces ambiguity and learns conditional distributions across noise levels using a proper scoring rule. Experiments demonstrate improved one‑step forecasting, especially at longer horizons, and better calibration in high‑dimensional global weather scenarios.

By Joonhyeong Park, Giung Nam, Hyungi Lee, Kyunghyun Cho, Byoungwoo Park, Juho Lee
arXiv Machine Learning
Sep 29

WorldTS: World Modeling for Multimodal Covariate-aware Time Series Forecasting

WorldTS is a new forecasting framework that models latent dynamics conditioned on multimodal covariates to improve time‑series prediction. It uses a two‑stage training process: first learning latent state dynamics from historical data and covariates, then training a decoder to map predicted latent states back to future observations. Experiments on 21 real‑world datasets demonstrate the effectiveness of this approach.

By Yuhan Zhu, Xiangfei Qiu, Hanyin Cheng, Wangmeng Shen, Chenjuan Guo, Bin Yang, Jilin Hu, Christian S. Jensen
arXiv AI
Oct 2

ProtoFlow: Prototype-Guided Flow Matching for Multivariate Time Series Forecasting

ProtoFlow is a new multivariate time series forecasting framework that combines vector‑quantized autoencoding with prototype‑guided flow matching. It maps sequences into a discrete latent space, constructs a structured prior from the learned VQ codebook, and trains a DiT‑based rectified flow to transport samples from this prior to future latent representations conditioned on past observations. By replacing generic Gaussian noise with a learned prototype prior, ProtoFlow eliminates autoregressive rollout mismatch and achieves faster training convergence while delivering superior forecasting performance on benchmark datasets.

By Shibo Feng, Wanjin Feng, Yang Qiu, Deheng Ye, Peilin Zhao, Chunyan Miao