arXiv Machine Learning By Haoran Zhang, Haixuan Liu, Yong Liu, Yunzhong Qiu, Yuxuan Wang, Jianmin Wang, Mingsheng Long

DiTS: Multimodal Diffusion Transformers Are Time Series Forecasters

Read the original on arXiv Machine Learning →

DiTS introduces a Multimodal Diffusion Transformer designed for time‑series forecasting that incorporates heterogeneous exogenous covariates. The model treats endogenous targets and exogenous covariates as separate modalities, jointly conditioning future generation on target history and available covariates. By employing flow matching and Time‑aligned Modulation, DiTS achieves strong deterministic and probabilistic forecasting performance across diverse covariate‑aware tasks.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Aug 19

TiMi: Empower Time Series Transformers with Multimodal Mixture of Experts

The paper introduces TiMi, a framework that enhances time series transformers with a Multimodal Mixture-of-Experts (MMoE) module to incorporate multimodal data, especially textual information, into forecasting. TiMi leverages large language models to generate future inferences that guide predictions, eliminating the need for explicit representation alignment. Experiments show TiMi achieves state‑of‑the‑art performance on sixteen real‑world multimodal forecasting benchmarks, outperforming advanced baselines while maintaining adaptability and interpretability.

By Jiafeng Lin, Yuxuan Wang, Huakun Luo, Jianmin Wang, Zhongyi Pei
arXiv Machine Learning
Sep 3

DynG-Diff: A State-Aware Dynamic Guidance Diffusion Framework for Probabilistic Time Series Forecasting

DynG-Diff is a new diffusion-based framework for probabilistic multivariate time‑series forecasting that addresses the challenge of information heterogeneity across variables. It uses a two‑stage training strategy with an unconditional diffusion backbone and introduces a lightweight state‑aware policy network that dynamically adjusts guidance strength based on real‑time variable reliability. The dynamic guidance is mathematically framed as local precision, allowing the model to focus on high‑confidence variables and suppress anomalous noise, leading to competitive performance and robustness on real‑world benchmarks.

By Zhente Zhang, Zhengwei Ni, Wei Fan
arXiv Machine Learning
Oct 2

Proper Scoring Rule-based Diffusion for Probabilistic Weather Forecasting

The paper introduces a new diffusion-based approach for probabilistic weather forecasting that incorporates auxiliary conditional denoising tasks. By predicting future states from both clean and corrupted contexts, the model reduces ambiguity and learns conditional distributions across noise levels using a proper scoring rule. Experiments demonstrate improved one‑step forecasting, especially at longer horizons, and better calibration in high‑dimensional global weather scenarios.

By Joonhyeong Park, Giung Nam, Hyungi Lee, Kyunghyun Cho, Byoungwoo Park, Juho Lee