arXiv Machine Learning

When Denoising Hurts: Rethinking the Terminal Step of Diffusion Time Series Forecasters -- Extended Version

arXiv:2608. 14067v1 Announce Type: new Abstract: Diffusion models offer a natural way to model uncertainty in time series forecasting, yet their iterative sampling process is often treated as a uniformly beneficial refinement procedure.

arXiv Machine Learning
Sep 22

Monotone-Constrained Diffusion Models for Long-Horizon Production Forecasting

The paper introduces Physics‑SIMS‑TS, a conditional diffusion model designed for long‑horizon oil and gas production forecasting. It enforces monotone decline through negative guidance, decline‑curve constraints, and isotonic projection during sampling, and incorporates spatial training augmentation and an ensembled stochastic sampler to produce calibrated predictive distributions. Evaluated on over 35,000 wells across three jurisdictions, Physics‑SIMS‑TS achieves the highest accuracy among diffusion forecasters and matches transformer ensembles, with only a 0.5% increase in mean squared error for monotonicity.

By Temesgen Mikael Abraha, Yves Lucet
arXiv Machine Learning
1d ago

Learned End-to-End Guidance Schedules for Diffusion Models

The paper introduces Learned End-to-End Guidance Schedules (LEEGS) for diffusion models, which train a time‑dependent guidance schedule to balance data quality and requirement satisfaction while reducing sampling steps. LEEGS minimizes the guidance function over a small set of examples using stochastic gradient descent and employs a gradient approximation to cut training time by a factor of four. Experiments on tasks such as image inpainting, noisy image inverse problems, face‑ID‑guided generation, and PDE problems show that LEEGS outperforms baselines at the same computational budget or matches constant guidance with only 10% of the steps.

By Aneesh Barthakur, Mathias Niepert, Luiz F. O. Chamon
arXiv Machine Learning
Sep 3

DynG-Diff: A State-Aware Dynamic Guidance Diffusion Framework for Probabilistic Time Series Forecasting

DynG-Diff is a new diffusion-based framework for probabilistic multivariate time‑series forecasting that addresses the challenge of information heterogeneity across variables. It uses a two‑stage training strategy with an unconditional diffusion backbone and introduces a lightweight state‑aware policy network that dynamically adjusts guidance strength based on real‑time variable reliability. The dynamic guidance is mathematically framed as local precision, allowing the model to focus on high‑confidence variables and suppress anomalous noise, leading to competitive performance and robustness on real‑world benchmarks.

By Zhente Zhang, Zhengwei Ni, Wei Fan