arXiv Machine Learning

Scan-Parallel Variational Inference for event-driven Latent Jump Models

The paper introduces latent jump models (LJMs) for continuous-time latent state-space modeling, where the latent state evolves deterministically between Poisson-driven events and experiences learned instantaneous jumps at each event. It presents a tractable event-augmented ELBO and a novel Scan-Parallel Variational Inference (SPVI) method that samples the full latent event configuration before evaluating state recurrence, enabling logarithmic temporal depth and fast, scalable training. Experiments on synthetic and real irregular time series show that LJMs achieve competitive forecast accuracy with fewer latent updates and train one to two orders of magnitude faster than sequential baselines.

arXiv Machine Learning
Sep 23

One-Step Generative Surrogate Models via Block-Triangular Joint Drifting

The paper introduces block‑triangular joint drifting, a method that applies a projected drift field to the joint distribution of consecutive states, enabling one‑step generative surrogate models for stochastic transition dynamics. This architecture preserves the current‑state marginal while directly sampling the conditional distribution of next states, allowing stochastic trajectories to be generated with a single model evaluation per time step. Experiments show that the approach achieves accurate marginal and trajectory‑dependent statistics with favorable accuracy‑cost tradeoffs compared to deterministic, diffusion, flow, and distillation‑based generative surrogates.

By Nicholas Geissler, Shreya Jha, Ricardo Baptista, Benjamin Peherstorfer
arXiv Machine Learning
Sep 30

HALO: Enhancing Time Series Generation via Hyperspherical Latents and Masked AutoregRessive Modeling

HALO introduces a hyperspherical VAE to constrain continuous latent representations to a fixed‑radius shell, stabilizing numerical fluctuations. It then employs a masked autoregressive model that balances parallel decoding with temporal correlation learning, reducing inference steps and improving stability. Experiments show HALO achieves state‑of‑the‑art generation performance with significantly better inference efficiency compared to existing baselines.

By Chunyi Hou, Xiangfei Qiu, Hanyin Cheng, Yutong Li, Bin Yang
arXiv Machine Learning
Jul 22

Neural Kolmogorov Equations: Parallelizable Learning of Stochastic Dynamics under General Noise

arXiv:2607. 19173v1 Announce Type: new Abstract: Neural stochastic differential equations (SDEs) have emerged as powerful tools for learning noisy or stochastic dynamics directly from data; however, existing approaches largely assume uncoupled and continuous noise, limiting their applicability to realistic stochastic drivers, and often scale poorly in time, requiring expensive autoregressive training.

By Arthur Bizzi, Olga Fink
arXiv Machine Learning
Jul 2

TRIE: An Evaluation Framework for Stochastic PDE Surrogates

arXiv:2607. 00196v1 Announce Type: new Abstract: Many scientific systems exhibit uncertainty from stochastic forcing, unresolved degrees of freedom, or imperfect observations, making reliable surrogate forecasting fundamentally distributional rather than pointwise.

By Bharat Srikishan, Javier E. Santos, Nikhil Muralidhar, Charles D. Young
arXiv Machine Learning
Jun 9

In-Context Learning of Stochastic Differential Equations with Foundation Inference Models

arXiv:2502. 19049v3 Announce Type: replace Abstract: Stochastic differential equations (SDEs) describe dynamical systems where deterministic flows, governed by a drift function, are superimposed with random fluctuations, dictated by a diffusion function.

By Patrick Seifner, Kostadin Cvejoski, David Berghaus, Cesar Ojeda, Ramses J. Sanchez