arXiv Machine Learning

ZENO: Nonlinear filtering with Zakai Equation Neural Operators

arXiv Machine Learning
Jul 22

Neural Kolmogorov Equations: Parallelizable Learning of Stochastic Dynamics under General Noise

arXiv:2607. 19173v1 Announce Type: new Abstract: Neural stochastic differential equations (SDEs) have emerged as powerful tools for learning noisy or stochastic dynamics directly from data; however, existing approaches largely assume uncoupled and continuous noise, limiting their applicability to realistic stochastic drivers, and often scale poorly in time, requiring expensive autoregressive training.

By Arthur Bizzi, Olga Fink
arXiv Machine Learning
Jul 17

RTS Smoother-Guided Learning of Physics-Based Neural Differential Models

arXiv:2607. 15180v1 Announce Type: new Abstract: Ordinary differential equations (ODEs) are widely used to model dynamical systems in physics, biology, neuroscience, and physiology, but in many applications some equations of the dynamics are unknown and only a subset of the state variables are measured.

By Ahmet Demirkaya, Georgios Stratis, Tales Imbiriba, Zachary D. Danziger, Deniz Erdogmus
arXiv AI
Aug 28

Physics-Informed Stochastic Configuration Machine: A Backpropagation-Free Neural Network with Fast Training for Nonlinear Differential Equations

The paper introduces the Physics-Informed Stochastic Configuration Machine (PI‑SCM), a backpropagation‑free neural network designed for solving nonlinear differential equations. By analytically evaluating local Jacobians, PI‑SCM linearizes the physical loss, enabling optimal weight determination through generalized linear least squares and avoiding iterative nonlinear optimization. The authors present a progressive algorithmic suite—PI‑SC‑I, PI‑SC‑II, and PI‑SC‑III—prove their universal approximation properties, and show through experiments that PI‑SCM achieves high‑fidelity predictions and parameter identification while accelerating training by orders of magnitude compared to standard PINNs.

By Yuehao Song (School of Automation, Central South University, Changsha, China), Zhong Chen (School of Automation, Central South University, Changsha, China), Lihui Cen (School of Automation, Central South University, Changsha, China), Liang Wu (Johns Hopkins University, Baltimore, USA), Kai Zhang (State Key Laboratory of Simulation and Regulation of Water Cycle in River Basin, China Institute of Water Resources and Hydropower Research, Beijing, China)
arXiv Statistics ML
Oct 23

Automatic Differentiation for Inference on Partially Observed Markov Process Models

The paper introduces a new class of algorithms that embed existing automatic differentiation (AD) particle filter methods, enabling a bias‑variance tradeoff and reducing mean squared error in likelihood estimation for partially observed nonlinear stochastic dynamical systems. Unlike prior approaches, these algorithms only require a differentiable simulator of the latent dynamics, not explicit transition probabilities. Numerical experiments demonstrate that a hybrid method—using AD to refine a coarse solution from iterated filtering—outperforms current state‑of‑the‑art techniques on a challenging scientific benchmark.

By Kevin Tan, Aaron J. Abkemeier, Kunyang He, Giles Hooker, Edward L. Ionides