arXiv Statistics ML By Kevin Tan, Aaron J. Abkemeier, Kunyang He, Giles Hooker, Edward L. Ionides

Automatic Differentiation for Inference on Partially Observed Markov Process Models

Read the original on arXiv Statistics ML →

The paper introduces a new class of algorithms that embed existing automatic differentiation (AD) particle filter methods, enabling a bias‑variance tradeoff and reducing mean squared error in likelihood estimation for partially observed nonlinear stochastic dynamical systems. Unlike prior approaches, these algorithms only require a differentiable simulator of the latent dynamics, not explicit transition probabilities. Numerical experiments demonstrate that a hybrid method—using AD to refine a coarse solution from iterated filtering—outperforms current state‑of‑the‑art techniques on a challenging scientific benchmark.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Statistics ML.

arXiv Machine Learning
Sep 22

Bayesian Filtering in Physical Systems via Test-time Trained Flow Matching

The paper introduces the Belief Flow Filter (BFF), a generative filtering framework that encodes the evolving posterior distribution directly into flow matching model weights and updates them via test‑time gradient descent. By avoiding particle representations and Gaussian assumptions, BFF aligns structurally with Bayesian filtering and targets the recursive filtering operator. Empirical results on five physical systems—including chaotic dynamics, sparse observations, and a tokamak plasma estimation task—show that BFF outperforms existing methods in most benchmark metrics.

By Ruiqi Feng, Chongyi Wang, Tao Zhang, Tailin Wu
arXiv Machine Learning
Oct 9

Differentiable Systematic Resampling for Variational Sequential Monte Carlo

The paper introduces Differentiable Systematic Resampling (DSR), a temperature-controlled relaxation of systematic resampling that maintains the CDF-ordered, banded structure while allowing full gradient flow. DSR converges to exact systematic resampling as temperature approaches zero and the authors prove a pointwise exponential convergence rate for the induced bias. Compared to optimal-transport-based differentiable resampling, DSR avoids iterative solvers and has substantially lower computational overhead, achieving comparable or superior filtering and dynamics learning performance on stochastic dynamical systems and real-world handwriting data.

By Fredrik Cumlin, Saikat Chatterjee