arXiv Machine Learning By Guy Gerson, Tomer Raviv, Nir Shlezinger, Tirza Routtenberg, Osvaldo Simeone

Online Learning via Learned Latent Bayesian Tracking

Read the original on arXiv Machine Learning →

The paper introduces AURA, a meta‑learning framework that learns a low‑dimensional latent state‑space model for the evolution of optimal model parameters under distribution shift. Online adaptation is performed via extended Kalman filtering in this latent space, followed by reconstruction of full model parameters through a learned lifting map, enabling efficient single‑step updates. Experiments on neural wireless receivers and non‑stationary image classification show that AURA improves adaptation speed, accuracy, and computational efficiency compared to existing online learning and Bayesian filtering baselines.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Sep 24

Full-Covariance Smoothing of Bayesian Neural Networks for Online Adaptation

The paper proposes treating a neural network’s layers as time steps in a state‑space model, converting Bayesian training into a smoothing problem. By propagating Gaussian moments forward and applying a Rauch–Tung–Striebel backward pass, weight posteriors are updated in closed form without gradient iterations or replay. The authors extend prior work by introducing a cross‑covariance identity that allows full‑covariance propagation through nonlinear activations, enabling more accurate online adaptation in non‑stationary classification, dynamics learning, and vision‑language‑action policy adaptation.

By Oren Wright, Haoming Jing, Qiaoan Shen, Koichiro Niinuma, Yorie Nakahira, Jos\'e M. F. Moura
arXiv AI
Sep 10

FILT3R: Latent State Adaptive Kalman Filter for Streaming 3D Reconstruction

FILT3R is a training‑free latent filtering layer for streaming 3D reconstruction that treats recurrent state updates as stochastic state estimation in token space. It maintains per‑token variance and computes a Kalman‑style gain to balance memory retention with new observations, estimating process noise online from temporal drift of candidate tokens. Experiments show that FILT3R generalizes overwrite and gating policies, shrinking gains in stable regimes and increasing them during genuine scene changes, thereby improving long‑horizon stability for depth, pose, and 3D reconstruction.

By Seonghyun Jin, Jong Chul Ye