arXiv Machine Learning

The Bayesian Reflex: A Predictive Coding Engine for Artificial Intelligence

arXiv:2608. 00492v1 Announce Type: cross Abstract: Predictive coding offers a powerful theory of cortical computation, but corresponding scalable algorithmic implementations for artificial intelligence have remained elusive.

arXiv Machine Learning
Aug 4

Recursive Gaussian Processes and the Bayesian Brain

arXiv:2608. 00503v1 Announce Type: cross Abstract: Predictive coding offers a powerful framework for cortical computation, yet scalable implementations that respect both Bayesian exactness and neurobiological constraints remain scarce.

By Moumita Das, Dipanjan Ray, Sourabh Bhattacharya
arXiv Machine Learning
Jun 25

Efficient Adaptive Data Acquisition via Pretrained Belief Representations

arXiv:2606. 25197v1 Announce Type: new Abstract: Learning effective policies for adaptive data acquisition remains challenging: posterior-based methods rely on surrogate models and posterior approximations that can be misspecified or biased, while direct policy-learning methods map from historical observations and fail to exploit available model representations, making learning harder.

By Daolang Huang, Zhuoyue Huang, Conor Hassan, Luigi Acerbi, Samuel Kaski, Tom Rainforth
arXiv Machine Learning
Sep 11

Bio-inspired Learning and Decision-Making with Probabilistic In-Memory Computing Hardware: Part 1

The article explores how biological learning and decision-making, often modeled as Bayesian processes, can be replicated in computing systems by leveraging noisy neural and synaptic dynamics for stochastic sampling. It proposes a biologically grounded framework where internal energy functions capture uncertainty over latent states and model parameters, enabling predictive coding networks to perform Markov chain Monte Carlo sampling. By drawing parallels between intrinsic biological noise and electrical noise in emerging probabilistic analogue memory technologies, the authors argue that analogue in‑memory computing hardware offers a massively scalable and energy‑efficient solution for probabilistic inference.

By Thomas Dalgaty, Eiji Kawasaki, Miguel de Prado, Devendra Vyas, Tommaso Salvatori
Hugging Face Trending Papers
Aug 10

Renormalising Generative Models for Active Inference: Foundations, Derivations, and Verification

Active inference offers a unified framework for perception, learning, and action, but scaling discrete active-inference models to rich spatial and temporal domains remains difficult. Renormalising generative models (RGMs) address this challenge by composing discrete generative models across spatial and temporal scales, coarse-graining lower-level states and paths into higher-level causes for objects, events, and action.

arXiv Machine Learning
Aug 31

Prequential posteriors

The paper introduces prequential posteriors, a Bayesian approach that uses a predictive‑sequential loss function to update deep generative forecasting models (DGFMs) when new data arrive. By adopting a consistency notion suitable for model misspecification, the authors prove that both the loss minimizer and the posterior concentrate on parameters with optimal predictive performance. Scalable inference is achieved with parallelisable waste‑free sequential Monte Carlo samplers that employ preconditioned gradient kernels, and the method is validated on synthetic and real meteorological time‑series data.

By Shreya Sinha-Roy, Richard G. Everitt, Christian P. Robert, Ritabrata Dutta
arXiv Machine Learning
Jul 28

Forgetting is Everywhere

arXiv:2511. 04666v4 Announce Type: replace Abstract: A fundamental challenge in developing general learning algorithms is their tendency to forget past knowledge as they adapt to new data.

By Ben Sanati, Thomas L. Lee, Trevor McInroe, Aidan Scannell, Esmeralda S. Whitammer, David Abel, Amos Storkey