Hugging Face Trending Papers

Spike-based Belief Propagation in Nonlinear Dynamical Systems

The paper introduces a Bayesian control framework that merges spike-based neural dynamics with probabilistic inference for adaptive control. It applies this brain-inspired model to the mountain car parking problem, showing that the controller can update states in real time and generate goal-directed action plans via spike-driven dynamics. The results suggest the model could serve as a bridge between computational neuroscience and probabilistic control theory.

arXiv Machine Learning
Sep 11

Bio-inspired Learning and Decision-Making with Probabilistic In-Memory Computing Hardware: Part 1

The article explores how biological learning and decision-making, often modeled as Bayesian processes, can be replicated in computing systems by leveraging noisy neural and synaptic dynamics for stochastic sampling. It proposes a biologically grounded framework where internal energy functions capture uncertainty over latent states and model parameters, enabling predictive coding networks to perform Markov chain Monte Carlo sampling. By drawing parallels between intrinsic biological noise and electrical noise in emerging probabilistic analogue memory technologies, the authors argue that analogue in‑memory computing hardware offers a massively scalable and energy‑efficient solution for probabilistic inference.

By Thomas Dalgaty, Eiji Kawasaki, Miguel de Prado, Devendra Vyas, Tommaso Salvatori
arXiv AI
2d ago

SpikeMoE: Brain-Inspired Competitive Routing for Flexible Spiking Mixture-of-Experts

SpikeMoE introduces a spike-based k‑WTA router that uses lateral inhibition and refractory periods to select the top‑K experts based on discrete spike counts, inspired by hippocampal CA1 competition. The framework combines spiking neural network dynamics with mixture‑of‑experts conditional computation and adds a two‑stage missing‑modality module for robust multimodal processing. Experiments on vision, language, and multimodal tasks show that SpikeMoE matches or surpasses ANN baselines while offering energy‑efficient performance.

By Xiaoli Liu, Yujie Liang, Jialin Li, Malu Zhang
arXiv Machine Learning
Aug 4

Recursive Gaussian Processes and the Bayesian Brain

arXiv:2608. 00503v1 Announce Type: cross Abstract: Predictive coding offers a powerful framework for cortical computation, yet scalable implementations that respect both Bayesian exactness and neurobiological constraints remain scarce.

By Moumita Das, Dipanjan Ray, Sourabh Bhattacharya
arXiv Machine Learning
Sep 25

On the second-order optimization for spiking neural networks

The paper introduces SpiKFAX, a second‑order optimization technique for Spiking Neural Networks (SNNs) that uses a Kronecker‑factored approximation of the Fisher information matrix tailored to the sparse, discrete, and temporally recurrent dynamics of SNNs. By addressing the sharp loss landscape that hampers training with conventional optimizers, SpiKFAX improves test accuracy and training stability across five architectures and seven datasets. The method offers a computationally tractable alternative to existing curvature‑based approaches for SNNs.

By Ngoc Phu Doan, Ihsen Alouani
arXiv Machine Learning
Aug 6

Distributional Active Inference

arXiv:2601. 20985v2 Announce Type: replace Abstract: Optimal control of complex environments with robotic systems faces two complementary and intertwined challenges: efficient organization of sensory state information and far-sighted action planning.

By Abdullah Akg\"ul, Gulcin Baykal, Manuel Hau{\ss}mann, Mustafa Mert \c{C}elikok, Melih Kandemir