arXiv Machine Learning

Equivariant Neural Belief Propagation

arXiv:2606. 06344v1 Announce Type: new Abstract: Probabilistic inference over spatially embedded variables requires beliefs that respect $SE(3)$ symmetry, yet existing equivariant networks produce only scalars and vectors -- not the rank-2 precision tensors needed for anisotropic uncertainty, and single-component messages collapse multi-modal energy landscapes to physically meaningless averages.

arXiv AI
Jun 30

Representation Learning for Equivariant Inference with Guarantees

arXiv:2505. 19809v3 Announce Type: replace-cross Abstract: In many real-world applications of regression, conditional probability estimation, and uncertainty quantification, exploiting symmetries rooted in physics or geometry can dramatically improve generalization and sample efficiency.

By Daniel Ordo\~nez-Apraez, Vladimir Kosti\'c, Alek Fr\"ohlich, Vivien Brandt, Karim Lounici, Massimiliano Pontil
arXiv Machine Learning
Jun 4

In-Context Graphical Inference

arXiv:2606. 05042v1 Announce Type: new Abstract: Marginal inference in discrete graphical models forces a choice between exactness and scalability: exact algorithms are intractable for high-treewidth graphs, while iterative approximations (Belief Propagation, variational methods) sacrifice convergence guarantees on frustrated topologies.

By Zehua Cheng, Wei Dai, Jiahao Sun
arXiv Machine Learning
Sep 14

Surrogate Modeling of 3D Rayleigh-Benard Convection with Equivariant Autoencoders

The paper introduces an end‑to‑end equivariant surrogate model for three‑dimensional Rayleigh‑Bénard convection, combining an equivariant convolutional autoencoder with an equivariant convolutional LSTM that employs $G$‑steerable kernels. The architecture exploits $D_4$‑steerable kernels in vertically stacked layers and partial kernel sharing in the vertical direction to respect the system’s E(2) equivariance in the horizontal plane while handling broken translational symmetry vertically. Experiments show notable improvements in sample and parameter efficiency and better scaling to more complex dynamics.

By Fynn Fromme, Hans Harder, Christine Allen-Blanchette, Sebastian Peitz
arXiv AI
Sep 1

EquiReg: Equivariance Regularized Diffusion for Inverse Problems

EquiReg introduces an equivariance‑regularized diffusion framework that penalises sampling trajectories deviating from the data manifold, thereby improving posterior sampling for inverse problems. By formalising manifold‑preferential equivariant functions—naturally arising from data augmentation or inherent symmetries—EquiReg guides diffusion steps toward symmetry‑preserving regions of the solution space. The method shows consistent gains in both linear and nonlinear image restoration tasks and partial differential equation solving, especially under reduced sampling and measurement consistency steps, and is available as open‑source code.

By Bahareh Tolooshams, Aditi Chandrashekar, Rayhan Zirvi, Abbas Mammadov, Jiachen Yao, Chuwei Wang, Anima Anandkumar