arXiv AI By Sahil Sidheekh, Sriraam Natarajan

Building Expressive and Tractable Probabilistic Generative Models: A Review

Read the original on arXiv AI →

The article surveys recent progress in tractable probabilistic generative modeling, with a focus on Probabilistic Circuits (PCs). It offers a unified view of the trade‑offs between expressivity and tractability, outlining design principles, algorithmic extensions, and a taxonomy of the field. The review also covers deep and hybrid PCs that integrate ideas from deep neural models, and highlights challenges and open questions for future research.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Hugging Face Trending Papers
Aug 13

A Compositional Theory of Curvature in Probabilistic Circuits

Probabilistic Circuits (PCs) are generative models that support exact inference and, unlike deep neural networks, admit an exact and tractable measure of loss-surface curvature: the trace of the Hessian of the log-likelihood. Recent work regularizes this trace globally to bias learning toward flatter, better generalizing optima.

arXiv AI
Aug 14

A Compositional Theory of Curvature in Probabilistic Circuits

arXiv:2608. 12869v1 Announce Type: cross Abstract: Probabilistic Circuits (PCs) are generative models that support exact inference and, unlike deep neural networks, admit an exact and tractable measure of loss-surface curvature: the trace of the Hessian of the log-likelihood.

By Hrithik Suresh, Sahil Sidheekh, Shelar Parth Vijay, Yasir Z, Sriraam Natarajan, Narayanan Chatapuram Krishnan
arXiv Machine Learning
Sep 11

Particle GFlowNets: Rethinking Generative Marginalization Models

The paper introduces Particle GFlowNets, showing that Generative Marginalization Models (MaMs) are equivalent to Generative Flow Networks. It extends MaMs to non‑autoregressive sampling and proposes an automatic full‑state rejuvenation criterion based on the Gelman‑Rubin statistic to accelerate learning. Experiments demonstrate significant training speedups in large combinatorial spaces.

By Tiago da Silva, Diego Mesquita, Salem Lahlou