OpenAI Blog
PixelCNN++: Improving the PixelCNN with discretized logistic mixture likelihood and other modifications
Read the original on OpenAI Blog →The Flow has not summarised this story yet — read it at OpenAI Blog.
Related stories
arXiv Machine Learning
Jul 28
PYPM-GGD: Pitman-Yor Process Mixture with Generalized Gaussian Density using ADAM
arXiv:2607. 24583v1 Announce Type: new Abstract: Large scale Bayesian nonparametrics (BNP) learner such as Stochastic Variational Inference (SVI) can handle datasets with large class number and large training size at fractional cost.
Hugging Face Trending Papers
Jun 29
Simplifying Flow Matching Transformations with Low-Rank Mixture Models
Normalizing flows are powerful generative models that learn an invertible mapping between complex data distributions and simple latent distributions, typically a standard normal density. However, this choice of latent density can impose unnecessary complexity on the learned flow transformation due to the topological mismatch between the latent and data densities, leading to slower training and suboptimal performance.
arXiv Machine Learning
Jun 30
Simplifying Flow Matching Transformations with Low-Rank Mixture Models
arXiv:2606. 29724v1 Announce Type: new Abstract: Normalizing flows are powerful generative models that learn an invertible mapping between complex data distributions and simple latent distributions, typically a standard normal density.
arXiv Machine Learning
Jul 28
Fisher Information based Stochastic Gradient Ascent for Online Learning of Dirichlet Process Mixture and Theory
arXiv:2412. 08951v3 Announce Type: replace Abstract: Scalable algorithms of posterior approximation allow Bayesian nonparametrics such as Dirichlet process mixture to scale up to larger dataset at fractional cost.
arXiv AI
Aug 11
A Sobering Look at Tabular Data Generation via Probabilistic Circuits
arXiv:2603. 23016v2 Announce Type: replace-cross Abstract: Tabular data is more challenging to generate than text and images, due to its heterogeneous features and much lower sample sizes.
arXiv AI
Jun 16
FastMix: Fast Data Mixture Optimization via Gradient Descent
arXiv:2606. 14971v1 Announce Type: cross Abstract: While large and diverse datasets have driven recent advances in large models, identifying the optimal data mixture for pre-training and post-training remains a significant open problem.