OpenAI Blog
Nov 8, 2016
Variational Autoencoders (VAEs) Explained: From Theory to ELBO and the Reparameterization Trick
A clear, math-first walkthrough of how VAEs learn to generate new data The post Variational Autoencoders (VAEs) Explained: From Theory to ELBO and the Reparameterization Trick appeared first on Towards Data Science .
Related stories
arXiv Machine Learning
Jun 25
Variational Autoencoder Layer
arXiv:2606. 25900v1 Announce Type: new Abstract: Variational Autoencoders (VAEs) belong to a family of autoencoders with probabilistic properties, making them well suited for generating data by producing a smooth and continuous latent space.
Hugging Face Trending Papers
Jun 24
Variational Autoencoder Layer
Variational Autoencoders (VAEs) belong to a family of autoencoders with probabilistic properties, making them well suited for generating data by producing a smooth and continuous latent space. Despite being introduced over a decade ago, the method continues to be widely adopted in both research and industry for diverse applications.
arXiv Machine Learning
Jun 4
Geometry-Preserving Encoder/Decoder in Latent Generative Models
arXiv:2501. 09876v3 Announce Type: replace-cross Abstract: Generative modeling aims to generate new data samples that resemble a given dataset.
Towards Data Science
Jul 14
A Gentle Introduction to Autoencoders & Latent Space
Introduction Heavy computation is a well-known problem in various ML algorithms today, especially when generative AI is applied to text, images, and other unstructured data. One of the principal approaches to mitigate this problem is to compress input data into a lower-dimensional representation while preserving the main context.
arXiv Machine Learning
Jun 17
Variational autoencoders with latent high-dimensional steady geometric flows for dynamics
arXiv:2410. 10137v5 Announce Type: replace Abstract: We develop Riemannian approaches to variational autoencoders (VAEs) for PDE-type ambient data with regularizing geometric latent dynamics, which we refer to as VAE-DLM, or VAEs with dynamical latent manifolds.
arXiv Machine Learning
Jul 8
$\mathbf{\lambda}$-VAE: Variance Equalization for Posterior Collapse
arXiv:2607. 05531v1 Announce Type: new Abstract: Variational Autoencoders (VAEs) frequently suffer from posterior collapse, a failure mode in which the approximate posterior converges to the prior, rendering the latent code uninformative.
arXiv Machine Learning
Jun 2
How Neural Losses Shape VAE Latents
arXiv:2606. 00635v1 Announce Type: new Abstract: Modern VAEs are rarely trained with the pointwise likelihood implied by the standard $\beta$-VAE objective.
arXiv Machine Learning
Jul 28
Soft-Constrained Optimization of Latent Space in Variational Autoencoders
arXiv:2607. 23751v1 Announce Type: new Abstract: The usefulness of a variational autoencoder (VAE) depends on two properties of its latent space that are hard to obtain together: high encoding capacity in the individual latent variables, and a low-dimensional, disentangled organization of those variables.
arXiv Machine Learning
Jul 7
Variational Sparse Paired Autoencoders (vsPAIR) for Inverse Problems and Uncertainty Quantification
arXiv:2602. 02948v3 Announce Type: replace Abstract: Inverse problems are fundamental to many scientific and engineering disciplines; they arise when one seeks to reconstruct hidden, underlying quantities from noisy measurements.
arXiv AI
Aug 12
ELVAE: Evidential Learning-Based Variational Autoencoder for Uncertainty-Aware Generation
arXiv:2608. 10398v1 Announce Type: cross Abstract: Variational autoencoders generate samples from probabilistic latent representations but do not distinguish uncertainty about the latent location from variability around it.
arXiv Machine Learning
Jun 9
Discovering and decoding latent mean-field structure with variational autoencoders
arXiv:2606. 08694v1 Announce Type: cross Abstract: Generative models are increasingly used to capture correlations in many-body systems, but the representations they learn remain largely opaque to physical interpretation.