arXiv Machine Learning
Aug 6
Stable GFlowNets with TV Monitoring and Probabilistic Guarantees
arXiv:2605. 01729v2 Announce Type: replace Abstract: Generative Flow Networks (GFlowNets) learn to sample states proportional to an unnormalized reward.
Trajectory balance: Improved credit assignment in GFlowNets
The paper introduces a new learning objective called trajectory balance for Generative Flow Networks (GFlowNets), aiming to improve credit assignment across long action sequences. It demonstrates that minimizing this objective yields a policy that samples exactly from the target distribution. Experiments on four domains show that trajectory balance enhances convergence, sample diversity, and robustness to long sequences and large action spaces.
Related stories
arXiv Machine Learning
Jun 5
Your GFlowNet Secretly Learns an Optimal Transport Plan
arXiv:2606. 06272v1 Announce Type: new Abstract: Generative Flow Networks (GFlowNets) are a framework for sampling structured objects via stochastic trajectories in a directed graph.
arXiv Machine Learning
Aug 6
GFlowNet Training by Policy Gradients
arXiv:2408. 05885v3 Announce Type: replace Abstract: Generative Flow Networks (GFlowNets) have been shown effective to generate combinatorial objects with desired properties.
arXiv AI
Jun 16
Proximal Policy Optimization for Amortized Discrete Sampling
arXiv:2606. 15793v1 Announce Type: cross Abstract: This paper explores policy gradient algorithms for training stochastic policies to sample from structured discrete probability distributions under the Generative Flow Network (GFlowNet) framework.
arXiv AI
1d ago
Action abstractions for amortized sampling
The paper introduces a method that integrates action abstraction into policy optimization for reinforcement learning and generative flow networks. By iteratively identifying frequently used action subsequences in high‑reward trajectories and treating them as single high‑level actions, the approach expands the action space and improves sample efficiency. Experiments on synthetic and real‑world tasks show that this technique discovers diverse high‑reward states more effectively, especially on challenging exploration problems, and yields interpretable abstract actions that reflect the underlying reward structure.
arXiv Machine Learning
Aug 5
Information-Geometric Forward Policy Training in GFlowNets
arXiv:2608. 03967v1 Announce Type: cross Abstract: Generative Flow Networks (GFlowNets) have emerged as a flexible framework for amortised inference over discrete and mixed discrete-continuous objects, requiring only an unnormalised target density specified through a reward.
arXiv Machine Learning
3d ago
GFlowNets and variational inference
arXiv:2210.00580v4 Announce Type: replace Abstract: This paper builds bridges between two families of probabilistic algorithms: (hierarchical) variational inference (VI), which is typically used to m...
arXiv Machine Learning
Jun 16
Stop the Sampler! Classifier-Based Adaptive Stopping for Sampling Kernels
arXiv:2606. 16073v1 Announce Type: new Abstract: Sampling from complex, unnormalized probability densities is a fundamental challenge in Bayesian inference and probabilistic modeling.
arXiv Machine Learning
3d ago
Expected flow networks in stochastic environments and two-player zero-sum games
arXiv:2310.02779v3 Announce Type: replace Abstract: Generative flow networks (GFlowNets) are sequential sampling models trained to match a given distribution. GFlowNets have been successfully applied...
arXiv Machine Learning
4d ago
Let the Flows Tell: Solving Graph Combinatorial Optimization Problems with GFlowNets
The paper introduces a method for tackling combinatorial optimization (CO) problems—often NP‑hard—by leveraging GFlowNets to sample solutions from the solution space. It designs Markov decision processes tailored to various CO tasks and trains conditional GFlowNets, incorporating efficient training techniques for long‑range credit assignment. Experiments on synthetic and realistic datasets show that these GFlowNet policies can efficiently locate high‑quality solutions, and the implementation is publicly available.
arXiv AI
Jun 24
FlowPipe: LLM-Enhanced Conditional Generative Flow Networks for Data Preparation Pipeline Construction
arXiv:2606. 24679v1 Announce Type: cross Abstract: Data preparation pipelines improve data quality in machine learning by transforming raw tables into learning-ready data through sequential cleaning and feature transformation operators.
arXiv Machine Learning
Jul 21
Routing by Reaching: Composition of Pre-trained GFlowNets for Multi-Objective Generation
arXiv:2602. 21565v3 Announce Type: replace Abstract: Generative Flow Networks (GFlowNets) learn to sample diverse candidates in proportion to a reward function, making them well-suited for scientific discovery, where exploring multiple promising solutions is crucial.