arXiv AI By Pedro Dall'Antonia, Juan Belieni, Ana Carolina Erthal, Saullo H. G. de Oliveira, Eliezer de Souza da Silva, Diego Mesquita

Hierarchical Cooperative GFlowNets

Read the original on arXiv AI →

Hierarchical Cooperative GFlowNets (HCG) dynamically partition the search space to coordinate multiple GFlowNets, preventing them from collapsing onto the same high‑reward regions. HCG imposes an ordering where the top model explores the full space while lower‑ranked models focus on uncovered areas, using a shared classifier and a normalizer‑weighted aggregation rule to maintain reward‑proportional sampling. Experiments on multimodal distributions, sequence generation, combinatorial optimization, and biological sequence design demonstrate that HCG improves mode coverage and target approximation, enabling broader complementary exploration.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
Sep 11

Partial GFlowNet: Accelerating Convergence in Large State Spaces via Strategic Partitioning

The paper introduces Partial GFlowNet, a method that partitions a large state space into overlapping partial state spaces to accelerate convergence of Generative Flow Networks. By restricting the actor’s exploration to these smaller regions and using a heuristic to switch between them, the approach enables efficient identification of high‑reward subregions. Experiments on popular datasets show that Partial GFlowNet converges faster, produces higher‑reward candidates, and improves diversity compared to existing methods.

By Xuan Yu, Xu Wang, Rui Zhu, Yudong Zhang, Yang Wang
arXiv Machine Learning
Sep 1

GFlowNets and variational inference

arXiv:2210.00580v4 Announce Type: replace Abstract: This paper builds bridges between two families of probabilistic algorithms: (hierarchical) variational inference (VI), which is typically used to m...

By Esmeralda S. Whitammer, Salem Lahlou, Tristan Deleu, Xu Ji, Edward Hu, Katie Everett, Dinghuai Zhang, Yoshua Bengio
arXiv Machine Learning
Jul 16

GFlowRL: Scaling Distribution-Matching RL to Large Language Models

arXiv:2607. 13394v1 Announce Type: cross Abstract: Generative Flow Networks (GFlowNets) offer a promising alternative to reward-maximizing reinforcement learning (RL) for large reasoning models, encouraging diverse reasoning paths by matching reward distributions rather than collapsing to dominant modes.

By Xiaodong Liu, Michael Xu, Jack W. Stokes, Paul Smolensky, Doug Burger, Jianfeng Gao
arXiv AI
Oct 7

Learning a Mixture of GFlowNets

arXiv:2610.07562v1 Announce Type: cross Abstract: Learning an ensemble of GFlowNets to sample from a discrete target distribution has become a common approach for achieving better state space explora...

By Tiago da Silva, Amauri H. Souza, Salem Lahlou
arXiv Machine Learning
Jul 21

Routing by Reaching: Composition of Pre-trained GFlowNets for Multi-Objective Generation

arXiv:2602. 21565v3 Announce Type: replace Abstract: Generative Flow Networks (GFlowNets) learn to sample diverse candidates in proportion to a reward function, making them well-suited for scientific discovery, where exploring multiple promising solutions is crucial.

By Seokwon Yoon, Youngbin Choi, Seunghyuk Cho, Seungbeom Lee, MoonJeong Park, Dongwoo Kim
arXiv AI
Oct 31

Rethinking GFlowNet Training: Negative Reinforce Dynamics

The paper introduces Negative Reinforce Dynamics (NRD), a new training approach for Generative Flow Networks (GFlowNets) that addresses the exploration–correctness trade‑off inherent in standard semi‑gradient updates. By linking the full gradient to a min‑min dynamic between a GFlowNet and a decoupled sampler, NRD effectively reduces balance errors in high‑error regions while preserving a single‑policy framework. Experiments on standard benchmarks show that NRD speeds up convergence and improves exploration efficiency compared to existing methods, without requiring a separate teacher or auxiliary policy.

By Pedro Dall'Antonia, Daniel Csillag, Diego Mesquita