arXiv Machine Learning

Primal-Dual Flow Matching for Sample-Wise Constrained Generation

The paper introduces Primal-Dual Flow Matching (PDFM), a method for learning data generators that satisfy user‑specified sample‑wise constraints with a guaranteed probability of satisfaction. PDFM builds on a population‑level constrained negative log‑likelihood objective and a flow‑matching parameterization, providing theoretical guarantees under regularity and expressivity assumptions. Practically, PDFM requires only binary membership oracle feedback, avoids differentiable distance metrics or convexity assumptions, and empirically outperforms vanilla flow matching while maintaining distributional fidelity.

arXiv AI
Jun 12

PolyFlow: Safe and Efficient Polytope-Constrained Flow Matching with Constraint Embedding and Projection-free Update

arXiv:2606. 13400v1 Announce Type: cross Abstract: While flow-based generative models have demonstrated strong performance across a wide range of domains, deploying them in safety-critical physical systems remains challenging due to strict constraint requirements.

By Jianming Ma, Qiyue Yang, Yang Zhang, Liyun Yan, Zhanxiang Cao, Yazhou Zhang, Yue Gao
arXiv Machine Learning
Oct 8

ORACLE: Optimizer-Relative Alignment for Constrained LEarning

The paper introduces ORACLE, a method for constrained learning that evaluates constraint compatibility after the optimizer has taken a step, rather than before. ORACLE performs a joint endpoint linearization of diverse constraint families, constructs an alignment in the optimizer’s geometry, bounds its authority, and commits the adjustment only after validation. Experiments on eight PDE benchmarks with four different optimizers show that ORACLE matches or improves performance in 94% of configurations, outperforming other constraint-handling approaches.

By Utkarsh Grover, Wyatt Mackey, Kaixun Hua, J. Morris Chang, Xiaomin Lin
arXiv Machine Learning
Oct 2

A Flow Matching Algorithm for Many-Shot Adaptation to Unseen Distributions

The paper introduces Function Projection for Flow Matching (FP‑FM), an algorithm that conditions generative models directly on samples from a target distribution. FP‑FM learns basis functions spanning velocity fields for training distributions and adapts to new distributions via a simple least‑squares projection, enabling efficient sample generation without additional training at inference time. Variants of the method trade expressivity for computational cost by enriching coefficient calculations, and the approach shows markedly better precision and recall than baselines, especially on unseen distributions.

By Tyler Ingebrand, Ruihan Zhao, Kushagra Gupta, David Fridovich-Keil, Sandeep P. Chinchali, Ufuk Topcu
arXiv AI
Aug 28

CG4AI: A Column Generation Framework for Training AI Models Under Constraints

CG4AI is a column generation framework that trains AI models while enforcing linear constraints on their outputs. It constructs a convex combination of models, using a master linear program to set mixture weights and a pricing subproblem to generate new models guided by dual variables, focusing on the most violated constraints. The method is applied to MNIST digit classification—demonstrating constraint learning, adversarial robustness, error correction, and output relabeling—and to multi‑commodity flow routing, achieving feasible predictors with higher accuracy than single‑model baselines.

By Youcef Magnouche, Abderrahmane Driouch, S\'ebastien Martin, Pierre Bauguion
arXiv Machine Learning
Sep 10

ParetoTransport: Generative Optimization by Mass Transport Toward The Pareto Front

ParetoTransport is a training‑free guidance method for pre‑trained flow‑matching models that explicitly refines a population‑level distribution in objective space. It iteratively transports the empirical offline distribution toward the Pareto front using Wasserstein matching to intermediate proxy distributions, thereby controlling distributional displacement and mass allocation along the front. The authors prove a convergence result and show state‑of‑the‑art performance on standard offline multi‑objective optimization benchmarks, evaluating beyond hypervolume to generational distance, inverted generational distance, and Wasserstein distance.

By Stephanie Holly, Sepp Hochreiter, Werner Zellinger