arXiv Machine Learning

Learning Where to Steer: Noise-Space Geometry for Efficient Offline Multi-Objective Optimization with Generative Models

arXiv AI
Jun 2

Efficient Weighted Sampling via Score-based Generative Models

arXiv:2502. 04646v2 Announce Type: replace-cross Abstract: Weighted sampling -- sampling from a probability density function (PDF) proportional to the product of a base PDF and a weight function -- is a fundamental technique with wide-ranging applications in variance reduction, biased sampling, data augmentation, and more.

By Heasung Kim, Taekyun Lee, Hyeji Kim, Gustavo de Veciana
arXiv Machine Learning
Sep 10

ParetoTransport: Generative Optimization by Mass Transport Toward The Pareto Front

ParetoTransport is a training‑free guidance method for pre‑trained flow‑matching models that explicitly refines a population‑level distribution in objective space. It iteratively transports the empirical offline distribution toward the Pareto front using Wasserstein matching to intermediate proxy distributions, thereby controlling distributional displacement and mass allocation along the front. The authors prove a convergence result and show state‑of‑the‑art performance on standard offline multi‑objective optimization benchmarks, evaluating beyond hypervolume to generational distance, inverted generational distance, and Wasserstein distance.

By Stephanie Holly, Sepp Hochreiter, Werner Zellinger