arXiv Machine Learning
Jun 8
MIST: Mutual Information Estimation Via Supervised Training
arXiv:2511. 18945v4 Announce Type: replace Abstract: We propose a fully data-driven approach to designing mutual information (MI) estimators.
ALICE: In-context, Zero-shot, Mutual Information Estimation
ALICE is a foundation model that estimates mutual information (MI) without per‑distribution training. Trained only on synthetic distributions, it acts as an in‑context estimator of rectified‑flow velocity fields, producing MI via a fixed identity that integrates squared differences between joint and conditional fields. The authors validate ALICE on a challenging benchmark and demonstrate its applicability to unseen data in biology, genetics, and neuroscience, achieving performance comparable to neural estimators trained separately for each distribution.
Related stories
arXiv AI
Jun 2
InfoAtlas: A Foundation Model for Zero-Shot Statistical Dependence Estimate
arXiv:2606. 00241v1 Announce Type: cross Abstract: Measuring statistical dependency between high-dimensional random variables is a fundamental task in data science and machine learning.
arXiv Machine Learning
2d ago
A Flow Matching Algorithm for Many-Shot Adaptation to Unseen Distributions
arXiv:2605.06272v2 Announce Type: replace Abstract: While generative modeling has achieved remarkable success on tasks like natural language-conditioned image generation, enabling model adaptation fr...
arXiv Machine Learning
Sep 1
Multi-Marginal Flow Matching with Adversarially Learnt Interpolants
arXiv:2510.01159v3 Announce Type: replace Abstract: Learning the dynamics of a process given sampled observations at several time points is an important but difficult task in many scientific applicat...
arXiv Statistics ML
2d ago
Zero Flux: Flow-Based Comparison of High-Dimensional Discrete Distributions
The paper introduces the Zero Flux criterion, a flow‑based method for comparing high‑dimensional discrete distributions. By extending a vector‑field approach from continuous to discrete settings, it defines local probability fluxes that vanish at the midpoint if and only if the two distributions are identical. The authors provide finite‑sample error bounds and demonstrate the method’s effectiveness on synthetic and real categorical data for detecting sparse dependence and tracking distribution shifts.
Hugging Face Trending Papers
Jul 21
ROMS-IMLE: A Minimalist Approach to Competitive Single-Step Generative Modelling
Generative models have undergone many generations of evolution, from VAEs/GANs to diffusion/flow matching. Along the way, the underlying techniques have become more complicated and various beliefs about what drives strong empirical performance have taken hold.
arXiv AI
Sep 2
Training-Free Refinement of Flow Matching with Divergence-based Sampling
The paper introduces Flow Divergence Sampler (FDS), a training‑free method that refines intermediate states in flow‑matching models by using the divergence of the marginal velocity field to detect and correct misguidance toward low‑density regions. FDS operates during inference, requires no additional training, and can be applied as a plug‑and‑play module with standard solvers and existing flow backbones. Experiments show that FDS consistently improves fidelity in tasks such as text‑to‑image synthesis and inverse problems.
arXiv AI
Sep 10
Deep Barycentric Regression for Optimal Transport Map Estimation and its Statistical Optimality
The paper introduces BROT, a two‑step approach for estimating optimal transport maps. First, it computes the unregularized OT plan, then fits a deep neural network to the resulting barycentric targets using least‑squares regression. The authors prove that, under standard regularity conditions, BROT achieves the minimax convergence rate when the true OT map is Lipschitz, and demonstrate its effectiveness on synthetic data, images, and downstream tasks such as single‑cell perturbation prediction and unsupervised domain adaptation.
arXiv Machine Learning
Jun 5
Coreset-Induced Conditional Velocity Flow Matching
arXiv:2605. 12951v2 Announce Type: replace-cross Abstract: We propose Coreset-Induced Conditional Velocity Flow Matching (CCVFM), a generative model that augments hierarchical rectified flow with a data-informed source distribution.
arXiv Machine Learning
Jun 2
Divergence is Uncertainty: A Closed-Form Posterior Covariance for Flow Matching
arXiv:2605. 00941v4 Announce Type: replace Abstract: Flow matching has become a leading framework for generative modeling, but quantifying the uncertainty of its samples remains an open problem.
arXiv Machine Learning
Aug 21
Continuous Adversarial MeanFlow Transfer
arXiv:2608. 19540v1 Announce Type: new Abstract: Training fast generators on new domains with limited data remains challenging for two reasons.
arXiv AI
Jul 15
Self-Consistent Flow: Unifying Velocity and Endpoint Prediction for Rectified Flow Models
arXiv:2607. 12171v1 Announce Type: cross Abstract: In rectified-flow-based generative models, the neural network can be trained to predict two different targets, such as the instantaneous velocity or the data endpoint, to perform denoising.