arXiv AI

Generative AI for Validating Physics Laws

arXiv Machine Learning
Oct 23

ACTIVA: Amortized Causal Effect Estimation via Variational Autoencoders

ACTIVA is a transformer‑based conditional variational autoencoder designed to estimate full interventional distributions from observational data without requiring interventional data, a causal graph, or per‑task fitting. It learns a conditional latent prior that amortizes causal knowledge across diverse training tasks, enabling a single forward pass to handle new causal models drawn from the training distribution. Empirical results on synthetic and biologically realistic gene‑expression simulations show that ACTIVA outperforms correlational baselines, reduces spurious non‑descendant effects, and matches strong amortized baselines, while also validating its theoretical mixture‑of‑distributions property on observationally equivalent models.

By Andreas Sauter, Saber Salehkaleybar, Frank van Harmelen, Aske Plaat, Erman Acar
Hugging Face Trending Papers
Jul 5

Optimal Mixture-of-Experts Model Averaging for Conditional Generative Models

Conditional generative models have emerged as powerful tools for sampling from target conditional distributions, driving substantial advances across a wide range of scientific and applied domains. As these models proliferate, practitioners often face multiple plausible generators whose performance can vary with the task, data, or input condition.

arXiv Machine Learning
Aug 7

Kastor: An efficient fine-tuning strategy for generative emulation of PDE simulations

arXiv:2608. 06107v1 Announce Type: new Abstract: Machine learning offers a promising avenue to accelerate physical simulations by replacing computationally expensive traditional Partial Differential Equation (PDE) solvers with fast, differentiable surrogate models.

By Guillaume Couairon, Alexis Jacq, Yu-Han Wu, Renu Singh, Yana Hasson, Quentin Berthet, Romuald Elie
arXiv Machine Learning
Oct 22

Residual-Based Causal Discovery via Pretrained In-Context Quantile Regression

Residual-Based Causal Discovery via Pretrained In-Context Quantile Regression proposes Loscar, an extension of the RESIT framework to location-scale noise models (LSNMs). Loscar estimates conditional mean and scale using quantile regression, allowing pretrained tabular foundation models to serve as plug‑in estimators. Experiments on bivariate and multivariate causal‑discovery benchmarks show that in‑context quantile regression outperforms a feasible generalized least squares (FGLS) variant, especially when causes are multivariate.

By Daniel Klippert, Quang Nhat Huynh, Alexander Marx
arXiv Machine Learning
Oct 28

A Causal Bootstrap for Diverse Image Generation under Unobserved Confounding

The paper introduces CauVaDE, a causal generative model that represents an unobserved confounder as a discrete latent cluster, enabling accurate approximation of both observational and interventional image distributions. It demonstrates that this representation can capture diverse causal explanations without sacrificing fit to the data. A novel causal bootstrap method is proposed to vary confounder entropy, producing a family of distinct interventional image distributions.

By Jingyuan Chen, Kangrui Ruan, Junzhe Zhang
arXiv Machine Learning
Jun 30

Distributional Causal Mediation via Conditional Generative Modeling

arXiv:2605. 01765v2 Announce Type: replace-cross Abstract: Mediation analysis has traditionally focused on outcome-level summary contrasts, such as mean effects, which may obscure substantial distributional changes induced by complex and nonlinear causal mechanisms.

By Jinlun Zhang, Haoneng Huang, Zishu Zhan, Chunquan Ou
arXiv Machine Learning
Aug 27

Controlling for Omitted Variable Bias in Deep Neural Networks

The paper introduces a control‑variable framework for deep neural networks to mitigate omitted variable bias, particularly shortcut learning where covariates like demographics influence predictions. It refits the final layer of a pre‑trained network using cross‑fitting with ridge penalisation, orthogonalises covariate effects, and marginalises predictions over covariate distributions to achieve unbiased, interpretable results. Experiments on simulated images and neuroimaging data show consistent estimation of true effects and performance close to models trained on unconfounded data.

By Manuel Pfeuffer, Roshan Prakash Rane, Kerstin Ritter, Sonja Greven
arXiv Machine Learning
Oct 16

Classical methods for modern applications: synthetic tabular data generation using lightweight discrete response continuous latent variable model

The paper introduces a lightweight algorithm for modeling tabular data with both continuous and discrete variables. It transforms data into a continuous latent space using empirical marginals and a quantile function, enabling efficient estimation with distributions like a multivariate Gaussian. The method preserves complex marginal distributions and correlations, and handles discrete variables via a Monte Carlo expectation‑maximisation framework that allows conventional maximum‑likelihood estimation.

By Bartosz Barzdajn, Mateusz Krzyszto\'n