arXiv AI By Juan L. Gamella, Simon Bing, Jakob Runge

Sanity Checking Causal Representation Learning on a Simple Real-World System

Read the original on arXiv AI →

The paper evaluates causal representation learning (CRL) methods on a controlled optical experiment where the true causal factors are known. All selected methods fail to reliably recover these factors, even when the data-generating process is simplified to a synthetic version. The study highlights reproducibility issues and the importance of mixing function assumptions, underscoring the gap between theoretical promise and practical performance of CRL techniques.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
Sep 11

CausalArena: Benchmarking Causal Discovery in the Foundation Model Era

CausalArena is a new benchmark designed to evaluate causal discovery methods in the era of foundation models. It unifies synthetic structural causal models (SCMs), semantically grounded SCMs, and formula‑grounded SCMs, while also including real‑world datasets for external validation. Experiments show that performance rankings vary widely across different SCM families and protocols, indicating that strong results on one benchmark do not necessarily transfer to others.

By Zi-Rong Li, Si-Yang Liu, Tian-Zuo Wang, Han-Jia Ye