arXiv Machine Learning By Ruchi Sandilya, Conor Liston, Logan Grosenick

Identifiable World Models from Pretrained Diffusion Representations

Read the original on arXiv Machine Learning →

The paper demonstrates that a frozen pretrained diffusion model can be endowed with identifiable latent coordinates via a lightweight alignment map called Contrastive Diffusion Alignment (ConDA). By leveraging auxiliary-variable nonlinear ICA guarantees, ConDA aligns diffusion latents so that the resulting representation recovers latent dynamical states up to permutation and componentwise invertible transformations, preserves the underlying structural causal model, and simplifies lagged graph recovery. Experiments on physical and robotic video systems show that ConDA, especially under TCL and GCL assumptions, achieves near-perfect state recovery and accurate lagged graph reconstruction, even in simulated falling-body and bipedal robot scenarios.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Sep 25

RD-JEPA: Predictive latent pretraining for few-trajectory transfer across reaction--diffusion equations

RD‑JEPA is a joint‑embedding predictive architecture designed for self‑supervised pretraining on reaction‑diffusion trajectories. The model is pretrained on five parameterized systems and then adapted to three held‑out systems that were not seen during pretraining. Using as few as one, five, or ten complete trajectories from a held‑out system, RD‑JEPA outperforms five supervised surrogate baselines, an independently trained control that removes the trajectory‑dependent predictive latent pathway, and an architecture‑matched model trained from scratch, achieving lower mean relative discrete β field error and mean absolute spatial first‑difference error across various output resolutions, forecast horizons, and adaptation trajectory choices.

By Chenhao Si, Ming Yan