arXiv AI By Manvendra Modgil

Readable Is Not Steerable: Pre-Registered Tests of Physical Structure in Learned Fluid Representations

Read the original on arXiv AI →

The paper reports three pre‑registered studies on 2D Navier‑Stokes flow that examine whether self‑supervised models organize their latent spaces around physical fluid quantities. In Study 1, a joint‑embedding predictive architecture (JEPA) fails to outperform an untrained network in capturing fluid dynamics, while a JEPA trained on non‑physical dynamics and a static invariance model perform equally well or better. Study 2 shows that plain autoencoders make enstrophy prominent in their slowest latent directions, and adding VICReg reduces this prominence but improves linear decodability. Study 3 constructs steerable latent directions (“dials”) via routing; a loudness dial is found in all eight trained models and a shape dial in three of five seeds, though neither control shows a shape dial. Across all studies, the content of a latent and what can be controlled through it diverge, and exploratory experiments reveal that supervised spectral‑shape directions do not affect the output when steered.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Hugging Face Trending Papers
Jun 10

Sparse probes and murky physics: a case study of interpretability challenges in a foundation model for continuum dynamics

Generative AI emulators are increasingly used in scientific domains where we already have strong theory, benchmarks, and physical intuition. This raises a central evaluation and interpretability question: when a foundation-style model can reproduce known continuum dynamics, what internal mechanism supports that behavior, is the internal behaviour consistent with known physics, and how does it relate to where the emulator succeeds or fails?

arXiv Machine Learning
Oct 5

Drive vs. Decay: On the Training Dynamics of Joint-Embedding Predictive Architectures

The paper introduces a stability theory for Joint-Embedding Predictive Architectures (JEPAs), showing that training dynamics involve a driving force and a decay effect that determine representation collapse. By linearising the gradient flow, the authors derive a per‑mode stability ratio that separates data‑side and predictor‑side contributions, predicting a phase boundary confirmed across 800 configurations. Using this insight, they propose ResidualPred, a transformer predictor that biases attention toward the identity at initialization, improving representation rank and downstream accuracy on tabular and image benchmarks.

By Jos\'e Lucas De Melo Costa, Seong Woo Ahn, Fabrice Popineau, Arpad Rimmel, Bich-Li\^en Doan