arXiv AI
Aug 6
Seeking Physics in Diffusion Noise
arXiv:2603. 14294v3 Announce Type: replace-cross Abstract: Do video diffusion models encode signals predictive of physical plausibility?
The Invisible Hand of Physics: When Video Diffusion Models Know More Than They Show
arXiv:2606. 05328v1 Announce Type: cross Abstract: Modern video diffusion models generate increasingly realistic and temporally coherent videos, motivating their use as candidate world simulators.
Related stories
arXiv Machine Learning
Sep 22
Why Do Video Diffusion Models Violate Physics? Unveiling the Flaws in Attention Mechanisms
arXiv:2609.23658v1 Announce Type: cross Abstract: Despite impressive visual quality, state-of-the-art video diffusion models often generate content that violates real-world physical laws. While exist...
arXiv Computer Vision
Aug 25
Steering Video Diffusion Transformers with Massive Activations
arXiv:2603.17825v2 Announce Type: replace Abstract: In this work, we study the role of Massive Activations (MAs), which are rare, high-magnitude spikes confined to a few fixed hidden dimensions in vi...
arXiv Machine Learning
Jul 30
Mitigating Compounding Error via Video Representation Regularization
arXiv:2607. 27036v1 Announce Type: cross Abstract: Video diffusion-based world models enable long autoregressive video generation for robotics, autonomous driving and simulation tasks, yet sliding-window autoregressive inference suffers from severe error accumulation that degrades frame quality over time.
arXiv Computer Vision
3d ago
Enhancing Autoregressive Video Generation via Representation Adversarial Distillation
arXiv:2609.40037v1 Announce Type: new Abstract: Few-step autoregressive video generation enables efficient streaming synthesis, but errors introduced in early temporal blocks are reused as context an...
arXiv Machine Learning
Jul 9
Gen4U: Unifying Video Generation and Understanding via Diffusion
arXiv:2607. 06856v1 Announce Type: cross Abstract: Prior work suggests that diffusion representations capture low-level geometry but struggle with high-level semantics.
arXiv AI
Jun 17
Phys4D: Fine-Grained Physics-Consistent 4D Modeling from Video Diffusion
arXiv:2603. 03485v3 Announce Type: replace-cross Abstract: Recent video diffusion models have achieved impressive capabilities as large-scale generative world models.
arXiv AI
Sep 15
How Do Video Foundation Models Encode Intuitive Physics? Probing Across Pretraining Paradigms
arXiv:2606.09646v2 Announce Type: replace-cross Abstract: We study whether pretrained video foundation models encode intuitive-physics information in their frozen representations, and how this inform...
arXiv AI
Jun 9
What Makes Video World Model Latents Action-Relevant: Prediction over Reconstruction
arXiv:2606. 07687v1 Announce Type: cross Abstract: Video world models are increasingly used to provide predictive visual representations, yet it remains unclear which pretraining signals induce action-relevant structure in their latent spaces.
arXiv Machine Learning
Jun 11
Physics-Driven Spatiotemporal Modeling for AI-Generated Video Detection
arXiv:2510. 08073v2 Announce Type: replace-cross Abstract: AI-generated videos have achieved near-perfect visual realism (e.
arXiv AI
Jun 9
Do Video Foundation Models Understand Intuitive Physics? A Layerwise Probing Analysis
arXiv:2606. 09646v1 Announce Type: cross Abstract: We study whether pretrained video foundation models encode intuitive-physics information in their frozen representations, and how this information varies across model families, layers, and probe types.
arXiv AI
Jul 20
Toward a mechanistic understanding of inference in visual cortex and diffusion models
arXiv:2607. 15693v1 Announce Type: cross Abstract: We describe a model of perceptual inference in primary visual cortex (V1) equivalent to a minimal diffusion model whose function can be readily understood from its parameters.