arXiv Computer Vision

Risk Decomposition for Hallucination-Aware Video Sampling

arXiv Computer Vision
Oct 21

Robotic Video World Models: A Survey of Applications, Research Challenges, Future Directions

arXiv:2601.07823v2 Announce Type: cross Abstract: Video world models have emerged as promising candidates for high-fidelity world models, offering the potential to synthesize high-quality videos capt...

By Zhiting Mei, Tenny Yin, Ola Shorinwa, Apurva Badithela, Zhonghe Zheng, Joseph Bruno, Madison Bland, Lihan Zha, Asher Hancock, Jaime Fern\'andez Fisac, Philip Dames, Anirudha Majumdar
arXiv Computer Vision
Sep 14

Physics-Aware Video Generation via Agentic Planning and Graph-Guided Optimization

PhysPlan is a training‑free guidance framework that enhances video diffusion models by incorporating physical awareness through agentic physics simulation. It uses a vision‑language model to generate a Chain‑of‑Visual‑Thought representation of kinematic trajectories and 3D depth, which then drives an object‑centric test‑time optimization that isolates kinematic changes and locks the passive environment. The framework also employs Kinetic Intensity Profiling to adapt hyperparameters to varying physical deformations, and demonstrates superior performance on PhyGenBench and Physics‑IQ benchmarks compared to existing VDM baselines.

By Minh-Loi Nguyen, Xuan-Vu Le, Thanh-Toan Do, Tam V. Nguyen, Minh-Triet Tran, Trung-Nghia Le
Hugging Face Trending Papers
Jun 25

Hallucination in World Models is Predictable and Preventable

Modern generative world models render increasingly realistic action-controllable futures, yet they frequently hallucinate: rollouts remain visually fluent while drifting from the ground-truth dynamics. We hypothesize that hallucination concentrates in low-coverage regions of the state-action space, where lightweight data-centric signals can both detect it and guide mitigation.

arXiv Computer Vision
Oct 23

MotionHalluc: Diagnosing Kinematic Hallucinations in Fine-Grained Motion Reasoning

MotionHalluc is a benchmark designed to evaluate motion hallucinations in cross‑video comparison tasks, consisting of 1,540 fine‑grained questions over 553 video pairs. It assesses hallucinations across three dimensions—directional, attributional, and temporal—and reveals that current large multimodal models are highly susceptible to these errors. The authors also introduce a training‑free Perceive‑Parse‑Verify baseline that injects explicit kinematic measurements, achieving an average 10.6% performance improvement across models.

By Weile Guo, Shenghong He, Danying Mo, Chengdong Xu, Xuexun Liu, Chao Yu
arXiv AI
Aug 18

CaliBench: Are the Stochastic Dynamics of Video World Models Physically Calibrated?

arXiv:2608. 16829v1 Announce Type: cross Abstract: Video world models approximate the stochastic distribution of physical outcomes through generative sampling, but existing benchmarks score individual generations or compare distributions coarsely over a whole dataset, leaving the fine-grained aleatoric uncertainty of specific phenomena untested.

By Jonathan Sadeghi, Jenny Seidenschwarz, Jesse Allardice, Sirish Srinivasan, Benjamin Graham, Jeffrey Hawke
arXiv Computer Vision
Oct 12

Neural Voxel Dynamics: Learning Volumetric Feature Advection for 3D Physics in V-JEPA Latent Space

Neural Voxel Dynamics introduces a self‑supervised framework that learns 3D latent dynamics from monocular video by unprojecting V‑JEPAs features into a voxel grid using depth priors. It then applies Volumetric Feature Advection, an action‑conditioned transition model, to predict the evolution of these latent features directly in 3D, without relying on privileged physics‑engine states. The method is evaluated on synthetic and real datasets, demonstrating predictive fidelity, 3D geometric consistency, and physical plausibility via Physics‑IQ metrics.

By Zican Wang, Niloy Mitra
arXiv Computer Vision
Oct 9

Fluid-Gen-Zero: Grounding Pretrained Video Generators in Physics without Training

Fluid-Gen-Zero is a training-free framework that generates physics-aware fluid-object interaction videos by separating physical reasoning from appearance synthesis. It uses a physics simulator for motion dynamics and a pretrained video generator for visual quality, coordinated through a two-level agentic workflow involving a vision-language model for planning and latent-space guidance for simulation signals. The method improves simulation alignment and fluid flow accuracy across multiple backbones while maintaining perceptual quality, as shown by quantitative metrics and human preference studies.

By Hong Huang, Yuqiu Liu, Chenyu You, Daniel Martin, Chuhang Zou, Wuyang Chen