arXiv Computer Vision By Yueen Ma, Zenglin Xu, Irwin King

4DGS-WAM: Bridging Past and Future with an Object-Centric World Action Model based on 4D Gaussian Splatting

Read the original on arXiv Computer Vision →

The paper introduces 4DGS-WAM, an object‑centric world action model that uses a 4D Gaussian Splatting representation to separate dynamic objects from a static background. By predicting future actions of dynamic actors and their Gaussian splat transformations, the model can reuse previously observed static content for future state generation, reducing redundant background processing. Experiments on the KITTI‑MOT dataset demonstrate the model’s ability to perform short‑horizon prediction and past reconstruction.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Machine Learning
Oct 15

StateCraft: Augmenting Video World Models with Abstract-State Reasoning

StateCraft introduces a new architecture that separates a persistent, updatable abstract state from the visual state in video world models. By pairing a language model with a video diffusion model, it tracks entity changes over time and conditions visual generation on this abstract state. The approach is evaluated on generative interfaces and a new benchmark, showing improved generation quality, memory usage, and controllability, while enabling direct editing of unseen states and extending to spatial 3D environments.

By Lorenzo Venturoli, Nedko Savov, Xi Wang, Marc Pollefeys, Luc Van Gool