arXiv Computer Vision

4DGS-WAM: Bridging Past and Future with an Object-Centric World Action Model based on 4D Gaussian Splatting

The paper introduces 4DGS-WAM, an object‑centric world action model that uses a 4D Gaussian Splatting representation to separate dynamic objects from a static background. By predicting future actions of dynamic actors and their Gaussian splat transformations, the model can reuse previously observed static content for future state generation, reducing redundant background processing. Experiments on the KITTI‑MOT dataset demonstrate the model’s ability to perform short‑horizon prediction and past reconstruction.

arXiv Machine Learning
Oct 15

StateCraft: Augmenting Video World Models with Abstract-State Reasoning

StateCraft introduces a new architecture that separates a persistent, updatable abstract state from the visual state in video world models. By pairing a language model with a video diffusion model, it tracks entity changes over time and conditions visual generation on this abstract state. The approach is evaluated on generative interfaces and a new benchmark, showing improved generation quality, memory usage, and controllability, while enabling direct editing of unseen states and extending to spatial 3D environments.

By Lorenzo Venturoli, Nedko Savov, Xi Wang, Marc Pollefeys, Luc Van Gool
Hugging Face Trending Papers
Oct 13

Box-WAM: Box Trajectories as Compact State Representations for World Action Models

Box-WAM introduces a new approach to world action models (WAMs) by replacing dense future video predictions with oriented bounding box trajectories of task-relevant objects. This compact, object-centric representation reduces computational cost during training and inference while improving action prediction performance. The method demonstrates that box trajectory prediction can serve as an efficient alternative to full-frame video-based world action modeling for robotic manipulation tasks.

arXiv Computer Vision
Oct 27

FL4N: Feed-forward Latent Model for 4D Novel View Synthesis

arXiv:2610.35854v1 Announce Type: new Abstract: 4D novel view synthesis (NVS) aims to render dynamic scenes across viewpoints and timestamps, which requires jointly inferring 3D structure and tempora...

By Eunbeen Hong, Hyeonseo Yu, Honggyu An, Jooho Son, Hyunah Ko, Soowon Son, Chaehyun Kim, Jahyeok Koo, Jisoo Kim, Junhwa Hur, Seungryong Kim
arXiv Computer Vision
Oct 21

Learning the 4D World through Point Trajectory Forecasting

arXiv:2610.28594v1 Announce Type: new Abstract: Reliable multi-view forecasting requires videos from different cameras to describe the same evolving 3D scene. To this end, we introduce Video-Point Mo...

By Byungwoo Jeon, Sunghwan Hong, Dohyeon Kim, Jonghoon Lee, Jungwoo Park, Inhee Lee, Doosan Baek, Jinil Kim, Taehyun Lim, Hanbyul Joo, Marc Pollefeys, Saining Xie, Jinwoo Shin