arXiv Computer Vision September 18, 2026 By Guangzhao He, Hadar Averbuch-Elor, Wei-Chiu Ma

Can 4D Foundation Models Remember?

Read the original on arXiv Computer Vision →

The paper "Can 4D Foundation Models Remember?" introduces PersistBench, a dataset and metric suite that uses 360° videos to evaluate visual memory in 4D foundation models. It focuses on three aspects—object permanence, motion continuity, and appearance preservation—to assess how well models remember objects after they leave the field of view. Experiments show that current models only maintain short‑term consistency, revealing a significant gap between perception and robust memory.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

benchmarks

arXiv Machine Learning

Aug 10

Addressable Memory for Video World Models

arXiv:2608. 07408v1 Announce Type: cross Abstract: We study visual persistence in interactive video world models.

By Xindi Wu, Sven Elflein, James Lucas, Olga Russakovsky, Laura Leal-Taix\'e, Despoina Paschalidou, Jonathan Lorraine, Aljo\v{s}a O\v{s}ep

rag benchmarks

arXiv AI

Aug 14

AlayaWorld: Interactive Long-Horizon World Modeling - Full Technical Report (v1.1)

arXiv:2608. 13492v1 Announce Type: new Abstract: This report presents an improved version of AlayaWorld.

By AlayaWorld Team, Kaipeng Zhang, Chuanhao Li, Yifan Zhan, Yongtao Ge, Yuanyang Yin, Jiaming Tan, Kang He, Liaoyuan Fan, Mingliang Zhai, Ruicong Liu, Xiaojie Xu, Xuangeng Chu, Zhen Li, Zhengyuan Lin, Zhixiang Wang, Zian Meng, Zihui Gao

diffusion

arXiv Computer Vision

2d ago

4Director: Controlling Video World Models with Rigid 3D Geometry

arXiv:2610.02160v1 Announce Type: new Abstract: Precise control over camera and object motion is essential for professional video production. Existing methods control objects only coarsely, through i...

By Wei Cao, Hao Zhang, Vikram Voleti, Yuqun Wu, Mallikarjun B R, Shimon Vainer, Mark Boss, Yaoyao Liu

arXiv Computer Vision

Aug 31

LayerRecall: A State-Conditioned Memory Router for Long-Horizon Consistency in Video Generation

LayerRecall is a memory router for autoregressive video diffusion that selectively retrieves and injects historical key/value states into specific layers of the model, based on the current context. It addresses the problem that existing memory mechanisms expose nonlocal history but do not guarantee effective use, by recognizing that different layers prefer current, recent, or distant context. The method, combined with Cross‑Horizon Prediction Matching, achieves state‑of‑the‑art long‑range consistency on MemoBench and MovieBench while maintaining local continuity and incurring negligible inference overhead.

By Yixuan Ding, Jiahao Kong, Wei Huang, Ruijie Quan, Yi Yang

diffusion

Hugging Face Trending Papers

Sep 21

WorldCrafter: Consistent Video World Model with Implicit 3D-aware Memory

Video world models enable interactive exploration of dynamic environments, yet struggle to respect prior observations over long horizons and across viewpoints. We present WorldCrafter, a video world m...

efficiency

arXiv AI

Jun 4

Beyond Pixel Histories: World Models with Persistent 3D State

arXiv:2603. 03482v2 Announce Type: replace-cross Abstract: Interactive world models continually generate video by responding to a user's actions, enabling open-ended generation capabilities.

By Samuel Garcin, Thomas Walker, Steven McDonagh, Tim Pearce, Hakan Bilen, Tianyu He, Kaixin Wang, Jiang Bian

agents