arXiv Computer Vision By Zhufeng Xu, Henglei Lv, Bailin Deng, Yikang Ding, Xiaoqiang Liu, Guoxin Zhang, Hongbo Fu, Lin Gao

GLIMPSE: Global-Local Indexing with Multi-Precision Spectral Encoding for Explorable Video World Models

Read the original on arXiv Computer Vision →

GLIMPSE is a global‑local memory interface for camera‑controlled video world models that uses band‑wise multi‑precision coordinates and geometry‑conditioned spectral attenuation to reduce errors from inaccurate projected addresses. It combines local patch memory for view‑specific appearance with recurrent global memory for scene context, and employs footprint‑guided retrieval to select historical patches within a fixed local read budget. Compared with deterministic positional transport, GLIMPSE improves geometric correspondence and photometric consistency under matched retrieval and read budgets.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv AI
Sep 7

AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories

AnchorWeave is a memory‑augmented video generation framework that replaces a single misaligned global memory with multiple clean local geometric memories. It retrieves local memories based on coverage of the target trajectory and integrates them through a multi‑anchor weaving controller during generation. Experiments show that this approach improves long‑term scene consistency while preserving visual quality, with ablation studies confirming the benefits of local conditioning, multi‑anchor control, and coverage‑driven retrieval.

By Zun Wang, Han Lin, Jaehong Yoon, Jaemin Cho, Yue Zhang, Mohit Bansal
arXiv Computer Vision
Aug 31

LayerRecall: A State-Conditioned Memory Router for Long-Horizon Consistency in Video Generation

LayerRecall is a memory router for autoregressive video diffusion that selectively retrieves and injects historical key/value states into specific layers of the model, based on the current context. It addresses the problem that existing memory mechanisms expose nonlocal history but do not guarantee effective use, by recognizing that different layers prefer current, recent, or distant context. The method, combined with Cross‑Horizon Prediction Matching, achieves state‑of‑the‑art long‑range consistency on MemoBench and MovieBench while maintaining local continuity and incurring negligible inference overhead.

By Yixuan Ding, Jiahao Kong, Wei Huang, Ruijie Quan, Yi Yang
arXiv Computer Vision
Oct 9

Learning to Retrieve: Internalizing Memory Retrieval for Video World Models

The paper introduces Learning-to-Retrieve (L2R), a method that embeds memory retrieval directly into video world models. By using the model’s internal state as a memory and employing a camera‑conditioned retrieval gate and a retrieval trigger supervised by a 3D re‑visibility signal, the approach learns when and what historical information to access. This eliminates the need for external memory systems and improves long‑term scene consistency across various base models and camera‑revisit benchmarks.

By JiaKui Hu, Tailai Chen, Yuqi Pan, Xuerui Qiu, Jialun Liu, Xiao Cao, Zhenxin Zhu, Guang Chen, Hangjun Ye, Bing Wang, Yanye Lu
arXiv Computer Vision
6d ago

Memorize When Needed: Decoupled Memory Control for Spatially Consistent Long-Horizon Video Generation

The paper introduces a decoupled memory control framework for spatially consistent long‑horizon video generation. By separating memory conditioning from generation, it uses a lightweight memory branch to learn spatial consistency from past observations and a per‑frame cross‑attention mechanism to condition each frame on the most relevant historical data. A camera‑aware gating mechanism further ensures memory is used only when meaningful references exist, resulting in lower training costs, higher spatial consistency, and state‑of‑the‑art visual quality.

By Yanjun Guo, Zhengqiang Zhang, Pengfei Wang, Xinyue Liang, Zhiyuan Ma, Lei Zhang