Reading, Writing, Sharing, and Interacting with the World through Video

The paper surveys recent progress in video foundation and world models, framing both as ways to relate video observations to an evolving latent world. It categorizes the literature into four operations—reading, writing, sharing, and interacting—highlighting how each addresses different aspects of understanding, generating, integrating, and updating world states from video. The authors trace a shift from clip‑level recognition toward persistent, controllable, and physically valid world representations, and outline remaining challenges.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

• benchmarks