Learning to Correct Geometry in Generated Videos
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
The Flow has not summarised this story yet — read it at arXiv Computer Vision.
arXiv:2510.24904v2 Announce Type: replace Abstract: Although recent video generative models are getting more capable of following external camera controls, imposed by either text descriptions or came...
CameraEditor is a new framework that transforms camera-controlled image editing into a temporal sequence prediction problem. By using video diffusion models, it incorporates a geometric perception module and dynamic reference routing to create precise visual references through dynamic panorama cropping. The method also inserts intermediate transition frames to handle large perspective shifts, maintaining content identity and spatial coherence, and is evaluated on a dataset of 5,760 instances with a benchmark of 462 test cases, achieving state‑of‑the‑art performance.
Synthesizing a novel-view video from a monocular reference video along a target camera trajectory requires both geometric consistency and motion fidelity with respect to the reference video. Existing methods based on explicit 3D representations are limited by the accuracy of off-the-shelf reconstruction modules, which often produce inaccurate geometry for dynamic objects in monocular videos.
Momentum introduces a two-stage pipeline for video world models that uses synchronized multi-camera rigs to represent evolving scenes. The WorldUpdate stage generates shared reference-camera videos as a memory of scene dynamics, while WorldInteract grounds target camera video generation in this memory, ensuring moving objects remain represented outside the field of view. Experiments on CARLA street scenes show a 126.2% improvement in dynamic scene consistency over static image conditioning.
arXiv:2608. 05745v1 Announce Type: cross Abstract: Video Virtual Try-On (VVT) synthesizes a video of a person wearing a target garment while preserving identity, motion, and scene dynamics.
Generative Cinematographer (GenCine) lifts a single image into an editable 3D scene scaffold, allowing artists to jointly author camera paths and foreground motion using local 3D motion handles. The system projects these controls into guidance maps that encode handle positions and colors across frames, enabling a pretrained video model to follow camera-relative, piecewise-rigid motion without physics simulation. Training recovers controls from real videos and synthetic ground-truth geometry, and experiments demonstrate consistent camera-relative motion, improved geometric consistency, and strong controllability across diverse real-world scenes.