arXiv Computer Vision
Off-Manifold Refinement: Guiding Video Generators with a Frozen World Model
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv Computer Vision
Sep 11
World in World: Explore the World with World Models
World in World introduces a training‑free, inference‑time interface that transforms diverse control signals—such as source‑video observations, target‑view projections, geometry renderings, and retrieved states—into camera‑ and time‑labelled visual states. These states are processed by a frozen causal video model’s self‑attention, enabling tasks like camera‑controlled rerendering, long‑horizon revisiting, and human‑motion transfer without additional training. The method employs a correspondence router and evidence‑wise attention to align token identities and regulate auxiliary channel contributions during a single denoising pass.
arXiv Computer Vision
Oct 12
VideoAWR: Reinforcing Video Flow Models with Decoupled-Timestep Advantage-Weighted Rectification
VideoAWR introduces a decoupled-timestep advantage‑weighted rectification framework for video flow models, separating guided rollouts from the optimization anchor to avoid geometric guidance blow‑up and cold‑start collapse. The method uses an EMA reference policy for guided rollouts while rectifying against an unguided conditional anchor, proving that the centered advantage cancels the anchor in expectation and retains only reward‑correlated covariance. Experiments on Wan2.1‑1.3B and 14B models show stable training and improved visual and motion quality in both CFG‑free and CFG‑enabled settings.
arXiv Computer Vision
Oct 12
SimVTA: Simulation-Grounded Video-Trajectory Alignment for Driving World Action Models
SimVTA is a post‑training framework that enhances driving world action models by aligning simulated future videos with candidate trajectories. It samples trajectories, renders high‑reward futures in a real‑world simulator using 3D Gaussian Splatting, and prioritizes video supervision for high‑error futures. The approach improves planning performance, raising PDMS from 86.2 to 91.3 on NAVSIM v1 and achieving strong results on NAVSIM v2 and HUGSIM.
arXiv AI
Aug 25
ReWorld: An Interactive World Model with Long-Horizon Memory
arXiv:2608.23565v1 Announce Type: new Abstract: An interactive world model must follow the user's actions, remember the places it has shown, and stream in real time. The tension is structural: contro...
Hugging Face Trending Papers
Aug 24
ReWorld: An Interactive World Model with Long-Horizon Memory
An interactive world model must follow the user's actions, remember the places it has shown, and stream in real time. The tension is structural: control wants a short horizon, memory wants an unbounde...
Hugging Face Trending Papers
Sep 10
World in World: Explore the World with World Models
World in World introduces a training‑free inference interface that lets users control autoregressive video world models from new viewpoints. By converting diverse control signals—source‑video observations, target‑view projections, geometry renderings, and retrieved states—into camera‑ and time‑labelled visual tokens, the system uses a frozen causal video model’s self‑attention to maintain synchronization, complete unseen regions, and recover past appearances. The method supports camera‑controlled rerendering, long‑horizon revisiting, and human‑motion transfer while preserving perceptual quality, temporal consistency, and camera‑following accuracy.