arXiv Machine Learning

MirrorWorld: Taming Video Diffusion Models for Mirror Reflection Generation

arXiv:2608. 07463v1 Announce Type: cross Abstract: Recent advances in video diffusion models (VDMs) have enabled high-fidelity video synthesis.

arXiv AI
Sep 7

Reflection-aware Generative Novel View Synthesis

The paper introduces Ref-GeNVS, a training‑free, reflection‑aware approach for generative novel view synthesis in mirror scenes. It treats a mirror image as two complementary views, estimates the mirror plane and reflected camera poses, and uses a two‑stage generation process with Mirror‑gated attention and Reflection injection to produce reflection‑consistent novel views. The method leverages a multi‑view diffusion backbone without finetuning, outperforming recent generative NVS methods on synthetic and real mirror scenes.

By GeonU Kim, Shin Dong-Yeon, Tae-Hyun Oh
arXiv Computer Vision
Sep 4

Fill My Mirror: Geometry-Constrained Mirror Inpainting

The paper introduces a method for mirror inpainting that leverages scene geometry to generate realistic reflections. By estimating the geometry of the fixed scene, the approach projects visible content into the mirror region, reducing the need for hallucination. A two‑mask diffusion strategy then refines the mirror area, balancing geometric constraints with learned priors, and the method operates without training on complex real‑world scenes.

By Ofek Basson, Shimon Vainer, Yacov Hel-Or, Ohad Fried
arXiv Computer Vision
Sep 2

CameraEditor: Camera-Controlled Image Editing via Video-Prior Sequential Modeling

CameraEditor is a new framework that transforms camera-controlled image editing into a temporal sequence prediction problem. By using video diffusion models, it incorporates a geometric perception module and dynamic reference routing to create precise visual references through dynamic panorama cropping. The method also inserts intermediate transition frames to handle large perspective shifts, maintaining content identity and spatial coherence, and is evaluated on a dataset of 5,760 instances with a benchmark of 462 test cases, achieving state‑of‑the‑art performance.

By Xin Shen, Chengyou Jia, Keshuo Xing, Zifeng Zhu, Changliang Xia, Bowen Ping, Zhuohang Dang, Hangwei Qian, Minnan Luo
arXiv AI
Aug 28

LiveVVT: High-Fidelity Video Virtual Try-On in Real Time

LiveVVT introduces a rolling streaming diffusion framework for video virtual try‑on that maintains high visual fidelity while enabling real‑time performance. It preserves bounded bidirectional modeling within a fixed‑size window, emits clean video chunks iteratively, and uses two memory modules—a bounded temporal memory and a persistent global appearance memory—to sustain long‑term consistency. A progressive distillation process further aligns teacher‑based bidirectional learning with causal few‑step inference, resulting in superior generation quality with 26× lower latency and 11× higher throughput compared to comparable models.

By Yushe Cao, Shikun Feng, Ruxiang Duan, Liyong Wang, Dianxi Shi, Chun Yu, Junliang Xing
arXiv AI
Sep 3

ContextAnyone: Context-Aware Diffusion for Character-Consistent Text-to-Video Generation

ContextAnyone is a context‑aware diffusion framework that treats a reference image as an explicitly preserved appearance anchor rather than a simple conditioning signal. By jointly reconstructing the reference image and generating the target video within a shared diffusion transformer, it provides direct supervision for maintaining identity and fine‑grained appearance throughout denoising. The method introduces asymmetric information flow and Gap‑RoPE positional representations to keep the reference stable while allowing selective access by video tokens, and demonstrates improved identity and appearance consistency on an OpenVid‑HD benchmark.

By Ziyang Mai, Yu-Wing Tai