arXiv AI

Mirror Illusion Art

arXiv:2607. 02015v1 Announce Type: cross Abstract: Mirror Illusion Art is a novel reflection-conditioned 3D illusion where one object yields two target appearances (front and mirror).

arXiv Computer Vision
Sep 4

Fill My Mirror: Geometry-Constrained Mirror Inpainting

The paper introduces a method for mirror inpainting that leverages scene geometry to generate realistic reflections. By estimating the geometry of the fixed scene, the approach projects visible content into the mirror region, reducing the need for hallucination. A two‑mask diffusion strategy then refines the mirror area, balancing geometric constraints with learned priors, and the method operates without training on complex real‑world scenes.

By Ofek Basson, Shimon Vainer, Yacov Hel-Or, Ohad Fried
arXiv Computer Vision
Sep 2

JanusMesh: Fast and Zero-Shot 3D Visual Illusion Generation via Cross-Space Denoising

JanusMesh introduces a fast, training‑free framework for creating 3D visual illusion meshes that reveal different semantics from various viewpoints. The method splits generation into two stages: a cross‑space dual‑branch denoising process that aligns 3D latents with CLIP guidance and blends Signed Distance Fields for seamless geometry, followed by a view‑conditioned texture synthesis module that aggregates 2D diffusion priors onto the fused mesh. Experiments show that JanusMesh produces highly realistic, dual‑semantic 3D illustrations in only 3–5 minutes, outperforming prior approaches in geometric integrity, semantic recognizability, and efficiency.

By Siang-Ling Zhang, Huai-Hsun Cheng, Tsung-Ju Yang, Yu-Lun Liu
arXiv Computer Vision
Sep 18

RGS: Reflection-aware Gaussian Splatting via Learning Geometry Continuity for Reflective Objects

The paper introduces Reflection-aware Gaussian Splatting (RGS), a physically-based deferred rendering framework that improves novel view synthesis for reflective objects. RGS leverages a powerful 3D foundation model to provide a strong geometric prior and employs cross-view shape consistency regularization to prevent surface collapse and reduce geometric hollows. Additionally, a reflection-aware densification strategy captures specular variations across views, resulting in higher-quality renderings of reflective objects.

By Xiaobiao Du, Yida Wang, Cheng Bi, Kun Zhan, Xin Yu
arXiv Computer Vision
Sep 25

OREO: Fidelity Alignment in 3D Generation via On-the-fly Rendering-Editing Optimization

OREO is a framework that improves the visual fidelity of 3D generation models by using on-the-fly rendered and edited 2D views as pseudo-targets. It introduces a dynamic optimization loop where a 2D diffusion model refines rendered views, preserving geometry, viewpoint, and content while enhancing realism. These refined views serve as high‑quality supervision, enabling the 3D generator to learn from its own outputs and progressively improve its visual quality, outperforming pre‑trained baselines.

By Zhiyuan Ma, Wenbo Hu, Wang Zhao, Pengfei Wang, Ying Shan, Lei Zhang
arXiv Computer Vision
Sep 18

GS-PI: An Optimization-Decoupled Appearance Decomposition Approach for Generating PBR Gaussian Assets

GS-PI introduces an optimization‑decoupled framework that transforms Gaussian Splatting (GS) assets into physically based rendering (PBR) compatible Gaussian assets. By treating PBR material generation as a geometry‑conditioned diffusion process on 3D point clouds, it achieves multi‑view consistency and avoids the pixel‑correspondence problems of 2D diffusion. The method employs a multi‑scale cross‑view conditioning mechanism—combining global semantic priors, photometric cues, and spatial view‑direction signals—to prevent specular highlights from baking into intrinsic colors, and then distills the predicted attributes back into a fully relightable PBR‑GS asset without requiring proxy meshes.

By Jieting Xu, Rengan Xie, Zijian Huang, Zehui Jin, Rui Wang, Yuchi Huo
arXiv AI
Sep 7

Reflection-aware Generative Novel View Synthesis

The paper introduces Ref-GeNVS, a training‑free, reflection‑aware approach for generative novel view synthesis in mirror scenes. It treats a mirror image as two complementary views, estimates the mirror plane and reflected camera poses, and uses a two‑stage generation process with Mirror‑gated attention and Reflection injection to produce reflection‑consistent novel views. The method leverages a multi‑view diffusion backbone without finetuning, outperforming recent generative NVS methods on synthetic and real mirror scenes.

By GeonU Kim, Shin Dong-Yeon, Tae-Hyun Oh