arXiv Computer Vision
Aug 28

SpatialCrafter: Single Image World Modeling with Generative 3D Proxies

SpatialCrafter introduces a two‑stage framework for single‑image world modeling that first generates a global 3D proxy using a Point‑anchored Sparse Structure Flow module, then refines appearance with a Generative Deferred Refiner built on a video diffusion model. The method incorporates Parallel Geometry Injection and Proxy‑Aware Corruption training to integrate the proxy without disrupting the pretrained generative manifold, and it is evaluated on a newly constructed dataset of 115K scenes. Experiments demonstrate that SpatialCrafter outperforms existing approaches, reducing long‑term drift and maintaining consistency under rapid camera motion and extreme viewpoints.

By Chuan Fang, Lingteng Qiu, Yixun Liang, Rui Chen, Kunming Luo, Zhaohua Zheng, Tongyuan Bai, Feipeng Tian, Zilong Dong, Zihan Zhou, Ping Tan
arXiv Computer Vision
Sep 2

JanusMesh: Fast and Zero-Shot 3D Visual Illusion Generation via Cross-Space Denoising

JanusMesh introduces a fast, training‑free framework for creating 3D visual illusion meshes that reveal different semantics from various viewpoints. The method splits generation into two stages: a cross‑space dual‑branch denoising process that aligns 3D latents with CLIP guidance and blends Signed Distance Fields for seamless geometry, followed by a view‑conditioned texture synthesis module that aggregates 2D diffusion priors onto the fused mesh. Experiments show that JanusMesh produces highly realistic, dual‑semantic 3D illustrations in only 3–5 minutes, outperforming prior approaches in geometric integrity, semantic recognizability, and efficiency.

By Siang-Ling Zhang, Huai-Hsun Cheng, Tsung-Ju Yang, Yu-Lun Liu
arXiv Computer Vision
Aug 25

WildShadowRemover: In-the-Wild Video Shadow Removal via Detail-Preserving Video Diffusion Models

WildShadowRemover is a framework that adapts a pretrained video diffusion model for robust in-the-wild video shadow removal using LoRA fine-tuning. It augments the frozen VAE decoder with a detail injection module and introduces a shadow‑mask‑guided frequency‑decomposed modulation module to restore high‑frequency textures while suppressing shadow artifacts, with monocular depth priors providing geometry‑aware guidance. The authors also create WildShadow, a large‑scale paired video shadow removal dataset, and show that their method outperforms existing approaches in shadow removal quality, temporal consistency, and generalization across challenging real‑world scenarios.

By Jiamin Xu, Cong Wang, Zheng Dong, Chi Wang, Renshu Gu, Weiwei Xu, Gang Xu