arXiv Computer Vision

JanusMesh: Fast and Zero-Shot 3D Visual Illusion Generation via Cross-Space Denoising

JanusMesh introduces a fast, training‑free framework for creating 3D visual illusion meshes that reveal different semantics from various viewpoints. The method splits generation into two stages: a cross‑space dual‑branch denoising process that aligns 3D latents with CLIP guidance and blends Signed Distance Fields for seamless geometry, followed by a view‑conditioned texture synthesis module that aggregates 2D diffusion priors onto the fused mesh. Experiments show that JanusMesh produces highly realistic, dual‑semantic 3D illustrations in only 3–5 minutes, outperforming prior approaches in geometric integrity, semantic recognizability, and efficiency.

arXiv Computer Vision
Oct 2

DecomVoxel: Harnessing 3D-Native Priors with Guided In-situ Denoising Optimization for Decompositional Scene Reconstruction

DecomVoxel introduces a guided in‑situ denoising optimization that fuses 3D‑native priors with neural scene reconstruction to improve decompositional scene reconstruction. The method employs an epsilon‑based distillation loss for stable latent refinement and adaptive spatial guidance using occupied and vacant anchors with temporal annealing to reduce hallucinations and spatial drift. Experiments on Replica and ScanNet++ demonstrate that DecomVoxel outperforms state‑of‑the‑art approaches while preserving spatial layout, structural fidelity, and style‑consistent texture, yielding high‑quality textured meshes with clean topology.

By Junfeng Ni, Zirui Zhou, Yixin Chen, Yu Liu, Nan Jiang, Zhifei Yang, Song-Chun Zhu, Siyuan Huang
arXiv Computer Vision
Aug 28

SpatialCrafter: Single Image World Modeling with Generative 3D Proxies

SpatialCrafter introduces a two‑stage framework for single‑image world modeling that first generates a global 3D proxy using a Point‑anchored Sparse Structure Flow module, then refines appearance with a Generative Deferred Refiner built on a video diffusion model. The method incorporates Parallel Geometry Injection and Proxy‑Aware Corruption training to integrate the proxy without disrupting the pretrained generative manifold, and it is evaluated on a newly constructed dataset of 115K scenes. Experiments demonstrate that SpatialCrafter outperforms existing approaches, reducing long‑term drift and maintaining consistency under rapid camera motion and extreme viewpoints.

By Chuan Fang, Lingteng Qiu, Yixun Liang, Rui Chen, Kunming Luo, Zhaohua Zheng, Tongyuan Bai, Feipeng Tian, Zilong Dong, Zihan Zhou, Ping Tan
arXiv Computer Vision
Oct 12

NOFACE3D: NOise-scheduled Focused Anchoring and Controlled Enhancement for 3D Generation

NOFACE3D is a training‑free framework that refines fine‑scale, detail‑critical regions in 3D assets generated from a single image. It extracts a selected submesh, scales it to the generator’s input volume, and re‑encodes it into a full‑resolution latent grid, refining the region with flow‑based sampling guided by a spatially varying noise schedule. The refined region is then reintegrated, preserving surrounding geometry and appearance, and the method is evaluated on PAniC‑3D, TexVerse, and a new BigDetail benchmark, showing sharper geometry and finer texture detail. whyItMatters: The approach improves the fidelity of small, high‑curvature structures in image‑to‑3D models without requiring additional training, addressing a key limitation in current generators.

By James Rose, Jingwen Liang, Wenchao Ma, Oren Jacob, Haomiao Jiang
arXiv Computer Vision
Sep 4

PoseDreamer: Scalable and Photorealistic Human Data Generation Pipeline with Diffusion Models

PoseDreamer is a new pipeline that uses diffusion models to generate large‑scale synthetic datasets for 3D human mesh estimation, providing 3D mesh annotations that remain aligned with the generated images. The system incorporates controllable image generation, Direct Preference Optimization for control alignment, curriculum‑based hard sample mining, and multi‑stage quality filtering to produce over 500,000 high‑quality samples with a 76% improvement in image‑quality metrics over traditional rendering‑based datasets. Models trained on PoseDreamer match or surpass those trained on real‑world or conventional synthetic data, and combining PoseDreamer with synthetic datasets yields better performance than mixing real and synthetic data alone.

By Lorenza Prospero, Orest Kupyn, Ostap Viniavskyi, Jo\~ao F. Henriques, Christian Rupprecht
arXiv AI
Jul 15

Hallo4D: Multi-Modal Hallucination Mitigation for Consistent Spatio-Temporal Generation

arXiv:2607. 12752v1 Announce Type: cross Abstract: While recent advances in 3D generation have enabled impressive visual synthesis, existing methods often rely on 2D diffusion supervision without explicit mechanisms for geometric consistency, leading to spatial hallucinations such as duplicated structures and misaligned geometry.

By Hongbo Wang, Huaibo Huang, Jie Cao, Jin Liu, Haoyang Tong, Ran He