The paper introduces ESC, a framework that improves 3D-consistent novel view synthesis from a single 2D image by jointly generating a target view and its depth map. By conditioning the diffusion model on the source image, source depth, and target camera rays, ESC forces the model to reason in 3D even under extreme viewpoint changes. A per‑pixel depth consistency constraint is added to enforce spatial fidelity, resulting in superior visual accuracy and spatial alignment compared to current state‑of‑the‑art methods.
By Ge Ya Luo, Daniel Severo, Brian Karrer, Christopher Pal, Adriana Romero-Soriano, Michal Drozdzal
PRISM is a feed‑forward single‑image 3D reconstruction framework that splits the task into a parameter‑free geometric warp and a learned residual correction, eliminating the need for iterative diffusion sampling. It uses a two‑stage training strategy—latent supervised distillation for geometric generalization and perceptual fine‑tuning for appearance quality—to generalize from synthetic data. Experiments on three benchmarks show PRISM matches diffusion‑based methods in quality while cutting inference time to just 36 seconds per scene.
By Zhijie Zheng, Xinhao Xiang, Jiawei Zhang
Reconstructing 3D scenes from a single image is a fundamental challenge in computer vision, with broad applications in virtual reality, robotics, and content creation. Recent methods achieve outstanding performance by leveraging camera-controlled video diffusion models, but rely on iterative diffusion sampling, which greatly limits their practical deployment.
arXiv:2609.39709v1 Announce Type: new
Abstract: Recent diffusion-based pipelines have achieved promising progress in image-to-3D synthesis. However, generating high-fidelity details remains challengi...
By Junyu Li, Qiuyu Chen, Pengcheng Wang, Shiqi Yang, Alexandra Gomez-Villa, Joost van de Weijer, Ruilin Li, Kai Wang
Reconstructing detailed geometry and realistic appearance from a single RGB image is essential yet fundamentally challenging due to inherent ambiguities such as occlusion, lighting variations, and tex...
arXiv:2608.28895v1 Announce Type: new
Abstract: We introduce ReconSplat, a feed-forward model for 3D scene reconstruction that aims to address the longstanding trade-off between plausible view genera...
By Giuseppe Stracquadanio, Kevin Raj, Julia Grabinski, Stefan Roth
Recent diffusion-based pipelines have achieved promising progress in image-to-3D synthesis. However, generating high-fidelity details remains challenging, especially when the input image contains rich...
PoseDreamer is a new pipeline that uses diffusion models to generate large‑scale synthetic datasets for 3D human mesh estimation, providing 3D mesh annotations that remain aligned with the generated images. The system incorporates controllable image generation, Direct Preference Optimization for control alignment, curriculum‑based hard sample mining, and multi‑stage quality filtering to produce over 500,000 high‑quality samples with a 76% improvement in image‑quality metrics over traditional rendering‑based datasets. Models trained on PoseDreamer match or surpass those trained on real‑world or conventional synthetic data, and combining PoseDreamer with synthetic datasets yields better performance than mixing real and synthetic data alone.
By Lorenza Prospero, Orest Kupyn, Ostap Viniavskyi, Jo\~ao F. Henriques, Christian Rupprecht
arXiv:2605.12957v2 Announce Type: replace
Abstract: Recent developments in generative models and large-scale datasets have substantially advanced 3D world generation, facilitating a broad range of do...
By Hanxin Zhu, Cong Wang, Peiyan Tu, Jiayi Luo, Tianyu He, Xin Jin, Zhibo Chen
ReconPlusGen introduces a method that injects a reconstruction prior into multi‑view 3D generation. By predicting a point cloud in canonical space from multiple input images, the method deterministically injects the geometry into a diffusion process via noise inversion and then modulates the noise to maintain generative flexibility for completing unseen areas and refining visible geometry. The paper presents qualitative results on benchmark and real‑world images, along with an illustration of the reconstruction‑guided noise initialization and modulation.
By Jiarui Liu, Heng Li, Weiyu Li, Keng Deng, Junyuan Deng, Zheng Zhongxing, Junyu Huang, Jiahao Chang, Xiaoguang Han, Ping Tan
arXiv:2609.09890v1 Announce Type: new
Abstract: Multi-view diffusion models have shown strong performance in scenes with strong geometric priors and sparse semantics, such as indoor rooms or simple o...
By Qi Zhang, Yanyifan Wang, Weiyuan Zhang, Hui Huang
The paper introduces LEGO, a lifting‑free method for generating egocentric videos from a single exocentric recording. Instead of reconstructing depth and point clouds, it trains a transformer‑based view synthesizer that directly predicts the egocentric view, providing a probabilistic correspondence map that balances structural alignment with texture averaging. This approach outperforms existing explicit pipelines and generalizes across datasets without retraining.
By Suhwan Cho, Yonwoo Choi, Soongjin Kim, Jicheol Park, Taegyu Lim