arXiv:2609.06436v2 Announce Type: replace
Abstract: High-resolution 3D asset generation is vital in various 3D applications. Existing state-of-the-art diffusion-based models remain constrained by fix...
By Yuxin Liu, Minshan Xie, Jiawen Liang, Runsong Zhu, Chi-Wing Fu, Tien-Tsin Wong
The paper introduces SPAR3S, a sparse voxel‑aligned 3D latent generative model that completes 3D scenes from sparse, unconstrained multi‑view images. By representing only occupied voxels in a compact latent space and training a masked autoregressive transformer with photometric supervision via differentiable 3D Gaussian Splatting, the method predicts missing latent tokens and spatial support, enabling efficient and spatially consistent generation of unseen regions. Experiments on synthetic indoor scenes and RealEstate10k demonstrate higher novel‑view quality and real‑world applicability compared to prior work.
arXiv:2607. 13468v1 Announce Type: cross Abstract: Recently, a line of works can generate impressive 3D objects from a single image, but they are limited by restricted representation resolution, making them unsuitable for 3D scene generation.
By Bin Zang, Wenting Zheng, Xiaoliang Luo, Zhiyuan Fang, Shi Li, Lvchun Wang, Wei Yu, Yi Zhao, Tian Xie, Yuchi Huo, Rengan Xie
The paper introduces SPAR3S, a sparse voxel‑aligned 3D latent generative model that completes 3D scenes from sparse, unconstrained multi‑view images. It learns a compact voxel‑aligned latent space using photometric supervision via differentiable 3D Gaussian Splatting, and employs a masked autoregressive transformer to predict missing voxel occupancy and latent tokens. Experiments on synthetic indoor scenes and RealEstate10k show that SPAR3S achieves higher novel‑view quality than prior methods and generalizes to real‑world data.
By Thomas Lucas, Maxime Pietrantoni, Philippe Weinzaepfel, Wonjune Cho, Bardienus Pieter Duisterhof, Vincent Leroy, Jerome Revaud
SpatialCrafter introduces a two‑stage framework for single‑image world modeling that first generates a global 3D proxy using a Point‑anchored Sparse Structure Flow module, then refines appearance with a Generative Deferred Refiner built on a video diffusion model. The method incorporates Parallel Geometry Injection and Proxy‑Aware Corruption training to integrate the proxy without disrupting the pretrained generative manifold, and it is evaluated on a newly constructed dataset of 115K scenes. Experiments demonstrate that SpatialCrafter outperforms existing approaches, reducing long‑term drift and maintaining consistency under rapid camera motion and extreme viewpoints.
By Chuan Fang, Lingteng Qiu, Yixun Liang, Rui Chen, Kunming Luo, Zhaohua Zheng, Tongyuan Bai, Feipeng Tian, Zilong Dong, Zihan Zhou, Ping Tan
arXiv:2611.06141v1 Announce Type: new
Abstract: High-fidelity 3D geometry generation requires maintaining global structural coherence alongside fine-grained surface details. While recent coarse-to-fi...
By Jiale Zhang, Yang Liu, Chengyang Li, Jin Yuan, Qianxi Jia, Taicheng Huang
arXiv:2605.29655v4 Announce Type: replace
Abstract: Autoregressive multimodal large language models (MLLMs) enable 3D generation but struggle to scale to high-resolution shapes due to inadequate 3D t...
By Yuan Li, Congyi Zhang, Xifeng Gao, Xiaohu Guo
Coarse3D is a new sparse‑structure generation model that produces orientation‑controllable and structurally faithful voxel geometry from arbitrary unposed images. It introduces a first‑frame anchored canonical space, a dual‑tower DiT with auxiliary reconstruction, and spatial‑prior guided attention to align generation with the input view and ground 2D‑3D correspondence. The model can replace the coarse stage in existing pipelines and, according to experiments, substantially improves sparse structure quality and overall 3D generation performance.
By Gaige Wang, Bowen Pan, Hao Ren, Jiangjing Lyu, Chengfei Lyu
The paper introduces SVRecon, a generalizable neural surface reconstruction framework that uses sparse volumetric representations to achieve high-resolution 3D reconstruction. It employs a two-stage architecture: first predicting occupied voxels with an occupancy network, then rendering only within those regions using specialized sparse algorithms. This approach allows reconstruction at resolutions up to 512³ on 32 GB hardware, producing smoother and more precise surfaces, especially in sparse-view scenarios.
By Aoxiang Fan, Corentin Dumery, Nicolas Talabot, Ming Xu, Hieu Le, Pascal Fua
High-fidelity 3D geometry generation requires maintaining global structural coherence alongside fine-grained surface details. While recent coarse-to-fine frameworks leverage Rotary Position Embeddings...
OctWorld is a video diffusion framework that uses a persistent 3D memory called OctMap to generate long‑range, world‑consistent videos from a single image. OctMap fuses visual observations and depth maps into a dynamic sparse octree, adapting spatial resolution to image evidence while keeping memory usage low. Experiments show that OctWorld produces spatially consistent videos over extended camera paths and outperforms previous methods on both standard benchmarks and challenging long‑range scenarios.
By Zelong Lv, Sicheng Xu, Jianfeng Xiang, Ruicheng Wang, Yue Dong, Yu Deng, Guangzhong Sun, Jiaolong Yang
ZipTok3D is a 3D tokenizer that achieves high‑fidelity reconstruction from extremely short token sequences by organizing object geometry into progressively informative global‑token prefixes. During training, nested dropout truncates the latent sequence, forcing each retained prefix to reconstruct the full object, which prioritizes essential geometric information in the leading tokens. The decoder uses a parameter‑shared Transformer block to iteratively recover fine‑grained geometry, enabling reconstruction quality comparable to a 32‑token baseline while using only one token on ShapeNet and four on TRELLIS.
By Mingda Lin, Weijie Wang, Zeyu Zhang, Bowen Cui, Yefei He, Haoyu Zhao, Yuanyu He, Donny Y. Chen, Feng Chen, Bohan Zhuang