arXiv Computer Vision

Block3D: Efficient Text-to-3D Generation via Block-Wise Diffusion

arXiv:2608. 19567v1 Announce Type: new Abstract: While text-to-3D generation has advanced rapidly, achieving high geometric fidelity at low inference cost remains challenging.

arXiv Computer Vision
Sep 3

ZipTok3D: High-Fidelity 3D Tokenization with Compact Token Prefixes

ZipTok3D is a 3D tokenizer that achieves high‑fidelity reconstruction from extremely short token sequences by organizing object geometry into progressively informative global‑token prefixes. During training, nested dropout truncates the latent sequence, forcing each retained prefix to reconstruct the full object, which prioritizes essential geometric information in the leading tokens. The decoder uses a parameter‑shared Transformer block to iteratively recover fine‑grained geometry, enabling reconstruction quality comparable to a 32‑token baseline while using only one token on ShapeNet and four on TRELLIS.

By Mingda Lin, Weijie Wang, Zeyu Zhang, Bowen Cui, Yefei He, Haoyu Zhao, Yuanyu He, Donny Y. Chen, Feng Chen, Bohan Zhuang
arXiv Computer Vision
Sep 4

Vitality-Aware Compression for Efficient Image-to-Shape Diffusion Transformers

The paper introduces a novel compression framework for image-to-shape Diffusion Transformers (DiTs) that significantly reduces model size while preserving geometric fidelity. By exploiting the non-uniform importance of 3D DiT layers, the authors combine structured pruning, adaptive quantization, and targeted fine‑tuning into a vitality‑guided approach. The method achieves up to a 66% reduction in model size across state‑of‑the‑art image‑to‑3D models without compromising synthesis quality, offering a plug‑and‑play solution for efficient 3D shape generation.

By Jaeah Lee, Hyunjin Kim, Jaewoong Cho, Gihyun Kwon
arXiv Computer Vision
Aug 24

RecGen3D: Reconstruction-Guided 3D Generation in a Shared Canonical Space

RecGen3D is a framework that merges feed‑forward reconstruction and diffusion‑based generation to address the trade‑off between reconstruction fidelity and generative plausibility in sparse‑view 3D modeling. By aligning both models in a shared canonical space and using decoupled cooperative learning, the system stabilizes training and allows the reconstruction module to supply canonical geometric anchors while the diffusion generator refines and completes the structure. Experiments show that RecGen3D outperforms existing methods in producing complete and consistent 3D models from sparse observations.

By Zhisheng Huang, Jiahao Chen, Cheng Lin, Chenyu Hu, Hanzhuo Huang, Zhengming Yu, Mengfei Li, Yuheng Liu, Zekai Gu, Zibo Zhao, Yuan Liu, Xin Li, Wenping Wang
arXiv AI
Jun 24

FLUX3D: High-Fidelity 3D Gaussian Generation with Diffusion-Aligned Sparse Representation

arXiv:2606. 24874v1 Announce Type: cross Abstract: Sparse voxel representation has emerged as a scalable foundation for image-to-3D Gaussian Splatting (3DGS) generation, yet current methods struggle to preserve high-frequency visual details of input images due to two structural bottlenecks.

By Haorui Ji, Weizhe Liu, Hongdong Li, Hengkai Guo
Hugging Face Trending Papers
Jul 4

CGGS: Consistency-Augmented Geometric Gaussian Splatting for Ego-centric 3D Scene Generation

Challenges remain in ego-centric 3D scene generation due to limited view overlap and the dominant influence of individual perspectives on scene interpretation. These factors hinder the creation of viewpoint-consistent and semantically aligned visual content, as well as the construction of accurate geometric structures.

arXiv AI
Sep 17

From Alignment to Synthesis: Contrastive Volumetric Grounding for Text-to-CT Generation

The paper introduces a 3D-CLIP encoder trained with structured hard negatives to improve vision‑language alignment for text‑to‑CT generation. This encoder drives a latent diffusion model that operates directly in 3D latent space, eliminating spatial artifacts from super‑resolution pipelines. Experiments on the CT‑RATE dataset show state‑of‑the‑art image fidelity and factual correctness across 18 pathological conditions, with lower inference time and GPU memory usage than competing methods.

By Daniele Molino, Camillo Maria Caruso, Filippo Ruffini, Paolo Soda, Valerio Guarrasi