arXiv Machine Learning

ManiFusion: Unlocking the High-Throughput Generation via Superposition in Manifold Space

ManiFusion is a backbone‑agnostic framework that boosts the throughput of diffusion models by fusing multiple samples into a single denoising evaluation and then unfusing them afterward. It introduces Trajectory‑Fusion Scheduling to dynamically adjust fusion factors across sampling stages, allowing shared representations while preserving individual generation paths. The method works with various diffusion families, including U‑Net and transformer backbones in pixel and latent spaces, and can be combined with existing acceleration techniques to achieve higher throughput with minimal quality loss.

arXiv Computer Vision
Oct 12

InstantFusion: A Shared Latent Interface for Heterogeneous Image Generators

InstantFusion introduces a lightweight shared latent interface that enables cross-model state translation between heterogeneous image generators. By training model-specific Latent AutoEncoders to project intermediate denoising states into a common latent space, the method aligns states from the same image at matched noise levels and synchronizes their local denoising velocities. This allows seamless denoising transitions across frozen generators, supporting applications such as acceleration, multi-preference composition, on-policy distillation, and cross-model composition.

By Xuanlang Dai, Jiazi Bu, Yujie Zhou, Yuhong Liu, Beichen Zhang, Penghui Yang, Ziyu Liu, Yuhang Zang
arXiv Computer Vision
Aug 24

RecGen3D: Reconstruction-Guided 3D Generation in a Shared Canonical Space

RecGen3D is a framework that merges feed‑forward reconstruction and diffusion‑based generation to address the trade‑off between reconstruction fidelity and generative plausibility in sparse‑view 3D modeling. By aligning both models in a shared canonical space and using decoupled cooperative learning, the system stabilizes training and allows the reconstruction module to supply canonical geometric anchors while the diffusion generator refines and completes the structure. Experiments show that RecGen3D outperforms existing methods in producing complete and consistent 3D models from sparse observations.

By Zhisheng Huang, Jiahao Chen, Cheng Lin, Chenyu Hu, Hanzhuo Huang, Zhengming Yu, Mengfei Li, Yuheng Liu, Zekai Gu, Zibo Zhao, Yuan Liu, Xin Li, Wenping Wang
arXiv AI
Jun 24

FLUX3D: High-Fidelity 3D Gaussian Generation with Diffusion-Aligned Sparse Representation

arXiv:2606. 24874v1 Announce Type: cross Abstract: Sparse voxel representation has emerged as a scalable foundation for image-to-3D Gaussian Splatting (3DGS) generation, yet current methods struggle to preserve high-frequency visual details of input images due to two structural bottlenecks.

By Haorui Ji, Weizhe Liu, Hongdong Li, Hengkai Guo
Hugging Face Trending Papers
Jun 29

UniGP: Taming Diffusion Transformer for Prior-Preserved Unified Generation and Perception

Recent advances in diffusion models have shown impressive performance in controllable image generation and dense prediction tasks. However, existing approaches typically treat diffusion-based controllable generation and dense prediction as separate tasks, overlooking the potential benefits of jointly modeling the heterogeneous distributions.

arXiv AI
Aug 12

Flow Straight to Reality: Perceptually Consistent Flow Matching for Efficient Image Restoration

arXiv:2608. 10544v1 Announce Type: cross Abstract: Image restoration is fundamentally constrained by the tradeoff between distortion and perception: minimizing pixel-wise error yields over-smoothed results, whereas optimizing for perceptual realism often introduces structural deviations.

By Sangwoo Jo, Donggeun Ko, Jayeon Kang, Youngsang Kwak, Jaehwa Kwak, Sungjoon Choi
Hugging Face Trending Papers
Jul 2

NeoMap: Training-free Novel-View Synthesis from Single Images and Videos

We study the challenging problem of novel view video synthesis from single images or monocular videos. Existing methods, which operate under the assumption that pre-trained video models lack native novel view synthesis capability and enforce view alignment via camera conditioning, task-specific fine-tuning, or stepwise hard denoising guidance, often suffer from artifacts and compromised global scene consistency.