arXiv Computer Vision

Advanced Pixel Diffusion Model with Guided Sparse Global Refinement

arXiv Computer Vision
Aug 25

Pixel-Space Diffusion via Observation Operators

Pixel‑Space Diffusion via Observation Operators introduces a new framework for pixel‑space diffusion models that addresses a scale‑time mismatch in existing methods. By replacing fixed full‑image supervision with a time‑indexed observation trajectory that progresses from coarse structures to the full image, the model aligns supervision with the natural recovery order of image details. The approach employs Gaussian‑Lanczos operators and a GL‑CoDA decoder to refine features progressively, resulting in faster convergence and higher generation quality, achieving an FID of 1.52 on ImageNet‑256.

By Shaojie Guo, Lichen Ma, Haoyang Tong, Yu He, Zipeng Guo, Xiaoan Liu, Feng Yan, Yu Guo, Fei Wang, Junshi Huang, Yan Wang
Hugging Face Trending Papers
5d ago

PixelMoE: Scaling Pixel-Space Diffusion with LLM-Style Mixture-of-Experts

PixelMoE introduces a pixel-space generative framework that applies LLM-style Mixture-of-Experts (MoE) to diffusion models, enabling sparse scaling of model capacity without diffusion-specific routing. The approach combines Token-Choice routing, fine-grained routed experts, a shared expert, and bias-based load balancing, while also employing Pixel-Space Hierarchical Flow Matching to adjust spatial resolution during denoising. PixelMoE outperforms dense counterparts at comparable active parameter counts, achieving strong FID scores on class-conditional ImageNet-1K.

arXiv AI
Sep 10

Adaptive Densification for High-Fidelity and Efficient Sparse Gaussian Splatting in Arbitrary-Scale Super-Resolution

The paper introduces QuADA-GS, a method for Arbitrary-Scale Super-Resolution that dynamically densifies 2D Gaussian splatting based on low‑resolution input. By allocating Gaussians adaptively to structurally complex regions and employing a sparse communication mechanism, it balances high visual fidelity with lower computational cost. Experiments show that this approach achieves a competitive trade‑off between quality and efficiency for super‑resolution tasks.

By Giulio Federico, Giuseppe Amato, Claudio Gennaro, Fabio Carrara, Marco Di Benedetto
arXiv Computer Vision
Oct 9

BudgetPix: Compute-Adaptive Tokenization for Pixel-Space Image Diffusion

BudgetPix introduces a compute‑adaptive tokenization framework for pixel‑space image diffusion, dynamically allocating computational resources based on visual complexity and spatial layout. It comprises an adaptive encoder using an entropy‑guided quadtree and multi‑scale patch embedder, a scale‑aware decoder, and a flexible training schedule that allows pixel‑space denoisers to operate across variable token counts. The method integrates with existing diffusion architectures, achieving comparable fidelity to larger models while using only a fraction of the compute budget, and demonstrates improved quality‑efficiency tradeoffs in both text‑to‑image and class‑conditional generation.

By Ozgur Kara, Yujia Chen, Daniel Watson, David Forsyth, James Matthew Rehg, Wen-Sheng Chu, Du Tran