arXiv Computer Vision

SP-MoMamba: Superpixel-driven Mixture of State Space Experts for Efficient Image Super-Resolution

SP-MoMamba introduces a superpixel-driven mixture of state space experts for efficient image super‑resolution. By grouping spatially coherent features into region‑level tokens, the Superpixel‑SSM performs global sequence modeling over compact representations, reducing redundant computation while enabling long‑range structural interaction. The Multi‑Scale Superpixel Mixture of State Space Experts further adapts to varying representation granularities, and a Local Spatial Modulation Expert refines local high‑frequency details, resulting in strong reconstruction performance with a favorable trade‑off among model size, computational cost, and inference efficiency.

arXiv AI
Sep 10

Adaptive Densification for High-Fidelity and Efficient Sparse Gaussian Splatting in Arbitrary-Scale Super-Resolution

The paper introduces QuADA-GS, a method for Arbitrary-Scale Super-Resolution that dynamically densifies 2D Gaussian splatting based on low‑resolution input. By allocating Gaussians adaptively to structurally complex regions and employing a sparse communication mechanism, it balances high visual fidelity with lower computational cost. Experiments show that this approach achieves a competitive trade‑off between quality and efficiency for super‑resolution tasks.

By Giulio Federico, Giuseppe Amato, Claudio Gennaro, Fabio Carrara, Marco Di Benedetto
arXiv Computer Vision
Aug 27

Compact Feed-Forward 3D Gaussians via Saliency-Guided Primitive Merging

The paper introduces a structure‑aware merging pipeline that consolidates per‑pixel 3D Gaussian primitives from any feed‑forward reconstruction method into a compact, content‑adaptive Gaussian set. By grouping spatially coherent Gaussians with adaptive superpixel segmentation guided by a saliency map, compressing clusters via a learned encoder, and merging representations across views using geometric overlap and feature similarity, the method reduces the number of Gaussians to about one‑twentieth of the original while preserving visual quality. A level‑of‑detail decoder allows controllable resolution, and the pipeline operates as a backbone‑agnostic post‑processing module, improving robustness and rendering efficiency.

By Tim-Felix Fassch, Jochen Kall, Cyrill Stachniss
arXiv Computer Vision
5d ago

PixelMoE: Scaling Pixel-Space Diffusion with LLM-Style Mixture-of-Experts

PixelMoE introduces a pixel‑space generative framework that applies LLM‑style Mixture‑of‑Experts (MoE) to diffusion models, enabling sparse scaling of model capacity without diffusion‑specific routing. It combines Token‑Choice routing, fine‑grained routed experts, a shared expert, and bias‑based load balancing, and adds Pixel‑Space Hierarchical Flow Matching to vary spatial resolution during denoising. Across model scales, PixelMoE outperforms dense counterparts and achieves competitive FID scores on class‑conditional ImageNet‑1K, with code and pretrained models publicly released.

By Ruixiao Dong, Jianmin Bao, Bozhi Luan, Zijie Meng, Xin Tao, Pengfei Wan, Kun Gai, Li Li, Houqiang Li
arXiv Computer Vision
Oct 1

PixelUMM: Encoder-Free Unified Image and Video Understanding and Generation

PixelUMM is an encoder‑free model that unifies image and video understanding and generation directly in pixel space. It represents images as spatial patches and videos as spatiotemporal tubelets, feeding both through single‑layer linear projections into a shared multimodal backbone. The Mixture‑of‑Transformers architecture blends shared attention with task‑specific parameters, enabling autoregressive text prediction, pixel‑space flow matching, and clean‑pixel video generation, and experiments show competitive performance across tasks while providing design insights for future pixel‑space multimodal models.

By Cong Wei, Xuanchi Ren, Bryan Chu, Weiming Ren, Huan Ling, Jiahui Huang, Laura Leal-Taix\'e, Sanja Fidler, Wenhu Chen, Zian Wang, Jay Zhangjie Wu
arXiv AI
Jun 2

Beyond Visual Fidelity: Benchmarking Super-Resolution Models for Large-Scale Remote Sensing Imagery via Downstream Task Integration

arXiv:2605. 00310v2 Announce Type: replace-cross Abstract: Super-resolution (SR) techniques have made major advances in reconstructing high-resolution images from low-resolution inputs.

By Zhili Li, Kangyang Chai, Zhihao Wang, Xiaowei Jia, Yanhua Li, Gengchen Mai, Sergii Skakun, Dinesh Manocha, Yiqun Xie
Hugging Face Trending Papers
Oct 13

PixelMoE: Scaling Pixel-Space Diffusion with LLM-Style Mixture-of-Experts

PixelMoE introduces a pixel-space generative framework that applies LLM-style Mixture-of-Experts (MoE) to diffusion models, enabling sparse scaling of model capacity without diffusion-specific routing. The approach combines Token-Choice routing, fine-grained routed experts, a shared expert, and bias-based load balancing, while also employing Pixel-Space Hierarchical Flow Matching to adjust spatial resolution during denoising. PixelMoE outperforms dense counterparts at comparable active parameter counts, achieving strong FID scores on class-conditional ImageNet-1K.