arXiv Computer Vision

Beyond Pairwise Repulsion: Collective Diversity via Determinant Maximization in Diffusion Sampling

The paper introduces DetNO, a method that enhances diversity in text-to-image diffusion models by maximizing the log-determinant of an RBF Gram matrix over initial noise vectors. DetNO treats diversity as a collective property of the entire batch, using a volume maximization objective that self-attenuates as diversity improves, and includes an anchor-based fidelity term to keep samples realistic. Experiments on SD1.5, SDXL, and SD3 backbones show that DetNO outperforms existing pairwise repulsion methods in intra-batch diversity metrics and yields statistically significant accuracy gains in few-shot classification tasks when used for synthetic data augmentation.

arXiv AI
Aug 20

From Inference to Adaptation: A Unified Optimal Transport View of Vision Language Model

arXiv:2608. 18339v1 Announce Type: cross Abstract: Vision-language models (VLMs) have demonstrated remarkable zero-shot capabilities yet remain sensitive to real-world distribution shifts during inference.

By Qi Yu, Zhichen Zeng, Katherine Tieu, Xiyuan Yang, Ruizhong Qiu, Yuchen Yan, Lihui Liu, Yanjun Zhao, Lingjie Chen, Jingrui He, Hanghang Tong
arXiv AI
Jul 2

UltraFlux: Data-Model Co-Design for High-quality Native 4K Text-to-Image Generation across Diverse Aspect Ratios

arXiv:2511. 18050v1 Announce Type: cross Abstract: Diffusion transformers have recently delivered strong text-to-image generation around 1K resolution, but we show that extending them to native 4K across diverse aspect ratios exposes a tightly coupled failure mode spanning positional encoding, VAE compression, and optimization.

By Tian Ye, Song Fei, Lei Zhu
arXiv AI
4d ago

Correction Training for Diffusion Models

arXiv:2610.14136v2 Announce Type: new Abstract: Iterative sampling in diffusion models can lead to error accumulation due to exposure bias. The denoiser is trained on real images interpolated with no...

By Donghoon Ahn, Runqian Wang, Alexei A. Efros, Taesung Park, Yash Belhe
arXiv Machine Learning
Jul 15

Steering Diffusion Models via Class-Contrastive Influence for Few-Shot Medical Classification

arXiv:2607. 12464v1 Announce Type: cross Abstract: When labeled data are scarce, off-the-shelf diffusion models can augment training sets for few-shot medical image classification, but not all generated samples are equally useful for the downstream task.

By Jeeyung Kim, Erfan Esmaeili, Qiang Qiu