arXiv Computer Vision

Stratified Multi-View Aggregation for Score Distillation

The paper introduces Multi-View Aggregated Score Distillation (MV‑SDI), a training‑free sampler that replaces the single‑view per‑step gradient in score distillation with an average over K views while keeping the diffusion prior frozen. By averaging gradients from multiple views—especially antipodal pairs—MV‑SDI reduces per‑step variance by roughly 1/K, improves angular coverage, and cuts optimization steps while boosting CLIP R‑Precision and CLIP score on the SDI benchmark. The method achieves these gains without retraining or additional multi‑view data and is compatible with existing gradient‑based score‑distillation pipelines.

Hugging Face Trending Papers
Jun 29

Variance Reduction on the Camera Axis: Multi-View Score Distillation for 3D

Score distillation turns a pretrained 2D diffusion model into a 3D generator, but the per-step gradient is estimated from a single randomly chosen view: it is high-variance and blind to global shape consistency. Prior work addresses this by retraining the diffusion prior on multi-view data; this improves consistency but makes the sampling contribution inseparable from prior quality.

arXiv AI
Oct 28

A First-Step Bias Restores Lost Diversity in Diffusion Model Distillation

The paper introduces ReSeed, a lightweight post‑distillation technique that restores lost diversity in diffusion model distillation by adding a seed‑response bias adapter only to the first denoising step. By aligning the first step’s velocity with the teacher’s, ReSeed recovers most of the output diversity without altering later steps or adding target images. Experiments on SD3‑Medium, SD3.5‑Medium, FLUX.1‑dev, and Wan2.1‑T2V‑1.3B show a 48.3% increase in DINO diversity with negligible extra parameters and training data.

By Wenwu Tang, Dong Wang, Yun Cheng, Olga Saukh
arXiv Machine Learning
Jul 14

BARD: Bridging AutoRegressive and Diffusion Vision-Language Models Via Highly Efficient Progressive Block Merging and Stage-Wise Distillation

arXiv:2604. 16514v5 Announce Type: replace-cross Abstract: Autoregressive vision-language models (VLMs) deliver strong multimodal capability, but their token-by-token decoding imposes a fundamental inference bottleneck.

By Baoyou Chen, Hanchen Xia, Peng Tu, Haojun Shi, Liwei Zhang, Yuxuan Yao, Weihao Yuan, Siyu Zhu
arXiv Machine Learning
Sep 14

Same Encoder, Different Winner: A Paired-View Framework for Cell Painting Encoder Evaluation

The paper introduces CP‑BG‑Bench, a paired‑view evaluation framework for Cell Painting vision encoders that fixes a central cell across four matched views (raw crop, segmented, and density‑augmented variants). Using this framework on three datasets and three encoders, the authors show that standard single‑metric rankings (e.g., replicate mAP) vary systematically across protocols, revealing disagreements along axes of cell versus background, morphology versus context, and within‑study versus across‑batch performance. The study demonstrates that segmented views can outperform crops in certain tasks and that background‑driven gains are largely determined by experimental design rather than encoder choice.

By Tim Treis, Nikita Moshkov, Johan Fredin Haslum, Shantanu Singh, Fabian J. Theis
arXiv Machine Learning
Jun 29

StableMotion: One-Step Motion Estimation with Diffusion Prior

arXiv:2505. 06668v2 Announce Type: replace-cross Abstract: We present StableMotion, a novel framework that leverages geometric and content priors from pretrained large-scale image diffusion models for motion estimation in single-image rectification tasks such as Stitched Image Rectangling (SIR) and Rolling Shutter Correction (RSC).

By Ziyi Wang, Haipeng Li, Lin Sui, Tianhao Zhou, Hai Jiang, Lang Nie, Bing Zeng, Shuaicheng Liu
arXiv Computer Vision
Sep 15

CrossDistill: Balancing Quality and Diversity via Trajectory-Level Hybrid Few-Step Distillation

CrossDistill is a trajectory-level hybrid few-step distillation framework for diffusion models that balances quality and diversity by splitting the sampling trajectory at a crossover point. The high-noise interval uses a trajectory-preserving objective to maintain global mode coverage, while the low-noise interval applies a distribution-matching objective to sharpen local details, with the two stages coupled through the crossover state. This noise-level scheduling policy, demonstrated on text-to-video and image-to-video diffusion models, expands the few-step quality-diversity frontier by preserving seed-level variation while achieving competitive visual fidelity.

By Yuxi Liu, Haoyu Li, Yixiang Cai, Tengxu Sun, Zekun Zhang, Baole Ai, Ang Wang, Jiamang Wang, Lin Qu, Kun Yuan, Kai Zhang
arXiv Computer Vision
Sep 21

Probability-Flow Distillation: Distribution Matching in Parameter Space

The paper introduces Probability‑Flow Distillation (PFD), a new method for matching parameter distributions in diffusion‑based models. It extends the particle variational inference framework of Variational Score Distillation to Score Distillation Sampling (SDS) and Score Distillation via Inversion (SDI), revealing that SDS focuses on mode collapse while SDI converges to a contracted distribution. By replacing a single Euler step in SDI with a full reverse probability‑flow ODE solve and simplifying the gradient, PFD achieves distribution matching with only a forward ODE solve, and experiments on synthetic data, CelebA, and text‑to‑3D tasks confirm its effectiveness.

By Rohith Ramanan, A. N. Rajagopalan