AdvFidelity: Unifying Preference Alignment and Few-Step Image Generation within Reinforcement Learning
Read the original on Hugging Face Trending Papers →The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
AdvFidelity unifies preference alignment and few-step image generation by embedding artifact-sensitive fidelity supervision directly into reinforcement learning. It trains a discriminator to rank high-quality references above content-matched reconstructions, enabling online adaptation of fidelity rewards without explicit distillation. The method achieves alignment, task performance, and generation quality comparable to full-step LeapAlign while using only 4 or 8 steps and no classifier-free guidance.
arXiv:2608. 09226v1 Announce Type: cross Abstract: Efficient text-to-image generation requires both reinforcement-learning (RL)-based reward alignment and few-step distillation, yet these procedures are typically performed sequentially, increasing training cost and risking the loss of reward gains during compression.
Efficient text-to-image generation requires both reinforcement-learning (RL)-based reward alignment and few-step distillation, yet these procedures are typically performed sequentially, increasing training cost and risking the loss of reward gains during compression. We instead take an RL-native perspective: diffusion RL already generates reward-scored finite-step trajectories, whose intermediate states provide a natural source of distillation supervision rather than a disposable byproduct of sampling.
The paper introduces DM-Align, a single-stage optimization framework that jointly performs distribution matching for distillation and aligns video generative models with human preferences. By deriving complementary gradient directions—one minimizing the gap between real and fake models and another guiding the model toward preferred samples—the method eliminates the need for separate reinforcement learning and distillation stages. Experiments on multiple foundational video models show that this sample-guided approach consistently outperforms both standalone variants and traditional two-stage pipelines.
RAGDiffusion++ advances garment generation by addressing the high‑frequency texture gap that previous retrieval‑augmented models left unresolved. The approach introduces a dual‑image FLUX architecture trained on a large, complex garment dataset, coupled with a new attribute‑aware reward model that guides reinforcement learning to favor realistic high‑frequency patterns. An adversarial‑regularized RL strategy (AR‑GRPO) further prevents artifact exploitation, ensuring the model samples authentic, detailed garment textures.
arXiv:2607. 02291v1 Announce Type: new Abstract: Conventional reinforcement learning strategies for visual generation typically employ sample-wise reward functions, yet this practice frequently results in reward hacking that degrades image diversity and introduces visual anomalies.