arXiv Computer Vision
Understanding Reward Hacking in Text-to-Image Reinforcement Learning
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv AI
Oct 5
Post-Training Frontier Text-to-Image Models by Composing Preference and Rubric Rewards
The paper presents a post‑training approach for text‑to‑image models that combines a preference reward, trained on large human preference data, with rubric‑based rewards that assess prompt faithfulness and other desirable traits. The authors show that a simple reward composition strategy outperforms a naive weighted average, leading to significant Elo gains on the Arena leaderboard for models like Flux2dev and Ideogram‑4. They also release Arena‑T2I‑Training, a 1K subset of data to aid reproducible research in post‑training.
arXiv Computation and Language
Sep 30
POET: Preference Optimization for Enhanced Text-to-Image Generation
arXiv:2510.12041v3 Announce Type: replace Abstract: Recent advances in text-to-image (T2I) generation have achieved impressive results, yet existing models often struggle with simple or underspecifie...
arXiv AI
Jul 20
Debiasing Text-to-Image Evaluation via Implicit Cultural Alignment Reward Modeling
arXiv:2607. 15740v1 Announce Type: cross Abstract: As Text-to-Image (T2I) systems rapidly advance, evaluating the cultural authenticity of synthesized content has become increasingly important for fair and trustworthy generative AI.
arXiv Computer Vision
Aug 25
Can We Perform Online RL for Image Editing without Editing Rewards?
arXiv:2608.22780v1 Announce Type: new Abstract: Reinforcement learning (RL) enables direct preference optimization for image editing through editing-specific rewards, which remain less developed due...
arXiv Computer Vision
18h ago
AdvFidelity: Unifying Preference Alignment and Few-Step Image Generation within Reinforcement Learning
arXiv:2610.29380v1 Announce Type: new Abstract: Practical image generation requires both human preference alignment and few-step efficiency, yet combining reinforcement learning (RL) with distillatio...
arXiv AI
Jul 13
Multimodal Reward Hacking in Reinforcement Learning
arXiv:2607. 09492v1 Announce Type: new Abstract: Reinforcement learning (RL) is increasingly used to align multimodal large language models (MLLMs), but higher rewards do not always imply better task performance.