arXiv Computer Vision
Aug 28

RubricRM: Generative Reward Modeling via Dynamic Rubrics for Image Generation and Editing

RubricRM introduces a pairwise generative reward modeling framework that generates an input‑specific rubric—comprising evaluation dimensions, weights, and scoring criteria—to score candidate images. The method is trained in two stages: supervised fine‑tuning to learn the rubric‑based scoring paradigm and GRPO to refine dimension‑level rewards. Experiments on text‑to‑image generation and instruction‑based image editing benchmarks demonstrate that RubricRM outperforms existing specialized reward models and competes with strong proprietary MLLM judges while using smaller backbones.

By Zijian Kan, Wei Wang, Long Luo, Bing Zhao, Xuan Ren, Weixu Qiao, Wenbo Li, Hu Wei, Lin Qu
arXiv Computer Vision
Sep 7

Learning to Credit the Right Steps: Objective-aware Process Optimization for Visual Generation

The paper introduces Objective-aware Trajectory Credit Assignment (OTCA), a framework that refines reinforcement learning for diffusion-based visual generation. OTCA decomposes credit across denoising steps and allocates multiple reward signals adaptively, addressing the coarse, uniform reward assignment of existing GRPO pipelines. Experiments demonstrate that OTCA consistently enhances image and video generation quality across various metrics.

By Rui Li, Ke Hao, Yuanzhi Liang, Haibin Huang, Chi Zhang, Yun Gu, Xuelong Li
arXiv AI
Jun 26

Joint Reward Modeling: Internalizing Chain-of-Thought for Efficient Visual Reward Models

arXiv:2602. 07533v2 Announce Type: replace Abstract: Reward models are critical for reinforcement learning from human feedback, as they determine the alignment quality and reliability of generative models.

By Yankai Yang, Yancheng Long, Hongyang Wei, Wei Chen, Tianke Zhang, Kaiyu Jiang, Haonan Fan, Changyi Liu, Jiankang Chen, Kaiyu Tang, Bin Wen, Fan Yang, Tingting Gao, Han Li, Shuo Yang
arXiv Computer Vision
Sep 3

GDB-Reward: From Evaluation Metrics to Training Rewards for Graphic Design

GDB-Reward is a framework that converts diverse graphic design evaluation metrics into a single reinforcement learning reward, enabling prompt optimization for frozen image generators. By using these metrics as scalar rewards, the method improves adherence to design specifications in perceptual quality, rendering fidelity, and spatial accuracy without fine‑tuning the generator. Experiments show that non‑differentiable metrics can serve as effective optimization objectives in settings lacking differentiable supervision.

By Adrienne Deganutti, Purvanshi Mehta, Simon Hadfield, Andrew Gilbert