arXiv Computer Vision

OuroReward: Sequential Reward Scheduling for Reinforcement Learning in Text-to-3D Generation

arXiv Computer Vision
6d ago

SCOPE: Semantic Bounded Credit Optimization for Prompt Engineering in Text-to-image Generation

SCOPE introduces a reinforcement learning approach for text‑to‑image prompt engineering that respects semantic spans such as objects, counts, attributes, and relations. By pooling policy log‑probability shifts within each semantic span, the method assigns a shared coefficient to token losses while using a single advantage per completion, eliminating the need for separate span rewards or extra image renders. Experiments on Qwen‑Image, SD3, and FLUX.1‑dev show average relative gains of 9.48% on GeneVal and 7.62% on T2I‑CompBench compared to vanilla GRPO, with ablation studies confirming the benefit of semantic boundaries and pooling.

By Yufei Jiao, Jinfa Huang, Zeyue Xue, Tianyu Xie, Yuexiao Ma, Rongrong Ji, Xiawu Zheng, Jiebo Luo
arXiv Computer Vision
Oct 12

MotionRFT: Unified Reinforcement Fine-Tuning for Text-to-Motion Generation

MotionRFT introduces a reinforcement fine‑tuning framework for text‑to‑motion generation that unifies heterogeneous motion representations into a shared semantic space using the MotionReward model. The framework includes a fine‑grained, memory‑efficient fine‑tuning method called EasyTune, which optimizes step‑wise denoising steps to reduce computational overhead. Experiments show significant improvements in FID, R‑Precision, and memory usage across several motion models.

By Xiaofeng Tan, Wanjiang Weng, Hongsong Wang, Fang Zhao, Xin Geng, Liang Wang
arXiv AI
Aug 7

iARCS: Iterative Agentic RL for Controllable 3D Scene Generation

arXiv:2608. 06161v1 Announce Type: new Abstract: Synthetic 3D scene generation is increasingly used as a data source for computer vision and embodied AI, but existing generators often optimize perceptual realism without reliably satisfying task-critical functional constraints.

By Saugat Adhikari, Ashok Prasad Neupane, Pramish Paudel, Ajad Chhatkuli, Danda Pani Paudel
arXiv AI
Oct 2

Your Language Model is Its Own Critic: Reinforcement Learning with Value Estimation from Actor's Internal States

The paper introduces POISE, a reinforcement learning algorithm that uses a model’s internal states as a value estimator to reduce variance in reinforcement learning with verifiable rewards (RLVR). By employing a lightweight probe that reads internal signals during the forward pass, POISE predicts baselines online and uses a cross‑rollout construction to keep gradients unbiased. Experiments on Qwen3‑4B and OLMo3‑7B‑Instruct‑DPO across six domains show POISE outperforms existing RLVR baselines, offering more stable training and a value model that generalizes across tasks and scales with the policy.

By Yunho Choi, Jongwon Lim, Woojin Ahn, Minjae Oh, Jeonghoon Shim, Yohan Jo
arXiv Computer Vision
Sep 25

AdaPilot: Towards Scene-Adaptive Policy Learning for Cross-Generator Text-to-Image Quality Optimization

AdaPilot introduces a scene-adaptive, cross-generator policy for optimizing text-to-image generation quality. By framing multi-turn image generation as a Markov Decision Process and using reinforcement learning, it decouples the policy from specific generator internals, incorporates scene-aware and process-level rewards, and achieves superior quality and generalization compared to baselines. Experiments demonstrate that a single AdaPilot policy can transfer zero‑shot to unseen generators while consistently improving performance across all evaluated models.

By Wenjin Liu, Fayuan Ke, Yue Lu, Zhe Cui, Anh Tuan Luu, Haoran Luo
arXiv AI
Oct 5

Post-Training Frontier Text-to-Image Models by Composing Preference and Rubric Rewards

The paper presents a post‑training approach for text‑to‑image models that combines a preference reward, trained on large human preference data, with rubric‑based rewards that assess prompt faithfulness and other desirable traits. The authors show that a simple reward composition strategy outperforms a naive weighted average, leading to significant Elo gains on the Arena leaderboard for models like Flux2dev and Ideogram‑4. They also release Arena‑T2I‑Training, a 1K subset of data to aid reproducible research in post‑training.

By Yuanhao Ban, I-Hung Hsu, Anastasios Angelopoulos, Wei-Lin Chiang, Ion Stoica, Cho-Jui Hsieh