arXiv AI

Rethinking Visual Reasoning in Text-to-Image Reward Modeling

The paper examines how current reward models used in text-to-image systems struggle with visual reasoning tasks. By introducing a data‑centric approach that flips the pairing axis—using visual reasoning datasets as preference pairs with the same image but different prompts—the authors achieve simultaneous gains in visual understanding and preference accuracy. This method yields measurable improvements in generation quality on compositional prompts, outperforming a larger baseline model.

arXiv AI
Jun 26

Joint Reward Modeling: Internalizing Chain-of-Thought for Efficient Visual Reward Models

arXiv:2602. 07533v2 Announce Type: replace Abstract: Reward models are critical for reinforcement learning from human feedback, as they determine the alignment quality and reliability of generative models.

By Yankai Yang, Yancheng Long, Hongyang Wei, Wei Chen, Tianke Zhang, Kaiyu Jiang, Haonan Fan, Changyi Liu, Jiankang Chen, Kaiyu Tang, Bin Wen, Fan Yang, Tingting Gao, Han Li, Shuo Yang
arXiv AI
Oct 5

Post-Training Frontier Text-to-Image Models by Composing Preference and Rubric Rewards

The paper presents a post‑training approach for text‑to‑image models that combines a preference reward, trained on large human preference data, with rubric‑based rewards that assess prompt faithfulness and other desirable traits. The authors show that a simple reward composition strategy outperforms a naive weighted average, leading to significant Elo gains on the Arena leaderboard for models like Flux2dev and Ideogram‑4. They also release Arena‑T2I‑Training, a 1K subset of data to aid reproducible research in post‑training.

By Yuanhao Ban, I-Hung Hsu, Anastasios Angelopoulos, Wei-Lin Chiang, Ion Stoica, Cho-Jui Hsieh
Hugging Face Trending Papers
Jul 21

ExpertVerse: A General-Purpose Benchmark for Expert-Level Reasoning in Knowledge-Intensive Visual Synthesis

Recent advances in multimodal generative models have enabled instruction-based image generation to move beyond semantic manipulation to knowledge-driven visual reasoning. However, these methods focus on explicit commonsense reasoning, shallow causal understanding, and direct knowledge recall, failing at knowledge-intensive generation.

arXiv Computer Vision
Oct 23

RECAP: Looking Once Is Not Enough for Vision-Language Reasoning

The paper introduces RECAP, a training method that enhances vision‑language models by incorporating temporally localized reactivation of image evidence—called visual revisit—into the reinforcement learning process. Visual revisit peaks are shown to predict correctness and causally improve performance; masking them hurts accuracy more than masking non‑peaks, while adding revisit peaks to failed reasoning partially restores correct answers. RECAP applies revisit‑conditioned advantage estimation, dynamic discounting, and gated value prediction to propagate final rewards through visually important reasoning steps, achieving significant gains on HallusionBench and other benchmarks without extra rewards or inference‑time changes.

By Zhaolu Kang, Tailong Luo, Chenxin Li, Yingjie He, Zhenyu Yu, Fengyu Zhou, Jiachen Qian, Lei Wei, Shuang Chen, Jiachen Li, Eric Hanchen Jiang, Rongchao Zhang, Zhengtao Yao, Hoi Leong Lee, Guansu Wang, Kaiyue Zhou
arXiv AI
5d ago

Seeing Isn't Enough: Unlocking Visual Reasoning by Bridging the Reasoning-Access Gap with TIGER

The paper introduces TIGER, a training framework that addresses the modality reasoning‑access gap in multimodal large language models (MLLMs). By generating synthetic counterfactuals where models succeed on text but fail on rendered images, TIGER fine‑tunes MLLMs using Group Relative Policy Optimization, SFT, and DPO, improving performance on real‑world visual benchmarks such as MathVerse, EMMA, MMMU, ChartQAPro, and RoboSpatial‑Home. The approach demonstrates that visual reasoning can be enhanced without multimodal annotations, and it complements existing RLVR methods.

By Gregory Kang Ruey Lau, Minh Huynh Nguyen, Bryan Kian Hsiang Low
arXiv Computer Vision
Nov 2

On the Faithfulness of Visual Thinking: Measurement and Enhancement

The paper investigates the faithfulness of visual information in multimodal chain-of-thought (MCoT) reasoning by large vision-language models (LVLMs). It shows that visual cues in MCoT are often inaccurate and largely ignored, as predictions change little when visual input is altered but significantly when textual input is changed. To improve visual faithfulness, the authors propose an annotation‑free Sufficient‑Component Cause Model (SCCM) that encourages the generation of minimal yet sufficient visual components, and demonstrate its effectiveness across fine‑grained perception and reasoning benchmarks.

By Zujing Liu, Junwen Pan, Qi She, Yuan Gao, Guisong Xia
arXiv AI
Jun 17

MathVis-Fine: Aligning Visual Supervision with Necessity via Progressive Dependency-Guided Training for Multimodal Mathematical Reasoning

arXiv:2606. 17888v1 Announce Type: new Abstract: Chain-of-Thought (CoT) reasoning has extended from purely linguistic domains to multimodal scenarios; however, existing approaches often treat visual inputs as homogeneous or auxiliary signals, failing to capture the intricate and sample-specific dependencies between text and images in mathematical problem-solving.

By Wanshi Xu, Haokun Zhao, Haidong Yuan, Songjun Cao, Long Ma
arXiv Computer Vision
Sep 30

Think Before You Score: Thinking Reward Model for Visual Generation

arXiv:2609.37372v1 Announce Type: new Abstract: Visual reward models are essential for evaluating and improving visual generation models, yet existing approaches typically map task conditions and can...

By Xuehai Bai, Zhenchen Tang, Yang Shi, Dianyi Wang, Tengfei Liu, Wanshun Su, Xuanyu Zhu, Ruohui Wang, Haiwen Diao, Haotian Wang, Xiaoling Gu, Yuanxing Zhang