arXiv Computer Vision By Yutong Liu, Nan Huang, Xu Cao, James M. Rehg

Thinking in Pictures: A Systematic Benchmark for Reasoning-driven Image Generation

Read the original on arXiv Computer Vision →

The paper introduces RIG-BENCH, a benchmark for evaluating reasoning-driven image generation (RIG) in four cognitively demanding domains—Concept-based, Transformation-based, Pattern & Structure, and Scenario-based—using 2000 curated samples. It highlights a reasoning-generation gap in current unified generative models (UGMs) and world simulators, noting that these models often produce locally plausible but globally illogical outputs. RIG-BENCH aims to serve as a rigorous stress test and diagnostic framework to guide the development of next-generation, logically grounded UGMs and simulators.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computation and Language
Sep 1

UReason: Benchmarking Reasoning-to-Generation Alignment in Unified Multimodal Models

UReason is a benchmark that evaluates how well unified multimodal models (UMMs) align textual reasoning with image generation. It contains 2,000 human‑curated instances across five reasoning‑intensive tasks—Code, Arithmetic, Spatial, Attribute, and Text—and compares direct generation, reasoning‑guided generation, and decontextualized generation. The study finds that while reasoning‑guided generation improves over direct generation, decontextualized generation consistently outperforms it, indicating that the visual semantics in textual reasoning are not reliably reflected in the generated images.

By Cheng Yang, Chufan Shi, Bo Shui, Yaokang Wu, Muzi Tao, Huijuan Wang, Ivan Yee Lee, Yong Liu, Xuezhe Ma, Taylor Berg-Kirkpatrick
arXiv Computation and Language
Sep 14

MMGR: Multi-Modal Generative Reasoning Benchmark and Evaluation

arXiv:2512.14691v3 Announce Type: replace Abstract: Modern multimodal generative models can synthesize visually compelling images and videos, but it remains unclear whether this visual fluency reflec...

By Zefan Cai, Haoyi Qiu, Tianyi Ma, Haozhe Zhao, Gengze Zhou, Tingting Liao, Xinyan Velocity Yu, Kung-Hsiang Huang, Ke Wan, Shawn Lin, Parisa Kordjamshidi, Minjia Zhang, Wen Xiao, Jiuxiang Gu, Nanyun Peng, Junjie Hu
arXiv AI
3d ago

CoWorld Reasoner: Agentic Multimodal Reasoning with the Evolving Video World Model-Driven Harness

CoWorld Reasoner is an agentic framework that leverages a Video World Model (VWM) as a unified visual reasoning engine for Vision‑Language Models (VLMs). It exposes multiple visual operations through tools and skills, allowing the VLM to decide when to imagine, select an operation, generate visual content, and interpret the resulting evidence. The framework includes a VLM‑VWM Harness Co‑Evolution mechanism that jointly refines tools, skills, and execution code based on feedback, while keeping model weights fixed. Across seven benchmarks covering spatial, temporal, causal, and perceptual reasoning, CoWorld Reasoner outperforms direct VLM reasoning and improves accuracy on all benchmarks, achieving notable gains on MMSI and ERQA.

By Dongjie Cheng, Ruifeng Yuan, Ran Wei, Ning Song, Yongqi Li, Wenjie Li
arXiv AI
Aug 21

VGI-BENCH: Probing Visual Intelligence in Video Generation Models

arXiv:2608. 19583v1 Announce Type: cross Abstract: Recent studies suggest that video generation models can exhibit certain forms of zero-shot visual reasoning through generated frames.

By Xuan He, Cong Wei, Yuhao Cheng, Linrui Ma, Yuxuan Zhang, Zuojun Li, Yuhao Wen, Zeyi Liu, Yuren Hao, Songcheng Cai, Keming Wu, Penghui Du, Kai Zou, Rui Yang, Chenkai Sun, Ke Yang, Ping Nie, Kelsey R Allen, Chenglong Wang, Michel Galley, Jianfeng Gao, ChengXiang Zhai
arXiv AI
Aug 25

VGI-Bench: Probing Visual Intelligence in Video Generation Models

arXiv:2608.19583v2 Announce Type: replace-cross Abstract: Recent studies suggest that video generation models can exhibit certain forms of zero-shot visual reasoning through generated frames. Yet rel...

By Xuan He, Cong Wei, Yuhao Cheng, Linrui Ma, Yuxuan Zhang, Zuojun Li, Yuhao Wen, Jize Jiang, Zeyi Liu, Yuren Hao, Songcheng Cai, Keming Wu, Penghui Du, Kai Zou, Rui Yang, Chenkai Sun, Ke Yang, Ping Nie, Kelsey R Allen, Chenglong Wang, Michel Galley, Jianfeng Gao, ChengXiang Zhai
Hugging Face Trending Papers
Aug 20

VGI-BENCH: Probing Visual Intelligence in Video Generation Models

Recent studies suggest that video generation models can exhibit certain forms of zero-shot visual reasoning through generated frames. Yet reliable evaluation remains challenging: benchmarks should adopt inputs aligned with the visual priors of current video models, require valid evolving processes rather than only plausible final states, and calibrate task difficulty to remain challenging yet partly feasible.