arXiv Computation and Language

OmniVerifier-C1: Decomposed Graded Verifier for Rule-Governed Generative World Modeling

The paper introduces OmniVerifier-C1, a graded visual verifier that decomposes complex prompts or environmental rules into fine‑grained components and assigns continuous pointwise scores, moving beyond binary True/False judgments. Experiments show that this structured, interpretable output improves generalization to out‑of‑domain multimodal critic tasks and outperforms binary verifiers in text‑to‑image scenarios. In rule‑governed generative world modeling, the authors demonstrate that a pairwise verification approach yields more accurate critiques than pointwise scoring, with empirical validation on tasks such as Maze and Sudoku.

arXiv AI

3d ago

WorldCast: Exploring Intelligent Visual Generation in World State Prediction

WorldCast is a benchmark that tests multimodal generative models on multi-step world state prediction, requiring them to forecast successive future states from multimodal observations and diverse references. The study evaluates 12 models across 320 manually designed cases in eight categories, revealing that advanced models like GPT-Image-2.5 achieve high scores while open-source models lag behind, especially on complex context and reasoning tasks. The results underscore the importance of integrating dynamic planning, reasoning, and unified multimodal capabilities for realistic world simulation.

By Wenhao Yan, Haodong Li, Xiaotong Li, Yaxin Luo, Zhengrong Yue, Jialv Zou, Xu Huang, Haojin Yang, Nan Jia, Yan Feng, Peng Pei, Xunliang Cai

llms multimodal benchmarks

arXiv AI

Sep 10

PAN: A World Model for General, Actionable, and Long-Horizon World Simulation

arXiv:2511.09057v4 Announce Type: replace-cross Abstract: A world model is a cognitive simulator of the real-world environment allowing biological agents to reason about how the world evolves, whethe...

By PAN Team, Zihan Liu, Yi Gu, Mingkai Deng, Guangyi Liu, Zeyu Feng, Qiyue Gao, Yiyan Hu, Benhao Huang, Yichi Yang, Kun Zhou, Jiannan Xiang, Zhiting Hu, Zhengzhong Liu, Eric P. Xing

llms agents diffusion robotics

arXiv AI

Aug 25

Think with Structured Grounding: Perceptual Reinforcement Learning for Chart and Visual-Tabular Understanding

arXiv:2608.22429v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) capable of thinking with images often rely on external tools for fine-grained perception. However, this relian...

By Changjiang Jiang, Qiannian Zhao, Lei Xin, Jinxiang Xie, Preslav Nakov, Zhuohan Xie

llms reinforcement-learning fine-tuning efficiency multimodal

Hugging Face Trending Papers

Jul 21

ExpertVerse: A General-Purpose Benchmark for Expert-Level Reasoning in Knowledge-Intensive Visual Synthesis

Recent advances in multimodal generative models have enabled instruction-based image generation to move beyond semantic manipulation to knowledge-driven visual reasoning. However, these methods focus on explicit commonsense reasoning, shallow causal understanding, and direct knowledge recall, failing at knowledge-intensive generation.

diffusion reinforcement-learning robotics fine-tuning multimodal benchmarks

arXiv Computer Vision

Sep 30

Evaluating the Evaluators: Diagnosing Large Multimodal Models for AI-Generated Image Assessment

arXiv:2609.37576v1 Announce Type: new Abstract: With the rapid advancement of text-to-image (T2I) generation, robust evaluation becomes critical yet challenging, as traditional metrics fail to captur...

By Yu Zhao, Jiarui Wang, Huiyu Duan, Ye Zhao, Jutao Tang, Juntong Wang, Guangtao Zhai, Xiongkuo Min

llms diffusion multimodal benchmarks safety

arXiv Computer Vision

Oct 8

FiRe: Fine-grained Multimodal Reasoning for Enhanced Image Generation

arXiv:2604.13491v4 Announce Type: replace Abstract: With the rapid progress of Multimodal Large Language Models (MLLMs), unified MLLMs that jointly perform image understanding and generation have adv...

By Yongjin Kim, Yoonjin Oh, Yerin Kim, Hyomin Kim, Jeeyoung Yun, Yujung Heo, Minjun Kim, Sungwoong Kim

llms diffusion reinforcement-learning multimodal benchmarks safety

arXiv Computer Vision

Sep 11

From Evaluation to Enhancement: Benchmarking and Improving Think-with-Video Reasoning for Video Generative Models

The paper introduces VWG-Bench, a benchmark covering nine reasoning dimensions and 38 tasks to evaluate video generative models on symbolic reasoning, physical laws, and goal pursuit. It also presents Vid-PRE, a prompt-rewriting framework that offloads reasoning to a VLM, improving logical performance without changing the generator architecture. Experiments show that current models excel at visual quality but struggle with logic-heavy tasks, while Vid-PRE significantly boosts reasoning across multiple generators.

By Meng Luo, Yicheng Liu, Jiahao Wang, Yuanxing Zhang, Xin Tao, Pengfei Wan, Kun Gai, Hao Fei

diffusion reinforcement-learning multimodal benchmarks

arXiv Computer Vision

Sep 30

SciGen-Verifier: A Multimodal Reasoner for Explainable Verification in Scientific Image Generation

arXiv:2609.33399v2 Announce Type: replace Abstract: In realistic education, a solution is often expressed not only in words but in a drawing--a circuit, a geometric construction, a function plot--and...

By Jiali Chen, Zhengteng Lin, Zuqi Wang, Shirong Lin, Xi Yu, Xusen Hei, DingBa Fu, Jiayuan Xie, Yi Cai

diffusion reinforcement-learning fine-tuning multimodal benchmarks

arXiv AI

Jun 2

Mitigating Perceptual Judgment Bias in Multimodal LLM-as-a-Judge via Perceptual Perturbation and Reward Modeling

arXiv:2606. 02578v1 Announce Type: cross Abstract: Recent multimodal large language models have demonstrated strong reasoning ability, yet their reliability as automated evaluators remains limited by a critical weakness: when visual evidence conflicts with textual cues, MLLM judges tend to reward plausible narratives over perceptually correct answers.

By Seojeong Park, Jiho Choi, Junyong Kang, Seonho Lee, Jaeyo Shin, Hyunjung Shim

llms reinforcement-learning multimodal benchmarks safety

arXiv AI

Jul 20

Debiasing Text-to-Image Evaluation via Implicit Cultural Alignment Reward Modeling

arXiv:2607. 15740v1 Announce Type: cross Abstract: As Text-to-Image (T2I) systems rapidly advance, evaluating the cultural authenticity of synthesized content has become increasingly important for fair and trustworthy generative AI.

By Bo-An Chang, Yu-Chih Chen

llms diffusion nlp reinforcement-learning multimodal benchmarks safety

arXiv AI

Oct 7

When to Rethink: Learning Multi-Perspective Self-Verification for Vision-Language Models

The paper introduces MOTIVE, a multi-view self-verification framework for vision-language models that evaluates candidate answers from complementary perspectives and learns a reliability score aligned with correctness. By using this score to decide whether to accept an answer or trigger history-guided rethinking, MOTIVE improves reliability and efficiency compared to existing self-verification and self-correction methods. Extensive experiments on diverse multimodal benchmarks and VLM backbones show consistent performance gains and reduced unnecessary reasoning turns.

By Ziquan Zhu, Hanruo Zhu, Si-Yuan Lu, Morris Yu-Chao Huang, Yicheng Lin, Wei Han, Tianlong Chen, Mingyuan Wu, Hanchao Yu, Gaojie Jin, Lu Liu, Bo Sun, Tianjin Huang

llms multimodal benchmarks

arXiv AI

Oct 1

Reinforcing Multimodal Reasoning via Token-Level Perception-Grounded Advantage Estimation

arXiv:2609.39168v1 Announce Type: new Abstract: Reinforcement Learning with Verifiable Rewards (RLVR) has improved the reasoning capabilities of Multimodal Large Language Models (MLLMs), yet existing...

By Zhihan Zhang, Lizi Liao

llms reinforcement-learning multimodal benchmarks

Related stories