arXiv Computer Vision

GraphVerse: A Comprehensive Visual Graph Reasoning Benchmark for Multimodal Large Language Models

GraphVerse is a new benchmark for multimodal large language models that tests visual graph reasoning by combining perception, graph-based visual inputs, and multi-step reasoning. It introduces Graph-centric Image Editing strategies to actively challenge models while preserving semantics, and offers a VGR-Score metric that evaluates reasoning quality beyond simple answer accuracy. Experiments show current models have limitations in VGR and demonstrate the effectiveness of GraphVerse for broader multimodal reasoning tasks.

arXiv Computation and Language

3d ago

MVGraph: Benchmarking LVLMs on Evidence Composition across Multi-View Visual Graph

MVGraph is a new benchmark designed to evaluate large vision‑language models on multi‑graph reasoning tasks where evidence is spread across multiple interrelated visual graph views. It contains 8,000 instances covering eight graph‑theoretic tasks derived from partial and temporal graph scenarios, and each instance is provably unsolvable from a single view. The benchmark also offers 29 diagnostic tasks with 64,000 instances to probe four core capabilities—Perception, Alignment, Composition, and Reasoning—providing golden intermediate representations for detailed analysis.

By Yingjie Zhu, Han Cheng, Xuefeng Bai, Youcheng Pan, Yang Xiang, Kehai Chen

llms multimodal benchmarks safety

arXiv AI

Aug 7

ViSR-KGC: Visual Subgraph Reasoning with Vision-Language Models for Multimodal Knowledge Graph Completion

arXiv:2608. 05833v1 Announce Type: new Abstract: Knowledge graph completion (KGC) aims to infer missing entities or relations from incomplete graph structures, and has evolved into multimodal knowledge graph completion (MMKGC), where entities are associated with multiple modalities such as text and images.

By Jiafan Li, Mengxue Yang, Jiaqi Zhu, Liang Chang, Ying Li, Hongan Wang

llms rag multimodal

arXiv Computation and Language

Sep 25

Multimodal Thinking with Renderable Programs

The paper introduces SVGLM, a framework that integrates scalable vector graphics (SVG) primitives into vision‑language models to enable image generation within reasoning tasks. By treating SVG both as image descriptions and text instructions, SVGLM offers a compact and interpretable method for connecting text and image reasoning. The authors provide a curated SVG‑based image editing dataset and demonstrate strong SVG generation and image‑aware reasoning performance on a mathematical benchmark.

By Sunli Chen, Ding Zhong, Ziqiao Ma, Jiaxin Liu, Zeyuan Yang, Hao Zhang, Lie Lu, Joyce Chai, Chuang Gan

llms agents diffusion multimodal benchmarks

arXiv AI

Jun 3

Vision Inference Former: Sustaining Visual Consistency in Multimodal Large Language Models

arXiv:2605. 18160v2 Announce Type: replace-cross Abstract: In recent years, multimodal large language models (MLLMs) have achieved remarkable progress, primarily attributed to effective paradigms for integrating visual and textual information.

By Xinpeng Dong, Min Zhang, Kairong Han, Xu Tan, Fei Wu, Kun Kuang

llms computer-vision multimodal benchmarks safety

arXiv Machine Learning

Jul 2

VisReason: A Large-Scale Dataset for Visual Chain-of-Thought Reasoning

arXiv:2511. 17731v2 Announce Type: replace-cross Abstract: Chain-of-Thought (CoT) prompting has proven remarkably effective for eliciting complex reasoning in large language models (LLMs).

By Lingxiao Li, Yifan Wang, Xinyan Gao, Chen Tang, Xiangyu Yue, Chenyu You

llms fine-tuning multimodal benchmarks safety

arXiv Computer Vision

Sep 22

Visual Graph Reasoning via Knowledge Compilation

arXiv:2609.22327v1 Announce Type: cross Abstract: Visual graph reasoning requires answering graph-theoretic questions directly from graph images, where graph topology and state are conveyed visually...

By Rongzheng Wang, Zhe Wang, Ke Qin, Rongwei Wang, Muquan Li, Yizhuo Ma, Yihong Huang, Jielei Wang, Shuang Liang

llms reinforcement-learning multimodal benchmarks

arXiv AI

Jun 11

MLaGA: Multimodal Large Language and Graph Assistant

arXiv:2506. 02568v2 Announce Type: replace Abstract: Large Language Models (LLMs) have demonstrated substantial efficacy in advancing graph-structured data analysis.

By Dongzhe Fan, Yi Fang, Jiajin Liu, Djellel Difallah, Qiaoyu Tan

llms fine-tuning multimodal

arXiv Computer Vision

Oct 8

From Pixel to Coding: Evaluating the Figure Reproduction Capabilities of MLLMs

arXiv:2610.10066v1 Announce Type: new Abstract: Multimodal Large Language Models (MLLMs) have demonstrated impressive capabilities in both visual understanding and code generation. However, existing...

By Zijian Chen, Zhengyu Chen, Bohan Liang, Lirong Deng, Yushuo Zheng, Yanwei Jiang, Qi Jia, Kaiwei Zhang, Wenjun Zhang, Guangtao Zhai

llms multimodal benchmarks

arXiv AI

Aug 21

CharTool: Tool-Integrated Visual Reasoning for Chart Understanding

arXiv:2604. 02794v2 Announce Type: replace Abstract: Charts are ubiquitous in scientific and financial literature for presenting structured data.

By Situo Zhang, Yifan Zhang, Zichen Zhu, Da Ma, Lei Pan, Danyang Zhang, Zihan Zhao, Lu Chen, Kai Yu

llms agents reinforcement-learning multimodal benchmarks data-engineering

arXiv AI

Aug 5

CURV: Enhancing Chart Understanding Through Curriculum Visual Grounded Reasoning

arXiv:2608. 02833v1 Announce Type: cross Abstract: Chart question answering (CQA) requires multimodal large language models (MLLMs) to integrate visual comprehension with logical reasoning, yet current models struggle with accurate visual grounding and coherent reasoning chains.

By Xuehang Guo, Pingyue Zhang, Ruiyi Zhang, Zhenhailong Wang, Hanrui Lyu, Heng Ji, Tong Sun, Qingyun Wang, Manling Li

llms nlp multimodal benchmarks

arXiv Computer Vision

Oct 8

FiRe: Fine-grained Multimodal Reasoning for Enhanced Image Generation

arXiv:2604.13491v4 Announce Type: replace Abstract: With the rapid progress of Multimodal Large Language Models (MLLMs), unified MLLMs that jointly perform image understanding and generation have adv...

By Yongjin Kim, Yoonjin Oh, Yerin Kim, Hyomin Kim, Jeeyoung Yun, Yujung Heo, Minjun Kim, Sungwoong Kim

llms diffusion reinforcement-learning multimodal benchmarks safety

arXiv Computation and Language

Sep 14

MMGR: Multi-Modal Generative Reasoning Benchmark and Evaluation

arXiv:2512.14691v3 Announce Type: replace Abstract: Modern multimodal generative models can synthesize visually compelling images and videos, but it remains unclear whether this visual fluency reflec...

By Zefan Cai, Haoyi Qiu, Tianyi Ma, Haozhe Zhao, Gengze Zhou, Tingting Liao, Xinyan Velocity Yu, Kung-Hsiang Huang, Ke Wan, Shawn Lin, Parisa Kordjamshidi, Minjia Zhang, Wen Xiao, Jiuxiang Gu, Nanyun Peng, Junjie Hu

llms diffusion robotics multimodal benchmarks

Related stories