arXiv AI By Jiaxing Qiu, Kaihua Hou, Roxana Daneshjou, Ahmed Alaa, Thomas Hartvigsen

ReasonEdit: Editing Vision-Language Models using Human Reasoning

Read the original on arXiv AI →

ReasonEdit is a new editor for vision‑language models that allows users to provide reasoning explanations during the editing process. It stores human reasoning in a codebook and retrieves relevant facts at inference time using a topology‑balanced multimodal embedding approach inspired by network science. Experiments on four VLMs and multiple rationale‑based visual question answering datasets show that incorporating human reasoning leads to state‑of‑the‑art editing performance and better generalization.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Computer Vision
Oct 9

Reasoning-Informed Visual Editing

The paper introduces RISEBench and its expanded version RISEBench++, a benchmark for evaluating reasoning-informed visual editing (RISE). RISEBench++ categorizes tasks into six reasoning dimensions—Temporal, Causal, Spatial, Logical, Counterfactual, and Hybrid—decomposed into 12 subcategories and 65 fine-grained task types, and includes 1,000 human‑annotated test cases in English and Chinese. The authors also present RISE‑Agent, a training‑free framework that integrates reasoning‑driven planning, tool‑augmented execution, and verifier‑guided refinement, outperforming most existing approaches on diverse RISE tasks.

By Xue Yang, Peiyuan Zhang, Yilun Zhu, Qihao Yang, Mingxin Liu, Xiangyu Zhao, Ziqian Fan, Zhaokai Wang, Yan Li, Yifan Yang, Xu Yang, Xiaosong Jia, Yue Zhou, Zhihang Zhong, Junchi Yan
arXiv Computer Vision
Oct 1

ThinkV2V: Unleashing the Reasoning Capability of MLLMs for Instruction-Guided Video Editing

arXiv:2609.38541v1 Announce Type: new Abstract: Instruction-guided video editing has made significant progress, yet existing methods use multimodal large language models (MLLMs) primarily as semantic...

By Donghao Zhou, Haoyang He, Fan Zhang, Hao Yang, Guisheng Liu, Xin Gao, Zhongwei Wan, Xingyuan Bu, Jie Wang, Qiangpeng Yang, Shilei Wen, Chi-Wing Fu, Pheng-Ann Heng
arXiv Computation and Language
Sep 25

Multimodal Thinking with Renderable Programs

The paper introduces SVGLM, a framework that integrates scalable vector graphics (SVG) primitives into vision‑language models to enable image generation within reasoning tasks. By treating SVG both as image descriptions and text instructions, SVGLM offers a compact and interpretable method for connecting text and image reasoning. The authors provide a curated SVG‑based image editing dataset and demonstrate strong SVG generation and image‑aware reasoning performance on a mathematical benchmark.

By Sunli Chen, Ding Zhong, Ziqiao Ma, Jiaxin Liu, Zeyuan Yang, Hao Zhang, Lie Lu, Joyce Chai, Chuang Gan
arXiv Computer Vision
Oct 12

GraphVerse: A Comprehensive Visual Graph Reasoning Benchmark for Multimodal Large Language Models

GraphVerse is a new benchmark for multimodal large language models that tests visual graph reasoning by combining perception, graph-based visual inputs, and multi-step reasoning. It introduces Graph-centric Image Editing strategies to actively challenge models while preserving semantics, and offers a VGR-Score metric that evaluates reasoning quality beyond simple answer accuracy. Experiments show current models have limitations in VGR and demonstrate the effectiveness of GraphVerse for broader multimodal reasoning tasks.

By Yuanfu Sun, Yuanhang Ren, Kang Li, Chuanhao Ji, Jiaxi Li, Jiajin Liu, Ninghao Liu, Qiaoyu Tan
arXiv Computer Vision
Sep 16

GRADE: Benchmarking Discipline-Informed Reasoning in Image Editing

arXiv:2603.12264v2 Announce Type: replace Abstract: Unified multimodal models target joint understanding, reasoning, and generation, but current image editing benchmarks are largely confined to natur...

By Mingxin Liu, Ziqian Fan, Zhaokai Wang, Leyao Gu, Zirun Zhu, Yiguo He, Yuchen Yang, Changyao Tian, Xiangyu Zhao, Ning Liao, Shaofeng Zhang, Qibing Ren, Zhihang Zhong, Xuanhe Zhou, Junchi Yan, Xue Yang
arXiv AI
3d ago

ReasonUni: Reasoning-Augmented Reconstruction Advances Unified Multimodal Models

ReasonUni introduces a reasoning-augmented reconstructive post‑training framework for unified multimodal models (UMMs) that couples image‑to‑text understanding and text‑to‑image generation. The framework first reasons about the desired edit and its target state, then generates the target image conditioned on this reasoning output. A tree‑structured reinforcement learning method, TreeGRPO, jointly optimizes the reasoning and generation modules, yielding consistent performance gains across multiple benchmarks.

By Feize Wu, Zhiyuan Yan, Yuhuan Hong, Yuwei Niu, Zongjian Li, Zheyuan Liu, Bin Lin, Jinbo Yan, Jie Qin, Xudong Mao, Limeng Qiao, Guanglu Wan, Li Yuan