arXiv AI
Probing Visual Planning in Image Editing Models
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Computer Vision
Sep 15
PuzzleMate: Benchmarking MLLMs for Egocentric Puzzle Assistance
arXiv:2609.14473v1 Announce Type: new Abstract: Personal AI assistants hold the potential to evolve from digital interfaces into embodied companions capable of guiding users through complex physical...
arXiv Computer Vision
Oct 9
Reasoning-Informed Visual Editing
The paper introduces RISEBench and its expanded version RISEBench++, a benchmark for evaluating reasoning-informed visual editing (RISE). RISEBench++ categorizes tasks into six reasoning dimensions—Temporal, Causal, Spatial, Logical, Counterfactual, and Hybrid—decomposed into 12 subcategories and 65 fine-grained task types, and includes 1,000 human‑annotated test cases in English and Chinese. The authors also present RISE‑Agent, a training‑free framework that integrates reasoning‑driven planning, tool‑augmented execution, and verifier‑guided refinement, outperforming most existing approaches on diverse RISE tasks.
arXiv Computation and Language
Sep 25
Multimodal Thinking with Renderable Programs
The paper introduces SVGLM, a framework that integrates scalable vector graphics (SVG) primitives into vision‑language models to enable image generation within reasoning tasks. By treating SVG both as image descriptions and text instructions, SVGLM offers a compact and interpretable method for connecting text and image reasoning. The authors provide a curated SVG‑based image editing dataset and demonstrate strong SVG generation and image‑aware reasoning performance on a mathematical benchmark.
arXiv Computer Vision
Sep 3
Thinking in Pictures: A Systematic Benchmark for Reasoning-driven Image Generation
The paper introduces RIG-BENCH, a benchmark for evaluating reasoning-driven image generation (RIG) in four cognitively demanding domains—Concept-based, Transformation-based, Pattern & Structure, and Scenario-based—using 2000 curated samples. It highlights a reasoning-generation gap in current unified generative models (UGMs) and world simulators, noting that these models often produce locally plausible but globally illogical outputs. RIG-BENCH aims to serve as a rigorous stress test and diagnostic framework to guide the development of next-generation, logically grounded UGMs and simulators.
arXiv AI
Jul 21
Think, Plan, Paint: Layout-Aware Reasoning for Controllable Image Generation in Unified Models
arXiv:2607. 16409v1 Announce Type: cross Abstract: Unified Multimodal Large Language Models (MLLMs) offer a promising paradigm for unifying visual understanding and generation, yet they still struggle to follow complex spatial instructions and logical constraints in controllable image generation.
arXiv Computer Vision
Sep 22
PrismGPT: Proxy-Guided Learning for Region-Aware Photo Editing with Self-Synthesized Reasoning
PrismGPT is a Vision‑Language Model that generates structured, region‑aware photo‑editing plans from a single image, without relying on commercial black‑box tools. It learns to diagnose aesthetic issues globally and locally while predicting precise editing parameters, using proxy‑guided learning with operation decomposition and region‑aware aesthetic ranking to bootstrap the model. A competence‑based dynamic scheduler shifts training focus from proxy tasks to the main editing task as skills improve, and all reasoning traces for fine‑tuning are self‑synthesized by the model itself. Experiments on MIT‑Adobe FiveK and a new professionally retouched benchmark, SPIRE, show PrismGPT achieves state‑of‑the‑art results using only about 6% of the training data required by previous methods.