arXiv Computer Vision
MDMR-Bench: A Multi-Dimensional Benchmark for Multi-Reference Image Generation
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv Computation and Language
Sep 1
UReason: Benchmarking Reasoning-to-Generation Alignment in Unified Multimodal Models
UReason is a benchmark that evaluates how well unified multimodal models (UMMs) align textual reasoning with image generation. It contains 2,000 human‑curated instances across five reasoning‑intensive tasks—Code, Arithmetic, Spatial, Attribute, and Text—and compares direct generation, reasoning‑guided generation, and decontextualized generation. The study finds that while reasoning‑guided generation improves over direct generation, decontextualized generation consistently outperforms it, indicating that the visual semantics in textual reasoning are not reliably reflected in the generated images.
arXiv Machine Learning
Oct 12
Vision2Code: A Multi-Domain Benchmark for Evaluating Image-to-Code Generation
Vision2Code is a new benchmark for image-to-code generation that covers 15 domains and 539 test examples without relying on reference source code. It evaluates generated programs by executing them and comparing rendered outputs to the original images using domain‑specific rubrics, yielding scores that correlate better with human judgments than generic metrics. The study shows domain variability in model performance and demonstrates that the scoring method can improve fine‑tuning of models like Qwen3.5‑9B and Phi‑4‑MM via rejection sampling.
arXiv Computer Vision
Sep 30
Evaluating the Evaluators: Diagnosing Large Multimodal Models for AI-Generated Image Assessment
arXiv:2609.37576v1 Announce Type: new Abstract: With the rapid advancement of text-to-image (T2I) generation, robust evaluation becomes critical yet challenging, as traditional metrics fail to captur...
arXiv AI
Aug 18
TRACE-Bench: Decomposing and Diagnosing Multi-Reference Image Generation
arXiv:2608. 16765v1 Announce Type: cross Abstract: Despite recent advances in unified multimodal models for multi-reference image generation, existing benchmarks remain organized around predefined task types (e.
arXiv AI
Jun 26
Scaling Multi-Reference Image Generation with Dynamic Reward Optimization
arXiv:2606. 26947v1 Announce Type: cross Abstract: While personalized image generation has achieved remarkable progress, multi-reference image generation (MRIG) remains a challenging task.
arXiv Computer Vision
Oct 8
FiRe: Fine-grained Multimodal Reasoning for Enhanced Image Generation
arXiv:2604.13491v4 Announce Type: replace Abstract: With the rapid progress of Multimodal Large Language Models (MLLMs), unified MLLMs that jointly perform image understanding and generation have adv...