arXiv Computer Vision

Where, What, Why, and Importance: Structured Defect Grounding for Text-to-Image Feedback

The paper introduces Structured Defect Grounding (SDG), a method that treats text‑to‑image failure diagnosis as a structured set prediction problem, representing each defect as a tuple of location, type, reason, and importance. It presents SDG‑30K, a 30,000‑image dataset with box‑grounded annotations for four modern T2I generators, and a dedicated evaluation protocol, SDG‑Eval. Using a Vision‑Language Model as an SDG detector and a BoxFlow‑GRPO module, the authors demonstrate that SDG‑guided rewards improve diffusion model alignment and enable localized image refinement, positioning SDG as a unified interface for diagnosing and enhancing generative models.

Hugging Face Trending Papers
Jun 4

Where, What, Why, and Importance: Structured Defect Grounding for Text-to-Image Feedback

Despite generating increasingly photorealistic images, text-to-image (T2I) models still exhibit localized, subtle, and structurally complex failures. Diagnosing these failures requires instance-level feedback that answers where a defect occurs, what type it is, why it is defective, and its importance to overall image quality.

arXiv AI
Jun 9

Unification of Closed-Open Industrial Detection Scenarios: New Large-Scale Benchmarks,Challenges and Baselines

arXiv:2606. 07953v1 Announce Type: new Abstract: Large-scale Visual-Language Models (LVLMs) have achieved remarkable success in natural visual tasks, yet their application to industrial defect detection remains challenging due to two fundamental limitations: (i) the scarcity of large-scale industrial datasets that cover diverse defect categories across multiple domains, and (ii) the reliance on manual prompts (points, boxes, masks) that introduce subjective noise and lack text-visual interaction for fine-grained understanding.

By Zekai Zhang, Jinglin Zhang, Qinghui Chen, Gang Li, Da Chen, Shuainan Jing, He Wang, Dagang Li, Cong Liu, Cong Bai, Shengyong Chen
arXiv AI
6d ago

UniDG: Unified Defect Generation via Defect-Context Editing

UniDG introduces a unified defect generation framework that addresses the scarcity of abnormal samples in anomaly detection. By creating a large dataset of 300K normal‑abnormal‑mask‑caption quadruplets and formulating defect synthesis as Defect‑Context Editing, the model extracts reference defect context, organizes inputs in a diptych format, and fuses multimodal conditions via MM‑DiT attention. A two‑stage training strategy—Diversity‑SFT for transferable defect priors and optional Consistency‑RFT for reference adherence—enables UniDG to outperform prior few‑shot anomaly generation and editing baselines in both synthesis quality and downstream anomaly detection tasks without per‑category fine‑tuning.

By Yuanting Fan, Jun Liu, Bin-Bin Gao, Xiaochen Chen, Yuhuan Lin, Zhewei Dai, Jiawei Zhan, Chengjie Wang
arXiv Machine Learning
Oct 12

Vision2Code: A Multi-Domain Benchmark for Evaluating Image-to-Code Generation

Vision2Code is a new benchmark for image-to-code generation that covers 15 domains and 539 test examples without relying on reference source code. It evaluates generated programs by executing them and comparing rendered outputs to the original images using domain‑specific rubrics, yielding scores that correlate better with human judgments than generic metrics. The study shows domain variability in model performance and demonstrates that the scoring method can improve fine‑tuning of models like Qwen3.5‑9B and Phi‑4‑MM via rejection sampling.

By Ajay Vikram Periasami, Junlin Wang, Bhuwan Dhingra
arXiv AI
Jul 23

SynSur: An end-to-end generative pipeline for synthetic industrial surface defect generation and detection

arXiv:2604. 26633v2 Announce Type: replace-cross Abstract: Industrial surface defect inspection suffers from a fundamental data bottleneck: defects are rare, annotations require expert knowledge, and collecting balanced training sets is slow and costly.

By Paul Julius K\"uhn, Mika Pommeranz, Arjan Kuijper, Saptarshi Neil Sinha
arXiv Computer Vision
4d ago

From Evaluation to Evolution: Benchmarking Image Editing and Evolving Image Models

The paper introduces WeGenEditBench, a benchmark with 2,740 evaluation instances and 148 task types for image editing, focusing on local failure detection and prioritization for model improvement. It also presents WeGenEvoStudio, a multi‑agent harness that supports recursive self‑improvement by diagnosing failures, constructing retrieval‑grounded data, and adapting models. Experiments show that models such as GPT‑Image‑2 and Seedream‑5.0‑Pro excel in single‑image and text‑intensive editing, and evolution experiments demonstrate significant targeted gains on selected benchmarks.

By Jun He, Canmiao Fu, Ying Zhang, Zhipeng Huang, Chenyu Mu, Yazhen Xie, Chen Li, Jing Lyu, Weijia Li, Xiang Zhang