arXiv Machine Learning

Detect Anything in Graphic Design: Element-Level Rewards for Autoregressive Detection

arXiv Computer Vision
Aug 28

Beyond Atomic Layouts: Compositional Design Understanding with Vision-Language Models

The paper introduces a new task called compositional layout understanding, focusing on interpreting complex, multi‑layer document and UI designs. It presents CoDeLayout, a VQA dataset of about 20,000 real‑world layouts annotated with compositional element pairs and design intent. The authors identify semantic drift and structural ambiguity as key challenges for vision‑language models and propose MASON, a post‑training approach that combines multimodal alignment and structural perception to improve performance, achieving 91.66% accuracy with only 30% of the training data.

By Yiyang Huang, Zhaowen Wang, Simon Jenni, Jing Shi, Yitian Zhang, Yizhou Wang, Yun Fu
arXiv Computer Vision
Sep 11

Learning Interaction between Image and Layout Priors for Joint Image-Layout Generation in Design Templates

The paper introduces InterIL, a joint generative model that simultaneously produces a background image and a layout of foreground elements for graphic design templates, addressing the limitations of sequential generation approaches. InterIL connects pretrained image and layout diffusion backbones via a learnable communication module, freezing the backbones to preserve prior knowledge while training only the interaction module. The model also offers a test‑time guidance strategy, enabling users to impose preferences without retraining, and demonstrates superior image, layout, and harmonization quality compared to previous methods.

By Shirong Yang, Bo Yang, Ying Cao
Hugging Face Trending Papers
Aug 27

Beyond Atomic Layouts: Compositional Design Understanding with Vision-Language Models

The paper introduces a new task called compositional layout understanding, focusing on interpreting complex, multi-layer document and UI layouts that involve hierarchical relationships among visually entangled elements. It presents CoDeLayout, a VQA dataset of about 20,000 real-world layouts annotated with compositional element pairs and design intent, and identifies two main challenges for current vision‑language models: semantic drift between textual metadata and visual content, and structural ambiguity in hierarchical inter‑element relationships. To address these, the authors propose MASON, a post‑training paradigm that combines multimodal alignment and structural perception, achieving a 91.66% accuracy on CoDeLayout and outperforming full‑data direct fine‑tuning with only 30% of the training data.

arXiv Computer Vision
5d ago

MSU Team at the Explainable Deepfake Detection Challenge 2026: Grounded Artifact Evidence for Deepfake Detection

The MSU team presents a modular approach to the Explainable Deepfake Detection Challenge, combining multiple DINOv3 backbones with Mesorch manipulation-localization features for real/fake classification. They incorporate a Grounding-DINO-based pseudo-mask pipeline to generate artifact evidence maps and a local contrastive objective to separate artifact from authenticity cues. For explanations, class-conditional Qwen3-VL models produce complex descriptions, which are then simplified by a GRPO-optimized text model, achieving high detection and explanation scores on the XPlainVerse dataset.

By Artem Filippov, Aleksandr Gushchin, Kirill Koltsov, Dmitriy Vatolin, Anastasia Antsiferova
arXiv AI
Jul 1

Layout-Conditioned Autoregressive Text-to-Image Generation via Structured Masking

arXiv:2509. 12046v2 Announce Type: replace-cross Abstract: Although autoregressive (AR) models have demonstrated remarkable success in image generation, extending these models to layout-conditioned generation remains challenging due to the sparse nature of layout conditions and the risk of feature entanglement.

By Zirui Zheng, Takashi Isobe, Tong Shen, Xu Jia, Jianbin Zhao, Xiaomin Li, Mengmeng Ge, Baolu Li, Qinghe Wang, Dong Li, Dong Zhou, Yunzhi Zhuge, Huchuan Lu, Emad Barsoum
arXiv Computer Vision
4d ago

Relative Patch Response Learning for Generalizable AI-Generated Image Detection

The paper introduces Relative Patch Response Learning (PRL) to detect AI‑generated images by comparing patch responses across two mixed views of aligned real‑generated image pairs. PRL uses a relative response objective, a reference coherence objective, and an area ranking objective to address contextual shifts caused by self‑attention, providing precise supervision for patch‑level detection. Experiments show PRL outperforms prior methods by 4.3% and 5.9% in average balanced accuracy on standard and in‑the‑wild benchmarks.

By Tianyu Wang, Ouxiang Li, Yanbin Hao, Zhenhua Tang, Shuo Wang
arXiv Computer Vision
Aug 24

ES-VP : Energy-Shaped Dynamic Visual Prompting for Efficient Model Adaptation

ES‑VP introduces Energy‑Shaped Visual Prompting, a method that generates image‑specific prompts through low‑rank initialization and energy‑guided dynamic adaptation. It achieves higher performance than existing single‑prompt and diverse‑prompt approaches while using far fewer parameters. Experiments on five architectures and fifteen datasets show consistent superiority, including a 2.6% accuracy gain over DAM‑VP on CLIP with 590× fewer prompt parameters.

By Can Jin, Ying Li, Jingchen Sun, Hongwu Peng, Jiahui Zhao, Yang Zhou, Lei Li, Dimitris N. Metaxas