arXiv Machine Learning

Semantic Color Naturalness Breaker: Preventing Illegitimate Colorization via Content-Aware Color Priors

arXiv:2607. 17610v1 Announce Type: cross Abstract: Automatic image colorization enables large-scale and low-cost reuse of grayscale media (e.

arXiv AI
Aug 20

When to Call an Apple Red: Humans Follow Introspective Rules, VLMs Don't

The paper introduces the Graded Color Attribution (GCA) dataset, a benchmark that tests whether Vision‑Language Models (VLMs) and humans can articulate and follow a threshold rule for labeling objects by color. In experiments, humans consistently adhere to their stated rules, while VLMs—despite accurately estimating color coverage—often violate their own introspective rules, especially when world‑knowledge priors are present. This discrepancy highlights a miscalibration in VLM self‑knowledge that differs from human cognition.

By Jonathan Nemitz, Carsten Eickhoff, Junyi Jessy Li, Kyle Mahowald, Michal Golovanevsky, William Rudman
Hugging Face Trending Papers
Jul 7

AEGIS: A Mechanism-Guided Defense against Visual Synonym Jailbreaks in Text-to-Image Models

Text-to-image diffusion models have achieved high visual fidelity and broad adoption, but remain vulnerable to safety violations when adversaries exploit them to synthesize illicit content. Existing alignment paradigms, from input sanitization to structural feature pruning, are largely organized around unsafe concepts explicitly exposed during filtering, editing, or localization.

arXiv AI
Jun 30

Data Provenance for Image Auto-Regressive Generation

arXiv:2606. 28386v1 Announce Type: cross Abstract: Image autoregressive models (IARs) have recently demonstrated remarkable capabilities in visual content generation, achieving photorealistic quality and rapid synthesis through the next-token prediction paradigm adapted from large language models.

By Bihe Zhao, Louis Kerner, Michel Meintz, Tameem Bakr, Franziska Boenisch, Adam Dziedzic
arXiv Computer Vision
Sep 21

SafeStyle: Calibrated Style Residual Injection for Controllable Style-Leakage Trade-off in Diffusion Stylization

SafeStyle is a training‑free framework that injects calibrated style residuals into frozen diffusion models for reference‑guided stylization. It estimates style‑supported and content‑associated subspaces from small calibration sets, then transports purified style evidence across adaptive spatial granularity while limiting its influence with a residual‑norm budget. Experiments on texture‑ and geometry‑dominant styles show high DINO style similarity (0.432–0.474) with minimal semantic leakage (0.8%).

By Zhangping Yang, Min Li, Song Yan, Rong Gao, Xinliang Bi, Guanye Xiong, Yujie He
arXiv AI
Jun 10

Bypassing Copyright Protection in Diffusion-based Customization via Two-Stage Latent Feature Optimization

arXiv:2606. 09909v1 Announce Type: cross Abstract: With the growing concerns over copyright infringement in diffusion-based customization, adversarial attacks have emerged as a prominent defense strategy to prevent malicious content forgery in personalized image generation.

By Ziang Xu, Wenbo Yu, Hongyao Yu, Hao Fang, Jiawei Kong, Bin Chen, Hao Wu, Shu-Tao Xia, Zhiyong Wu
arXiv AI
Aug 19

COMIC: Reference-Aware Safety Gating for Multimodal Large Language Models

The paper introduces COMIC, a reference‑aware safety gate designed for multimodal large language models (MLLMs). COMIC detects the operation requested by a user, identifies visual targets through OCR and open‑vocabulary proposals, and evaluates safety on explicit operation‑target pairs, using max‑risk aggregation and quality‑aware routing to decide whether to allow or block a request. Experiments on several open‑source MLLMs and jailbreak benchmarks show that COMIC improves robustness while maintaining benign utility and efficiency.

By Md Abdullahil Oaphy, Anhao Xiang, Zongxing Xie, Huayue Gu, Chenyu Wang, Honghui Xu
arXiv AI
Sep 2

One Prompt Is Enough: Watermark Laundering Through Foundation Image Models

The paper introduces the concept of watermark laundering, where an attacker uses a single reconstruction prompt on public foundation image models to produce a visually faithful output that renders invisible watermarks undecodable. The authors evaluate this failure mode across six OpenAI and Google image editing models, three watermarking schemes, and 1,800 reconstructions, finding that OpenAI models cause the strongest payload disruption while Nano Banana 2 shows vulnerability of DwtDct under high-fidelity reconstruction. Prompt ablation experiments reveal that the disruption is driven by the reconstruction pathway itself rather than any specific removal instruction, highlighting prompt-conditioned reconstruction as a distinct attack interface.

By Jidong Yang, Qi Li, Wei Zong, Yang-Wai Chow, Willy Susilo, Huaike Yu, Chunpeng Wang, Suo Gao