arXiv AI
Jun 17
Detail++: Training-Free Detail Enhancer for Text-to-Image Diffusion Models
arXiv:2507. 17853v2 Announce Type: replace-cross Abstract: Recent advances in text-to-image (T2I) generation have led to impressive visual results.
Appearance Pointers -- Multimodal Region Control of Diffusion Transformers
arXiv:2607. 19344v1 Announce Type: cross Abstract: Controllable image generation remains challenging for creative professionals, who often require precise regional control over materials, object identities, and spatial arrangements that cannot be reliably achieved through text prompting alone.
Related stories
arXiv Computer Vision
Sep 14
Lumina-OmniLV: A Unified Multimodal Framework for General Low-Level Vision
arXiv:2504.04903v3 Announce Type: replace Abstract: We present Lunima-OmniLV (abbreviated as OmniLV), a universal multimodal multi-task framework for low-level vision that addresses over 100 sub-task...
arXiv Computer Vision
Sep 11
Overpainting: Localized Context-aware Diffusion Image Editing
The paper introduces "overpainting," a localized, context-aware image editing technique that allows users to specify precise or loose editing regions via a trimap. The method adapts a pretrained diffusion model with joint attention and low‑rank adaptation, incorporating attention‑dropout to balance noise, source, and mask inputs. An automated pipeline generates training data by pairing images from language‑based editing models, curating them, and extracting trimaps, enabling the model to perform a wide range of editing tasks.
arXiv Computer Vision
Sep 7
RefDiT: Local Attribute Guidance in Reference-Based Image Generation
RefDiT is a new framework for reference-guided image generation that addresses the shortcomings of previous methods when handling complex scenes with multiple objects. It introduces local region guidance by decomposing a single identifier token into attribute-level signals, allowing the model to learn correspondences between tokens and specific regions of a reference image. The approach incorporates a low-rank adapter (LoRA) within a diffusion transformer (DiT) to adjust the inference prompt based on user-provided guidance context, thereby enabling more precise local attribute control.
arXiv AI
Jul 10
Reinforcing the Generation Order of Multimodal Masked Diffusion Models
arXiv:2607. 08056v1 Announce Type: cross Abstract: Diffusion Language Models (DLMs) have recently achieved substantial progress in natural language generation tasks.
arXiv AI
Jun 4
On-the-fly Repulsion in the Contextual Space for Rich Diversity in Diffusion Transformers
arXiv:2603. 28762v2 Announce Type: replace-cross Abstract: Modern Text-to-Image (T2I) diffusion models have achieved remarkable semantic alignment, yet they often suffer from a significant lack of variety, converging on a narrow set of visual solutions for any given prompt.
Hugging Face Trending Papers
Jul 9
Reinforcing the Generation Order of Multimodal Masked Diffusion Models
Diffusion Language Models (DLMs) have recently achieved substantial progress in natural language generation tasks. Recent research demonstrates that adaptive token generation ordering can significantly improve performance in mathematical reasoning and code synthesis applications.
Hugging Face Trending Papers
Jul 23
MagicMakeup: A Region-Controllable Diffusion Transformer for High-Fidelity Makeup-Transfer
Makeup-transfer applies the reference makeup to the source face while preserving the source identity. Despite advances in full-face editing by diffusion-based methods, strong regional controllability, makeup fidelity, and identity preservation remain challenging.
arXiv AI
Sep 1
POCI-Diff: 3D-Layout Guided Diffusion for Controllable Synthetic Surveillance Data Generation
arXiv:2601.14056v2 Announce Type: replace-cross Abstract: Training robust visual surveillance models requires large-scale datasets with precise spatial annotations, yet collecting real surveillance d...
arXiv AI
Sep 3
ContextAnyone: Context-Aware Diffusion for Character-Consistent Text-to-Video Generation
ContextAnyone is a context‑aware diffusion framework that treats a reference image as an explicitly preserved appearance anchor rather than a simple conditioning signal. By jointly reconstructing the reference image and generating the target video within a shared diffusion transformer, it provides direct supervision for maintaining identity and fine‑grained appearance throughout denoising. The method introduces asymmetric information flow and Gap‑RoPE positional representations to keep the reference stable while allowing selective access by video tokens, and demonstrates improved identity and appearance consistency on an OpenVid‑HD benchmark.
arXiv AI
Jun 26
Semantic Generative Tuning for Unified Multimodal Models
arXiv:2605. 18714v2 Announce Type: replace-cross Abstract: Unified multimodal models (UMMs) strive to consolidate visual understanding and visual generation within a single architecture.
arXiv AI
Jun 15
HiLo-Token: Input-Adaptive High-Low Frequency Token Compression for Efficient Image Editing
arXiv:2606. 13898v1 Announce Type: cross Abstract: Creative image editing tools, such as Photoshop's Remove or Generative Fill buttons, are central to everyday customer use and account for a major share of traffic in Photoshop and Lightroom.