arXiv Computer Vision

AcFlow: Controlling Text-to-Image Diffusion Transformers via Learned Conditional Activation Flow

AcFlow introduces an inference‑time controller for text‑to‑image diffusion transformers that transports intermediate layer activations through a learned, concept‑conditioned velocity field while keeping the base model frozen. The method allows fine‑grained style intensity control and suppression of unwanted concepts, achieving superior style–content trade‑offs compared to baselines and generalizing to unseen concepts without per‑concept fitting. Experiments demonstrate improved style alignment and qualitative suppression of diverse concepts where direct prompting fails.

arXiv Machine Learning
Sep 25

CARE: Condition-Aware Representation Regularization for Diffusion Models

The paper introduces CARE, a lightweight, plug‑and‑play regularization framework for diffusion models that dynamically adjusts feature distributions based on condition similarity. By leveraging built‑in conditioning signals such as labels or text prompts, CARE promotes tighter feature clusters for similar conditions without requiring explicit alignment losses or external supervision. Empirical results show consistent improvements in visual fidelity and convergence stability, achieving significant FID reductions and speed‑ups on ImageNet and text‑to‑image tasks, and it can be combined with existing regularization methods for further gains.

By Fengjia Guo, Zhuoyi Yang, Jie Tang
arXiv Computer Vision
Oct 28

Nemotron-Labs-Diffusion-Uni: Elastic Self-Refining Unified Diffusion LLM with Cross-Paradigm On-Policy Distillation

Nemotron‑Labs‑Diffusion‑Uni (NLD‑Uni) is a unified discrete diffusion large language model designed for visual understanding and generation. It introduces a cross‑paradigm on‑policy distillation framework that transfers capabilities from autoregressive VLMs and continuous flow models into a single DLLM, and a progressive self‑refining diffusion process that corrupts tokens gradually during training. Experiments show NLD‑Uni outperforms other unified DLLMs on tasks such as visual question answering, multi‑modal reasoning, object grounding, text‑to‑image generation, and image editing.

By Shufan Li, Hanrong Ye, Greg Heinrich, Yonggan Fu, Haotian Zhang, Sifei Liu, Aditya Grover, Pavlo Molchanov