arXiv Machine Learning
On Color Alignment in VAE Latent Spaces and Its Applications
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv AI
Jun 11
The Latent Color Subspace: Emergent Order in High-Dimensional Chaos
arXiv:2603. 12261v2 Announce Type: replace-cross Abstract: Text-to-image generation models have advanced rapidly, yet achieving fine-grained control over generated images remains difficult, largely due to limited understanding of how semantic information is encoded.
arXiv AI
Sep 18
Paint-Anything: Unified Any-Color Control for Image Generation and Editing
Paint-Anything introduces a unified hex-prompt interface that allows users to specify any 24‑bit hex color for both image generation and editing. The method trains on a new Paint‑500K dataset created from real images with object grounding, perceptual color labeling, and editing‑pair synthesis, and supplements this with pure‑color anchors to address shadow‑induced color inaccuracies. Evaluated on the newly proposed Any Color Benchmark (ACBench), Paint‑Anything achieves significant improvements over the base FLUX.2‑4B model, boosting T2I and editing scores by 85.3 % and 28.3 % respectively, and outperforms competing methods on the CompColor metric.
arXiv Computer Vision
Oct 8
Iris-3B: Going Beyond the Latent with Pixel-Space Diffusion Training, Conversion and Fine-Tuning
arXiv:2610.09450v1 Announce Type: new Abstract: Pixel-space diffusion models avoid the lossy VAE of latent models, which suggests an advantage on downstream tasks where fine-grained detail matters. W...
Hugging Face Trending Papers
Aug 13
PixSDS: Why Latent SDS Makes Noisy Pixels
Score Distillation Sampling (SDS) enables text-to-3D generation by optimizing rendered images with a pretrained diffusion prior, but latent SDS often produces structured color artifacts and high-frequency texture noise. We identify a failure mode of latent SDS caused by VAE-induced pixel drift: the optimized image can move along pixel-space directions that are weakly constrained by the VAE encoder, so its latent representation remains clean and semantically meaningful while the image itself accumulates visible artifacts.
arXiv Computer Vision
Oct 2
DiDE:Direct Injection with Color-Texture DEcoupling for 3D Stylization
DiDE is a training‑free framework that enables independent control of color and texture when stylizing 3D assets generated by rectified flow‑based image‑to‑3D models. It leverages the overcomplete latent space of these models, partitioning channels so that texture occupies a small subset while color is encoded in a free subspace. Experiments on the newly collected Disen3D‑Bench benchmark demonstrate that DiDE outperforms existing 2D and 3D stylization methods in color fidelity, texture transfer, and content preservation.
arXiv AI
Aug 12
Beyond Fixed Luminance: Towards Panchromatic and Orthochromatic Image Colorization
arXiv:2608. 10798v1 Announce Type: cross Abstract: Most image colorization systems operate in $Lab$ space by predicting chroma ($ab$) while preserving an input-derived luminance channel ($L$).