arXiv Computer Vision
AlphaAnything: Extending Pretrained RGB Generators to RGBA
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
Hugging Face Trending Papers
Jul 7
From RGB Generation to Dense Field Readout: Pixel-Space Dense Prediction with Text-to-Image Models
Large-scale text-to-image models are attractive backbones for dense prediction because RGB generation pretraining learns rich semantic, structural, and geometric priors. Existing generative and editing approaches reuse these priors by casting dense prediction as target generation: annotations such as depth, normals, alpha mattes, masks, and heatmaps are encoded into an RGB-trained VAE latent space and decoded back as image-like targets.
arXiv AI
Oct 5
DAGS: Disentangled Appearance-and-Geometry Steering of a Frozen Image DiT for Temporally Stabilized Generative Rendering
DAGS introduces a lightweight, attention‑free conditioning scheme that disentangles appearance and geometry for a frozen image diffusion transformer (DiT), enabling high‑fidelity, temporally stable renders with independent control. Two small convolutional encoders generate per‑frame conditioning features, which are injected as learned residuals into the image tokens, avoiding the quadratic cost of attention. Coupled with a recurrent lighting stabilizer and a training‑free temporal guidance term, DAGS transforms a per‑frame image model into a streaming renderer that outperforms real‑time denoisers and diffusion renderers in PSNR and temporal stability while requiring far less compute than path tracing.
arXiv Computer Vision
Sep 22
PixelART: Image-to-Layer Decomposition without Latents or Text-to-Image Pretraining
arXiv:2609.22789v1 Announce Type: new Abstract: Image-to-layer decomposition converts a flattened image into editable RGBA layers, enabling element-level editing in design workflows. Existing diffusi...
arXiv Computer Vision
Oct 1
PixelUMM: Encoder-Free Unified Image and Video Understanding and Generation
PixelUMM is an encoder‑free model that unifies image and video understanding and generation directly in pixel space. It represents images as spatial patches and videos as spatiotemporal tubelets, feeding both through single‑layer linear projections into a shared multimodal backbone. The Mixture‑of‑Transformers architecture blends shared attention with task‑specific parameters, enabling autoregressive text prediction, pixel‑space flow matching, and clean‑pixel video generation, and experiments show competitive performance across tasks while providing design insights for future pixel‑space multimodal models.
arXiv Computer Vision
Oct 22
JointLight: Human-Centric Video Relighting with Asynchronous RGB-Irradiance Joint Modeling
JointLight introduces an asynchronous joint-modeling approach for human-centric video relighting, enabling fine-grained illumination control by jointly denoising RGB and irradiance frames during two-stage training. The method employs a domain matching strategy to bridge gaps between synthetic irradiance cues and real irradiance maps, and uses an asynchronous hijacked generation pipeline at inference. A newly created multi-illumination synthetic video dataset with paired irradiance maps supports training, and the model demonstrates strong generalization to real-world scenarios, outperforming prior methods in lighting fidelity and generative quality.
arXiv Computer Vision
Sep 30
JointEdit3D: Feed-Forward 3D Scene Editing in a Unified Latent Space
arXiv:2606.13345v2 Announce Type: replace Abstract: Existing 3D scene editing methods typically rely on per-scene optimization over explicit 3D representations or cascaded edit-and-reconstruct pipeli...