arXiv AI
Jun 16
Efficient Flow Matching using Latent Variables
arXiv:2505. 04486v4 Announce Type: replace-cross Abstract: Flow matching models have shown great potential in image generation tasks among probabilistic generative models.
MatLat: Material Latent Space for PBR Texture Generation
The paper introduces MatLat, a material latent space designed for generating high‑quality physically‑based rendering (PBR) textures on 3D meshes. It fine‑tunes a pretrained VAE to incorporate new material channels while preserving latent distribution, and adds a locality‑preserving regularization that aligns cropped latent patches with image regions. Experiments and ablation studies show that these components together improve PBR texture fidelity and outperform prior baselines.
Related stories
arXiv Computer Vision
Sep 30
Texture Space Material Diffusion
arXiv:2609.37654v1 Announce Type: new Abstract: We present a method for generating high quality materials for 3D objects entirely in texture space. We finetune a video diffusion transformer for text-...
arXiv AI
Jun 8
Native3D: End-to-End 3D Scene Generation via Unified Mesh-Texture Modeling and Semantic Alignment
arXiv:2606. 07117v1 Announce Type: cross Abstract: This paper presents Native3D, the first end-to-end 3D scene generation framework that completely bypasses 2D intermediate representations.
arXiv Computer Vision
Sep 30
GeoVerse: World-Consistent Novel View Synthesis in Geometric Latent Space
arXiv:2609.35734v2 Announce Type: replace Abstract: Novel view synthesis from sparse images must reconcile faithful reconstruction of observed regions with plausible completion of unseen content, whi...
arXiv Machine Learning
Aug 21
Decoupling High and Low Frequencies for Faithful Image Generation with Fine Details
arXiv:2509. 05441v4 Announce Type: replace-cross Abstract: Latent generative models compress images into learned embeddings prior to synthesis, and the generation quality critically depends on how faithfully these embeddings preserve visual detail.
arXiv Computer Vision
Sep 22
UltraTex: Unleashing 2K Multi-View Diffusion for 3D Texturing
arXiv:2609.23169v1 Announce Type: new Abstract: High-quality texture generation is essential for creating realistic and production-ready 3D assets. Recent multi-view diffusion methods have shown prom...
arXiv Computer Vision
Sep 30
DirectUV: Image-Conditioned UV Texture Generation with Surface-Aware Positional Encoding
DirectUV is an image-conditioned UV texture diffusion framework that generates high-quality textures directly in UV space using a pretrained image VAE and a Diffusion Transformer. It introduces Surface-Aware Positional Encoding (SAPE), which replaces standard 2D-grid positional encoding with encodings derived from 3D surface coordinates, enabling attention to operate based on surface proximity rather than UV-grid distance. A multi-level extension assigns different attention heads to progressively finer subdivisions of the UV patch, allowing the model to reason about surface structure at multiple granularities, resulting in sharper and more globally consistent textures, especially in occluded and view-unseen regions.
Hugging Face Trending Papers
Aug 13
PixSDS: Why Latent SDS Makes Noisy Pixels
Score Distillation Sampling (SDS) enables text-to-3D generation by optimizing rendered images with a pretrained diffusion prior, but latent SDS often produces structured color artifacts and high-frequency texture noise. We identify a failure mode of latent SDS caused by VAE-induced pixel drift: the optimized image can move along pixel-space directions that are weakly constrained by the VAE encoder, so its latent representation remains clean and semantically meaningful while the image itself accumulates visible artifacts.
arXiv Computer Vision
Aug 27
GraftSR: Grafting Authentic Textures for Real-World Image Super-Resolution via Identical-Instance Guidance
GraftSR is a diffusion-based super‑resolution framework that uses reference images of the same object to guide texture restoration, mitigating hallucination. It introduces a dual‑mask reference guidance mechanism to decouple texture extraction from application, avoiding reliance on spatial alignment. The authors also release TexRefSR‑141K, a large dataset of reference pairs with spatial masks, and show that GraftSR outperforms existing methods on the TexRefSR‑Eval benchmark, reducing LPIPS by 20.2%.
arXiv Computer Vision
Oct 8
Iris-3B: Going Beyond the Latent with Pixel-Space Diffusion Training, Conversion and Fine-Tuning
arXiv:2610.09450v1 Announce Type: new Abstract: Pixel-space diffusion models avoid the lossy VAE of latent models, which suggests an advantage on downstream tasks where fine-grained detail matters. W...
arXiv Machine Learning
Jun 4
Geometry-Preserving Encoder/Decoder in Latent Generative Models
arXiv:2501. 09876v3 Announce Type: replace-cross Abstract: Generative modeling aims to generate new data samples that resemble a given dataset.
arXiv Computer Vision
3d ago
SUPRA-TEX: 3D Generation with Super-Aligned Texture
SUPRA-Tex is a new method for single‑image 3D generation that dresses a 3D mesh with relightable materials while preserving the visual details of a reference image. It decouples visible‑material estimation, surface alignment, and observation‑guided 3D completion, allowing a 3D generator trained on limited data to focus on preserving visible evidence and completing unobserved surfaces. The approach uses an MLLM‑based image editor to predict lighting‑separated PBR maps, projects them onto the visible surface, encodes them with a pretrained material VAE, and employs an interleaved flow transformer to generate complete material latents, achieving state‑of‑the‑art performance on geometry‑conditioned texturing and end‑to‑end asset generation.