arXiv Computer Vision

RouTex: Multi-reference 3D Texture Generation by Reprogramming Rotary Position Encoding

arXiv Computer Vision
Sep 30

DirectUV: Image-Conditioned UV Texture Generation with Surface-Aware Positional Encoding

DirectUV is an image-conditioned UV texture diffusion framework that generates high-quality textures directly in UV space using a pretrained image VAE and a Diffusion Transformer. It introduces Surface-Aware Positional Encoding (SAPE), which replaces standard 2D-grid positional encoding with encodings derived from 3D surface coordinates, enabling attention to operate based on surface proximity rather than UV-grid distance. A multi-level extension assigns different attention heads to progressively finer subdivisions of the UV patch, allowing the model to reason about surface structure at multiple granularities, resulting in sharper and more globally consistent textures, especially in occluded and view-unseen regions.

By Jiantao Lin, Yingjie Xu, Mingzhi Sheng, Yangkai Wei, Hao Chen, Ying-Cong Chen
arXiv Computer Vision
Oct 16

Anchor3DGS: Feed-Forward 3D Gaussian Splatting with Compact Anchor-Based Representation

Anchor3DGS introduces a pose‑free, feed‑forward 3D Gaussian Splatting framework that replaces pixel‑aligned Gaussian prediction with a compact anchor‑based representation. By placing 3D anchors guided by information entropy, the method concentrates primitives in visually complex regions while ensuring broad spatial coverage, and each anchor aggregates multi‑view features to generate local Gaussians. A lightweight feature enhancement module refines the coarse RGB output, resulting in state‑of‑the‑art novel view synthesis quality with an order of magnitude fewer Gaussian primitives than prior approaches.

By Sheng Ye, Jiangke Lin, Fudong Wang, Yi Yuan, Zhen-Hui Dong, Yong-Jin Liu
arXiv Computer Vision
Oct 19

FlexPainter: Flexible and Multi-View Consistent Texture Generation

FlexPainter is a new texture generation pipeline that offers flexible multi‑modal conditional guidance and produces highly consistent textures across multiple views. It builds a shared conditional embedding space to aggregate different input modalities and introduces an image‑based CFG method to separate structural and style information for reference image‑based stylization. The system generates multi‑view images simultaneously using a grid representation, applies view synchronization and adaptive weighting during diffusion sampling for local consistency, and finally uses a 3D‑aware texture completion model with a texture enhancement model to produce seamless, high‑resolution texture maps, outperforming state‑of‑the‑art methods in flexibility and quality.

By Dongyu Yan, Leyi Wu, Jiantao Lin, Luozhou Wang, Tianshuo Xu, Zhifei Chen, Zhen Yang, Lie Xu, Shunsi Zhang, Yingcong Chen
arXiv Computer Vision
Oct 2

DiDE:Direct Injection with Color-Texture DEcoupling for 3D Stylization

DiDE is a training‑free framework that enables independent control of color and texture when stylizing 3D assets generated by rectified flow‑based image‑to‑3D models. It leverages the overcomplete latent space of these models, partitioning channels so that texture occupies a small subset while color is encoded in a free subspace. Experiments on the newly collected Disen3D‑Bench benchmark demonstrate that DiDE outperforms existing 2D and 3D stylization methods in color fidelity, texture transfer, and content preservation.

By Tao Wu, Alexandra Gomez-Villa, Senmao Li, Yaxing Wang, Joost van de Weijer, Kai Wang
arXiv Computer Vision
Oct 9

MatLat: Material Latent Space for PBR Texture Generation

The paper introduces MatLat, a material latent space designed for generating high‑quality physically‑based rendering (PBR) textures on 3D meshes. It fine‑tunes a pretrained VAE to incorporate new material channels while preserving latent distribution, and adds a locality‑preserving regularization that aligns cropped latent patches with image regions. Experiments and ablation studies show that these components together improve PBR texture fidelity and outperform prior baselines.

By Kyeongmin Yeo, Yunhong Min, Jaihoon Kim, Minhyuk Sung
arXiv Computer Vision
Aug 27

GraftSR: Grafting Authentic Textures for Real-World Image Super-Resolution via Identical-Instance Guidance

GraftSR is a diffusion-based super‑resolution framework that uses reference images of the same object to guide texture restoration, mitigating hallucination. It introduces a dual‑mask reference guidance mechanism to decouple texture extraction from application, avoiding reliance on spatial alignment. The authors also release TexRefSR‑141K, a large dataset of reference pairs with spatial masks, and show that GraftSR outperforms existing methods on the TexRefSR‑Eval benchmark, reducing LPIPS by 20.2%.

By Qifan Yu, Haoran Bai, Zongyao He, Weijie He, Sibin Deng, Honggang Qi, Ying Chen