arXiv Computer Vision

UltraTex: Unleashing 2K Multi-View Diffusion for 3D Texturing

arXiv Computer Vision
Oct 22

NeuralSRender: G-Buffer Guided Video Diffusion for Sim-to-Real Rendering

NeuralSRender is a sim‑to‑real video translation framework that improves the photorealism of synthetic driving videos while preserving geometric consistency. It builds on a pretrained video diffusion transformer and uses a lightweight projector to inject G‑buffer geometric and material priors, with LoRA for efficient adaptation. The two‑stage training first learns G‑buffer conditioning from synthetic data, then adapts to real‑world appearance, adding only 1.45 % parameter overhead and requiring 24 GB GPU memory. The authors also release GenReal, a large‑scale dataset of synthetic and real driving videos with G‑buffers, and show that training perception models on NeuralSRender‑translated videos boosts detection AP₅₀ on nuImages from 35.1 to 40.6 and segmentation mIoU on Cityscapes from 32.4 to 40.8.

By Yipeng Lu, Youqi Liao, Zhenyu Wang, Yuning Peng, Zhen Dong
arXiv AI
Jul 2

UltraFlux: Data-Model Co-Design for High-quality Native 4K Text-to-Image Generation across Diverse Aspect Ratios

arXiv:2511. 18050v1 Announce Type: cross Abstract: Diffusion transformers have recently delivered strong text-to-image generation around 1K resolution, but we show that extending them to native 4K across diverse aspect ratios exposes a tightly coupled failure mode spanning positional encoding, VAE compression, and optimization.

By Tian Ye, Song Fei, Lei Zhu
arXiv Computer Vision
Oct 12

NOFACE3D: NOise-scheduled Focused Anchoring and Controlled Enhancement for 3D Generation

NOFACE3D is a training‑free framework that refines fine‑scale, detail‑critical regions in 3D assets generated from a single image. It extracts a selected submesh, scales it to the generator’s input volume, and re‑encodes it into a full‑resolution latent grid, refining the region with flow‑based sampling guided by a spatially varying noise schedule. The refined region is then reintegrated, preserving surrounding geometry and appearance, and the method is evaluated on PAniC‑3D, TexVerse, and a new BigDetail benchmark, showing sharper geometry and finer texture detail. whyItMatters: The approach improves the fidelity of small, high‑curvature structures in image‑to‑3D models without requiring additional training, addressing a key limitation in current generators.

By James Rose, Jingwen Liang, Wenchao Ma, Oren Jacob, Haomiao Jiang
arXiv Computer Vision
Oct 22

Sphinx: Efficiently Serving Novel View Synthesis using Regression-Guided Selective Refinement

Sphinx is a training‑free hybrid inference system for novel view synthesis that combines fast regression models with selective diffusion refinement. It first generates coarse views via regression, then applies diffusion only where needed to improve quality while reducing computation. An SLO‑aware scheduler dynamically allocates GPU resources, achieving up to 2.7× faster inference with less than 10% perceptual loss and up to 10× higher SLO attainment compared to FCFS scheduling.

By Yuchen Xia, Souvik Kundu, Mosharaf Chowdhury, Nishil Talati