arXiv Computer Vision By Wanzhou Lei, Cuifeng Shen, Yanjin He, Maohua Li, Hua Yuan, Per-Olof Persson, Tao Lan, Kan Liu, Hanlin Tang

Super-Resolution in The Right Latent Space: A Frozen Vision-Foundation Substrate

Read the original on arXiv Computer Vision →

The paper proposes that super‑resolution should be performed in a latent space that is close to the manifold of high‑resolution images, rather than in reconstruction‑oriented or pixel spaces. By using the latent space of 23 fused layers of a frozen DINOv3‑L model, degraded images are embedded near this manifold, enabling a 415M decoder (RAESR) to map them back and decode to pixels in a single pass. RAESR achieves the best fidelity–perception trade‑off on several benchmarks while running at 37 ms per 512×512 image on a single H20 GPU, outperforming models that use a VAE latent substrate.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
Aug 31

Manifold4D: Denoising on Point Cloud Rendered Manifolds for Video Re-shooting

Manifold4D introduces a new denoising strategy for video re‑shooting that injects a rendered point‑cloud directly into the initial noise manifold, eliminating the need for the render to be an explicit conditioning stream during denoising. This approach allows the network to rely solely on the source video as a visual condition, improving camera‑control accuracy on the DAVIS‑Traj benchmark and Vista4D set, with significant reductions in rotation and translation errors while maintaining video fidelity. User studies confirm enhanced trajectory following and dynamic consistency, especially for large yaw amplitudes and even when the render is corrupted.

By Yongqi Mao, Zijia Dai, Zhishuo Liu, Wei Xu, Kaiwei Wang, Guotao Meng