arXiv Computer Vision By Jiahao Lu, Minghao Yin, Wenbo Hu, Hengyu Liu, Wang Zhao, Sai-Kit Yeung, Ying Shan, Yuan Liu

GAE: Learning a Geometry-Native Latent Space for 3D-Consistent World Generation

Read the original on arXiv Computer Vision →

The paper introduces the Geometry‑Native Autoencoder (GAE), a compact latent space that can be decoded into appearance, depth, camera parameters, and point maps, enabling 3D‑consistent world generation. By reparameterizing a geometry foundation model’s features, GAE replaces traditional appearance‑centric latents and improves visual quality and 3D coherence, achieving significant reductions in FVD and camera‑trajectory error on benchmark datasets. The work demonstrates that a geometry‑native latent space can serve as a shared interface between perception and generation models.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
Oct 21

Latent Bridge: From Video Latents to 3D Geometry via Feature Alignment

Latent Bridge connects video generative latent spaces with geometric feature spaces, enabling direct prediction of 3D geometry—cameras, depth, and point clouds—without an intermediate RGB decoding step. The method trains representation‑specific bridges for Wan2.1 and V‑RAE via feature distillation on RGB videos while keeping the video encoder and geometry model frozen, requiring no ground‑truth geometry. At inference, the same video latents support both RGB decoding and geometry prediction, and the trained bridge can be reused across image‑to‑video and text‑to‑video generation, achieving competitive reconstruction quality on Co3Dv2 and WildRGB‑D with efficient end‑to‑end generation.

By Shuai Zhang, Zhanpeng Ouyang, Zhengqing Chen, Ruohong Mei, Shaoyu Chen, Weiqiang Ren, Hui Sun, Qian Zhang, Wenyu Liu, Xinggang Wang