arXiv Computer Vision By Lisa Weijler, Irene Ballester, Guofeng Mei, Tolga Birdal, Pedro Hermosilla

Latent Riemannian Flow Matching for Geometry-Grounded 3D Foundation Models

Read the original on arXiv Computer Vision →

The paper introduces Latent Riemannian Flow Matching, a method that performs flow matching directly in the latent space of geometric foundation models like VGGT. By respecting the product of zero‑mean hyperspheres imposed by LayerNorm, the approach avoids the pitfalls of treating the latent space as unconstrained Euclidean. Experiments on RealEstate10K, ScanNet++, and ETH3D show that this technique outperforms recent scene‑generation baselines in both novel‑view appearance and aggregated 3D geometry, and it transfers to other pretrained 3D backbones such as Depth Anything 3.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
Oct 16

ControlFlow3D: Distilling Multi-View Knowledge into Latent Flow Matching for Point Cloud Upsampling

ControlFlow3D is a framework that upsamples point clouds by distilling knowledge from pretrained foundation models into a lightweight generation network. It performs conditional flow matching in a latent space defined by a frozen 3D encoder, using unsupervised soft KMeans to cluster multi‑view image tokens and 3D latent tokens into shared prototypes that guide the flow trajectory. A Mamba‑based geometry decoder then maps latent features to dense coordinates with linear complexity, and the authors introduce ShapeNetPU, a 35K‑object multi‑modal benchmark 31 times larger than previous datasets.

By Yuang Liu, Zhi Zuo, Zhengkai Zhao, Lirui Zhang, Pan Gao, Hao Feng, Zhengzhe Liu
arXiv Computer Vision
Sep 22

GAE: Learning a Geometry-Native Latent Space for 3D-Consistent World Generation

The paper introduces the Geometry‑Native Autoencoder (GAE), a compact latent space that can be decoded into appearance, depth, camera parameters, and point maps, enabling 3D‑consistent world generation. By reparameterizing a geometry foundation model’s features, GAE replaces traditional appearance‑centric latents and improves visual quality and 3D coherence, achieving significant reductions in FVD and camera‑trajectory error on benchmark datasets. The work demonstrates that a geometry‑native latent space can serve as a shared interface between perception and generation models.

By Jiahao Lu, Minghao Yin, Wenbo Hu, Hengyu Liu, Wang Zhao, Sai-Kit Yeung, Ying Shan, Yuan Liu
arXiv AI
Oct 16

Motion- and Gravity-Aware Feedforward 3D Reconstruction

The paper presents a motion- and gravity-aware framework for feed-forward transformer models in multi-view 3D reconstruction. By providing residual optical flow and gravity direction as privileged signals during training, the model learns stronger geometric representations while remaining efficient at inference. Experiments demonstrate consistent accuracy gains, particularly in dynamic scenes and challenging camera motions, with the optimal integration stage depending on the backbone architecture.

By Shiyao Qian, Yuan Ren, Dongfeng Bai
arXiv Computer Vision
Sep 24

GaussianDS: Depth-supervised Semantic Gaussian Splatting for Scene Understanding

GaussianDS introduces a depth‑supervised framework for 3D Gaussian Splatting that jointly optimizes RGB appearance, depth, and compact semantics from scratch. By arranging multi‑view images into a pose‑aware pseudo‑video and propagating view‑consistent masks via SAM2, the method aligns semantic lifting with geometric cues, using depth supervision and edge‑aware refinement to curb semantic drift and boundary leakage. The approach achieves state‑of‑the‑art performance on LERF and 3D‑OVS benchmarks while preserving high‑fidelity reconstruction and enabling downstream tasks such as 3D object removal.

By Yufei Zhang, Chenlu Zhan, Hongwei Wang