arXiv Computer Vision

Pixel-wise Planarity for High-Precision Monocular Plane Segmentation

arXiv Computer Vision
2d ago

AffineGS: Unlocking Accurate Geometry in 3DGS via Spatially Varying Affine Rectification

The paper introduces AffineGS, a method that improves the geometric accuracy of 3D Gaussian Splatting (3DGS) by applying a spatially varying affine rectification to monocular depth estimates. It identifies that monocular depth networks suffer from region-dependent, piecewise-linear distortions, rendering global alignment ineffective. By employing edge-aware, regionally smooth fields and a normal-aware regularizer, AffineGS aligns disparity with 3DGS depth and normals, achieving strong photometric quality while significantly enhancing geometry across diverse experiments.

By Tze Ho Elden Tse, Jizong Peng, Richard Chen, Angela Yao
arXiv AI
Aug 19

PXDepth: Pixel-Space Modeling for Structure Preserving Monocular Depth Estimation

PXDepth is a monocular depth estimation model that separates global context modeling from pixel-level depth prediction. It uses a large-patch Vision Transformer to capture scene context and a pixel-space predictor with Context‑Modulated Pixel Transformer blocks to preserve high‑resolution spatial details. The approach maintains fine structures and sharp boundaries while achieving competitive global depth accuracy in zero‑shot benchmarks.

By Zhiyuan Yuan, Guanying Chen, Lingteng Qiu, Ruimao Zhang, Shuguang Cui, Xiaochun Cao
arXiv Computer Vision
Sep 3

Geometric Distillation from Rectified Stereo: Leveraging Epipolar Cues for Monocular Depth

The paper introduces Epipolar Distillation (EpiDistill), a method that transfers scale‑aware geometric priors from multi‑view models to monocular depth foundation models using Rectified Stereo Tokens. By preserving epipolar attention patterns, the single‑view model maintains geometric consistency without needing multi‑view inputs during inference. Experiments show significant improvements in zero‑shot metric depth estimation on challenging datasets such as ETH3D and DIODE, and the approach consistently boosts performance of state‑of‑the‑art ViT‑based models like UniDepthV2 and DepthPro.

By Jung-Hee Kim, Xiaoming Liu
arXiv Computer Vision
Sep 25

PePESeg3D: Perception Prior Enhances Multi-Scale Segmentation for 3D Gaussian Splatting

PePESeg3D introduces perception priors into a multi‑scale 3D Gaussian segmentation pipeline, integrating monocular depth and mask constraints during geometry reconstruction and dense depth‑color cues with view‑consistent centroid supervision during contrastive feature learning. This dual‑stage approach aligns geometry with semantic structure and compensates for incomplete mask supervision from 2D foundation models. Experiments on SPIn‑NeRF, LERF‑Mask, and NVOS benchmarks show state‑of‑the‑art performance in both multi‑scale segmentation and scene reconstruction.

By Sungjae Choi, Seunghee Koh, Junmo Kim