arXiv Computer Vision

RGBD-to-3D Object Mesh Refinement via Depth Matching and Symmetry Propagation

The paper introduces a lightweight RGBD-to-3D refinement technique that improves single-view 3D reconstructions by correcting visible surfaces through bipartite matching with back-projected depth points, mirroring corrections across detected symmetry planes, and propagating them via a smoothness solver. The method is closed-form, significantly faster than optimization-heavy refinements, and works plug-and-play with any RGB-to-3D reconstructor without retraining. Experiments on GSO and OmniObject3D with five backbones show consistent accuracy gains, especially on symmetric objects, and the approach also benefits RGB-D-to-mesh reconstructions and real noisy sensor data.

Hugging Face Trending Papers
Aug 19

CoMVS-GS: Collaborative Multi-View Stereo and 3D Gaussian Splatting for Surface Reconstruction

CoMVS‑GS is a surface‑reconstruction framework that fuses Multi‑View Stereo (MVS) with 3D Gaussian splatting. It initializes Gaussian primitives from dense MVS points, uses PatchMatch‑3DGS mutual supervision to refine depths and normals, and replaces voxel‑based meshing with a Delaunay graph‑cut pipeline. Experiments on DTU, GauU‑Scene V2, and MatrixCity demonstrate competitive object‑level results and improved geometric accuracy and mesh compactness in outdoor scenes while preserving high rendering quality.

arXiv Computer Vision
3d ago

Sparse-GS2Mesh: 3D Gaussian Splatting Guided by Novel Stereo Views and 2DGS for Sparse View Surface Reconstruction

Sparse-GS2Mesh is a stereo-aware framework that improves 3D surface reconstruction from sparse camera views by combining 3D Gaussian Splatting (3DGS) with stereo matching techniques. The method begins by initializing 3DGS with epipolar depth priors to reduce overfitting, then applies adaptive baseline selection, stereo-matching‑guided fine‑tuning, and 2D/3D co‑regularization to refine the model. Experiments show a 15% performance gain over state‑of‑the‑art methods in low‑overlap scenarios and comparable results in high‑overlap settings.

By Younghyun Noh, Minje Kim, Tae-Kyun Kim
arXiv AI
3d ago

HI3D 3.0 (Twinkle3D): Object-specific 3D Asset Generation with High Resolution

Hi3D 3.0, also called Twinkle3D, is an image‑to‑3D generation system that produces watertight triangle meshes at a resolution of 2048³. It improves on previous methods by maintaining high representational precision while fixing surface quality and non‑watertight issues, scaling diffusion generation to 300K geometric tokens, strengthening global shape and local detail in a single stage, and adding a fine‑grained image‑3D cross‑modal interaction to better recover object‑specific structures such as inscriptions. The system outperforms four commercial competitors, recovering 82.1 % of inscribed characters with 98.2 % precision versus 21.7 % recall for the best rival.

By Ziying Li, Shengchu Zhao, Huiang He, Yiyang Chen, Jianwen Huang, Bailin Li, Changhao Li, Jianhui Li, Jie Li, Ruiyang Liu, Yibo Luo, Tengjiao Sun, Pei Tang, Shiwen Wang, Jiaqi Wu, Kang Wu, Kaiqiao Yang, Zherui Yang, Hu Zhang, Xuezhi Zhao, Xinhe Zheng, Yukun Li, Heliang Zheng, Rongfei Jia
arXiv AI
Sep 24

MessyKitchens: Contact-rich object-level 3D scene reconstruction

MessyKitchens introduces a new dataset of cluttered real-world kitchen scenes with detailed 3D object shapes, poses, and accurate contact information. The authors extend the SAM 3D single-object reconstruction method with a Multi-Object Decoder (MOD) to jointly reconstruct entire scenes, achieving better registration accuracy and reduced inter-object penetration compared to prior work. The dataset, benchmark, code, and pretrained models will be publicly released on the project website.

By Junaid Ahmed Ansari, Ran Ding, Fabio Pizzati, Ivan Laptev
arXiv Computer Vision
Sep 24

GaussianDS: Depth-supervised Semantic Gaussian Splatting for Scene Understanding

GaussianDS introduces a depth‑supervised framework for 3D Gaussian Splatting that jointly optimizes RGB appearance, depth, and compact semantics from scratch. By arranging multi‑view images into a pose‑aware pseudo‑video and propagating view‑consistent masks via SAM2, the method aligns semantic lifting with geometric cues, using depth supervision and edge‑aware refinement to curb semantic drift and boundary leakage. The approach achieves state‑of‑the‑art performance on LERF and 3D‑OVS benchmarks while preserving high‑fidelity reconstruction and enabling downstream tasks such as 3D object removal.

By Yufei Zhang, Chenlu Zhan, Hongwei Wang