arXiv AI

3D Oral Modelling with Improved Vertex Distribution Using Matching-Based Learning

arXiv:2606. 07907v1 Announce Type: cross Abstract: In our previous work, a deep learning-based framework for 3D intraoral reconstruction was proposed.

arXiv AI
Jun 4

SAM 3D: 3Dfy Anything in Images

arXiv:2511. 16624v2 Announce Type: replace-cross Abstract: We present SAM 3D, a generative model for visually grounded 3D object reconstruction, predicting geometry, texture, and layout from a single image.

By SAM 3D Team, Xingyu Chen, Fu-Jen Chu, Pierre Gleize, Kevin J Liang, Alexander Sax, Hao Tang, Weiyao Wang, Michelle Guo, Thibaut Hardin, Xiang Li, Aohan Lin, Jiawei Liu, Ziqi Ma, Anushka Sagar, Bowen Song, Xiaodong Wang, Jianing Yang, Bowen Zhang, Piotr Doll\'ar, Georgia Gkioxari, Matt Feiszli, Jitendra Malik
arXiv Computer Vision
Aug 24

RecGen3D: Reconstruction-Guided 3D Generation in a Shared Canonical Space

RecGen3D is a framework that merges feed‑forward reconstruction and diffusion‑based generation to address the trade‑off between reconstruction fidelity and generative plausibility in sparse‑view 3D modeling. By aligning both models in a shared canonical space and using decoupled cooperative learning, the system stabilizes training and allows the reconstruction module to supply canonical geometric anchors while the diffusion generator refines and completes the structure. Experiments show that RecGen3D outperforms existing methods in producing complete and consistent 3D models from sparse observations.

By Zhisheng Huang, Jiahao Chen, Cheng Lin, Chenyu Hu, Hanzhuo Huang, Zhengming Yu, Mengfei Li, Yuheng Liu, Zekai Gu, Zibo Zhao, Yuan Liu, Xin Li, Wenping Wang
arXiv Computer Vision
Sep 11

SAMV-DUSt3R: Instance-Centric 3D Scene Decoupling from Sparse Multi-Views

SAMV-DUSt3R is an end‑to‑end model that injects SAM2 2D masks into MV‑DUSt3R reconstruction to decouple objects from 3D scenes. A Cross Flow Mask Block steers the network toward the target instance, improving shape accuracy and achieving object‑level disentanglement without multi‑stage pipelines. A lightweight Spatial RankGNN selects the optimal reference view with 73.5% accuracy, and experiments show an 11% boost in average reconstruction precision over state‑of‑the‑art baselines.

By Langxu Zhao, Zuan Gu, Yingdan Zhang, Pengfei Zhao, Tianhan Gao
arXiv Computer Vision
Aug 31

Ex-Sim(3)-Reg: 2D-3D Correspondence Pruning via Extended Sim(3) Registration

The paper introduces Ex‑Sim(3)‑Reg, a fast and robust method for pruning 2D‑3D correspondences by reformulating the problem as an extended Sim(3) registration that explicitly accounts for depth noise. The authors provide a theoretical justification and demonstrate that their approach improves registration recall by up to 24.7% on several benchmark datasets, outperforming state‑of‑the‑art baselines. The code for the method is publicly available on GitHub.

By Pei An, Muyao Peng, Junfeng Ding, Jiaqi Yang, Liangliang Nan
arXiv AI
Sep 7

Mitigating Performance Discrepancy in Cross-Domain 3D Class-Incremental Learning

The paper addresses performance discrepancy in cross-domain 3D class‑incremental learning, where 3D point clouds from heterogeneous sources cause varying degrees of performance loss beyond catastrophic forgetting. The authors introduce the Domain3D‑CIL protocol and adapt existing CIL methods to 3D, showing consistent discrepancy across baselines. They propose PolyMem, an exemplar‑free approach that models high‑order feature statistics to improve cross‑domain robustness and reduce performance discrepancy.

By Jinge Ma, Gautham Vinod, Bruce Coburn, Jui-Feng Chi, Siddeshwar Raghavan, Fengqing Zhu
arXiv Computer Vision
Sep 23

Point Diffusion Mamba: Unified Diffusion-State-Space Modeling for Single-View 3D Reconstruction under Data Scarcity

Point Diffusion Mamba (PDM) is a new method that fuses diffusion models with state‑space modeling to perform single‑view 3D reconstruction when training data are scarce. It uses a lightweight reconstruction module for unordered point‑clouds, a Local Geometric Aggregation module combined with Mamba blocks to capture both global geometry and local detail, and a Hierarchical Feature Integration Network to merge high‑level semantic and local geometric features for each point. A Dynamic Weighted Sampling strategy further improves reconstruction quality by integrating generative priors, and experiments on ShapeNet and Pix3D show that PDM outperforms existing state‑of‑the‑art approaches.

By Wei Zhou, Xinzhe Shi, Xingxing Hao, Xing Hao, Kang Li, Jinye Peng, Ying He
arXiv Computer Vision
Aug 28

NeuDonatello: Uncertainty-Aware Framework for Accurate Neural SDF Learning

NeuDonatello is a new framework for neural signed distance function (SDF) learning that explicitly models spatially varying uncertainty using Monte Carlo sampling. By incorporating this uncertainty into an adaptive regularization scheme and an uncertainty-aware SDF-to-density conversion, the method selectively strengthens geometric constraints where RGB supervision is unreliable, thereby improving surface reconstruction accuracy. Experiments show that NeuDonatello achieves state‑of‑the‑art results on diverse scenes using only posed RGB images.

By Alvin Jinsung Choi, Wanhee Kim, Taeyun Kim, Dasol Hong, Wooju Lee, Hyun Myung