arXiv:2610.08780v1 Announce Type: cross Abstract: World models offer a data-driven alternative to traditional simulators for robotics, with applications spanning policy evaluation, improvement, and p...
World models offer a data-driven alternative to traditional simulators for robotics, with applications spanning policy evaluation, improvement, and planning. All of these uses depend on faithful 3D ge...
We present FoundationGeo, a two-stage framework that explicitly bridges relative and metric prediction via spatial calibration and principled data design. Stage 1 learns a high-fidelity, affine-invariant geometry model by initializing with DINOv3 and training on a curated 10.
arXiv:2609.23796v2 Announce Type: replace Abstract: Single-image 3D object generation can now produce high-fidelity assets, yet accurately placing them into a coherent scene layout remains an open ch...
arXiv:2609.23796v1 Announce Type: new Abstract: Single-image 3D object generation can now produce high-fidelity assets, yet accurately placing them into a coherent scene layout remains an open challe...
PURE is an unlabeled post‑training refinement framework that enhances feed‑forward 3D reconstruction models by improving depth and camera estimation without ground‑truth supervision. It distills structural knowledge from state‑of‑the‑art 2D priors into 4D architectures, using relative depth constraints, affine‑invariant geometry distillation, and pose refinement via feature correspondences. Experiments on synthetic and real‑world dynamic benchmarks show consistent improvements across multiple state‑of‑the‑art models, effectively mitigating domain shifts and unlocking their architectural limits in challenging in‑the‑wild scenes.
DeFM is a self‑supervised foundation model trained solely on depth images for robotics. It uses a DINO‑style self‑distillation objective on 60 M curated depth images to learn geometric and semantic representations that generalize across environments, tasks, and sensors. The model incorporates a novel input normalization strategy for metric awareness, can be distilled into compact versions for resource‑constrained systems, and achieves state‑of‑the‑art performance on depth‑based classification, segmentation, navigation, locomotion, and manipulation benchmarks, with strong sim‑to‑real transfer.
Con-DSO introduces a consistency-aware RGB‑D direct sparse odometry framework that learns pixel‑level photometric and geometric uncertainty from adjacent RGB‑D frame pairs. The network predicts uncertainties that are converted into pairwise quality scores, guiding support‑pixel selection and forming a host‑side quality prior for keyframe tracking. Experiments on five public benchmarks show that this approach reduces absolute trajectory error by over 20% on ICL‑NUIM and by 50–80% on other datasets, improving robustness in challenging environments.
GaussianDS introduces a depth‑supervised framework for 3D Gaussian Splatting that jointly optimizes RGB appearance, depth, and compact semantics from scratch. By arranging multi‑view images into a pose‑aware pseudo‑video and propagating view‑consistent masks via SAM2, the method aligns semantic lifting with geometric cues, using depth supervision and edge‑aware refinement to curb semantic drift and boundary leakage. The approach achieves state‑of‑the‑art performance on LERF and 3D‑OVS benchmarks while preserving high‑fidelity reconstruction and enabling downstream tasks such as 3D object removal.
arXiv:2608.20788v1 Announce Type: new Abstract: Deep learning-based Multi-View Stereo (MVS) has advanced significantly but often generalizes poorly to unseen scenes, particularly in occluded areas or...
StereoEngine introduces two methods for generating realistic synthetic stereo data for robotic manipulation. The first method warps a monocular video into a right view using depth estimation and a video diffusion model to inpaint disoccluded regions, while the second method renders stereo pairs directly in simulation. These approaches outperform existing baselines in stereo quality and enable improved bimanual manipulation policies when used for mid‑training or task‑specific fine‑tuning.
arXiv:2606. 29600v1 Announce Type: cross Abstract: A faithful 3D world representation should account for layered geometry, where a single camera ray may contain multiple visible and geometrically valid surfaces.