eSharp is a monocular depth estimation framework that uses an event camera and pretrained diffusion priors to produce accurate, sharp metric depth from sparse LiDAR ground truth. It tackles challenges of fast motion and high-dynamic-range scenes by cross‑modal distillation, generating dense pseudo‑labels from a co‑registered frame camera. Experiments demonstrate that eSharp surpasses existing event‑to‑depth baselines in both depth accuracy and spatial fidelity, positioning diffusion models as a strong foundation for event‑driven 3D perception.
arXiv:2609.36929v1 Announce Type: new Abstract: Recent event-based depth estimation methods successfully transfer geometric priors from vision foundation models via cross-modal distillation. However,...
The paper introduces HypoDepth, an event-image monocular depth estimation framework that uses a discrete Depth Hypothesis Volume (DHV) to convert depth regression into a constrained search problem. By building a lightweight 3D cost volume between DHV features and contextual features, the method performs multi-scale correlation search for stable residual optimization, enabling efficient global-to-local refinement across resolutions. Experiments on DSEC and MVSEC show state‑of‑the‑art performance, strong zero‑shot generalization, and real‑time capability on resource‑limited devices.
The paper introduces a depth completion method that focuses on extrapolating depth beyond LiDAR coverage, a scenario often overlooked in current research. It uses a frozen monocular depth foundation model, aligns it with sparse LiDAR points, and refines the result with a module that fuses the prior and sparse anchors to produce dense metric depth. A novel high‑frequency normal‑consistency loss and a new evaluation protocol that separates LiDAR‑supported and beyond‑coverage regions are also presented, demonstrating strong accuracy in unobserved areas while maintaining performance where LiDAR data exists.
FlowMoDE introduces a coarse‑to‑fine flow‑matching framework for monocular depth estimation that balances efficiency and detail reconstruction. The method first decodes coarse depth conditioned on diffused features from a pre‑trained semantic encoder, then refines fine structural patterns with expanded decoding layers. Trained only on a synthetic indoor dataset, FlowMoDE achieves a 14.1% lower relative error and a 9.9% lower Chamfer distance compared to state‑of‑the‑art methods across five real‑world indoor and outdoor datasets, and demonstrates strong generalization to realistic robotic scenes.
PatchScene is a diffusion-based framework that completes large-scale LiDAR scenes using a patch-based voxel diffusion paradigm, generating fine-grained geometry in localized 3D regions. It incorporates a confidence-guided spatio-temporal fusion mechanism to merge overlapping patches and adjacent frames, and introduces an Annular-Flow diffusion strategy that propagates high-fidelity information from near to far ranges. Experiments on SemanticKITTI show state-of-the-art performance, with the model trained on 20 m LiDAR ranges generalizing to 50 m scenes without retraining.
arXiv:2505. 08438v4 Announce Type: replace-cross Abstract: Event cameras are rapidly emerging as powerful vision sensors for 3D reconstruction, uniquely capable of asynchronously capturing per-pixel brightness changes.
DXPR is a depth‑based cross‑modal place recognition framework that matches monocular camera queries to a LiDAR map using a single vision foundation model backbone. By converting both modalities into a unified depth image representation, DXPR learns modality‑invariant global descriptors without modality‑specific encoders. A geometry‑aware overlap miner refines pairwise metric learning by computing pixel‑level overlap scores, and extensive tests on KITTI and Boreas show strong performance across seasons, weather, and day/night conditions, outperforming prior CMPR baselines.
arXiv:2606. 20189v3 Announce Type: replace-cross Abstract: Leveraging Vision Foundation Models (VFMs) for camera-to-LiDAR knowledge distillation offers a promising solution to the scarcity of annotated data needed to represent the immense geometric and kinematic diversity of real-world autonomous driving (AD).
arXiv:2606. 20189v1 Announce Type: cross Abstract: Leveraging Vision Foundation Models (VFMs) for camera-to-LiDAR knowledge distillation offers a promising solution to the scarcity of annotated data needed to represent the immense geometric and kinematic diversity of real-world autonomous driving (AD).
The paper introduces CELL, a confidence-weighted event-camera localization method that learns per-correspondence confidence end-to-end using a differentiable probabilistic PnP. It reweights flow supervision, drives probabilistic correspondence selection at test time, and refines edge matching, while also proposing a partial-completion depth representation. Experiments on M3ED and DSEC show significant reductions in median translation and rotation errors compared to the LEAR baseline.
arXiv:2610.19786v1 Announce Type: new Abstract: Generating LiDAR point clouds from multi-view camera images is a valuable task with applications in controllable data synthesis, cross-modal simulation...
M3GD introduces a multimodal representation that fuses pre‑trained 2D image and 3D LiDAR foundation models for robotic novel view synthesis, avoiding the need for a separate cross‑modal translator. By projecting LiDAR onto the image latent grid and injecting the resulting geometry‑aware packets via a lightweight residual adapter, the method enhances both RGB and depth synthesis on the GrandTour dataset compared to an image‑only baseline. Ablation studies confirm that pixel‑aligned LiDAR content drives the performance gains, and real‑world deployment on a ground robot demonstrates a tunable quality–cost trade‑off.