arXiv Computer Vision
Oct 28

4D Reconstruction with Events & RGB

The paper presents a lightweight extension to the Monst3R 4D reconstruction model by adding an event-camera input branch while keeping the rest of the architecture unchanged. Across three benchmark datasets, this RGB‑event fusion reduces absolute relative error by an average of 3.4% compared to the RGB‑only baseline, with the largest gains occurring under high object motion where RGB‑only methods falter. The study demonstrates that incorporating event data can meaningfully improve 4D reconstruction robustness without a full architectural redesign.

By Dulanga Weerakoon, Darshana Rathnayake, Van Minh Do, Hemanth Sabbella, Kaichen Zhou, Fangneng Zhan, Alok Prakash, Sanjay E. Sarma, Archan Misra, Paul Pu Liang
arXiv Computer Vision
Sep 28

DAPEVO: Deep Adaptive Patch Frame-Event Visual Odometry

DAPEVO is a learned visual odometry system that independently estimates image and event correspondences at shared patch locations and fuses their correlation evidence before motion refinement. It maintains image and event descriptors for each tracked patch, using a learned scalar gate to combine modality-specific correlation embeddings for each patch–frame edge, followed by a shared recurrent refinement and bundle‑adjustment update. The method supports event‑only observations and modality‑aware keyframe culling, achieving low trajectory error even when RGB frames are sparse or degraded, outperforming DPVO, RAMP‑VO, and event‑only DEVO on UZH‑FPV and TartanEvent datasets.

By Luca Gandolfi, Simone Nascivera, Roberto Pellerito, Rong Zou, Chiara Plizzari, Davide Scaramuzza