arXiv Computer Vision

E-RGB-D: Real-Time Event-Based Perception with Structured Light

The paper introduces E‑RGB‑D, a real‑time event‑based perception system that combines a Digital Light Processing projector with a monochrome event camera to produce RGB‑D data. By projecting structured light and capturing asynchronous brightness changes, the system can detect color and depth for each pixel, achieving a color detection speed of 1400 fps and a depth detection rate of 4 kHz. The approach enables frameless RGB‑D sensing and delivers colorful point clouds without compromising spatial resolution.

arXiv Computer Vision
6d ago

4D Reconstruction with Events & RGB

The paper presents a lightweight extension to the Monst3R 4D reconstruction model by adding an event-camera input branch while keeping the rest of the architecture unchanged. Across three benchmark datasets, this RGB‑event fusion reduces absolute relative error by an average of 3.4% compared to the RGB‑only baseline, with the largest gains occurring under high object motion where RGB‑only methods falter. The study demonstrates that incorporating event data can meaningfully improve 4D reconstruction robustness without a full architectural redesign.

By Dulanga Weerakoon, Darshana Rathnayake, Van Minh Do, Hemanth Sabbella, Kaichen Zhou, Fangneng Zhan, Alok Prakash, Sanjay E. Sarma, Archan Misra, Paul Pu Liang
Hugging Face Trending Papers
Jul 20

FF-ProCams: Feed-Forward Gaussian Splatting for Projector-Camera System

Projector-camera (ProCams) systems achieve active scene perception and controllable appearance manipulation via structured illumination, serving as a core infrastructure for spatial augmented reality, projection mapping, and surface reflectance acquisition. Existing inverse-rendering methods for ProCams deliver high-fidelity results but rely on time-consuming per-scene optimization, while mainstream feed-forward 3D reconstruction models produce baked appearance that cannot adapt to spatially varying projector illumination.

arXiv AI
3d ago

EventSeeColor: Learning to Reconstruct Color from Monochrome Events

EventSeeColor is a method that reconstructs color images from monochrome event camera data. It combines event‑reconstructed grayscale images with aligned events to guide a diffusion colorizer, using semantic context and region‑balanced chroma supervision to improve color fidelity. Evaluations on two real event datasets show that EventSeeColor outperforms existing methods in structural similarity, perceptual scores, and chromatic‑region color difference.

By Chuanzhi Xu, Langyi Chen, Haoxian Zhou, Zelin Zhang, Haodong Chen, Qiang Qu, Xiaoming Chen, Weidong Cai
arXiv AI
Jun 2

A Survey of 3D Reconstruction with Event Cameras

arXiv:2505. 08438v4 Announce Type: replace-cross Abstract: Event cameras are rapidly emerging as powerful vision sensors for 3D reconstruction, uniquely capable of asynchronously capturing per-pixel brightness changes.

By Chuanzhi Xu, Haoxian Zhou, Langyi Chen, Haodong Chen, Zeke Zexi Hu, Zhicheng Lu, Ying Zhou, Vera Chung, Qiang Qu, Weidong Cai
arXiv Computer Vision
Sep 4

Off the Planckian Locus: Using 2D Chromaticity to Improve In-Camera Color

The paper proposes replacing traditional one-dimensional correlated color temperature (CCT) interpolation with a two-dimensional chromaticity approach for in-camera colorimetric mapping. By training a lightweight multi-layer perceptron (MLP) on a lightbox calibration that includes representative LED sources, the method achieves a 22% average reduction in angular reproduction error across diverse LED lighting. It remains compatible with conventional illuminants, handles multi-illuminant scenes, and can be deployed in real time with minimal computational overhead.

By SaiKiran Tedla, Joshua E. Little, Hakki Can Karaimer, Michael S. Brown
arXiv Computer Vision
Sep 25

SEE Challenge 2026: Event-Guided Brightness Adjustment Across a Broad Illumination Range

The SEE Challenge 2026 invites participants to restore RGB images using synchronized event camera data and a target brightness statistic across a wide illumination range. Using the SEE-600K dataset of 610,126 image‑event pairs from 202 real‑world scenes, teams compete under an open‑system protocol, with PSNR as the primary ranking metric and SSIM as a secondary measure. Fifteen valid submissions were evaluated, revealing closely spaced top scores and consistent local errors under severe underexposure, while the report also examines exposure subsets, semantic test cases, shared failure patterns, and system design choices.

By Yunfan Lu, Mingchao Xu, Hanyu Zhou, Shaoyu Liu, Haoyue Liu, Peiqi Duan, Shihan Peng, Yinqiang Zheng, Boxin Shi, Gim Hee Lee, Hui Xiong, Davide Scaramuzza
Hugging Face Trending Papers
Jun 28

EvLIR: Learning Illumination Residuals from Ordered Events for Low-Light Image Enhancement

Low-light image enhancement is severely ill-posed when the input frame contains missing structure, saturated noise, and weak local contrast. Event cameras provide asynchronous brightness-change observations with high temporal resolution, but prior works often treat voxel channels as an unordered or static feature stack before fusion, rather than explicitly modeling their within-window temporal evolution, weakening the temporal evidence that makes events useful.