arXiv Computer Vision
Sep 7

E-RGB-D: Real-Time Event-Based Perception with Structured Light

The paper introduces E‑RGB‑D, a real‑time event‑based perception system that combines a Digital Light Processing projector with a monochrome event camera to produce RGB‑D data. By projecting structured light and capturing asynchronous brightness changes, the system can detect color and depth for each pixel, achieving a color detection speed of 1400 fps and a depth detection rate of 4 kHz. The approach enables frameless RGB‑D sensing and delivers colorful point clouds without compromising spatial resolution.

By Seyed Ehsan Marjani Bajestani, Giovanni Beltrame
arXiv Computer Vision
Oct 5

One Photon, Many Worlds: Posteriors and Predictions with Single-Photon Cameras

Single-photon avalanche diode (SPAD) cameras produce binary images where each pixel records zero or one photon arrival, making scene reconstruction a fundamentally one-to-many inverse problem. As more binary frames are accumulated, the uncertainty diminishes, transitioning from stochastic to near-deterministic scene understanding. The study introduces a conditional generative framework using a Hypergeometric frame‑thinning process to model this ambiguity and evaluates its impact on tasks such as character recognition, QR code decoding, and facial analysis.

By Haejoon Lee (Carnegie Mellon University), Mohit Gupta (University of Wisconsin-Madison), Vijayakumar Bhagavatula (Carnegie Mellon University), Aswin C. Sankaranarayanan (Carnegie Mellon University)