arXiv Computer Vision

Hybrid Event Frame Sensors: Modeling, Calibration, and Simulation

Hybrid event-frame sensors combine an Event Vision Sensor (EVS) and an Active Pixel Sensor (APS) on a single chip, offering high dynamic range, low latency, and rich spatial intensity data. The paper introduces a unified statistics-based noise model that captures photon shot noise, dark current noise, fixed-pattern noise, and quantization noise for both APS and EVS pixels, and links EVS noise to illumination and dark current. It also presents a calibration pipeline to estimate these noise parameters from real data and proposes H-ESIM, a simulator that generates realistic RAW frames and events, validated on two hybrid sensors for tasks such as video frame interpolation and deblurring.

arXiv Machine Learning
Jun 26

FracEvent: Event-Camera Simulation via Fractional-Relaxation Pixel Dynamics

arXiv:2606. 26636v1 Announce Type: cross Abstract: Event cameras asynchronously report brightness changes with microsecond-level temporal resolution, but real event data remain difficult to collect at scale because specialized sensors, careful synchronization, and task-specific annotations are required.

By Langyi Chen, Chuanzhi Xu, Haoxian Zhou, Pengfei Ye, Ziyu Luo, Haodong Chen, Qiang Qu, Xiaoming Chen, Weidong Cai
Hugging Face Trending Papers
Sep 24

Modelling dynamic systems transfer functions from events in computational neuromorphic imaging

The paper investigates how to model dynamic system transfer functions for event-based vision sensors. It analyzes three temporal probes—step, linear ramp, and exponential ramp—within a linear shift‑invariant optical system to determine which probe best matches a specified modulation transfer function. The study finds that step probes are vulnerable to threshold mismatch but robust to photon shot‑noise, while ramp probes maintain accuracy even with high mismatch, and it proposes dynamic point spread functions as part of a unified forward model for computational neuromorphic imaging.

arXiv Computer Vision
Sep 25

Modelling dynamic systems transfer functions from events in computational neuromorphic imaging

The paper investigates how to model dynamic system transfer functions for event‑based vision sensors by analyzing the correspondence between temporal probes and the resulting event streams in a linear shift‑invariant optical system. Using a first‑order filter pixel model and three temporal probes—a step, a linear ramp, and an exponential ramp—the authors derive the inverse chain for different event statistics and compare the results to the system’s modulation transfer function. The study finds that the step probe is highly sensitive to threshold mismatch but robust to photon shot‑noise, whereas linear and exponential probes maintain accurate signal inference even under significant mismatch, highlighting their potential for dynamic point spread function estimation in computational neuromorphic imaging.

By Nimrod Kruger, Gregory Cohen
Hugging Face Trending Papers
Jun 28

EvLIR: Learning Illumination Residuals from Ordered Events for Low-Light Image Enhancement

Low-light image enhancement is severely ill-posed when the input frame contains missing structure, saturated noise, and weak local contrast. Event cameras provide asynchronous brightness-change observations with high temporal resolution, but prior works often treat voxel channels as an unordered or static feature stack before fusion, rather than explicitly modeling their within-window temporal evolution, weakening the temporal evidence that makes events useful.

arXiv Computer Vision
Oct 28

4D Reconstruction with Events & RGB

The paper presents a lightweight extension to the Monst3R 4D reconstruction model by adding an event-camera input branch while keeping the rest of the architecture unchanged. Across three benchmark datasets, this RGB‑event fusion reduces absolute relative error by an average of 3.4% compared to the RGB‑only baseline, with the largest gains occurring under high object motion where RGB‑only methods falter. The study demonstrates that incorporating event data can meaningfully improve 4D reconstruction robustness without a full architectural redesign.

By Dulanga Weerakoon, Darshana Rathnayake, Van Minh Do, Hemanth Sabbella, Kaichen Zhou, Fangneng Zhan, Alok Prakash, Sanjay E. Sarma, Archan Misra, Paul Pu Liang
Hugging Face Trending Papers
4d ago

HIVE-Diff: High Frame Rate HDR Video Reconstruction from a Single LDR Frame and Events

HIVE-Diff is an event-conditioned video diffusion framework that reconstructs high‑frame‑rate HDR video from a single low‑dynamic‑range (LDR) reference frame and event data. It separates the task into event‑guided temporal generation and HDR content completion, enabling the creation of multiple HDR frames from one LDR observation. The model is trained on synthetic data and adapted to real events using teacher‑student distillation with LDR‑event sequences as proxy supervision, achieving strong reconstruction quality across synthetic and real datasets.

arXiv Computer Vision
Sep 7

E-RGB-D: Real-Time Event-Based Perception with Structured Light

The paper introduces E‑RGB‑D, a real‑time event‑based perception system that combines a Digital Light Processing projector with a monochrome event camera to produce RGB‑D data. By projecting structured light and capturing asynchronous brightness changes, the system can detect color and depth for each pixel, achieving a color detection speed of 1400 fps and a depth detection rate of 4 kHz. The approach enables frameless RGB‑D sensing and delivers colorful point clouds without compromising spatial resolution.

By Seyed Ehsan Marjani Bajestani, Giovanni Beltrame