arXiv Computer Vision

Event-Frame Fusion for Inter-Frame Segmentation via Event-Guided Motion

arXiv AI
Jun 2

A Survey of 3D Reconstruction with Event Cameras

arXiv:2505. 08438v4 Announce Type: replace-cross Abstract: Event cameras are rapidly emerging as powerful vision sensors for 3D reconstruction, uniquely capable of asynchronously capturing per-pixel brightness changes.

By Chuanzhi Xu, Haoxian Zhou, Langyi Chen, Haodong Chen, Zeke Zexi Hu, Zhicheng Lu, Ying Zhou, Vera Chung, Qiang Qu, Weidong Cai
arXiv Computer Vision
Oct 12

Leveraging Motion Estimation for Efficient Bayer-Domain Video Convolutional Networks

The paper introduces Motion Estimation-based Video Convolution (MEVC), a framework that removes the need for image signal processors by operating directly on raw Bayer pixel data. MEVC incorporates sliding‑window motion estimation into each convolutional layer, allowing prediction and residual refinement to cut redundant computations across frames. The resulting end‑to‑end pipeline achieves more than 70% reduction in FLOPs while maintaining accuracy on video semantic segmentation, depth estimation, and object detection tasks.

By Haichao Wang, Jiangtao Wen, Yuxing Han
arXiv Computer Vision
Sep 15

A 25-$\mu$s/inf Event-driven Graph Neural Network Processor with Spatiotemporal Caching and Spline Convolution for Ultra-low-latency AI at the Edge

The paper introduces ETHEREAL, the first accelerator for event-driven graph neural networks (EV‑GNNs) that can handle 640×480 resolution inputs. It achieves this through a neighbor‑parallel spline convolution engine and a 2D/3D‑split memory hierarchy that includes a novel region‑of‑interest spatiotemporal caching mechanism. Measurements show end‑to‑end inference latency of 25.6 µs and energy consumption of 1.7 µJ per event on state‑of‑the‑art workloads.

By Adrian Kneip, Martin Lefebvre, Daniel Gehrig, Victoria Catal\'an Pastor, Davide Scaramuzza, Marian Verhelst, Charlotte Frenkel
arXiv Computer Vision
Oct 5

Event-guided Neural Video Compression

The paper introduces Event-guided Neural Video Codec (ENVC), a neural video compression method that incorporates event streams—capturing brightness changes between frames—into both motion and frame coding stages. By using event-guided motion priors and event-conditioned predictors, ENVC improves RGB compression efficiency, achieving significant BD-rate savings across six benchmarks. The authors also synthesize paired RGB-event data for training and demonstrate that the gains persist on large-motion sequences, highlighting events as a valuable complementary modality for video coding.

By Jiyun Kong, Jungwoo Kim, Enes Eray Demirtas, Touradj Ebrahimi, Jong-Seok Lee
Hugging Face Trending Papers
Aug 5

Cooking beyond Frames: A Stereo Event Camera Dataset in the Kitchen

Event cameras, also known as neuromorphic cameras, have gained significant attention in recent years due to their high temporal resolution, high dynamic range, and low power consumption. While many studies and datasets in neuromorphic vision have focused on automotive and drone applications, human-centric daily-life scenarios remain largely underrepresented, despite their importance for developing and benchmarking event-based perception systems.