arXiv Computer Vision
Oct 12

Leveraging Motion Estimation for Efficient Bayer-Domain Video Convolutional Networks

The paper introduces Motion Estimation-based Video Convolution (MEVC), a framework that removes the need for image signal processors by operating directly on raw Bayer pixel data. MEVC incorporates sliding‑window motion estimation into each convolutional layer, allowing prediction and residual refinement to cut redundant computations across frames. The resulting end‑to‑end pipeline achieves more than 70% reduction in FLOPs while maintaining accuracy on video semantic segmentation, depth estimation, and object detection tasks.

By Haichao Wang, Jiangtao Wen, Yuxing Han