arXiv Computer Vision

Real Time Motion Detection in Video Inspired by Photonic Time Stretch

arXiv Computer Vision
Oct 12

Leveraging Motion Estimation for Efficient Bayer-Domain Video Convolutional Networks

The paper introduces Motion Estimation-based Video Convolution (MEVC), a framework that removes the need for image signal processors by operating directly on raw Bayer pixel data. MEVC incorporates sliding‑window motion estimation into each convolutional layer, allowing prediction and residual refinement to cut redundant computations across frames. The resulting end‑to‑end pipeline achieves more than 70% reduction in FLOPs while maintaining accuracy on video semantic segmentation, depth estimation, and object detection tasks.

By Haichao Wang, Jiangtao Wen, Yuxing Han
arXiv Computer Vision
Sep 3

Minimal Solvers for Full-DoF Motion Estimation from Asynchronous Differential SfM

The paper introduces a new framework for estimating full-degree-of-freedom egomotion directly from asynchronous optical flow captured by event cameras. By decoupling the differential epipolar constraint into angular and linear components and applying a first-order approximation, the authors derive a polynomial formulation that yields the first algebraic minimal 5‑point solver for this problem. An accelerated solver that truncates high‑order angular velocity terms is also proposed, enabling real‑time performance in high‑speed scenarios, and extensive tests show superior accuracy and robustness compared to traditional synchronous methods.

By Shuo Pan, Banglei Guan, Bin Li, Zhenbao Yu, Zibin Liu, Zi Wang, Yang Shang, Qifeng Yu
Hugging Face Trending Papers
Jul 14

FlowWAM: Optical Flow as a Unified Action Representation for World Action Models

World Action Models (WAMs) are able to leverage pretrained video generators for both world modeling and action prediction. However, directly leveraging such video generators for control raises a new challenge: how to represent actions in a suitable form that aligns with pretrained video generators while carrying enough motion cues for accurate control.