arXiv Computer Vision

Event-based Action Recognition by Pre-Training on Multi-Frame Representations

The paper presents a new multi-frame representation for event-based action recognition that outperforms single-frame approaches, especially on long and complex event sequences. It employs a masked auto-encoding framework to pre-train a Vision Transformer, using a sparsity-aware masking algorithm, token selection, and multiple mask tokens with position-aware attention to boost performance while managing computational cost. The method achieves state‑of‑the‑art results on the THU‑EACT‑50 CHL and DailyDVS‑200 benchmarks.

arXiv Computer Vision
Oct 9

SV-TAD: Native Sparse Convs for Efficient Temporal Action Detection

SV-TAD introduces native sparse 2D convolutions to enable convolutional adapters to operate directly on dynamically pruned token sets, addressing the inefficiency of dense reconstruction in token‑selection methods. By integrating this primitive into a temporal action detection framework, the approach cuts VideoMAEv2‑L computation by up to 64% and achieves 2.2× faster inference while preserving state‑of‑the‑art accuracy on THUMOS‑14 and ActivityNet‑1.3. When applied to InternVideoNext‑L, it surpasses prior state‑of‑the‑art performance at roughly half the computational cost and naturally supports auxiliary task tokens for improved fine‑grained assembly detection on ATTACH.

By Ricardo Pizarro, Roberto Valle, Jos\'e M. Buenaposada, Luis M. Bergasa, Luis Baumela
Hugging Face Trending Papers
Oct 8

SV-TAD: Native Sparse Convs for Efficient Temporal Action Detection

SV‑TAD introduces native sparse 2D convolutions to enable convolutional adapters to operate directly on dynamically pruned token sets, addressing the inefficiency of existing adapters that do not reduce inference‑time computation. By integrating this primitive, SV‑TAD cuts VideoMAEv2‑L computation by up to 64% and achieves 2.2× faster inference while preserving state‑of‑the‑art accuracy on THUMOS‑14 and ActivityNet‑1.3. When applied to InternVideoNext‑L, the approach surpasses prior state‑of‑the‑art performance at roughly half the computational cost and also supports auxiliary task tokens, improving fine‑grained assembly detection on ATTACH.

Hugging Face Trending Papers
Jul 13

Temporal Feature Distillation for Label-Efficient Precise Event Spotting in Sports Videos

Precise Event Spotting (PES) requires distinguishing visually similar yet semantically distinct adjacent frames, making it fundamentally different from image classification and coarse action recognition. Although self-distillation methods such as DINO have shown strong representation learning ability in images, we find that directly applying them to PES is ineffective: without supervised guidance, subtle but crucial motion cues are often suppressed as noise, leading to representations that are insensitive to precise event boundaries.

arXiv Computer Vision
Sep 7

Efficient Multi-Timescale Event Representations for Feed-Forward Object Detection

The paper introduces a confidence‑normalized continuous multi‑timescale representation for event cameras, using logarithmic B‑spline temporal encoding and a geometry‑aware local confidence mechanism. When paired with a fixed feed‑forward EventCenterNet detector, this representation outperforms the compact CSTR representation on the PEDRo and Gen1 datasets. Additionally, a recursive exponential‑polynomial approximation is proposed to allow efficient event‑by‑event updates while maintaining detection performance.

By Fredrik Lundell, Per-Erik Forssen, M{\aa}rten Wadenb\"ack, Astrid Lundmark
arXiv Computer Vision
Sep 22

Video-STLayout Pre-training

arXiv:2609.24031v1 Announce Type: new Abstract: In recent years, pre-training has become fundamental to learning effective video representations, enabling strong transfer to downstream tasks. A popul...

By Akash Abdu Jyothi, Greg Mori
arXiv Computer Vision
Sep 18

An Event Preserving Velocity Invariant Representation for Event Cameras

The paper introduces SCARF, a real‑time velocity‑invariant representation for event cameras that preserves raw events while handling fast motion, stationary scenes, and independently moving objects. Unlike previous methods that convert events into image‑like forms and lose temporal detail, SCARF maintains temporal information and achieves state‑of‑the‑art performance in computational efficiency and representation quality.

By Mikihiro Ikura, Luna Gava, Jiahang Wu, Chiara Bartolozzi, Arren Glover
Hugging Face Trending Papers
Sep 4

Efficient Multi-Timescale Event Representations for Feed-Forward Object Detection

The paper proposes a confidence‑normalized continuous multi‑timescale event representation that encodes temporal information directly into event data using logarithmic B‑spline temporal encoding and a geometry‑aware local confidence mechanism. When applied to a fixed feed‑forward EventCenterNet detector, this representation outperforms the compact CSTR representation on the PEDRo and Gen1 datasets. Additionally, a recursive exponential‑polynomial approximation is introduced to allow efficient event‑by‑event updates while largely preserving detection performance.

arXiv Computer Vision
Sep 23

TEMPURA: Temporal Event Masked Prediction and Understanding for Reasoning in Action

arXiv:2505.01583v2 Announce Type: replace Abstract: Understanding causal event relationships and achieving fine-grained temporal grounding in videos remain challenging for vision-language models (VLM...

By Jen-Hao Cheng, Yi-Hao Peng, Huapeng Zhou, Vivian Wang, Huayu Wang, Hsiang-Wei Huang, Wenhao Chai, Hou-I Liu, Kuang-Ming Chen, Cheng-Yen Yang, Yi-Ling Chen, Vibhav Vineet, Qin Cai, Jenq-Neng Hwang