arXiv Computer Vision

Event-based Selective Attention for Multi-resolution Fast Region of Interest (ROI) Detection

arXiv Computer Vision
Aug 27

Low-Latency Event-Based Object Detection with Spatially-Sparse Linear Attention

The paper introduces Spatially‑Sparse Linear Attention (SSLA), a novel attention mechanism that activates only a sparse subset of spatial states, enabling efficient parallel training and inference for event‑based vision. Building on SSLA, the authors present SSLA‑Det, an end‑to‑end asynchronous linear attention model that achieves state‑of‑the‑art accuracy on Gen1 and N‑Caltech101 while reducing per‑event computation by more than 20× compared to the strongest prior asynchronous baseline.

By Haiqing Hao, Zhipeng Sui, Rong Zou, Zijia Dai, Nikola Zubi\'c, Davide Scaramuzza, Wenhui Wang
arXiv AI
3d ago

Pedestrian Crossing Intent Classification From Event-Based Vision Using Convolutional Spiking Neural Networks With Temporal Augmentation

The paper presents an end‑to‑end system that converts driving footage into dynamic vision sensor (DVS) event streams, augments training with simulated DVS data, and trains a convolutional spiking neural network (Conv‑SNN) to classify pedestrian crossing intent as crossing or non‑crossing. The Conv‑SNN, trained with a class‑balanced loss and surrogate‑gradient learning, achieves high accuracy and F1 scores on JAAD and CARLA DVS datasets, outperforming or matching prior frame‑based methods while operating on sparse temporal representations. The study details architectural choices, neuron dynamics, and training protocols, and provides a convergence analysis and domain‑transfer evaluation.

By Henok Teklu, Mustafa Sakhai, Maciej Wielgosz, Matej Mertik
arXiv Computer Vision
Sep 7

Efficient Multi-Timescale Event Representations for Feed-Forward Object Detection

The paper introduces a confidence‑normalized continuous multi‑timescale representation for event cameras, using logarithmic B‑spline temporal encoding and a geometry‑aware local confidence mechanism. When paired with a fixed feed‑forward EventCenterNet detector, this representation outperforms the compact CSTR representation on the PEDRo and Gen1 datasets. Additionally, a recursive exponential‑polynomial approximation is proposed to allow efficient event‑by‑event updates while maintaining detection performance.

By Fredrik Lundell, Per-Erik Forssen, M{\aa}rten Wadenb\"ack, Astrid Lundmark
arXiv Computer Vision
Aug 27

MIMONet: Multi-scale Input and Multi-scale Output Network for Salient Object Detection

MIMONet is a saliency detection model that uses multi‑scale inputs and outputs to better handle objects of varying sizes. It processes three differently sized images through separate encoder branches that exchange information, allowing each branch to learn size‑variation knowledge from the others. A Multi‑scale Perception module further refines features, and a Joint Saliency Loss ensures consistent, well‑preserved boundaries across the multiple saliency maps produced.

By Zhaojian Yao, Wei Gao, Tiesong Zhao, Hui Yuan, Sam Kwong
arXiv Computation and Language
Aug 31

Semantic Head Specialization Guides Hybrid ViT Attention for Multimodal LLMs

The paper introduces Semantic Head Specialization (SHS), a phenomenon where Vision Transformer (ViT) attention heads specialize as either object- or background-focused, most evident under full attention. It proposes the SHS-Index to quantify this specialization, demonstrating its ability to distinguish full-attention from chunk-window ViTs and its strong correlation with downstream benchmark performance. Leveraging insights into window interaction, token serialization, and local softmax allocation, the authors design Ariadne Attention, a hybrid attention mechanism that matches full-attention performance on 22 image and video tasks while reducing attention compute by 6.5×.

By Chenhong He, Lei Li, Shicheng Li, Hanglong Lv, Lingpeng Kong, Qi Liu, Tong Yang, Shuhuai Ren
arXiv AI
Jul 2

A Two-stage Transformer Framework for Temporal Localization of Distracted Driver Behaviors

arXiv:2603. 21048v2 Announce Type: replace-cross Abstract: The identification of hazardous driving behaviors from in-cabin video streams is essential for enhancing road safety and supporting the detection of traffic violations and unsafe driver actions.

By Gia-Bao Doan, Nam-Khoa Huynh, Minh-Nhat-Huy Ho, Khanh-Thanh-Khoa Nguyen, Thi-Thu-Hien Pham, Thanh-Hai Le