arXiv Computer Vision

FLEET: Token-Based Feature Extraction for Event Camera-based Reinforcement Learning

FLEET is a token‑based feature extractor that processes event camera data directly, using random Fourier features and cross‑attention to compress variable‑length event streams into fixed‑size latent representations. By decoupling inference cost from sensor resolution, it avoids the high compute and temporal blurring associated with CNN‑based grid aggregation. Experiments on a new high‑throughput benchmark show that FLEET outperforms state‑of‑the‑art methods and remains robust across different observation frequencies.

Hugging Face Trending Papers
Oct 8

SV-TAD: Native Sparse Convs for Efficient Temporal Action Detection

SV‑TAD introduces native sparse 2D convolutions to enable convolutional adapters to operate directly on dynamically pruned token sets, addressing the inefficiency of existing adapters that do not reduce inference‑time computation. By integrating this primitive, SV‑TAD cuts VideoMAEv2‑L computation by up to 64% and achieves 2.2× faster inference while preserving state‑of‑the‑art accuracy on THUMOS‑14 and ActivityNet‑1.3. When applied to InternVideoNext‑L, the approach surpasses prior state‑of‑the‑art performance at roughly half the computational cost and also supports auxiliary task tokens, improving fine‑grained assembly detection on ATTACH.

arXiv Computer Vision
Oct 9

SV-TAD: Native Sparse Convs for Efficient Temporal Action Detection

SV-TAD introduces native sparse 2D convolutions to enable convolutional adapters to operate directly on dynamically pruned token sets, addressing the inefficiency of dense reconstruction in token‑selection methods. By integrating this primitive into a temporal action detection framework, the approach cuts VideoMAEv2‑L computation by up to 64% and achieves 2.2× faster inference while preserving state‑of‑the‑art accuracy on THUMOS‑14 and ActivityNet‑1.3. When applied to InternVideoNext‑L, it surpasses prior state‑of‑the‑art performance at roughly half the computational cost and naturally supports auxiliary task tokens for improved fine‑grained assembly detection on ATTACH.

By Ricardo Pizarro, Roberto Valle, Jos\'e M. Buenaposada, Luis M. Bergasa, Luis Baumela
arXiv Computer Vision
Aug 27

Low-Latency Event-Based Object Detection with Spatially-Sparse Linear Attention

The paper introduces Spatially‑Sparse Linear Attention (SSLA), a novel attention mechanism that activates only a sparse subset of spatial states, enabling efficient parallel training and inference for event‑based vision. Building on SSLA, the authors present SSLA‑Det, an end‑to‑end asynchronous linear attention model that achieves state‑of‑the‑art accuracy on Gen1 and N‑Caltech101 while reducing per‑event computation by more than 20× compared to the strongest prior asynchronous baseline.

By Haiqing Hao, Zhipeng Sui, Rong Zou, Zijia Dai, Nikola Zubi\'c, Davide Scaramuzza, Wenhui Wang
arXiv AI
Sep 18

PointEvent: Rethinking Event-based Tiny Object Detection via Serialized Motion Evidence Accumulation

PointEvent introduces serialized motion evidence accumulation for event-based tiny object detection, treating motion continuity as an ordered evidence propagation process. The method organizes event streams into locality‑preserving spatiotemporal paths and chronology‑preserving temporal paths, alternating serialized scans across complementary orders to consolidate fragmented motion evidence. A lightweight event‑wise state‑space framework with a high‑resolution event branch and compact context modulation achieves state‑of‑the‑art performance with the fewest parameters and fastest inference among compared methods.

By Zongze Wu, Baofeng Jia, Weiqi Yan, Jingyuan Zhang, Yu Zang, Xiaoyu Chen, Jing Han
arXiv Computer Vision
6d ago

Memorize When Needed: Decoupled Memory Control for Spatially Consistent Long-Horizon Video Generation

The paper introduces a decoupled memory control framework for spatially consistent long‑horizon video generation. By separating memory conditioning from generation, it uses a lightweight memory branch to learn spatial consistency from past observations and a per‑frame cross‑attention mechanism to condition each frame on the most relevant historical data. A camera‑aware gating mechanism further ensures memory is used only when meaningful references exist, resulting in lower training costs, higher spatial consistency, and state‑of‑the‑art visual quality.

By Yanjun Guo, Zhengqiang Zhang, Pengfei Wang, Xinyue Liang, Zhiyuan Ma, Lei Zhang
arXiv Computer Vision
Oct 9

Less from More: Reinforcing Sparse Video Reasoning from Dense References

The paper introduces SAVER, a dense-to-sparse post‑training framework that leverages dense video views as training‑time references to improve sparse‑frame inference. By optimizing paired dense and sparse views with grounding and reliability‑gated reference rewards, SAVER learns to preserve task‑relevant temporal evidence while using far fewer frames. Evaluated on three temporal grounding and six video question‑answering benchmarks, SAVER consistently outperforms dense‑frame baselines, matching or surpassing them with substantially reduced frame budgets.

By Wenfang Sun, Yingjun Du, Cees G. M. Snoek
arXiv Machine Learning
Sep 22

VISTA: An Attention-Based Multi-Agent Reinforcement Learning Architecture for Space Situational Awareness Sensor Tasking

arXiv:2609.23875v1 Announce Type: new Abstract: The rapid growth of resident space objects is increasing the complexity of space situational awareness sensor tasking, challenging classical optimizati...

By Miguel Leiva-V\'elez, Adalberto Claudio Quiros, Nicolas Gaston Rozado, Hodei Urrutxua, V\'ictor Rodr\'iguez-Fern\'andez