The paper introduces Event-Driven Refresh + Recurrence Memory (EDRRM) to improve Referring Video Object Segmentation (RVOS). EDRRM selectively re-invokes the Sa2VA model at stable change points, using an EMA‑smoothed event score from tracking cues and a recurrence memory that retrieves anchor frames via CLIP similarity. Experiments on Ref‑DAVIS17, MeViS, and ReVOS show that EDRRM maintains or surpasses J&F scores while reducing refresh calls and false‑positive failures, with modest overhead compared to Sa2VA inference.
By Abu Hanif Muhammad Syarubany, Jaehyun Jang, Siwoo Lim, Seungyeon Ryu, Chang D. Yoo
arXiv:2607. 24560v1 Announce Type: cross Abstract: We introduce EgoPlay, an event-triggered video-to-video editor for egocentric streams, obtained by fine-tuning a pretrained V2V diffusion transformer on event-conditioned data built primarily from Ego4D.
By Jinjie Mai, Gordon Guocheng Qian, Willi Menapace, Arpit Sahni, Chaoyang Wang, Ashkan Mirzaei, Runjia Li, Sergey Tulyakov, Bernard Ghanem, Peter Wonka, Rameen Abdal
We introduce EgoPlay, an event-triggered video-to-video editor for egocentric streams, obtained by fine-tuning a pretrained V2V diffusion transformer on event-conditioned data built primarily from Ego4D. Given a monocular video and an event-triggered prompt of the form "when X happens, do Y," EgoPlay infers whether and when event X occurs, preserves pre-event frames, and applies edit Y only to the post-event continuation.
arXiv:2605.08158v2 Announce Type: replace-cross
Abstract: Long video understanding with multimodal language models suffers from three compounding bottlenecks: heavy decode cost to obtain dense RGB fr...
By Haopeng Jin, Wenlong Zhao, Tao Yu, Tiankun Yang, Zhenyu Guan, ShiQuan Dong, Yujia Yang, Shani Ye, Chubin Chen, Hongzhu Yi, Jinwen Luo
arXiv:2608.28429v1 Announce Type: new
Abstract: Event cameras generate asynchronous, sparse data streams with microsecond temporal resolution, but in moderate-to-high motion scenes they can produce a...
By Zahra Rezaee, Catarina Brites, Jo\~ao Ascenso
arXiv:2609.39563v1 Announce Type: new
Abstract: Existing video language models encode sampled RGB frames independently, so a long video must either exhaust the token budget or drop the changes betwee...
By Can Zhang, Xiaotian Han, Junyuan Shang, Yuchen Ding, Zhenyu Zhang, Shuohuan Wang, Dianhai Yu, Ruirui Li
Dual-State Slot Attention (DSSA) is a self‑supervised framework that separates per‑frame appearance from temporally stable identity within each slot, addressing conflicts that cause slot swapping in video object‑centric learning. It introduces a learned recurrent transition for identity updates and competition‑modulated aggregation to suppress weakly matching slots, thereby improving segmentation quality and temporal consistency. Experiments on MOVi‑C, MOVi‑D, and YouTube‑VIS show DSSA outperforms prior methods and enhances downstream object recognition and video dynamics prediction.
By Sieu Tran, Duc Nguyen, Hao Vo, Khoa Vo, Ngan Le
The paper introduces Event-guided Neural Video Codec (ENVC), a neural video compression method that incorporates event streams—capturing brightness changes between frames—into both motion and frame coding stages. By using event-guided motion priors and event-conditioned predictors, ENVC improves RGB compression efficiency, achieving significant BD-rate savings across six benchmarks. The authors also synthesize paired RGB-event data for training and demonstrate that the gains persist on large-motion sequences, highlighting events as a valuable complementary modality for video coding.
By Jiyun Kong, Jungwoo Kim, Enes Eray Demirtas, Touradj Ebrahimi, Jong-Seok Lee
arXiv:2512.01495v4 Announce Type: replace
Abstract: Video instance segmentation (VIS) for low-light content remains highly challenging for both humans and machines alike, due to noise, blur and other...
By Joanne Lin, Ruirui Lin, Yini Li, David Bull, Nantheera Anantrasirichai
arXiv:2501.04001v4 Announce Type: replace
Abstract: This work presents Sa2VA, the first comprehensive, unified model for dense grounded understanding of both images and videos. Unlike existing multi-...
By Haobo Yuan, Xiangtai Li, Tao Zhang, Yueyi Sun, Zilong Huang, Shilin Xu, Shunping Ji, Yunhai Tong, Lu Qi, Jiashi Feng, Ming-Hsuan Yang
TSA: Temporal Slot Activation for Persistent Object-Centric Video Representation proposes a lightweight mechanism that learns per-slot, per-frame activation scores to control slot lifecycle in unsupervised video object-centric learning. By gating slot updates and decoder participation when objects are absent or occluded, TSA reduces state drift and reconstruction interference, improving object decomposition and temporal identity preservation. The method is evaluated on MOVi-C, MOVi-E, YTVIS-HQ, and OVIS benchmarks, showing significant gains, especially on long, heavily occluded videos.
By Duc Nguyen, Sieu Tran, Hao Vo, Khoa Vo, Duy Minh Ho Nguyen, Nghi D. Q. Bui, Anh Nguyen, Long Mai, Ngan Le
arXiv:2610.26933v1 Announce Type: new
Abstract: An event camera emits events at a rate given by the scene motion, object texture, illumination, its own contrast thresholds, and other settings. Across...
By Kavyansh Tyagi, Andreas Ziegler