Dual-State Slot Attention (DSSA) is a self‑supervised framework that separates per‑frame appearance from temporally stable identity within each slot, addressing conflicts that cause slot swapping in video object‑centric learning. It introduces a learned recurrent transition for identity updates and competition‑modulated aggregation to suppress weakly matching slots, thereby improving segmentation quality and temporal consistency. Experiments on MOVi‑C, MOVi‑D, and YouTube‑VIS show DSSA outperforms prior methods and enhances downstream object recognition and video dynamics prediction.
By Sieu Tran, Duc Nguyen, Hao Vo, Khoa Vo, Ngan Le
Semantic Slots for Video Object-Centric Learning proposes a Transformer-based decoder that frees slots from spatial anchoring, enabling them to act as semantic queries invariant to object position. This design removes the need for complex temporal predictors, allowing a single-frame slot to decompose subsequent video frames. On YouTube-VIS, the method outperforms prior approaches, improving mBO by 31 points over VideoSAUR and achieving state-of-the-art results with 86.6% ARI and 62.8% mBO.
By Khalil Sabri, Guillaume-Alexandre Bilodeau, Nicolas Saunier, Wassim Bouachir
TSA: Temporal Slot Activation for Persistent Object-Centric Video Representation proposes a lightweight mechanism that learns per-slot, per-frame activation scores to control slot lifecycle in unsupervised video object-centric learning. By gating slot updates and decoder participation when objects are absent or occluded, TSA reduces state drift and reconstruction interference, improving object decomposition and temporal identity preservation. The method is evaluated on MOVi-C, MOVi-E, YTVIS-HQ, and OVIS benchmarks, showing significant gains, especially on long, heavily occluded videos.
By Duc Nguyen, Sieu Tran, Hao Vo, Khoa Vo, Duy Minh Ho Nguyen, Nghi D. Q. Bui, Anh Nguyen, Long Mai, Ngan Le
arXiv:2506.01004v3 Announce Type: replace-cross
Abstract: Unlike traditional video editing or inpainting, video semantic mixing fuses a reference concept with a moving target entity to produce a hybr...
By Tong Zhang, Victor Escorcia, Juan C Leon Alcazar, Bernard Ghanem
arXiv:2607. 00858v1 Announce Type: cross Abstract: Contrastive pre-training has propelled video-text alignment, yet models often inherit the critical limitations of their image-text predecessors like CLIP, resulting in entangled representations.
By Peiyuan Zhu, Shaoan Xie, Zijian Li, Yifan Shen, Namrata Deka, Harsh Shrivastava, Guangyi Chen, Kun Zhang
TrajTok introduces an end‑to‑end video tokenizer that replaces traditional patchification with a lightweight, trajectory‑based tokenization process. It performs implicit clustering over space‑time pixels to generate object trajectories in a single forward pass, dynamically adjusting token granularity to semantic complexity while remaining independent of video duration. The resulting TrajViT2 model outperforms existing methods on classification and retrieval benchmarks, and TrajTok can also serve as a probing head (TrajAdapter) or alignment connector (TrajVLM) for vision‑language tasks, notably improving long‑video reasoning.
By Chenhao Zheng, Jieyu Zhang, Jianing Zhang, Weikai Huang, Ashutosh Kumar, Quan Kong, Oncel Tuzel, Chun-Liang Li, Ranjay Krishna
arXiv:2610.07689v1 Announce Type: new
Abstract: Vision-Language Models (VLMs) such as CLIP excel in global semantic alignment but often lack fine-grained perceptual capabilities. This hinders dense p...
By Juntong Li, Lingwei Dang, Haomin Wu, Ziyan Qiu, Qingxin Xiao, Qingyao Wu
arXiv:2605.12491v2 Announce Type: replace
Abstract: Vision Transformers (ViTs) learn rich visual-semantic representations through all-to-all self-attention among patch tokens. However, this design im...
By Alan Z. Song, Yinjie Chen, Mu Nan, Deva Ramanan, Michael J. Tarr, Andrew F. Luo
In video understanding, vision-language models (VLMs) must ingest massive numbers of visual tokens, causing the computational and memory cost of the prefill stage to rise sharply. Such visual sequences are highly redundant along the spatio-temporal dimension, yet a high compression ratio is often accompanied by the loss of critical details.
arXiv:2607. 13421v1 Announce Type: cross Abstract: Spatio-Temporal Video Grounding (STVG) aims to retrieve the visual trajectory of a specific object from a video stream as described by a natural language expression.
By Kai Chen, Ming Dai, Wenxuan Cheng, Wankou Yang
VTrajEmbed is an embedding model that aligns text with video object trajectories by decomposing videos into individual trajectories and embedding each trajectory separately. It introduces a Slow‑Fast Trajectory Encoding dual‑branch architecture that captures high‑frequency motion and scene context, and a Mask‑Guided Contrastive Learning objective that prevents false negatives during training. The model is evaluated on a new trajectory‑level benchmark, Text2Traj‑Bench, and outperforms existing large‑language‑model embeddings by significant margins on both text‑to‑trajectory and trajectory‑to‑text retrieval tasks.
By Ruizhi Chen, Zining Fan, Yudi Guo, Jiang Liu, Zhiyu Lin, Zhongjiang He, Shouqian Shi, Hao Sun
Video DeltaNet (VDN) introduces a hybrid attention mechanism for livestream video generation, combining local Softmax attention with a bidirectional linear memory branch called Video Delta Attention (VDA). VDA updates memory once per frame, integrating spatial tokens, while separate output projections and learnable gates balance the two branches. Applied to MiniMax H3, VDN achieves a 14.5× speedup over the dense baseline, completing 14.3‑second, 768p video denoising in 6.70 seconds on eight NVIDIA B200 GPUs.
By Haocheng Xi, Yiming Xie, Hexu Zhao, Yiwen Zhang, Michael Liu, Thomas Creavin, Kurt Keutzer, Xiuyu Li, Zhaoyang Lv, Chenfeng Xu, Haiwen Feng