arXiv Computer Vision By Khalil Sabri, Guillaume-Alexandre Bilodeau, Nicolas Saunier, Wassim Bouachir

Semantic Slots for Video Object-Centric Learning

Read the original on arXiv Computer Vision →

Semantic Slots for Video Object-Centric Learning proposes a Transformer-based decoder that frees slots from spatial anchoring, enabling them to act as semantic queries invariant to object position. This design removes the need for complex temporal predictors, allowing a single-frame slot to decompose subsequent video frames. On YouTube-VIS, the method outperforms prior approaches, improving mBO by 31 points over VideoSAUR and achieving state-of-the-art results with 86.6% ARI and 62.8% mBO.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv AI
Jun 16

Selective Synergistic Learning for Video Object-Centric Learning

arXiv:2606. 15527v1 Announce Type: cross Abstract: Typical video object-centric learning (VOCL) approaches employ slot-based frameworks that rely on reconstruction-driven encoder-decoder architectures, where learning is mediated by two spatial maps: attention maps from the encoder and object maps from the decoder.

By WonJun Moon, Jae-Pil Heo
arXiv Computation and Language
Aug 31

MemoryCard: Topic-Aware Multi-Modal Clue Compression for Long-Video Question Answering

MemoryCard is a video-memory-based augmentation framework designed to improve long-video question answering for Vision‑Language Models. It segments lengthy videos into semantically coherent units—each representing a distinct topic or event—by performing a self‑reading process over the video and aligned utterances. For each unit, the framework generates an event‑level video gist and selects representative visual moments, which are compiled into unified Memory Cards that are used for retrieval and answering questions, yielding up to a 21.8% relative accuracy improvement under comparable visual‑token budgets.

By Qing Yang, Pengcheng Huang, Xinze Li, Zhenghao Liu, Yukun Yan, Yu Gu, Ge Yu, Gang Li, Maosong Sun
arXiv Computer Vision
Aug 31

Training-Free Temporal Abstraction for General Video Understanding

The paper introduces STITCH, a training‑free method that partitions videos into semantically meaningful temporal chunks using a frozen video‑text backbone. By detecting changes in the embedding sequence of short video windows, STITCH produces reusable temporal abstractions that can be applied to multiple tasks such as event boundary detection, language‑based moment retrieval, and frame selection for vision‑language models. Experiments show that STITCH performs competitively with specialized methods while requiring no task‑specific training, especially when processing is limited to a few frames or tokens.

By Etienne Casanova, Sevan Brodjian, Pietro Perona
arXiv AI
Jul 29

Reasoning with Memory: A Temporal Granularity-Adaptive Framework for Training-Free Long Video Understanding

arXiv:2607. 24794v1 Announce Type: new Abstract: While Multimodal Large Language Models (MLLMs) demonstrate superior generalization in fundamental video tasks, restricted context windows limit their long video understanding.

By Linghao Meng, Qiankun Li, Junyuan Mao, Pujin Liao, Zhicheng He, Enbo Zhang, Kun Wang, Yang Liu, Huazhu Fu, Yueming Jin