Hugging Face Trending Papers
Jul 9

Whareformer: Learning to Track What is Where in Long Egocentric Videos

The recently established 'Out of Sight, Not out of Mind' (OSNOM) task for egocentric videos focuses on tracking objects that are moved by the camera wearer, online, maintaining knowledge of instance locations throughout the video even when they leave the field of view or become heavily occluded. In this paper, we propose the first learning-based solution to the OSNOM task: Whareformer, a transformer-based model with two components: an updatable memory of established tracks and a track assignment module that associates observations with existing tracks in a feed-forward manner.

arXiv Machine Learning
Jul 3

Object-centric LeJEPA

arXiv:2607. 02404v1 Announce Type: cross Abstract: Image encoders trained with LeJEPA can deliver strong features for downstream tasks, but, like other image-level self-supervised methods, typically require large training datasets.

By Jakob Geusen, Ender Konukoglu
arXiv Computer Vision
Sep 4

Temporal Self-Distillation: Learning Visual State Tracking in Videos Without Supervision

The paper introduces S$^3$T, a fully self‑contained framework for continuous video state tracking that uses temporal self‑distillation. It treats denser temporal sampling as privileged information, letting a dense‑view teacher guide a sparse‑view student to match its next‑token distribution without external labels or reward signals. Experiments on LLaVA-OneVision-2-8B show significant accuracy gains on VSTAT and MVBench benchmarks, and the learned capability transfers from synthetic to real videos.

By Shravan Venkatraman, Wenshuai Zhao, Mohammad Hassan Vali, Arno Solin