arXiv Computer Vision By Xin Chen, Jiao Xu, Dong Wang, Huchuan Lu, Kede Ma

Learning to Track from Privileged Target Appearances

Read the original on arXiv Computer Vision →

The paper introduces Privileged Appearance Transfer for Tracking (PATT), a teacher‑student framework that leverages exact target crops from past, current, and future frames during training to improve visual tracking. By weighting the teacher’s guidance with its localization advantage and accuracy, PATT transfers privileged appearance information to a deployable tracker that only uses past‑frame templates at inference. Experiments on seven benchmarks show consistent performance gains across both long‑ and short‑term tracking protocols.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

arXiv Computer Vision
Sep 3

TempoGround: State-Aware Streaming Visual Grounding with Vision-Language Models

TempoGround is a vision‑language model–native framework for streaming visual grounding that detects cross‑frame object correspondence and explicitly models object presence states. It uses a curriculum prediction mechanism to resolve 2D instance association, predict object entry, continuation, or exit, decode 2D boxes, and lift them to 3D camera‑frame boxes. The approach is further refined with Streaming Grounding Reinforcement, which optimizes grounding, identity, and consistency rewards, and achieves significant improvements on multiple streaming visual grounding benchmarks.

By Leqian Ding, Junning Qiu, Manwen Yang, Yu Guo, Fei Wang
arXiv Computer Vision
2d ago

MAETrack: Unleashing the Potential of Pretrained Geometric Priors for 3D Single Object Tracking

MAETrack introduces a lightweight framework to adapt pretrained masked autoencoder (MAE) representations for 3D single object tracking (SOT). It uses Layer‑Selective Initialization (LSI) to keep shallow geometric layers from the pre‑training while re‑initializing deeper layers, and Geometric Residual Gating (GRG) to emphasize salient regions in BEV features before template‑search fusion. Experiments on standard 3D SOT benchmarks show consistent improvements over vanilla fine‑tuning with minimal computational cost.

By Sifan Zhou, Qiwei Wang, Linyue Tan, Ziyu Liu, Ziyu Zhao, Xiaobo Lu
arXiv Computer Vision
Sep 4

Temporal Self-Distillation: Learning Visual State Tracking in Videos Without Supervision

The paper introduces S$^3$T, a fully self‑contained framework for continuous video state tracking that uses temporal self‑distillation. It treats denser temporal sampling as privileged information, letting a dense‑view teacher guide a sparse‑view student to match its next‑token distribution without external labels or reward signals. Experiments on LLaVA-OneVision-2-8B show significant accuracy gains on VSTAT and MVBench benchmarks, and the learned capability transfers from synthetic to real videos.

By Shravan Venkatraman, Wenshuai Zhao, Mohammad Hassan Vali, Arno Solin