arXiv Computer Vision
Sep 22

Beyond the Survey: A Systematic Empirical Study of Detection and Association in Visual MOT

This paper conducts a systematic empirical study of multi‑object tracking (MOT) algorithms, focusing on how detection and association components affect overall performance. By evaluating state‑of‑the‑art methods on benchmarks such as MOT16/17/20, SportsMOT, DanceTrack, and CrowdTrack, the authors find that detection quality has a far greater impact than association strategies, and that transformer‑based end‑to‑end models are more robust to detection variations but computationally expensive. The study provides a unified pipeline diagram and practical guidance for researchers and practitioners in selecting and designing MOT systems.

By Linh Van Ma, Juhua Hu, Wei Cheng, Unse Fatima, Moongu Jeon
arXiv Machine Learning
Oct 15

SAM3RL: Memory Control via Reinforcement Learning for Visual Object Tracking

SAM3RL introduces a reinforcement‑learning based memory controller for the Segment Anything Model 3 (SAM 3) visual object tracker, deciding which past frames to store in a memory bank to improve tracking performance. This data‑driven approach replaces hand‑crafted memory update rules and achieves state‑of‑the‑art results on 10 of 12 tracking and video object segmentation benchmarks, with no runtime overhead. The same method applied to SAM 2 (SAM2RL) also outperforms hand‑crafted rules on 9 of 12 benchmarks, demonstrating its generality across model generations.

By Tom\'a\v{s} \v{C}\'i\v{z}ek, Matej Straka, Illia Volkov, Mat\v{e}j Kripner, Ervin Maci\'c, Jiri Matas, Klara Janouskova, Martin Schmid