arXiv Computer Vision

UGO: Unified Architecture for General Multi-Object Tracking by Segmentation

arXiv Computer Vision
Sep 22

Beyond the Survey: A Systematic Empirical Study of Detection and Association in Visual MOT

This paper conducts a systematic empirical study of multi‑object tracking (MOT) algorithms, focusing on how detection and association components affect overall performance. By evaluating state‑of‑the‑art methods on benchmarks such as MOT16/17/20, SportsMOT, DanceTrack, and CrowdTrack, the authors find that detection quality has a far greater impact than association strategies, and that transformer‑based end‑to‑end models are more robust to detection variations but computationally expensive. The study provides a unified pipeline diagram and practical guidance for researchers and practitioners in selecting and designing MOT systems.

By Linh Van Ma, Juhua Hu, Wei Cheng, Unse Fatima, Moongu Jeon
arXiv Machine Learning
Oct 15

SAM3RL: Memory Control via Reinforcement Learning for Visual Object Tracking

SAM3RL introduces a reinforcement‑learning based memory controller for the Segment Anything Model 3 (SAM 3) visual object tracker, deciding which past frames to store in a memory bank to improve tracking performance. This data‑driven approach replaces hand‑crafted memory update rules and achieves state‑of‑the‑art results on 10 of 12 tracking and video object segmentation benchmarks, with no runtime overhead. The same method applied to SAM 2 (SAM2RL) also outperforms hand‑crafted rules on 9 of 12 benchmarks, demonstrating its generality across model generations.

By Tom\'a\v{s} \v{C}\'i\v{z}ek, Matej Straka, Illia Volkov, Mat\v{e}j Kripner, Ervin Maci\'c, Jiri Matas, Klara Janouskova, Martin Schmid
arXiv Computer Vision
Oct 22

DetM-Tracker: Deterministic and Memory-Efficient VIS for Autonomous Industrial Inspection

DetM-Tracker is a lightweight Video Instance Segmentation framework designed for autonomous industrial inspection. It reduces memory and computation by condensing instance features into four-scalar descriptors, dynamically allocating query capacity, and using entropy-gated skip connections to focus processing on uncertain regions. The method achieves roughly 20× lower inference latency and 6× less VRAM usage than dense-feature baselines.

By You-Rui Lin, Jen-Chieh Wu, Tzu-Ti Wei, Jen-Jee Chen, Yu-Chee Tseng
arXiv Machine Learning
Oct 15

The Impact of Detector Architecture, Model Scale, and Scene Density on Multi-Pedestrian Tracking

The paper investigates how detector architecture, model scale, scene density, and inference regime influence multi‑pedestrian tracking performance. It compares YOLO11, RT‑DETR, and YOLO26 detectors with ByteTrack and BoT‑SORT trackers on MOT17, MOT20, and SOMPT22 datasets, finding RT‑DETR best on HOTA but at higher cost, while YOLO26‑L with NMS balances quality and speed. End‑to‑end inference for YOLO26 did not consistently improve tracking over NMS.

By Pedro Manoel Herminio Alves, Dalton C\'ezane Gomes Valadares, Cl\'audio de Souza Baptista
arXiv Machine Learning
Sep 23

SAM-V: Geometry-Aware Segment Anything for Multi-View Instance Segmentation

SAM‑V is a geometry‑aware extension of the Segment Anything Model (SAM) that integrates 3D priors from a feed‑forward geometry model (VGGT) into 2D segmentation. It uses a prompt‑fusion mechanism to combine sparse SAM prompts with view‑specific camera tokens and local VGGT features, enabling a mask decoder that attends to both dense 2D and 3D cues. The resulting end‑to‑end system produces consistent multi‑view instance segmentation in a single forward pass, achieving significant gains on the IGGT 3D tracking benchmark without offline mask matching or explicit 3D reconstruction.

By Jiangshan Gong, Yuqun Wu, Qiqian Fu, Yao Xiao, Chuhang Zou, Shenlong Wang, Derek Hoiem