arXiv Computer Vision

TQD-Track: Temporal Query Denoising for 3D Multi-Object Tracking

TQD-Track introduces Temporal Query Denoising (TQD) for 3D Multi‑Object Tracking, extending query denoising beyond single frames by initializing denoising queries from previous‑frame ground truths and propagating them as independent association candidates. The method enriches track queries with temporal context and instance‑specific features, and incorporates diverse noise types to emulate real‑world tracking challenges. Experiments on nuScenes and Argoverse 2 show consistent improvements across multiple MOT baselines with only training‑process modifications.

arXiv Computer Vision
Sep 22

Beyond the Survey: A Systematic Empirical Study of Detection and Association in Visual MOT

This paper conducts a systematic empirical study of multi‑object tracking (MOT) algorithms, focusing on how detection and association components affect overall performance. By evaluating state‑of‑the‑art methods on benchmarks such as MOT16/17/20, SportsMOT, DanceTrack, and CrowdTrack, the authors find that detection quality has a far greater impact than association strategies, and that transformer‑based end‑to‑end models are more robust to detection variations but computationally expensive. The study provides a unified pipeline diagram and practical guidance for researchers and practitioners in selecting and designing MOT systems.

By Linh Van Ma, Juhua Hu, Wei Cheng, Unse Fatima, Moongu Jeon
arXiv AI
Sep 2

Beyond the Image Plane: World-Grounded Queries for Multi-Object Tracking

The paper introduces PLANET, a multi‑object tracker that transcends traditional image‑plane limitations by incorporating 3D scene geometry into its query formation. By lifting 2D tracking datasets into 3D and embedding reconstructed geometry into features and positional encodings, PLANET encourages queries to encode object positions. An auxiliary 3D location prediction task and a dual‑resolution temporal memory further enhance performance, enabling state‑of‑the‑art results on three diverse benchmarks.

By Orcun Cetintas, Guillem Bras\'o, Tim Meinhardt, Laura Leal-Taix\'e
arXiv Computer Vision
5d ago

MvT: Event-based Multi-view Projection for Multiple Object Tracking

The paper introduces MvT, a training‑free multi‑view pipeline for event‑camera based multiple object tracking. MvT preserves the 2‑D event format while generating three complementary spatio‑temporal views, then fuses them into a 3‑D coordinate system to resolve tracking ambiguities that arise in single‑view pseudo‑frames. Experiments on four datasets, including a new Small Objects Dataset, show that MvT outperforms both non‑learning and learning trackers and can be applied when ground‑truth annotations are unavailable.

By Muxi Zha, Banglei Guan, Minzu Liang, Zibin Liu, Yang Shang, Qifeng Yu, Laurent Kneip
Hugging Face Trending Papers
Aug 18

Probing Association Instability with Track-State Perturbations for Clip-Level Active Learning in Query-Propagation Multi-Object Tracking

Training query-propagation end-to-end multi-object tracking (MOT) models requires dense bounding-box and identity annotations across video sequences, making dataset construction expensive. Clip-level active learning reduces this cost by selecting video clips for annotation, but prior acquisition criteria based on output-level temporal uncertainty may miss clips whose informativeness comes from association instability in propagated track states.

arXiv AI
Sep 25

TrackEverything: Long Horizon Dense Tracking via De-Duplicating 3D Scene Representations

TrackEverything is a 3D point tracker that overcomes the trade‑off between sparse long‑horizon tracking and dense short‑clip tracking by representing videos as persistent 3D scene tracks in world coordinates. It introduces voxel‑based de‑duplication at sliding‑window boundaries, a two‑stage refinement process (endpoint refiner and lightweight trajectory refiner), and a 3D WAFT module that replaces memory‑heavy 4D correlation volumes with efficient feature sampling. The method can track all visible points in videos longer than 1000 frames using only 40 GB of GPU memory, outperforming existing dense trackers on short clips and matching sparse trackers on long sequences.

By Ayush Jain, Sreeharsha Paruchuri, Ishita Gupta, Fan Zhang, Tanner Schmidt, Jakob Engel, Katerina Fragkiadaki, Adam W. Harley