arXiv Computer Vision
Online Multi-Camera 3D Tracking via ID Prediction over Recurrent Sparse Queries
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv Computer Vision
Oct 2
ARROW: Arbitrary Reconstruction and Tracking of 4D Observations in the Wild
arXiv:2610.01314v1 Announce Type: new Abstract: Dynamic scenes may be captured by a moving camera, multiple video streams, or images taken at different times. These observations reveal complementary...
arXiv AI
Sep 25
TrackEverything: Long Horizon Dense Tracking via De-Duplicating 3D Scene Representations
TrackEverything is a 3D point tracker that overcomes the trade‑off between sparse long‑horizon tracking and dense short‑clip tracking by representing videos as persistent 3D scene tracks in world coordinates. It introduces voxel‑based de‑duplication at sliding‑window boundaries, a two‑stage refinement process (endpoint refiner and lightweight trajectory refiner), and a 3D WAFT module that replaces memory‑heavy 4D correlation volumes with efficient feature sampling. The method can track all visible points in videos longer than 1000 frames using only 40 GB of GPU memory, outperforming existing dense trackers on short clips and matching sparse trackers on long sequences.
arXiv AI
Sep 2
Beyond the Image Plane: World-Grounded Queries for Multi-Object Tracking
The paper introduces PLANET, a multi‑object tracker that transcends traditional image‑plane limitations by incorporating 3D scene geometry into its query formation. By lifting 2D tracking datasets into 3D and embedding reconstructed geometry into features and positional encodings, PLANET encourages queries to encode object positions. An auxiliary 3D location prediction task and a dual‑resolution temporal memory further enhance performance, enabling state‑of‑the‑art results on three diverse benchmarks.
Hugging Face Trending Papers
Sep 1
Beyond the Image Plane: World-Grounded Queries for Multi-Object Tracking
Monocular videos record 3D scenes as sequences of 2D image-plane projections, obscuring depth and spatial relationships. Multi-object trackers localize and associate objects primarily using appearance...
arXiv Computer Vision
Sep 3
TAPVid-MV: A Benchmark for Tracking Any Point in 3D Across Multiple Views
TAPVid-MV is a new benchmark for tracking any point in 3D across multiple synchronized camera views. It comprises 284 sequences, 1,142 calibrated camera streams, and 109,769 point tracks, covering indoor and outdoor domains and derived from various modalities such as depth, LiDAR, SLAM, and simulation. The dataset is visually verified, and evaluation shows that current multi‑view trackers do not consistently outperform monocular trackers, highlighting geometry recovery as a key bottleneck.
arXiv Computer Vision
5d ago
OmniGlimpse: Asymmetric Identity Memory for Online Multi-View Tracking
OmniGlimpse introduces an asymmetric propose‑verify framework for online multi‑view tracking, separating short‑term adaptive association from long‑term stable identity consolidation. It maps short‑term local and cross‑view evidence into target‑specific adaptive spaces for proposing associations, while maintaining long‑term identity distributions in a canonical space defined by a frozen encoder for verification. The method achieves significant gains over the best online baseline on M3Track and MvMHAT, outperforming offline‑trained references in IDF1 without any offline scene‑specific training.