arXiv Computer Vision By Youngdong Jang, Gyeongrok Oh, Jong Wook Kim, Hyunju Ryu, Hyung-gun Chi, SeungHyeon Kim, Seungryong Kim, Jonghyun Choi, Sangpil Kim

Motion Cues from Image-based Point Tracking for LiDAR Scene Flow Estimation

Read the original on arXiv Computer Vision →

TrackCue is a self‑supervised framework that enhances LiDAR scene flow estimation by using dense image‑based point tracking to generate reliable static‑dynamic supervision. It anchors tracking queries to projected LiDAR points, applies a visually consistent motion compensation strategy to isolate true object motion, and lifts image‑space motion cues back to LiDAR points for refined pseudo‑labels. This approach reduces noise from sparse or occluded LiDAR geometry and improves the precision of dynamic pseudo‑labels, leading to better scene flow learning.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

Hugging Face Trending Papers
Aug 19

RVLoss: Runoff Vote Loss for Self-Supervised LiDAR Scene Flow Estimation

RVLoss introduces a runoff vote mechanism for self‑supervised LiDAR scene flow estimation, addressing motion rigidity by grouping nearest‑neighbor derived motions into dominant flow candidates and selecting the most consistent one through a two‑stage voting process. This approach generates cluster‑wise rigid flows and free‑form flows as pseudo‑labels, enabling seamless integration into existing feedforward architectures. Experiments on the Argoverse2 2026 Challenge demonstrate that models trained with RVLoss outperform baseline self‑supervised methods by 20% and maintain consistent gains across four additional datasets.

arXiv Computer Vision
Sep 3

TAPVid-MV: A Benchmark for Tracking Any Point in 3D Across Multiple Views

TAPVid-MV is a new benchmark for tracking any point in 3D across multiple synchronized camera views. It comprises 284 sequences, 1,142 calibrated camera streams, and 109,769 point tracks, covering indoor and outdoor domains and derived from various modalities such as depth, LiDAR, SLAM, and simulation. The dataset is visually verified, and evaluation shows that current multi‑view trackers do not consistently outperform monocular trackers, highlighting geometry recovery as a key bottleneck.

By Skanda Koppula, Frano Rajic, Abdullah Faiz Ur Rahman, Yi Yang, Ignacio Rocco, Jeet Thakwani, Rishabh Kabra, Andrew Zisserman, Joao Carreira, Siyu Tang, Carl Doersch, Gabriel Brostow
arXiv AI
Sep 25

TrackEverything: Long Horizon Dense Tracking via De-Duplicating 3D Scene Representations

TrackEverything is a 3D point tracker that overcomes the trade‑off between sparse long‑horizon tracking and dense short‑clip tracking by representing videos as persistent 3D scene tracks in world coordinates. It introduces voxel‑based de‑duplication at sliding‑window boundaries, a two‑stage refinement process (endpoint refiner and lightweight trajectory refiner), and a 3D WAFT module that replaces memory‑heavy 4D correlation volumes with efficient feature sampling. The method can track all visible points in videos longer than 1000 frames using only 40 GB of GPU memory, outperforming existing dense trackers on short clips and matching sparse trackers on long sequences.

By Ayush Jain, Sreeharsha Paruchuri, Ishita Gupta, Fan Zhang, Tanner Schmidt, Jakob Engel, Katerina Fragkiadaki, Adam W. Harley
Hugging Face Trending Papers
Jun 24

MVTrack4Gen: Multi-View Point Tracking as Geometric Supervision for 4D Video Generation

Synthesizing a novel-view video from a monocular reference video along a target camera trajectory requires both geometric consistency and motion fidelity with respect to the reference video. Existing methods based on explicit 3D representations are limited by the accuracy of off-the-shelf reconstruction modules, which often produce inaccurate geometry for dynamic objects in monocular videos.