arXiv Computation and Language
Oct 19

Referring Multi-Object Tracking with Diverse Dynamic Expressions

The paper introduces Referring Multi-Object Tracking (RMOT), a task that uses natural language expressions to guide the prediction of multiple objects over time, addressing limitations in previous work that lacked dynamic language expressiveness. It presents the Refer-KITTI-V2 benchmark, which includes 9,758 semi-automatically generated language prompts for diverse object dynamics. The authors also propose TempRMOT, a Transformer-based framework with a Temporal Enhancement Module that achieves state‑of‑the‑art results on both Refer‑KITTI and Refer‑KITTI‑V2.

By Yani Zhang, Dongming Wu, Wencheng Han, Xingping Dong, Shengcai Liao, Bo Du