arXiv:2602.05718v2 Announce Type: replace
Abstract: Point-supervised Temporal Action Localization (PTAL) adopts a lightly frame-annotated paradigm (\textit{i.e.}, labeling only a single frame per act...
By Yunchuan Ma, Laiyun Qing, Guorong Li, Yuqing Liu, Yuankai Qi, Qingming Huang
arXiv:2610.34618v1 Announce Type: new
Abstract: Recently, point-supervised temporal action localization has attracted increasing attention due to its low annotation cost (only one frame per action in...
By Yunchuan Ma, Laiyun Qing, Sai Xu, Guorong Li, Qingming Huang
The paper explores training a large language model solely on textual video descriptions to perform zero‑shot video temporal localization, eliminating the need for paired video‑text data during training. Using a 134K‑example corpus and adapting Qwen3‑8B with LoRA on CLIP or LLM2CLIP embeddings, the authors evaluate on Charades‑STA and QV‑Highlights, achieving modest performance when directly replacing text with frame embeddings. They introduce Nearest Entity Replacement (NER), a training‑free mapping that represents each video frame by the mean of its nearest text‑entity embeddings, which significantly improves results and narrows the modality gap.
By Divyanshu Mishra, Sabine Sternig, Rakshith Shetty, Erhan Gundogdu
arXiv:2609.00505v1 Announce Type: new
Abstract: Video-text models adapted from image-text architectures (e.g., CLIP) frequently exhibit temporal blindness, the inability to perceive fundamental cues...
By Sethuraman T V, Savya Khosla, Onkar Kishor Susladkar, Aditi Tiwari, Seoung Wug Oh, Kushal Kafle, Joon-Young Lee, Derek Hoiem, Simon Jenni
arXiv:2611.06302v1 Announce Type: new
Abstract: Fine-grained action understanding requires vision-language models to ground what an agent does, how it acts, and why it acts in spatio-temporal evidenc...
By Zhiliang Zhu, Jiazheng Huang, Dawei Zhao
arXiv:2607. 00858v1 Announce Type: cross Abstract: Contrastive pre-training has propelled video-text alignment, yet models often inherit the critical limitations of their image-text predecessors like CLIP, resulting in entangled representations.
By Peiyuan Zhu, Shaoan Xie, Zijian Li, Yifan Shen, Namrata Deka, Harsh Shrivastava, Guangyi Chen, Kun Zhang
arXiv:2608. 20127v1 Announce Type: new Abstract: Video Temporal Grounding (VTG) faces significant challenges when natural language queries must distinguish between multiple events involving visually similar entities, particularly when relying on fine-grained visual attributes that are difficult to describe accurately in words alone.
By Minghang Zheng, Jingli Wei, Hongyi Yang, Yang Liu
Video-text models adapted from image-text architectures (e.g., CLIP) frequently exhibit temporal blindness, the inability to perceive fundamental cues like order, direction, and motion dynamics. Stand...
arXiv:2511.17681v2 Announce Type: replace
Abstract: Referring Multi-Object Tracking (RMOT) extends conventional multi-object tracking (MOT) by introducing natural language references for multi-modal...
By Weiyi Lv, Ning Zhang, Hanyang Sun, Haoran Jiang, Kai Zhao, Yixiao Gu, Jing Xiao, Dan Zeng
arXiv:2610.35516v1 Announce Type: new
Abstract: Point-supervised temporal action localization (PTAL) aims to recognize and localize action instances in untrimmed videos using only point-level annotat...
By Zhenying Fang
arXiv:2604. 22823v2 Announce Type: replace-cross Abstract: Multimodal Large Language Models (MLLMs) rely on multimodal pre-training over diverse data sources, where different datasets often induce complementary cross-modal alignment capabilities.
By Zibo Shao, Baochen Xiong, Xiaoshan Yang, Yaguang Song, Qimeng Zhang, Haifeng Chen, Changsheng Xu
VTrajEmbed is an embedding model that aligns text with video object trajectories by decomposing videos into individual trajectories and embedding each trajectory separately. It introduces a Slow‑Fast Trajectory Encoding dual‑branch architecture that captures high‑frequency motion and scene context, and a Mask‑Guided Contrastive Learning objective that prevents false negatives during training. The model is evaluated on a new trajectory‑level benchmark, Text2Traj‑Bench, and outperforms existing large‑language‑model embeddings by significant margins on both text‑to‑trajectory and trajectory‑to‑text retrieval tasks.
By Ruizhi Chen, Zining Fan, Yudi Guo, Jiang Liu, Zhiyu Lin, Zhongjiang He, Shouqian Shi, Hao Sun