arXiv AI October 16, 2026 By Yogesh Kumar

Where, How, and When: Query-Guided Grounding for Video Understanding

The paper introduces query‑guided grounding methods for video understanding, covering object‑level, relationship‑level, and moment‑level tasks. For object grounding, QDETRv and TOViT enable one‑shot and few‑shot localization of unseen objects using query‑context fusion, memory modules, and language‑aligned vision encoders. Relationship grounding is addressed with a few‑shot referring framework that optimizes a T‑partite random field, while moment grounding is tackled by the Moment Alignment Transformer (MATR), which employs dynamic time warping and self‑supervised pretraining for video‑to‑video and text‑to‑video retrieval.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI

Jul 16

ScanFocus: A Coarse-to-Fine Framework for Spatio-Temporal Video Grounding

arXiv:2607. 13421v1 Announce Type: cross Abstract: Spatio-Temporal Video Grounding (STVG) aims to retrieve the visual trajectory of a specific object from a video stream as described by a natural language expression.

By Kai Chen, Ming Dai, Wenxuan Cheng, Wankou Yang

multimodal benchmarks

arXiv Computer Vision

5d ago

VTrajEmbed: Aligning Text with Video Object Trajectories via Spatiotemporal Embeddings

VTrajEmbed is an embedding model that aligns text with video object trajectories by decomposing videos into individual trajectories and embedding each trajectory separately. It introduces a Slow‑Fast Trajectory Encoding dual‑branch architecture that captures high‑frequency motion and scene context, and a Mask‑Guided Contrastive Learning objective that prevents false negatives during training. The model is evaluated on a new trajectory‑level benchmark, Text2Traj‑Bench, and outperforms existing large‑language‑model embeddings by significant margins on both text‑to‑trajectory and trajectory‑to‑text retrieval tasks.

By Ruizhi Chen, Zining Fan, Yudi Guo, Jiang Liu, Zhiyu Lin, Zhongjiang He, Shouqian Shi, Hao Sun

llms rag multimodal benchmarks safety

arXiv Computer Vision

Oct 7

TF-PRVR: Training-Free Partially Relevant Video Retrieval

arXiv:2610.07925v1 Announce Type: new Abstract: Partially Relevant Video Retrieval (PRVR) aims to retrieve untrimmed videos containing moments relevant to a given text query. Despite recent progress,...

By Giyeol Kim, Chanho Eom

llms multimodal safety

arXiv Machine Learning

Aug 14

TraVEL: Trajectory-Guided Video Embedding Learning for Driving-Video Retrieval

arXiv:2608. 13495v1 Announce Type: cross Abstract: Efficiently retrieving relevant clips from large-scale driving logs is essential for data curation, model development, and safety analysis.

By Yi-Chung Chen, Philip Jacobson, Tom Lampo, Yiren Lu, Jin Yao, David I. Inouye, Jing Gao, Danhua Guo, Burhan Yaman

rag fine-tuning multimodal benchmarks safety

arXiv Machine Learning

Sep 1

SynMulti: Synthetic-to-Real Learning for Multimodal Video Understanding

arXiv:2604.12335v2 Announce Type: replace-cross Abstract: Training multimodal large language models (MLLMs) for video understanding requires large-scale annotated data spanning diverse tasks such as...

By Tanzila Rahman, Renjie Liao, Leonid Sigal

llms computer-vision nlp fine-tuning multimodal

arXiv AI

Jul 20

Modularized Dynamic-Granularity Video LLM for Multi-Event Long Video Understanding

arXiv:2607. 15778v1 Announce Type: cross Abstract: Video Large Language Models (Video LLMs) have made significant advancements in various video understanding tasks.

By Wei Feng, Xin Wang, Yu-Wei Zhan, Yuwei Zhou, Wenwu Zhu

llms reinforcement-learning benchmarks