arXiv Computer Vision

Organizing Temporal Evidence in Hyperbolic Space for Video Moment Retrieval

arXiv Computer Vision
Oct 23

Retrieval-Augmented Online Textual Memory for Episodic Memory Video Question Answering

The paper introduces a retrieval-augmented online textual memory for episodic memory video question answering, focusing on long egocentric videos. It evaluates how different retrieval units, query formulations, context budgets, and reranking strategies affect multiple-choice answering on QAEgo4D-Closed, keeping the generated memory fixed. The best configuration, Parent, matches strong baselines while exposing only a small fraction of the textual memory, and the study shows that better temporal coverage does not always improve accuracy, highlighting the need for evidence-aware representations.

By Raffaele Cali, Giuseppe Lando, Rosario Forte, Antonino Furnari
arXiv AI
Aug 20

Event-Causal RAG: A Retrieval-Augmented Generation Framework for Long Video Reasoning in Complex Scenarios

Event-Causal RAG (EC‑RAG) is a lightweight retrieval‑augmented framework designed for reasoning over ultra‑long and streaming videos. It segments video streams into semantically complete events using a dual visual‑audio sentinel mechanism, representing each event as a State‑Event‑State (SES) structure that captures pre‑event, event, and post‑event states. During question answering, bidirectional graph retrieval accesses relevant predecessor and successor events from a dual vector‑graph memory, and answers are generated using both this structured memory and the corresponding video evidence. The authors also introduce ECV‑1H, an hour‑scale long‑video QA benchmark with over 150 hours of untrimmed video and 1,251 human‑annotated QA pairs, where EC‑RAG achieves significant accuracy gains across multiple video foundation models while maintaining efficient streaming memory usage on a single RTX 5090 GPU.

By Peizheng Yan, Yu Zhao, Liang Xie, Juntong Qi, Mingming Wang, Erwei Yin
arXiv AI
Jul 29

Reasoning with Memory: A Temporal Granularity-Adaptive Framework for Training-Free Long Video Understanding

arXiv:2607. 24794v1 Announce Type: new Abstract: While Multimodal Large Language Models (MLLMs) demonstrate superior generalization in fundamental video tasks, restricted context windows limit their long video understanding.

By Linghao Meng, Qiankun Li, Junyuan Mao, Pujin Liao, Zhicheng He, Enbo Zhang, Kun Wang, Yang Liu, Huazhu Fu, Yueming Jin
Hugging Face Trending Papers
Aug 6

Beyond Frame Selection: Rethinking Long-Video Understanding with MLLMs

Multimodal Large Language Models (MLLMs) have achieved strong progress in video understanding, yet it remains challenging because the token limitation makes MLLMs difficult to capture temporally sparse evidence. Existing methods typically rely on uniform sampling, or frame selection, but these strategies usually optimize either broad temporal coverage or local relevance, making it difficult to preserve both global storyline context and fine-grained evidence.

arXiv Computer Vision
Oct 26

Separating Angular Alignment from Radial Ordering in Hyperbolic Vision-Language Models

The paper introduces AURORA, a hyperbolic vision‑language framework that separates angular alignment from radial ordering. Angular alignment captures semantic similarity while a novel Radial‑Angular Order Cone (RAOC) models hierarchical entailment based on parent‑child radial gaps. The approach includes norm regularization to prevent radial degeneration and is evaluated on large image‑text datasets, outperforming both Euclidean and hyperbolic baselines in zero‑shot classification, retrieval, hierarchical reasoning, and compositional understanding.

By Mingyang Gao, Yuwei Wu, Shiyu Luo, Wei Wu, Xiaomeng Fan, Qihao Lv, Haoyu Zhang, Rui Gao, Bingzhen Liu, Zhi Gao, Che Sun