ProactEgoMem: Benchmarking Proactive Memory in Streaming Egocentric Video
Read the original on Hugging Face Trending Papers →The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
ProactEgoMem is a benchmark for evaluating proactive memory in streaming egocentric video, focusing on three tasks—Information Capture, State Tracking, and Location Tracking—to reflect real-world environmental needs. It introduces two levels of proactiveness: Notification Level, which requires a single timely alert, and Intervention Level, which demands continuous memory maintenance via an active tool lifecycle. The benchmark includes daily and scientific datasets with corresponding QA sets, and shows that current models struggle to capture memory both timely and accurately.
EgoMemReason is a new benchmark for week‑long egocentric video understanding that focuses on memory‑driven reasoning rather than simple perception tasks. It tests three memory types—entity, event, and behavior—across 500 questions, each requiring evidence from an average of 5.1 video segments and 25.9 hours of backtracking. Evaluation of 17 models shows that even the best achieves only 39.6% accuracy, highlighting the difficulty of long‑horizon memory in multimodal systems.
arXiv:2608. 02392v2 Announce Type: replace-cross Abstract: A wearable assistant should both answer questions about its visual history and recognize when that history is useful to the present situation.
arXiv:2609.37559v1 Announce Type: new Abstract: To serve as real-world personal assistants, streaming video models need persistent memory that retains past experiences for later use. Yet existing str...
arXiv:2607. 11523v1 Announce Type: cross Abstract: When should an intelligent assistant speak up without being asked?
When should an intelligent assistant speak up without being asked? Continuous egocentric video offers rich, evolving context that enables a new form of assistance: one that is proactive rather than merely reactive.