APM-Bench: Benchmarking Cross-session Persistent Memory for Egocentric Streaming Video Assistants
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
The Flow has not summarised this story yet — read it at arXiv Computer Vision.
EGOSTREAM is a diagnostic benchmark for evaluating streaming episodic memory in egocentric vision, comprising 2,250 curated questions across seven cognitive dimensions and expanding to 8,528 recall‑conditioned evaluations using the Answer Validity Window. It enables controlled testing from instant to ultra‑long‑term recall while distinguishing genuine forgetting from natural scene changes. Baseline experiments on a unified MLLM framework reveal that different memory‑management mechanisms yield similar overall accuracies but markedly different memory profiles, with all in‑cache policies operating below real‑time and achieving at most 45% accuracy under a 9,804‑token budget.
ProactEgoMem is a benchmark for evaluating proactive memory in streaming egocentric video, focusing on three tasks—Information Capture, State Tracking, and Location Tracking—to reflect real-world environmental needs. It introduces two levels of proactiveness: Notification Level, which requires a single timely alert, and Intervention Level, which demands continuous memory maintenance via an active tool lifecycle. The benchmark includes daily and scientific datasets with corresponding QA sets, and shows that current models struggle to capture memory both timely and accurately.
arXiv:2606. 16353v1 Announce Type: cross Abstract: Streaming video understanding models must answer queries at any moment during an ongoing stream, using only what they have observed so far and under fixed memory and computation budgets.
MemInStream is a new benchmark designed to evaluate memory capabilities in streaming video understanding. It introduces an evidence‑controlled validation protocol that links each question to temporally localized evidence intervals, ensuring that models must rely on historical memory rather than recent observations or linguistic priors. The benchmark covers four key categories—Episodic Retrieval, State Tracking & Updating, Multi‑Evidence Integration, and Contextual Memory—across diverse video scenarios to systematically assess memory performance.
Today's multimodal assistants are typically prompted to interpret the visual evidence presented to them. To offload the cognitive burden of remembering across long horizons, wearable assistants should...
arXiv:2606. 17798v1 Announce Type: cross Abstract: Despite the remarkable progress of Video Large Language Models (Video-LLMs), current online architectures still struggle to simultaneously process continuous video streams, decide autonomously when to respond, and preserve long-horizon contextual memory.