SPARE is a framework for streaming video understanding that adaptively retrieves historical evidence when recent observations are insufficient to answer a question. It uses a lightweight gate to decide when to fetch relevant past clips via a multimodal embedding model, and trains the system with LoRA instruction tuning to jointly use recent and retrieved context while abstaining when evidence is lacking. By sharing a visual encoder between understanding and retrieval branches and aligning features with linear adapters, SPARE achieves state‑of‑the‑art accuracy on OVO‑Bench and StreamingBench, outperforming Qwen3‑VL‑8B‑Instruct by over 20 percentage points on OVO‑Bench and 14 on StreamingBench.
arXiv:2609.00291v1 Announce Type: new Abstract: Streaming video understanding requires answering questions that arrive at arbitrary moments over an unbounded video stream. Existing systems primarily...
arXiv:2609.37345v1 Announce Type: new Abstract: Streaming video understanding requires Video Large Language Models (Video-LLMs) to reason over continuous visual streams under causal constraints. As t...
arXiv:2606. 16353v1 Announce Type: cross Abstract: Streaming video understanding models must answer queries at any moment during an ongoing stream, using only what they have observed so far and under fixed memory and computation budgets.
The paper introduces MaLoW, a streaming memory framework that internalizes long‑term video history into evolving lightweight parameter updates using a recurrent HyperNetwork and LoRA weights. MaLoW keeps current observations as input while carrying historical context forward without re‑visiting the full video stream. The authors also present MaLoW‑Instruct, a large streaming video dataset, and show that MaLoW outperforms prior memory methods on several benchmarks and improves action success in a vision‑language‑action setting.
CoFiE introduces a two‑stage evidence selection framework for streaming video understanding, separating a coarse, query‑agnostic filtering of visually distinctive frames from a fine, query‑specific refinement during LLM prefill. By filtering out redundant frames before expensive vision encoding, CoFiE reduces end‑to‑end latency while maintaining high accuracy. The method achieves state‑of‑the‑art performance on benchmarks such as StreamingBench and OvO‑Bench, improving accuracy by up to 3.15% and inference speed by up to 2.54× compared to prior approaches.
arXiv:2607. 25266v2 Announce Type: replace-cross Abstract: Multimodal large language models (MLLMs) have enabled long-form video understanding at a scale that was not previously possible.
arXiv:2610.01192v1 Announce Type: new Abstract: Streaming vision-language models must process continuously growing video streams under a bounded compute budget, creating a persistent tension between...
arXiv:2610.26910v1 Announce Type: new Abstract: Long-video understanding often requires answering many questions about a single video whose evidence is distributed across extended temporal contexts....
We introduce Predictive State Retrieval (PSR), a task in which a model observes a short video prefix and a temporal question about an object's future state, then retrieves instances from other videos or images that depict that state. Unlike action anticipation, which predicts a label, moment retrieval, which localizes an observed event within a video, or video generation, which synthesizes pixels, PSR combines anticipation with cross-instance retrieval across multiple temporal horizons.
arXiv:2610.08674v1 Announce Type: new Abstract: Current large video-language models (LVLMs) still face challenges when dealing with long videos, mainly because frames are often processed independentl...
arXiv:2604.17422v2 Announce Type: replace Abstract: Long video understanding remains a formidable challenge for Multimodal Large Language Models (MLLMs) due to the prohibitive cost of processing dens...
arXiv:2608.30294v1 Announce Type: new Abstract: Streaming video understanding requires answering questions at arbitrary times over a continuously growing visual stream. The central challenge is to co...