arXiv:2603. 19054v2 Announce Type: replace-cross Abstract: Recent advances in Streaming Video Understanding has enabled a new interaction paradigm where models respond proactively to user queries.
Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.
CoFiE introduces a two‑stage evidence selection framework for streaming video understanding, separating a coarse, query‑agnostic filtering of visually distinctive frames from a fine, query‑specific refinement during LLM prefill. By filtering out redundant frames before expensive vision encoding, CoFiE reduces end‑to‑end latency while maintaining high accuracy. The method achieves state‑of‑the‑art performance on benchmarks such as StreamingBench and OvO‑Bench, improving accuracy by up to 3.15% and inference speed by up to 2.54× compared to prior approaches.
SPARE is a framework for streaming video understanding that adaptively retrieves historical evidence when recent observations are insufficient to answer a question. It uses a lightweight gate to decide when to fetch relevant past clips via a multimodal embedding model, and trains the system with LoRA instruction tuning to jointly use recent and retrieved context while abstaining when evidence is lacking. By sharing a visual encoder between understanding and retrieval branches and aligning features with linear adapters, SPARE achieves state‑of‑the‑art accuracy on OVO‑Bench and StreamingBench, outperforming Qwen3‑VL‑8B‑Instruct by over 20 percentage points on OVO‑Bench and 14 on StreamingBench.
OneStreamer is a streaming video model that jointly learns to record evidence and respond to tasks through a shared proactive generation process. Its Proactive Hierarchical Caption Memory creates time‑grounded local‑detail captions and event summaries, while Proactive State Transition Learning reduces waiting states by supervising all output anchors. The authors also built a large OneStreamer‑1M dataset and show that a 4B model outperforms baselines on eight streaming video benchmarks, with ablations confirming the benefits of generated captions and PSTL.
arXiv:2610.34662v1 Announce Type: new Abstract: Vision-language models are shifting from offline passive understanding toward online proactive interaction. However, prevailing methods largely rely on...
arXiv:2610.23975v2 Announce Type: replace-cross Abstract: Long video understanding requires VideoLLMs to answer queries about videos spanning tens of minutes to hours, but such long videos produce fa...
arXiv:2506. 01274v2 Announce Type: replace-cross Abstract: Recent progress in Large Multi-modal Models (LMMs) has enabled effective vision-language reasoning, yet the ability to video understanding remains constrained by suboptimal frame selection strategies, albeit with the rapid development of video-specialized LMMs.