The Flow has not summarised this story yet — read it at arXiv Computation and Language.
Video understanding has rapidly evolved toward video large language models (VideoLLMs): systems that couple video representations with pretrained large language models and condition generation on a te...
The paper surveys training‑free methods to accelerate inference in Video Large Language Models (VLMs), aiming to reduce computational, latency, and memory costs while retaining task‑relevant spatiotemporal evidence. It categorizes techniques by their intervention points in the inference pipeline—input, visual encoding, projector, prefill, and decoding—and discusses post‑training quantization as a cross‑stage approach. The authors analyze how the position of each intervention influences evidence preservation and computational savings, noting that local efficiency gains may not lead to overall acceleration, and they provide quantitative comparisons from prior work and new experiments to evaluate accuracy‑latency trade‑offs.
arXiv:2609.37042v1 Announce Type: cross Abstract: Video Large Language Models (VideoLLMs) have achieved strong video understanding capabilities but incur substantial inference overhead due to the lar...
arXiv:2606. 07577v1 Announce Type: new Abstract: Audio-visual large language models (LLMs) hold strong promise for long-form video understanding, yet their long-video inference is fundamentally limited by the linear growth of video tokens and key-value (KV) caches.
arXiv:2609.23601v1 Announce Type: new Abstract: Long-video understanding must capture transient visual evidence under strict token budgets, yet existing methods compress frames, append memory tokens,...
arXiv:2609.16722v1 Announce Type: new Abstract: Scaling Multimodal Large Language Models (MLLMs) to long-form video understanding is bottlenecked by the explosion of visual tokens, which saturates co...