arXiv Computer Vision
Video-MOPD: Multi-Teacher On-Policy Distillation for Video Understanding
Read the original on arXiv Computer Vision →The Flow has not summarised this story yet — read it at arXiv Computer Vision.
Related stories
arXiv Computer Vision
Aug 28
Video-OPSD: Exploiting Privileged Visual Evidence for On-Policy Self-Distillation in Video Large Language Models
Video-OPSD introduces a post‑training framework for Video Large Language Models that leverages privileged visual evidence to enhance on‑policy self‑distillation. The method constructs a self‑teacher conditioned only on annotated evidence frames, while the student processes the full video, allowing the teacher to provide more focused supervision. Additionally, an evidence‑guided token optimization scheme weights distillation based on each token’s reliance on privileged evidence, improving perceptually grounded reasoning. Experiments demonstrate consistent gains over standard OPSD and comparable performance to GRPO with less training time.
arXiv AI
Aug 21
VISD: Enhancing Video Reasoning via Structured Self-Distillation
arXiv:2605. 06094v5 Announce Type: replace-cross Abstract: Training VideoLLMs for complex reasoning remains challenging due to sparse sequence level rewards and the lack of fine grained credit assignment over long, temporally grounded reasoning trajectories.
arXiv AI
Aug 18
Deep Thought Alignment: Trajectory-Level Latent Distillation for Video Reasoning
arXiv:2608. 16316v1 Announce Type: cross Abstract: Large Multimodal Models (LMMs) for video reasoning have long been hindered by the high computational cost of processing vast amounts of visual information.
arXiv Computer Vision
Aug 27
Where to Look Matters: On-Policy Self-Distillation for Long-Video Understanding
The paper introduces Clue-OPSD, a clue‑privileged on‑policy self‑distillation framework that improves long‑video understanding by focusing on short, question‑relevant clue intervals rather than the entire video. Experiments on multiple benchmarks and Qwen3.5 model scales show that this approach consistently outperforms standard backbone models and competes strongly with supervised post‑training baselines, all while requiring fewer input frames and no additional inference modules.
arXiv AI
Aug 25
WAM-OPD: On-Policy Distillation for World Action Models
arXiv:2608.22364v1 Announce Type: new Abstract: World action models (WAMs) couple visual future prediction with robot action generation, but accelerated students can lose task capabilities during dis...
Hugging Face Trending Papers
Aug 26
Where to Look Matters: On-Policy Self-Distillation for Long-Video Understanding
Vision-language models (VLMs) have made substantial progress in long-video understanding, with standard backbone models typically answering questions from frames sampled across the full video. However...