← Back to all news
arXiv Computer Vision By Xinkai Lu, Junli Zha, Haolan Wei, Jiahui Wang, Chao Zhou, Xiang Song

Redirecting Teacher Supervision: Temporal-Response-Guided Latent Distillation for Video-Language Models

Read the original on arXiv Computer Vision →

The paper introduces Temporal-Response Guidance (TRG), a method that enhances on‑policy distillation for video‑language models by aligning teacher corrections with the student’s temporal response space. TRG measures how representations change under local temporal perturbations, projects teacher corrections onto this space, and restores the original correction norm, thereby altering the supervision direction while preserving key loss properties. Experiments on TempCompass, Video‑MME, MVBench, and Video‑MMMU show that TRG boosts a 4B student’s macro accuracy by 2.86 percentage points over the baseline output‑only OPD approach.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.

Related stories

arXiv Computer Vision
Sep 3

CA-OPD: Confidence-Aware On-Policy Distillation for Structured Visual Prediction

CA-OPD is a confidence‑aware on‑policy distillation framework that improves structured visual prediction by using teacher confidence to selectively correct unreliable student transitions and gradually transfer rollout control to the student. The method aligns supervision with intervention decisions, providing direct cross‑entropy loss for corrected tokens and full predictive distribution for retained tokens. In a multi‑teacher setting for GUI grounding and OCR, CA‑OPD significantly outperforms the Qwen3.5‑0.8B baseline, achieving large gains on benchmarks such as ScreenSpot‑Pro and OCRBench‑v2 English.

By Menghao Li, Linjie Mu, Yin Wang, Haotian Hu, Yannian Gu, Lujiayi Xue, Fanyi Wang
llmsefficiencybenchmarks
More like this →