The paper investigates the teacher‑student framework used in Test‑Time Adaptation (TTA) and questions the common practice of updating the teacher via an exponential moving average of the student. The authors demonstrate that error accumulation still occurs, especially over longer sequences, and propose an intransigent teacher that remains fixed. This modification yields significant performance gains across multiple datasets, longer scenarios, and various architectures, including semantic segmentation, while also improving robustness to hyperparameter changes.
By Damian S\'ojka, Marc Masana, Bart{\l}omiej Twardowski, Sebastian Cygert
arXiv:2607. 23735v1 Announce Type: new Abstract: In many real-world scenarios, encountering continual shifts in domain during inference is very common.
By Anurag Roy, Riddhiman Moulick, Vinay Kumar Verma, Saptarshi Ghosh, Abir Das
arXiv:2610.34092v1 Announce Type: new
Abstract: Few-step distillation for autoregressive (AR) video generation commonly first initializes an AR student and then refines it with distribution matching...
By Zixuan Duan, Yabo Chen, Xunzhi Xiang, Xin Zhang, Haibin Huang, Yin Chen, Chi Zhang, Qi Fan
arXiv:2608. 01263v1 Announce Type: new Abstract: On-policy distillation (OPD) samples trajectories from the current student policy and minimizes token-level divergence between student and teacher next-token distributions at prefixes along those trajectories.
By Leyan Xue, Feng Xiong, Mingjun Ma, Changqing Zhang
Tail Cues, Principal Corrections: Plug-and-Play Rectification for Open-Set Test-Time Adaptation introduces TALOR, a lightweight module that rectifies features for non-stationary target streams by decomposing them into high-gain principal and low-gain tail coordinates. TALOR applies a soft-routed affine correction in the principal subspace, subtracts drift via weighted ridge regression, and reconstructs the feature for the source head. On ImageNet-C with six csOOD datasets, TALOR surpasses the next-best UniEnt by 2.2% H-score, runs 2.5× faster, and uses only 12% of its GPU memory, while also boosting COME to 68.4% H-score with minimal memory overhead.
By Yingkai Yang, Chaoqi Chen, Hui Huang
Open-Set Test-Time Adaptation (OSTTA) operates on non-stationary target streams where covariate and semantic shifts coexist. Existing TTA methods often obtain adaptation signals by updating model para...