The paper investigates the teacher‑student framework used in Test‑Time Adaptation (TTA) and questions the common practice of updating the teacher via an exponential moving average of the student. The authors demonstrate that error accumulation still occurs, especially over longer sequences, and propose an intransigent teacher that remains fixed. This modification yields significant performance gains across multiple datasets, longer scenarios, and various architectures, including semantic segmentation, while also improving robustness to hyperparameter changes.
By Damian S\'ojka, Marc Masana, Bart{\l}omiej Twardowski, Sebastian Cygert
arXiv:2606. 31420v1 Announce Type: new Abstract: Test-Time Adaptation (TTA) enables models trained on a source domain to adapt online to unlabeled test data under distribution shifts.
By Shaoyang Huang, Yashi Zhu, Yichen Yu, Lei Zhang, Zhang Yi, Tao He
arXiv:2511. 18468v2 Announce Type: replace Abstract: Continual Test-Time Adaptation (CTTA) is crucial for deploying models in real-world applications with unseen, evolving target domains.
By Md Akil Raihan Iftee, Mir Sazzat Hossain, Rakibul Hasan Rajib, Tariq Iqbal, Md Mofijul Islam, M Ashraful Amin, Amin Ahsan Ali, AKM Mahbubur Rahman
Deep neural nets achieve remarkable performance when training and test data share the same distribution, but this assumption frequently breaks in real-world deployment, where data undergoes continual distributional shifts. Continual Test-Time Adaptation (CTTA) addresses this challenge by adapting pretrained models to non-stationary target distributions on-the-fly, without access to source data or labeled targets, while mitigating two critical failure modes: catastrophic forgetting of source knowledge and error accumulation from noisy pseudo-labels over extended time horizons.
arXiv:2609.37687v1 Announce Type: new
Abstract: Active test-time adaptation (ATTA) improves robustness under distribution shift by updating a deployed model during inference while selectively queryin...
By Muhammad Huzaifa, Lea Sch\"onherr, Thorsten Eisenhofer
DESA‑TTA introduces a low‑overhead test‑time adaptation technique for vision‑language object detectors that dynamically adjusts the teacher’s exponential moving average coefficient based on pseudo‑label confidence and box density. It also employs source anchoring to gradually pull student parameters back toward their pretrained values, mitigating cumulative drift. Experiments on multiple distribution shifts and two VLOD architectures demonstrate consistent gains, with a 14.5‑point AP₅₀ improvement on VOC‑C and a 55% higher inference throughput compared to the prior state‑of‑the‑art TTA method for YOLO‑World.
By Atif Belal, Lilian Hollard, Marco Pedersoli, Eric Granger