← Back to all news
Hugging Face Trending Papers

A probabilistic framework for online test-time adaptation

This paper presents a probabilistic framework for online test-time adaptation problems. In them, a model is trained on labeled data but must adapt to unlabeled data at test time under the assumption that training and test distributions potentially differ, that is, there might have been a distributional shift.

Related stories

arXiv Machine Learning
Aug 31

Temporal Memory-Aware Online Test-Time Adaptation on Dynamic Graphs

The paper introduces DGOTTA, a framework for temporal memory‑aware online test‑time adaptation on dynamic graphs. DGOTTA comprises three modules: temporal‑aware augmentation to diversify test graphs, memory‑aware model prediction to mitigate catastrophic forgetting, and consistency‑guided online adaptation to enforce temporal alignment and smoothness. Experiments on three real‑world datasets and four DGNN backbones show that DGOTTA improves generalization under diverse distribution shifts and across multiple model architectures.

By Bo Li, Xin Zheng, Ming Jin, Can Wang, Shirui Pan
safety
More like this →
arXiv Computer Vision
Sep 14

TestDG: Test-time Domain Generalization for Continual Test-time Adaptation

This paper introduces TestDG, an online test-time domain generalization framework for continual test-time adaptation (CTTA). TestDG learns features invariant to both current and past test domains during testing, using a new model architecture, adaptation strategy, and prototype selection/update mechanisms. It achieves state‑of‑the‑art results on four CTTA benchmarks and demonstrates superior generalization to unseen test domains.

By Sohyun Lee, Nayeong Kim, Juwon Kang, Seong Joon Oh, Suha Kwak
benchmarks
More like this →
arXiv Machine Learning
Aug 26

Adaptive prediction theory combining offline and online learning

The paper studies a two‑stage learning framework that first trains an offline model using approximate nonlinear‑least‑squares estimation and then adapts it online with a meta‑LMS algorithm to handle parameter drift in nonlinear stochastic dynamical systems. It provides an upper bound on the offline generalization error that accounts for strong data correlation and distribution shift via Kullback‑Leibler divergence, and it demonstrates that the combined offline‑online approach outperforms methods that rely solely on offline or online learning. Both theoretical analysis and empirical experiments support the claimed performance gains.

By Haizheng Li, Lei Guo
More like this →
arXiv Machine Learning
Sep 3

Rethinking the Teacher-Student Framework for Test-Time Adaptation

The paper investigates the teacher‑student framework used in Test‑Time Adaptation (TTA) and questions the common practice of updating the teacher via an exponential moving average of the student. The authors demonstrate that error accumulation still occurs, especially over longer sequences, and propose an intransigent teacher that remains fixed. This modification yields significant performance gains across multiple datasets, longer scenarios, and various architectures, including semantic segmentation, while also improving robustness to hyperparameter changes.

By Damian S\'ojka, Marc Masana, Bart{\l}omiej Twardowski, Sebastian Cygert
computer-vision
More like this →
arXiv Machine Learning
1d ago

Learning to Predict Distributions over Weight Updates for Test-Time Adaptation

The paper introduces query‑conditioned hypernetworks that predict distributions over LoRA weight updates for large language models. By learning a distribution rather than a single point estimate, the method allows sampling multiple adapted models for the same query, improving performance over deterministic hypernetworks and token‑sampling baselines. The study also shows that these learned updates can transfer across different queries, indicating reusable adaptation patterns.

By Azal Ahmad Khan, Keshav Ramji, Tahira Naseem, Ali Anwar, Ram\'on Fernandez Astudillo
llmsfine-tuning
More like this →