arXiv AI

Towards Stream Learning on Embedded Systems: Benchmarking the Memory Consumption of Stream Learning Methods

arXiv Machine Learning
5d ago

Inference-Time Prior Adaptation for Imbalanced Data Streams under Concept Drift

The paper introduces PAI-KNN, a k‑nearest neighbor classifier designed for data stream classification with concept drift and class imbalance. Unlike traditional methods that modify memory through instance removal or resampling, PAI‑KNN keeps a simple sliding‑window buffer and adapts its decision rule at inference time by adjusting class priors based on recent observations. Experiments on synthetic streams with varying imbalance and drift show that PAI‑KNN performs competitively with state‑of‑the‑art techniques, especially when dynamic class imbalance and concept drift are present.

By Tobias Callies (University of the Bundeswehr Munich), Eirini Ntoutsi (University of the Bundeswehr Munich), Arthur Zimek (University of Southern Denmark)
arXiv Machine Learning
Aug 5

When RL Meets Adaptive Speculative Training: A Unified Training-Serving System

arXiv:2602. 06932v5 Announce Type: replace Abstract: Speculative decoding can significantly accelerate LLM serving, yet most deployments today disentangle speculator training from serving, treating speculator training as a standalone offline modeling problem.

By Junxiong Wang, Fengxiang Bie, Jisen Li, Zhongzhu Zhou, Zelei Shao, Yubo Wang, Yinghui Liu, Qingyang Wu, Avner May, Sri Yanamandra, Ce Zhang, Tri Dao, Percy Liang, Ben Athiwaratkun, Shuaiwen Leon Song, Chenfeng Xu, Xiaoxia Wu
arXiv Machine Learning
Oct 9

AdaptLSTM: Efficient Adaptive Online Learning for Cloud Workload Forecasting under Distribution Drift

AdaptLSTM is an adaptive online learning framework designed for cloud workload forecasting under distribution drift. It detects drift using validation‑calibrated thresholds and performs selective, targeted updates, achieving a large portion of the accuracy gains of naive online learning while reducing per‑step compute cost. Experiments on Alibaba and Container traces show significant efficiency improvements and error reductions compared to static models and classical drift detectors.

By Xinhua Miao, Bowei Yang, Zhengong Cai
arXiv Machine Learning
Oct 2

Decoupled and Distilled: Task-Adaptive LoRA-Teachers with Ensemble Knowledge Transfer for Few-Shot Class-Incremental Learning

The paper introduces TALON, a Task‑Adaptive LoRA‑Teacher framework for Few‑Shot Class‑Incremental Learning. TALON assigns a dedicated LoRA‑Teacher to each incremental task, then distills the frozen teachers into a single LoRA‑Student via Ensemble Knowledge Transfer, using a semantic‑guided weighting scheme to reduce forgetting and overfitting. Experiments on four FSCIL benchmarks show that TALON matches or surpasses state‑of‑the‑art accuracy while using up to 33× fewer deployment parameters and cutting inference time by 41.7%.

By Hongwei Zhao (School of Computer Science,Engineering, Beihang University), Rui Liu (School of Computer Science,Engineering, Beihang University), Yansong Liu (School of Computer Science,Engineering, Beihang University), Zhiyuan Zou (School of Computer Science,Engineering, Beihang University), Yong Chen (School of Computer Science, Beijing University of Posts,Telecommunications)