arXiv Machine Learning

AdaptLSTM: Efficient Adaptive Online Learning for Cloud Workload Forecasting under Distribution Drift

AdaptLSTM is an adaptive online learning framework designed for cloud workload forecasting under distribution drift. It detects drift using validation‑calibrated thresholds and performs selective, targeted updates, achieving a large portion of the accuracy gains of naive online learning while reducing per‑step compute cost. Experiments on Alibaba and Container traces show significant efficiency improvements and error reductions compared to static models and classical drift detectors.

arXiv Machine Learning
Sep 4

A Two-Stage Forecasting System for CPU Workload Prediction in Private Clouds

A two-stage forecasting system is introduced for predicting CPU workload in private clouds. The model first forecasts customer service requests in Transactions Per Second (TPS) and then estimates future CPU usage from the TPS forecast, both stages using XGBoost within a cascaded architecture. Experiments on real private‑cloud traces show SMAPE below 7% for most applications, with the best case achieving an MAE of 0.7372 and an R² of 0.9185, and stable error accumulation over a 60‑step horizon.

By Ashir Javeed, Anton Borg, H{\aa}kan Grahn, Lars Lundberg, Dhyey Patel, Sogand Shirinbab
arXiv Machine Learning
Sep 2

When Does Online Adaptation Pay on the Edge? A Leakage-Free Evaluation of Warmup, Learning-Rate Selection, and Resource Trade-offs for Time-Series Forecasting

The paper investigates when online adaptation benefits edge time‑series forecasting under distribution drift, using a leakage‑free streaming protocol on six public multivariate datasets. It shows that the warmup budget for static baselines and the choice of learning rate can bias perceived adaptation gains, and that a validation‑only procedure selecting warmup and optimizer rates yields Adam outperforming SGD with momentum in most settings. The study also examines accuracy versus adaptation‑state memory and per‑update latency for different adaptation strategies, highlighting parameter‑efficient variants that are nondominated on the memory axis.

By Takumi Fujimoto, Hiroaki Nishi
arXiv AI
Sep 11

SCCM : Stream Cruise Control Method for Automated Drift Detection and Adaptation

The paper introduces the Stream Cruise Control Method (SCCM), a framework for detecting and adapting to concept drift in online regression. SCCM performs early-response drift detection, quantifies drift magnitude, applies KPI-window-based thresholding to reduce false alarms, dynamically tunes hyperparameters, and recalibrates models, all within an in-memory design for real-time operation. Evaluations on synthetic and real-world datasets demonstrate that SCCM improves predictive performance compared to eight baseline detector–adaptation methods.

By Mohammad Abu-Shaira, Weishi Shi
arXiv Machine Learning
Oct 5

AIGS: Adaptive Incremental Gating System for Online Representation Learning in Non-Stationary Data Streams

The paper introduces AIGS, a lightweight Adaptive Incremental Gating System designed for online representation learning in non‑stationary data streams. AIGS uses a Shock Ratio feedback signal to drive a Continuous Plasticity Controller, enabling smooth adaptation between learning plasticity and memory retention while keeping per‑step complexity linear in the feature dimension. Experiments on smart‑city traffic, meteorological, and industrial datasets show that AIGS improves early‑warning lead times, accelerates recovery after abrupt changes, and enhances anomaly recall in noisy environments.

By SiRui He, Kai Liang Lew, Chui Zi Ong, Chean Khim Toa
arXiv Machine Learning
Aug 5

When RL Meets Adaptive Speculative Training: A Unified Training-Serving System

arXiv:2602. 06932v5 Announce Type: replace Abstract: Speculative decoding can significantly accelerate LLM serving, yet most deployments today disentangle speculator training from serving, treating speculator training as a standalone offline modeling problem.

By Junxiong Wang, Fengxiang Bie, Jisen Li, Zhongzhu Zhou, Zelei Shao, Yubo Wang, Yinghui Liu, Qingyang Wu, Avner May, Sri Yanamandra, Ce Zhang, Tri Dao, Percy Liang, Ben Athiwaratkun, Shuaiwen Leon Song, Chenfeng Xu, Xiaoxia Wu
arXiv AI
Oct 5

Zephon: Elastic Determinism for Online, Stateful Foundation Model Data Loading Pipelines

Zephon is a data loader designed for foundation model training that ensures deterministic ordering of training data batches even when GPU resources change, checkpoints are resumed, or different processing backends are used. It handles online, stateful pipelines—where tokenization, packing, and mixing of samples create complex n‑to‑m transformations—by partitioning the data stream into topology‑independent lanes, serializing ordering decisions, and checkpointing only bounded in‑flight state. Experiments on text and vision‑language tasks show Zephon delivers competitive throughput while offering guarantees that existing loaders lack for such pipelines.

By Maximilian B\"other, Josh Wills, Ties Robroek, Sonnet Xu, Paul Burstein, Daniel Zayas, Cody Blakeney, Siddharth Joshi, Haoli Yin, Rishabh Adiga, Haakon Mongstad, Luke Merrick, Pratyush Maini, Ari Morcos, Matthew Leavitt, Ana Klimovic, Bogdan Gaza