arXiv Machine Learning

When Is Coarse Supervision Worth It? Cost-Aware Learning under Unknown Aggregation

arXiv AI
Oct 27

Should Pseudo-Labels Share Mini-Batches with Labeled Examples? Semi-Supervised Continual Active Learning with Limited Training Cost

The paper investigates how pseudo‑labeled examples should be incorporated into mini‑batches during continual active learning (CAL) to balance annotation savings and training cost. It formalizes the problem as two decisions: selecting which unlabeled examples receive pseudo‑labels and determining their share of each mini‑batch. The proposed semi‑supervised continual active learning (SSCAL) method, compatible with any acquisition function, uses distance‑based pseudo‑labeling, caps their batch share, and reweights labeled losses to maintain gradient balance, achieving top performance across multiple audio datasets and settings.

By Shiqi Zhang, Tuomas Virtanen
Hugging Face Trending Papers
Jul 27

Adaptive Data Admission and Retention for Streaming Federated Learning

We study streaming federated learning with limited client memory, where newly generated training data incur time-varying sampling costs and must be selectively admitted and retained over time. We consider a joint server-side admission and client-side memory-management framework with the objective of minimizing the cumulative excess population risk under a sampling-cost budget and buffer constraints.