arXiv AI

Distributed Optimization with Streaming Data: A Temporal Weighting Perspective

arXiv:2608. 09565v1 Announce Type: cross Abstract: Optimization theory is a widely used tool for intelligent decision-making.

arXiv Machine Learning
Aug 27

Resilient Decentralized Wireless Federated Learning via Gradient Tracking with AdamW

The paper introduces QEF-GT-AdamW, a communication‑efficient and outage‑resilient algorithm for decentralized wireless federated learning. It combines gradient tracking, AdamW adaptive optimization, and dual‑stream biased quantization with error feedback to reduce communication payloads while mitigating non‑IID data effects. The method includes a local fallback strategy for unreliable broadcasts and provides convergence guarantees under compressed, unreliable wireless communication, demonstrating improved robustness and accuracy‑communication trade‑offs on heterogeneous MNIST and CIFAR‑10 datasets.

By Nguyen Van Thieu, Ti Ti Nguyen, Ons Aouedi, Vu Nguyen Ha, Symeon Chatzinotas