arXiv Machine Learning By Zhirayr Tovmasyan, Slavom\'ir Hanzely, Egor Shulgin, Peter Richt\'arik, Sebastian U. Stich

SCAFFOLD under Hessian Similarity: Sharp Convergence Rates

Read the original on arXiv Machine Learning →

arXiv:2610. 35663v1 Announce Type: new Abstract: One of the main challenges of federated learning is heterogeneous data split among the clients, leading to biased local updates called client drift.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Oct 16

Personalized Projected Ascent for Federated Stackelberg Optimization

The paper introduces a federated minimax framework where the minimization variable is shared across clients while each client retains a personalized maximization variable. It proposes a projected ascent method for the personalized variables and shows that in nonconvex-concave settings it achieves a sublinear convergence rate, but in nonconvex-PL settings it suffers from a noise floor. To overcome this, the authors develop VR-SGDA, a variance‑reduced algorithm that eliminates the noise floor through a two‑timescale update scheme, and demonstrate its effectiveness on subpopulation‑robustness and NLP adversarial training tasks.

By M Yashwanth, Sharannya Ghosh, Saikiran Bulusu, Anirban Chakraborty