The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
The paper introduces ZO-COSMO, an index‑free one‑hop mixing scheme for decentralized zeroth‑order optimization that couples two‑query estimation with average‑preserving masked consensus. It characterizes the necessary one‑hop condition for sparse communication, derives sharp contraction bounds and convergence guarantees for core and sparse‑momentum updates, and demonstrates empirical gains on synthetic agents and Qwen LoRA workers, achieving notable accuracy improvements over traditional Rand‑k and all‑neighbor mixing methods.
arXiv:2504. 12742v2 Announce Type: replace Abstract: Decentralized Federated Learning (DFL) enables collaborative model training without relying on a central server.
SeedFlood is a novel decentralized fine‑tuning method for large language models that scales to billions of parameters and hundreds of clients. It leverages the seed‑reconstructible structure of zeroth‑order gradients to reduce message sizes to near‑zero, enabling efficient flooding across the network. Experiments show SeedFlood outperforms standard zeroth‑order baselines in communication efficiency and generalization, and rivals first‑order gossip methods while incurring far less communication cost.
arXiv:2607. 21876v1 Announce Type: new Abstract: We investigate a decentralized reinforcement learning problem involving multiple agents that interact with the same Markov Decision Process (MDP).
arXiv:2608. 15256v1 Announce Type: new Abstract: Collaborative training in distributed semantic communication (DSC) networks typically relies on decentralized federated learning (DFL).
arXiv:2607. 01665v1 Announce Type: new Abstract: Decentralized online convex optimization (D-OCO) is a popular framework for distributed applications with streaming data.