arXiv AI By Mert Cihangiroglu, Antonino Nocera

Integrity of peer-to-peer distributed LLM inference under malicious nodes

Read the original on arXiv AI →

arXiv:2607. 19490v1 Announce Type: cross Abstract: Peer-to-peer distributed inference executes a Large Language Model (LLM) on pooled consumer hardware by spreading its layers across many nodes.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
Aug 26

SketchGuard: Scaling Byzantine-Robust Decentralized Federated Learning via Sketch-Based Screening

SketchGuard is a Byzantine‑robust decentralized federated learning method that separates neighbor screening from model aggregation by using a Count Sketch representation. The approach mitigates a vulnerability where an adaptive adversary can hide large perturbations in the sketch’s null space, by adopting a commit‑then‑sketch protocol that ensures the sketch seed is chosen only after model commitment. The authors prove convergence in both convex and non‑convex settings, demonstrate that SketchGuard achieves state‑of‑the‑art robustness against six attacks—including the adaptive null‑space attack—across various network topologies and data heterogeneity, while reducing per‑neighbor communication to a model‑dimension‑independent size.

By Murtaza Rangwala, Farag Azzedin, Richard O. Sinnott, Rajkumar Buyya