arXiv AI

Integrity of peer-to-peer distributed LLM inference under malicious nodes

arXiv:2607. 19490v1 Announce Type: cross Abstract: Peer-to-peer distributed inference executes a Large Language Model (LLM) on pooled consumer hardware by spreading its layers across many nodes.

arXiv Machine Learning
Aug 26

SketchGuard: Scaling Byzantine-Robust Decentralized Federated Learning via Sketch-Based Screening

SketchGuard is a Byzantine‑robust decentralized federated learning method that separates neighbor screening from model aggregation by using a Count Sketch representation. The approach mitigates a vulnerability where an adaptive adversary can hide large perturbations in the sketch’s null space, by adopting a commit‑then‑sketch protocol that ensures the sketch seed is chosen only after model commitment. The authors prove convergence in both convex and non‑convex settings, demonstrate that SketchGuard achieves state‑of‑the‑art robustness against six attacks—including the adaptive null‑space attack—across various network topologies and data heterogeneity, while reducing per‑neighbor communication to a model‑dimension‑independent size.

By Murtaza Rangwala, Farag Azzedin, Richard O. Sinnott, Rajkumar Buyya
arXiv AI
3d ago

Trusted Weights, Treacherous Optimizations? Optimization-Triggered Backdoor Attacks on LLMs

The paper investigates how inference optimization for large language models can introduce numerical inconsistencies that trigger hidden backdoors. It introduces two types of optimization‑triggered backdoors: the Input‑Specific Optimization Backdoor (ISOB) and the Universal Optimization Backdoor (UOB), the latter enabling a model to remain benign under normal execution but activate a backdoor when optimization is applied. Experiments on seven open‑source LLMs, across multiple tasks and optimization backends, show UOB can achieve up to 100% attack success while maintaining clean accuracy, and the authors propose three defenses that reduce the attack success rate to 0.02.

By Yifei Wang, Yida Yang, Tianlin Li, Xiaohan Zhang, Xiaoyu Zhang, Li Pan